Your Bright Spots May Be Your Blind Spots: How to Understand Variation in Data to Accelerate Network Learning