I should clarify "by go from there" I work on the next smallest, simplest part and so on. Tasks or projects are scenes in The Hard Story and each is a hard story in itself. It's a recursive narrative.
When you're not out of your league on a problem, sometimes you'll go after the more complex parts of the problem first because you'll be bored by the small and simple ones.