I feel the same way about podcasts as you did about Netflix. I'm cutting back on podcasts unless I'm doing something truly mindless and longer-lasting (weeding, say).

Also I've noticed that if I'm listening to podcasts while doing chores, I don't have ideas, my mind doesn't wander. And I think that kind of thing (mind wandering) is actually a very useful, healthy thing.