I often listen to podcasts while I'm working on something that doesn't require a lot of thinking, like after I've done the math and am just cutting, or while I'm squaring up blocks. Otherwise I never have time to listen to them.
Let me know if you need help on coming up with new excuses, I've got a few.