Yes, I do it occasionally, especially on blocks that other people make, or on blocks I made because I was a doorknob and didn't measure correctly.
You can sometimes shrink the larger blocks a bit with water and starch. I've taken apart small blocks and sewn them back together with a 1/8" seam allowance. It all depends on how much work you're willing to put into the project.