I always remove the freezer paper. I usually have it on top when I use it, so it's not a big deal, but if perchance I have it inside, I cut the background away and remove the paper then. If it's glued down, you can also soak the block to loosen the glue.
Janet