It depends on how thick the seams are going to be when trying to join the blocks together. I usually leave it in until the top is complete but if the machine starts bogging down; I remove it. It will also depend on what kind of paper was used. Regular copy paper is thick! The cheaper stuff is easier to deal with.