I have done english paper piecing and I chose to leave the card/paper in until I have completely surrounded a shape--then, I take it out. If you take the pieces out before they are surrounded they sort of flop around and can curl up--it's just easier to leave in.
As your project grows, taking out the centers gives the project more flexibilit.y.
Hope this helps/makes sense :).