I like the feel better if I remove the centers of larger pieces but like you said it adds a bit to the overall patience level of placement. Some days I’m just not in the mood to deal with fiddly and if it’s for a wall hanging I usually leave. Your quilt - your rules! Quilting is meant to be enjoyed so do what works for you.