How stiff do you want this to be? It needs enough quilting to be durable but not so much that it isn't cuddly. I'd stitch in the ditch on the bricks and outline the features of the panel. Then take a look if you have enough inside the features that it is stable. Sometimes less is more.