I would back it with muslin. When doing upholstery, you would put the foam on the frame, then cover it with canvas or muslin & tack down. This fabric takes most of the stress of holding the foam in place. The fashion fabric goes on top, which again is often first lined first. Look on you tube for ideas.
Your idea of half inch seams is also a good idea.