I also don't think you can. You must have something to hold the sandwich together.
As a test, take two sheets, put some batting in the middle and seam around all 4 sides with a slip stitch (big stitches easy to remove). Then abuse it. Roll around on the top of it, wash it, wiggle it around, pull the two sheets apart from each other, shake it. That batting is going to lump and begin to come apart. That's what I think.
Think about the Dallas Cowboy design. There must be something on it you could outline with your stitches. Got any pictures?????