it sounds as if you are using a one sided fleece???where one side is soft & one side is a 'backing'....the backing side should be toward the batting- the soft side out---the whole reason for using fleece is to have a soft/cozy side next to your skin to cuddle with.