If you use a fleece (there are so many cute ones) be sure it is safe for babies and children's sleepware....or you can test it yourself by touching a scrap with a lit match (over a sink full of water of course). If the fabric continues to burn or starts to melt when you remove the lit match, I would use something else.
Gotta love those babies.
K Cama