I have always used the Aleene's Tacky glue products with felt.
I made some wool felt this year from a Moda FQ pack. It came out gorgeous and is very nice to hand stitch. I'd love to try a penny rug, one of these days. I like to switch to hand sewing when my back wears out at the machine.