Well, I'm a 43 year old woman, and I'm NOT the youngest in my quilting group. The youngest is 38, I believe. There are also LOTS of famous men quilters: John Flynn, Ricky Timms, George Siciliano, just to name a few. There is even a facebook-style community page for male quilters:
http://manquilters.ning.com/