Definitely check out the garment district. Tons of fabric stores, notions, etc. I have never been to the City Quilter, but I did order online and was very pleased. It is pricey, but I was looking for NYC themed fabric.
Wish I was a quilter when I lived in NYC.