Yes, I'd also send back his $150, and then return the fabric at my own expense... if the company even takes back cut yardage. It's a lesson learned, to know your costs before you quote a price.
Since you won't be making the quilt for zero money for labor, I think you come out on top!