I agree with so many that this one is on you. If the price was agreed upon and you found the cost would be much higher, a more equitable price should have been arranged before materials were ordered.
You are kind to factor in the sale price of fabric from your stash and so your client received a bargain on his first quilt. An explanation, an apology and his refund in a nice note card will save your credibility.