My Dad always says "What takes nerve to ask takes NO nerve to refuse."
If you can't say no for your sake, say no for your husband's
sake. Why should either of you have to live in an uncomfortable situation at this point - or any point -of your life. If you can't say "No Way!!!!" try
"You're joking, right????" and then just close the door- firmly.