If it was up to me I would suggest rotating sites. I would also say that bring a sack lunch so we don't spend so much time on the food part and in case some folks are dieting. If you still want to have it at your house just say I don't want to take up the space for the floor frame.
But to be honest, they were all there, they saw how it went and I think they are just taking advantage of you. And frankly it doesn't sound like you were really having any fun, so why bother.