From your description it sounds like some rules need to be set down.
Problem 1: Some people only showed up when their quilt was in the frame.
Problem 2: One person showed up drunk (not a good sign at lunchtime!)
Problem 3: Not rotating homes.
Problem 4: You didn't get to work on anything for you.
Problem 5: People forgetting who's supposed to bring lunch.
Unless these issues can be resolved I would either find another group or not start it up again!!!