Hide the fabric then collect up items of their clothing. When they ask what you're up to explain to them that you did what they wanted and got rid of the fabric but you need some to complete a project and their shirt or pants are just the thing. When you get the scissors out they will most likely decide not nagging you about a stash of fabric is better then loosing their favorite item of clothing