Loretta,
The light weight fabric sounds yummy but then I got to wondering if it would have too much give to it. I have seen a few yo-yo quilts at our fair and they didn't attach them to a backing. I wonder how long they hold together without a backing for support. Hmm. All I can say is try it and see what happens. Yo-yos are fun and a great carry along project.