There are no rules and no quilt police. You can define scrappy any way you want, and it may be different from what someone else calls scrappy.
I couldn't put completely random fabrics together. I would have to have some control over the fabrics. That's just me. Do whatever makes you happy.