You can use any fabrics you want. I would suspect that you wouldn't be able to see the overall "disappearing" pattern with that variety of fabric, but that it would just turn out looking even more scrappy and more interesting than if you have just sewn the squares together. If you are just going for a scrappy quilt top, then, that will do the job!