I've been doing raggy quilts for a while; never heard of not being able to use white. Of course, none of my backs have had white on them. I mostly use white as the inner layer; again, never had a problem.
I feel the same way as others; I will do what I want on my quilts.
If there is a problem because of "bleeding", then all the fabrics could be washed first.