One of my first quilts was scrappy. I had to buy all of the fabric. It was the ugliest thing you never wanted to see. Not real proud of that one.
I am just now starting a quilt I am calling scrappy. I know I do not have enough stash to do it, so once I know what I have, I can go get the rest I need to finish.
Do what seems right to you. But have fun with it.