I'd think that as long as you didn't have a big chunk of one or the other you'd be ok. I'd try to keep them more or less evenly spread throughout so it looks random but doesn't have glaringly bright or dark sections. You should be ok if you just shuffle them around in the scrap basket so everything is mixed pretty evenly.