I've been "going against the grain" for years...I'm sure of it, because I don't waste material just to get the grain right....and don't worry about it. I cut and sew and work in all my flaws and imperfections and have never had a complaint from a quilt recipient.
To each his own...or as I like to say, in quilting there are no rights and wrongs...only preferences.