I *love* shopping at Aldi. Of course, I'm one of those college kids they build them for, but my mom shops there too. Milk and eggs are much cheaper there, and I've found most of the time that the quality of food that is much cheaper there is almost as or just as good at the stuff you can buy at Walmart or a regular grocery store.
They've also remodeled a lot of their stores, and their new stores are much better constructed than they used to be. It's a recent thing, so make sure you check it out for yourself, because chances are, since your's is a new one, it'll be pretty darn nice!
Remembering a quarter you can reuse for carts is a small price to pay for the money you can save there!