It does that because technically your iPad only sees 2 orientations as "correct" and the other 2 as upside down. It corrects them when you look at them on the screen, but they are upside down in real life.
If it's the same as my phone (should be) pictures will be right side up if you take the photo with the home button to the right or at the bottom. No more acrobatic photos.
