I found Algebra, Trig, and Calculus all easy. I had a great Algebra teacher (plus my Dad, who also taught me Trig and still remembers it 30 years later without opening a book) and after that, calc was easy.
Here's the thing with algebra-the MOST important thing you have to learn is how to set up the problem. After that, you're good to go, just don't make any silly basic math mistakes. And PRACTICE all you can! It's really fun, it's hands on, and I just loved it. Wish I had been a math major.
Best wishes! You CAN do it!!!!!!! And congrats on going back to school!