Dear Ashlett - I am so happy you finally tried kayaking. I have been involved in the sport in a major way for over 30 years. I was partners in a design/manufacturing company with a dear friend for many years and I taught both my girls who have gone on to compete in kayak racing for longer than I can remember. In 2000, my eldest girl came in 7th in Sprint Races at the Empire State Games held in Binghamton, NY.
One thing you need to know is that you must try out several kayaks before you buy one. Not all kayaks fit all bodies. Go for one that is wide and stable and has some sort of skeg (fin) on the bottom to help you track straight. Sit in the boats, try them out on the water. If your legs fall asleep, try another boat.
Make sure you are able to pick up your kayak on your own, with out help. Fiberglass or Kevlar kayaks are the best, but there are some decent models out there made of PVC for the beginner. Do your homework. Over the years I've seen too many people run out and buy a kayak and then find they're so dissatisfied with their purchase.
Educate yourself before you put your money down on the counter - it'll be time well spent. Good kayak shops will make sure you get the one that will best suit your needs.
Good Luck and Happy Paddling!!
P.S. One last thing - you might want to check out some kayaking classes in your area just to learn the basics and safety aspects of the sport. I used to run a series of classes at an indoor pool, but that pool was shut down for renovations. Won't re-open till next year.