The mat, rotary cutter and a good 6x24 ruler will get you going. A smaller ruler will come in handy as well. Try to get the same brand when you buy different size rulers. If you can find a ruler you like with 1/8" lines, it will stand the test of time. I recommend laying the ruler you think you want on several different color fabrics. You might decide those bright green or yellow lines are difficult to see on different colored fabrics. And definitely some straight pins. You don't need a gazillion but a box of the yellow-head clover ones are not too expensive and they work for most applications. A decent pair of 6" or 8" scissors and a small pair of thread snips. And, yes, the requisite seam ripper.
Someone mentioned a sewing machine. Definitely a worthwhile investment but you can actually make a quilt from start to finish without a machine if that is your preference or bank account at the moment. A high quality used machine is generally a better deal than a new cheap machine. But get what you can afford.
Start with a small project - table runner/topper; baby or lap quilt so you don't get overwhelmed. Just make sure it's a pattern you like so you'll be more inclined to finish it vs tossing it aside if you get frustrated.
For books - check your local library. Browse few as many quilting books, even basic ones, they have available and see what seems to have the most resources/information if you can before making a purchase. Might save you some $$ in the long run.