Definitely stay in! It's comforting to be with others of your own level, but in the long run you'll learn heaps more with people who have more knowledge than you, and are willing to share it with you.
It isn't a competition - relax! Everyone there - like here - is in it for the joy, and finds joy in watching others learn as they learned.
And yeah, you can totally catch up outside of class with the help of kind, talented people like Sadiemae! (I'd offer my help, too, but I'm pretty much where you are...so call on me when you want to commiserate ;))