Jealousy is the green eyed monster, those ladies is making comments so they look good for the down sizing choices to not be them. A good manager knows who is the worker and who is the slacker.
Your former boss must value your work skills or she would not have recommended you to follow her. If working with her is better than your current environment then you did the correct thing.
But remember, once the decision has been made to follow, your name may be put on the list of your current position even if you don't get one you are going after. After working almost 40 plus years, I know managers have to interview several for a position by law and then make offers. Hopefully your former co-worker has not miss led you.
Sorry for the message, but I felt I just had to tell you this.