lovely job! I did the same pattern for a jacket for my Mom a couple of years ago--had the same problem, plus the sleeves were very tight at the cuff. I added about 2-3" of the fracture material at the bottom of the jacket and a smaller strip at the cuff and opned the sleeve cuff opening just a little. Worked very well.
When I made the same jacket for myself this summer, I bought a plain jacket pattern and used twill as the foundation--not sure I could have found a sweatshirt big enough to work for me!