I would see if I could get by with a more narrow seam allowance so you didn't lose your points rather than trim them all down. No one will see the uneven seam allowances as they will be on the inside. If they are quite narrow then double stitch or stitch with a smaller stitch. Nothing says you have to have perfect 1/4" seams on the back. It's the front you see.