I would also trim it down to the smallest measurement. Your pinwheels are more than 1/4" from the edge, so you won't be cutting off any points and you can make it perfectly square. I think it's a cleaner solution than easing the borders in and your quilt will lay flat.
Very cute top!