My instruction book (Janome) troubleshoots buttonhole problems by saying the stitch density may not be suitable to the fabric being sewn. Maybe it's taking a while to catch, but by then it's too late to catch up. I would check everything - after a good long break, that is.