I too have begun to use poly and/or rayon almost exclusively. Superior Threads has a lot to say in their many videos about whether or not it has an effect on the cotton fabrics, i.e., "cutting" into the fabric. I have never experienced it and started using it more frequently many years ago.
Here is one thing I also do without fail. Invariably, I will find a bit of lint in unexpected places, so I have taken to keeping a number of pipe cleaners at hand. The large craft kind work best. They will bend and curve around to those nooks and crannies and the little bits of lint just cling to them. They are not so stiff as to cause harm to any moving parts, but they are like little dust magnets. And as the ends become soiled, I just trim off an inch or so with my paper scissors. Since using them (every time I change a bobbin), I have not had a lint build-up problem.
Give it a try. I think you'll be amazed at the little bits lurking below sight line.