I leave mine on all the time. Haven't seen any need to change it out. Seems to make everything feed more evenly. Of course I don't do any fancy quilting yet either. Works fine on gentle curves.
The quarter inch foot I got wasn't! So I just figured out where on the screw that holds the face plate on was a quarter inch and go by that.