I like the velcro/foam board idea. I keep mine in the "Bernina" red box on a shelf in my sewing table. If I know I'm going to be switching between two feet often during a sewing session (try to plan not to) I put them in the bowl next to my pins and pinmoors so at least I'm not chasing them around on the floor.
Cheers, K