You are screwing the boards to the wall and then attaching the felt to the board? Would strips of sticky Velcro on the board and sew on Velcro on the felt work? Can you wash felt? You might want to go ahead and attach the felt permanently and vacuum it when it gets dusty.