After I made my first one I used the cut off material and made a little case for my credit cards to match the purse. I believe the next one I make I am going to use velcro to close the top instead of using the button . I think it will be safer that way.
Another suggestion - wrap your credit cards in tin foil so they cannot be scanned by scammers, so I put tin foil on both sides of by pocket.