What items? Used stuff? Newly made? I have seen quilt wall hangings go for a lot more than they cost to make. A lot depends on the workmanship. Is the bazaar a charity event? Or do you keep the proceeds?
I would start at higher than cost and if need be, you can lower the price if they aren't selling. Customers can always bargain with you too.
Don't sell yourself short!