Well, perhaps a box equiped with the hot wires that are used on fences (they give a jolt but not leathol) would be a surprise for the low life person who insists that they may take what ever when ever they please.
Be sure to place a sign that reads "DO NOT TOUCH". If they choose to ignore the sign, oh well. It is a "what part of "DO NOT TOUCH" do you not understand?