Check your city ordinances. There is probably not only one against the sign, but one against him allowing his cats to run free. If it bugs you enough, you can always look at a civil suit or play his game and put up a sign of your own pointed at his yard telling your side of the story! Good luck!
Me, I would have probably just kept the cat!! hee hee