I would post a sign, just as big, with the words 'Irresponsible cat owner' and an arrow pointing to their house. What's good for the goose...! Yes, this is a childish response, but it would show them that they will only make things worse by continuing.
If you go to your local big box grocery and buy the big containers of black pepper, and pepper your yard, you will be cat free.