don't text back anything rude - you work with this person and will still be working together after the breakup.
just call him or meet and person and just explain that your feelings have changed and your hearts just not in it any longer.
try to be kind - just because he's a jerk doesn't mean you have to be one too.
be graceful and sympathetic but very clear that the relationship is over.