Vanessa, he needs a hobby!!! It's a shame he can't just do something independently while you do. We all need our own space sometimes. That's what I would tell him, really.
I can't give anyone my undivided attention all the time. Did that when my kids were little, now done!