If your plans for you trip are just for you, no problem your husband can still go to the birthday party. But if they are for the two of you, get together with the grandson and his parents just before his birthday (and your trip) and do something special.