If you're alone all that time during the week, get it packed up while he is gone, label it and tell them where you want it packed in the truck. This is something they do all the time.....put things where people want them but then be sure to WATCH that they do it or make sure it is the last thing on the truck.
You are not weird for wanting this. If he had something he strongly cared for like woodworking projects or something else, he'd be the same way....well, maybe not, men are so different!!
You're fine, just fine and this is just one small moment of time. :) :) :)