What would be crazy would be to live on the sunny, warm, west coast & move to the cold, snow covered east coast. If you can swing it, and it will mean being closer to family as you enter this next season of life, go for it!
My husband actually thinks that we are going to move out of California when we retire (like to Washington, Oregon or back east. My "ok dear" = "only if you go alone dear" :)