I would try a smaller crate, no toys, no towels. But I would also do it while I was at home, that way I could discipline him immediately when he tries to move the crate. When discipline is done later he has no idea what he did wrong. Above all be consistent. Some dogs view the crate as a form of punishment, others see it as a safe haven. My dog's crate door is always open and she comes and goes.
I once had a poodle that wanted in her crate when noisy, rowdy, children were around.
Whatever you do must be consitent.