Yes, I think you made the right decision. Why have all that aggravation if you think you'll like the other job. Especially without losing any pay......
I use to work in an all female office. OMG, I hated it.....Finally quit after a job offer as an office mgr with all men....I was the only women.
I loved that job.