Sorry, the Swastika just screams out at me too. I think it's because it's a single block. If you had a quilt of many of these blocks you would seen an overall pattern and the swastika thing would be less obvious. I like the suggestion to pick apart the four separate sections and play with them til you like the look.
Penny