I know exactly what you mean. It's hard to work on something when you don't love the fabric (made one and gave it away) Can you do a few blocks at a time? Then work on something that you really love?
Even though it may not be pretty now, once all the blocks are together it'll be a show stopper I bet!