If you use decorator fabric, put an interfacing on it (preferably a fusible one). Decorator fabrics sometimes have a more open weave than 100% cotton and need the interfacing for extra stability.
I've made purses and tote bags with both, so use which ever fabric you like.