I have a small one on my wall.
I used whatever fabric would suit the block.
Like the roof on a Madison House might have fabric that looks like shingles.
A tree would have a brown trunk and green leaves.
Aside from that, all I really care about on a sampler is the blocks being the same size.