Personally, I wouldn't use the selvage in anything, but I think if you trim off the very edge of it to 'slice off' the loops where the weft threads turn back and go the other way, you should be alright. That would create enough ease in the weave so that it wouldn't pull over time. It's a compromise measure. :-D