If the envelope is on the smaller side, it has probably been put in the 'hand cancel' pile which could have held it up as well. If you're dealing with anything other than standard envelope sizes any more 1) you pay more postage and 2) it can't go through the sorting machines so it gets pushed off to the side to do 'when there's time'. Could be the reason for the delay.