If your batting requirements state every 4" (or every 2" or every 10" or whatever) that means in all directions. so yes, even if your border is only a few inches wide, you still need to put some quilting in your border that satisfies the minimum quilting distance your batting specifies. It will not only look better but it will keep your batting from shifting into unsightly lumps along the borders.