If he's bothering the area, yes keep the cone on. he will get used to it and it is only temporary.
Two weeks seems like far longer than necessary as the stitches (if indeed there are any) come out in 10 days. Also, he will probably stop attempting to bother the area after about 4-5 days.