No, the oil will not hurt a wooded pitman but like Rodney said it will darken the wood. If I have an old wooden pitman still functional and I can see that oil has been used I cont. to use oil. If I need to make a new wood pitman then I use graphite to keep the finish on the pitman looking nice.
Skip