I wonder if the bluetits visit a peanut dispenser? If they do, I expect the
nest box smells of peanuts. I suppose there's a possibility that the
woodpecker can smell peanuts in the box and is trying to get to them.

Perfumed spray might deter it!!!

Geoff