Filling in the holes with caulk will discourage them.

Nothing does, they are back same time each year here. Saw them yesterday.
Colleen