Just an update.
I have now removed the ivy, there was one small birds nest but thousands of
woodlice and I would think that they may damage the tree.