The 3 photos are Vinca not ivy, often used as a ground cover plant, it has a habit of speading vigorously. To get rid of it you could either cut back all the top growth and find out exactly where its roots are, then dig each plant up invidually, probably the most reliable method, or spray it with a systemic weedkiller eg glyphosate.
Graham