Recently bought a mint plant from a supermarket and have been growing it a
pot on the kitchen window sill. The other week we put it in a bigger pot,
but now have a lot of ants coming out of it.

Have just submerged the pot in a large jug of water. Will this do the trick?
If so how long will it have to soak? Or is there a better way? thanks.