Our composter is invaded by ants!

When I open the door at the base to take some out there are thousands
of ants in it.

What is they best way to deal with this? The bin is full and I could
do with removing some from the base so I can add more peelings etc to
the top!

I feel uneasy about spreading the ants round the garden (using compost
as mulch) as it seems that I'll be spreading ants all over the garden
adn then the whole place will have hundreds of ants nests!

Any advice (non-chemical) much appreciated.