Yellow jackets won't swarm after the sun goes down. The best way to destroy
a nest is pour gasoline in the hole and light it. I know you can't do that
where your nest is located, so I guess your other alternative is to have
your landlord bring in an exterminator.