You could try sifting out some of the rubbish by making a compost
sifter, which is just a wooden frame with some small-weave wire mesh
stapled over it. You put the sifter over a wheelbarrow and then rub
the compost through it. Takes a while but is very effective.