aubergines
 

I am growing aubergines for the first time, with just two plants outdoors.
Each plant has one fruit a bit larger than a tennis ball and several only
just appearing. I would assume these immature fruits (and several dying
flowers) will not mature now, so should I remove all but the two decent
sized ones? and any other help please.