The above poster has hit the nail on the head. Outside there would have been a natural balance, bugs like ladybirds eat aphids and so keep them off your plants. How about keeping them outside but under a cloche or fleece?