It can be a weather problem..if it is too cold, too windy, or too wet when the bees are out maybe they just aren't getting properly pollinated..