It looks more like the daylily midge. The midge fly lays eggs on the young buds... if you break open the deformed buds you should see little white larva that look like rice. The buds fall to the ground where the larva pupates and over winters. Next Spring the flies come up from the ground and the infestation will be even worse. The only effective method of control is to remove all the affected buds and destroy them. The first season you will be removing most of the flower buds... but the following year there will be many fewer infested buds. Also, earlier blooming varieties tend to be affected more... at least in our Puget Sound region. This pest only recently showed up here... say in the last 5 years.