Should I just cut off the spent blooms? How far down?

Is there any reason to cut plant back to the ground?

I trim off the spent blooms and my daughter uses them for all kinds of craft
projects. Sometimes they will bloom again. If they do, I trim them again. I've
never in 20 yrs. of growing lavender ever cut them back to the ground.
Sue in Mi. (zone 5)