Sometimes there are "nuts" on the roots too, but even tho' they are
supposed to be edible, I've found them to be unbearably bitter.

Perhaps you have the related Purple Nutsedge? (according to
http://en.wikipedia.org/wiki/Cyperus_esculentus the taste is a key
difference between yellow nutsedge and purple nutsedge).