Sounds as though you have Japanese stilt grass or micrcostegium. Very invasive.
Get rid of it before it seeds in late summer. It will cover everything. Check
out these websites for more info:

http://samab.org/Focus/Invasive/JapStilt/japstilt.html
http://www.nps.gov/plants/alien/fact/mivi1.htm