I have this Canada thistle everywhere and I'll assume it's from my finch
feeder?

Anyway, I read where you can get rid of it by not letting it go to
seed.....is that true?

Just cut it before it seeds and it won't propagate any other way?

Damn that Canada.