Is there any downside to keping seeds year after year?

I was talking to someone yesterday who reckons he has grown broad beans
every year since about 1965 by keeping the seeds for the following year.
Won't the seeds revert to basic broad bean as opposed to any particular
variety? Do veg seeds come in F1 hybrids etc?

And what other crops would you consider suitable for this strategy?

Steve