We are buying a house, and it is likely we will be at the place for
around 3 or 4 years before moving. As such, I've been trying to figure
out what plants to focus on. Obviously, we shouldn't really plant
anything that takes 4+ years to mature.

I seem to recall planting a Hale Haven peach, and getting a decent
crop the second year from that. Also, I was thinking of rhubarb,
perhaps some strawberries, and maybe asparagus.

Would raspberries get established quickly enough? Can anyone
recommend anything else that would be a good choice? I do prefer things
that come back the next year, like the things I've mentioned above.
However, I would also be open to a few annuals.