Originally Posted by echinosum

It's impossible to know without a picture, but the most common thing of that description is Chaenomeles japonica, colloquially known as Japonica or Japanese Quince. It won't be true quince, that's a tree.