I quite like the Aubretia and the Saponaria ocymoides.

I am in Surrey and the garden is south facing so the walls in question
get the sun for most of the day.

I think the soil is standard/chalky. I seem to be digging up lumps of
chalk periodically and haven't found any clay yet.

Thanks

James