Is it that simple?

not quite!! you would be best using the blue plastic pipe made for the
purpose, have a look at the screwfix site and you'll find the stuff,
although it's available in many places.
any hose outlet to the garden / pond etc is required to have a one way
valve to stop "foul water" being drawn into the mains. This would be covered
if you used the correct blue pipe and then used a standard garden tap kit on
the far end as these now include the one way vale in the tap (there is a
bylaw number for it but I can't remmmember that!!!

The Q