Then we noticed some white 'fluff' at the base of the new growth areas
at the top of the branches. On closer inspection we can also see what
look like small white woodlouse.

Sounds like mealy bugs. See:
http://www.colostate.edu/Depts/CoopE...ts/mealy2b.htm
sed5555