Luckily general gradient for spherical harmonics is defined

http://web4.cs.ucl.ac.uk/staff/j.kautz/publications/gradientSH_RS04.pdf