Disorder In An Exactly Solvable Quantum Spin Liquid