More on the black hole S-matrix