Signal LED causing distortion

[AndrewT]

I think what you have found is that driving the output cap pulls enormous current in short spikes from the supply rails.
Those rail glitches are getting into your audio stream.

Try improving your rail decoupling. Then use the wrong cap connection to prove how effective the decoupling is at smoothing the glitches.