It can cause loss of localization cues. Fortunately, it is relatively easy to cancel using simple op-amp based circuits operating at line level. Unfortunately it works for one listener in one position in the listening room so it gets low WAF scores. It is also highly variable depending on the recording.
Several commercial products have been produced to deal with it.