AT2380v1 // 2 Channels digitally controlled stepped attenuator

The source impedance issue is quite real and few opamps address it. TI has one (I forgot the number) that is optimized for minimal input C change with voltage. The relay solution I linked would be my first choice for a no compromise volume control. Frex's attenuator is very good but really addressed to a different task.