Got the BD34301EKV eval board out again for another try. Sending it the DSD format it prefers where MLCK is the same frequency as BCLK. Also still using IC opamp I/V but the rest of the output stage is discrete, similar to what I have been using with AK4499. It actually sounds not too bad, like it has some potential.