DI noise only with passive instrument

I recently was given a Jensen DB-E transformer and decided to try my hand at building a simple direct box based on their schematic. I’ve done some basic projects before but I’m certainly not and expert and I’m stumped by this problem. When I plug in a bass with an onboard active preamp, it sounds great. When I plug in a passive bass, there is all kinds of noise. Ground buzz type noise. I have a couple basses that can switch between active and passive. In active mode, great. In passive mode, buzzzzzzzx.

I thought it might be a ground loop issue but lifting the ground has no effect. Only thing that changes it is when I turn the volume down on the passive basses, the buzz seems to get louder. Any ideas???