Absolutely agree, change one "thing" at a time (IE just power supply caps, just input caps, just inductors, just bypass op-amp). Then you know what made the most improvement.