The boost converter is possibly getting overwhelmed by the load from the amplifier. Why not do a conventional power supply with mains transformer?
I probably will but this seemed ideal for playing around whilst learning. And it's isolated from mains AC also... Expense is another factor. The first schematic is taken from a YouTube video where the builder successfully used the same schematic. Also, I've seen quite a few boost using boost converters for the HT supply since.