It seems to me, that any difference that can only be heard/shown with that level of equipment and training, will in any case be completely irrelevant in any practical scenario...
Misses the point completely - people prefer the speakers in sighted tests but this doesn't satisfy the scientific measure for objectivity as bias is cited as an influencing factor. Therefore, a very careful, formalised testing methodology is needed to minimise as much as possible these influencing biases & anybody presenting research in the scientific area needs to do this as Olive/Toole did.
What this means is not that this complexity is needed to prefer the best measuring speaker, both simple sighted listening & complex blind test listening come to the same result so the complexity is NOT needed - it's only needed for scientific research & presentation of objective findings
Last edited:
I have no belief on this matter. I suspect that they might sound different, since both may be flawed in different ways: one by using a curious architecture, the other by cost constraints. However, take a good tube amp and a good SS amp and it has been shown that by some small adjustments (frequency response, output impedance) they can be rendered indistinguishable.Doppler9000 said:Do you believe that an OTL tube amp and a cheap Pioneer receiver sound the same?
'Good enough' means sufficiently good that the unit becomes indistinguishable in almost any reasonable ears-only test from any other 'good enough' item. Items which are not good enough are more likely to be distinguishable, except where they all share a common flaw but are otherwise good enough.What is the basis for your binary condition of “good enough” or “not good enough”?
How do you define or specify “good enough”?
I simply asked a question. I do not seem to have received an answer.For example, instead of trying to understand the critiques of the ABX approach on their merits (or lack of merits), based on evidence and logic, you have imagined that I am part of a snake oil conspiracy, thus explaining why I am offended by someone like the OP exposing the “truth”. You have substituted your imagined story for the objective reality.
In audio it is a large fringe. No collusion or coordination is needed, other than herd instinct. The poor teaching of science (and economics) in modern schools leads to lots of people being easily bamboozled.I believe that there are questionable claims at the fringes. To be much wider, however, would require collusion and coordination among an increasingly larger group of manufacturers, suppliers, and sellers, as well as ever-larger groups of buyers who are easily bamboozled.
There is ample evidence just on this forum. People with crazy ideas or simple ignorance of the basics - some of them engaged commercially in the audio business. Before I joined this forum I assumed that most audio was competently designed, and that 'more expensive' probably meant 'better design'. I now know that this was hopelessly naive, and the correlation between cost and quality becomes ever weaker at the 'high end' and may even turn negative. Items praised to the skies by journalists, but containing basic design errors and/or appallingly poor performance.I would like to hear your evidence for and explanation of how this can be the case.
I told you, Doppler, you would get that answer the 'test' is what defines "good enough"
Now here's just one problem with that - how do we know the 'test' is sufficiently sensitive? How do we know that the test isn't masking differences?
Surely to use a test as the reference for defining "competent design" or "good enough" the test itself has to meet certain rigorous standards which have been shown to not influence the results?
What do we have here - a definition "almost any reasonable ears-only test" - pretty wide-ranging definition!! Wonder who decides what's a "reasonable ears only test"?
Who tests the test? Nobody. The suggestion was made early in the thread that some known & audible difference should be included in the blind test & used as a means of at least verifying that the test & participants have some hope of revealing similar differences (the level of this anomaly needs to be determined to define the sensitivity of the test itself)
Now here's just one problem with that - how do we know the 'test' is sufficiently sensitive? How do we know that the test isn't masking differences?
Surely to use a test as the reference for defining "competent design" or "good enough" the test itself has to meet certain rigorous standards which have been shown to not influence the results?
What do we have here - a definition "almost any reasonable ears-only test" - pretty wide-ranging definition!! Wonder who decides what's a "reasonable ears only test"?
Who tests the test? Nobody. The suggestion was made early in the thread that some known & audible difference should be included in the blind test & used as a means of at least verifying that the test & participants have some hope of revealing similar differences (the level of this anomaly needs to be determined to define the sensitivity of the test itself)
Last edited:
You want a good Hifi ?
Mostly : don't read Hifi 'zines. You just read about margins between brands, distributors, ads editors incomes, grup of friends and sometimes corupted writers.
Better is to go the hifi consumers exhibitions... and most of the time it tells you just about how a combination of devices is poor or good (if Lucky, good room, etc, asf). No more !
Many Dacs are equally bad or close enough bad, and I think this what the op experienced, or the speakers were poor stuffs (most are) ! Price indeed not a good factor enough to sort them out.
Experience should be more interessant between a good vynil brand new without surface scratchs and the same reccording with a DAC. Of course with acoustical instruments recordings. If listeners are hearing no difference, discussion start becoming of a great interest.
Mostly : don't read Hifi 'zines. You just read about margins between brands, distributors, ads editors incomes, grup of friends and sometimes corupted writers.
Better is to go the hifi consumers exhibitions... and most of the time it tells you just about how a combination of devices is poor or good (if Lucky, good room, etc, asf). No more !
Many Dacs are equally bad or close enough bad, and I think this what the op experienced, or the speakers were poor stuffs (most are) ! Price indeed not a good factor enough to sort them out.
Experience should be more interessant between a good vynil brand new without surface scratchs and the same reccording with a DAC. Of course with acoustical instruments recordings. If listeners are hearing no difference, discussion start becoming of a great interest.
I have no belief on this matter. I suspect that they might sound different, since both may be flawed in different ways: one by using a curious architecture, the other by cost constraints. However, take a good tube amp and a good SS amp and it has been shown that by some small adjustments (frequency response, output impedance) they can be rendered indistinguishable.
Was it through ABX “testing” that this indistinguishable rendering was demonstrated?
'Good enough' means sufficiently good that the unit becomes indistinguishable in almost any reasonable ears-only test from any other 'good enough' item. Items which are not good enough are more likely to be distinguishable, except where they all share a common flaw but are otherwise good enough.
As was predicted, you chose a tautological definition. At least you are consistent.
I simply asked a question. I do not seem to have received an answer.
The answer is relevant only if you choose to ignore logic and prefer, instead, to fit the answer into your narrative fallacy.
If I work in the audio industry, presumably I am a snake oil salesman and not to be trusted.
What if I was a farmer? Would I be less knowledgeable but more trustworthy, in your view?
Would you view the merits of a logical argument made by an astronaut differently than those made by a banker?
In audio it is a large fringe. No collusion or coordination is needed, other than herd instinct. The poor teaching of science (and economics) in modern schools leads to lots of people being easily bamboozled.
If all DACs sound the same, how would you explain a competitive market that prices them differently? Trickery?
Last edited:
Marketing. Selling stories. Ergonomy. Esthetics. Functionnalities. National pride. The peace of mind that comes from buying something that comforts your beliefs.
I could add a dozen reasons...
What makes me sympathetic to the OP's positions is how the audio industry is touting "huge, night and day" differences between devices. Yeah... for speakers or headphones sure. For amps ? On difficult loads and at high level, ok. For DACs ? Subtle at best in my experience.
I could add a dozen reasons...
What makes me sympathetic to the OP's positions is how the audio industry is touting "huge, night and day" differences between devices. Yeah... for speakers or headphones sure. For amps ? On difficult loads and at high level, ok. For DACs ? Subtle at best in my experience.
Just a silly story, quite irrelevant to anything else.
I think it has already be acknowledged that humans can imagine things. No argument there. It is also true that humans can be convinced that something doesn't exist when in fact it does physically exist.
So what do we do? Hopefully we try to sort it out as best we can, and allow that our sorting might not be perfect. Maybe with enough work we can arrive at some reliable statistics as to the probability that our sorting is correct, and feel appropriately confident about it (neither overconfident nor under).
People who have done work trying to sort out what humans can hear, such as out own Earl Geddes, say that they have a pretty good idea what most humans can hear, maybe about 95% of humans (based on the test protocols that currently exist, and the technical performance of test equipment in use at the time research was conducted).
One thing we don't have is a Guinness Book of World Records category for being able to hear the smallest distortion humanly possible. That being the case, we don't know what is possible. We can conjecture about it, and we do, but it hasn't been measured.
As a matter of personal opinion, I do some blind testing but not with foobar, and I have blindly and repeatedly at different sittings identified file differences at a very low distortion levels, and lower than I could do with foobar ABX. In other posts I have already outlined particular shortcomings with foobar ABX that make it distracting when used for testing with very low distortion levels. It should be very easy to demonstrate with some small changes to foobar ABX, that people would probably start producing better scores with very low level distortion testing. But I didn't and don't write foobar ABX software and neither do you. So what do we do?
We argue. We make up silly stories. Pretty much everything but do some science to test a hypothesis that small changes to foobar ABX would result in significantly different scores for a certain class of test cases.
Now that we have that out of the way, shall we get back to arguing? 🙂
Last edited:
What makes me sympathetic to the OP's positions is how the audio industry is touting "huge, night and day" differences between devices. Yeah... for speakers or headphones sure. For amps ? On difficult loads and at high level, ok. For DACs ? Subtle at best in my experience.
How could the words chosen by the audio industry affect the validity of a null test?
It seems that you believe in the merits of the test because the results fit your world view.
Have you read this thread by the OP? It is an earlier chapter in his serial test/surprise cycle.
"World' Best Midranges - SHOCKING Results & Conclusions."
Last edited:
The post was about price setting for DAC. Since you don't pick on that, do you accept the reasons I gave ?
And sympathetic just means that the results fits the data points I already have by experience with a few dozens DACs (and not bothering doing ABX myself btw). Nothing more.
And sympathetic just means that the results fits the data points I already have by experience with a few dozens DACs (and not bothering doing ABX myself btw). Nothing more.
Evidently the DAC chip manufacturers are so committed to THE LIE they are paying their engineers to come up with new and interesting ways to fool the public. I bet if you visit ESS, AKM, etc. they are just sitting around playing minecraft with marketing because they know all their chips sound the same anyway.
I'm so glad we know better than they do. We're awesome you guys.
I'm so glad we know better than they do. We're awesome you guys.
Wouldn't it actually take a positive effort to design a DAC chip that sounded crap these days? Most of the cost is probably in the housing
Wouldn't it actually take a positive effort to design a DAC chip that sounded crap these days? Most of the cost is probably in the housing
Probably. The engineers in the recent AKM interview are probably actors.
This one, or a more recent one? Audio Market Voices | LINN x AKM | interview | AKM - Asahi Kasei Microdevices [RWD]
ABX testing method is widely used by multi-billions pharmaceutical companies for decades. In fact, it's a sina que non condition for FDA approval.
My methodology for this particular test may be flawed, but i don't think the ABX method is.
Or prove me wrong. 😉
Google "placebo effect" and "nocebo effect". Not one; both.
One exhibits the symptoms of the cure while eating sugar pills.
The other is fed sugar pills but exhibits the side effects (which are disclosed as part of the study protocol) of the medicine under test. And not just sniffles ... in some cases, where there was a chance of fatal complications, patients have convinced themselves they have the fatal condition, and in fact follow that up by ... you guessed it ... dying.
The "multi-billions pharmaceutical companies" have to filter out these participants and results; if they didn't, the MAJORITY of the subjects would be under one or the other false symptoms, making the research pointless ... no drug could be approved with the unfiltered results.
Last edited:
Wouldn't it actually take a positive effort to design a DAC chip that sounded crap these days? Most of the cost is probably in the housing
Yes - I read that the cost of housing has gone up a lot. The insides are all the same, so they sound the same. That fully explains both the results of the test and the enormous price range of DACs.
Welcome to Team Awesome!
Last edited:
This one, or a more recent one? Audio Market Voices | LINN x AKM | interview | AKM - Asahi Kasei Microdevices [RWD]
Sato: And our chip has greatly improved distortion by new, “VELVET SOUND,” architecture that is AKM’s innovated technology. This time, we also reviewed the LSI production process for the AK4497. We developed a new LSI production process only for premium audio devices. With this new process, the sound quality characteristics have hugely improved, achieving the best sound quality ever.
Like I said, they're busy playing Minecraft. Just look at the pic. Just sitting around with laptops. How can they engineer something that is beneath the threshold of audible differentiation based on our awesome and rigorous standards?
Yes - I read that the cost of housing has gone up a lot. That fully explains it.
Welcome to Team Awesome!
The money is always dumped into the enclosure. Just look at the speaker industry. Another con!
- Home
- Source & Line
- Digital Line Level
- DAC blind test: NO audible difference whatsoever