Topping DM7 8-channel USB DAC using ESS ES9038PRO - wow!

Status
Not open for further replies.
What are "typical sighted tests"?
Sighted tests presented on this site have typically these shortcomings:
  • Equipment to be tested are owned by test subject(s)
  • Level matching is not done properly.
  • Testing involves component rolling or modifications so A/B may not even be possible since A is not available anymore.
  • Modification process takes too long to have meaningful results (i.e. takes longer than auditory memory).
Which tests do not suffer from cognitive bias?
DBTs can mostly eliminate cognitive bias since test subjects may not not even be aware of what is being tested.
 
It does cause damage because they try to persuade other people to join their hypocritical quasi-religion. It also causes damage when their words are laced with sarcasm that expresses their disgust with people that report hearing differences. Again, the damage is that it tends to result in newbies believing they should feel disgust too. Its contagious.

A huge issue is that for every claim of improvement that is legitimate there are many cases where someone is indeed trying to fleece the credulous. The latter is absolutely worthy of disgust.

Newbies should interact with all extraordinary claims with skeptisicm and critical thinking. This is far from a quasi-religion.

To them sighted listening is utterly unreliable and nobody would say otherwise unless they were up to some kind of no good, probably trying to sell some overpriced snake oil or something equivalently evil. Seriously. Those kind of days should not repeat.

A guy who has been here a long time and saw what happened made a graphic showing the range of personality types and beliefs along a couple of dimensions. Bonsai is the name he goes by here. Its actually a pretty accurate pegging of people's personalities. One thing you may notice in the graphic is that some people are of extreme beliefs and tend to be intolerant of other beliefs. It is the intolerance, the disgust associated with it, and the way it is expressed that is bad.

Sighted tests are indeed unreliable. There are simply too many potential biases and variables to permit the drawing of a solid conclusion. Please not that I'm not attributing malice here - people are all too often simply unaware of their biases.

Should said listening tests be undertaken with sufficient rigor and the ever-useful double-blind ABX methodology, then credence can easily be attached. Unfortunately, many making extraordinary claims refuse this approach with various forms of dubious rationalisation.
 
Last edited:
Sighted tests presented on this site have typically these shortcomings:
  • Equipment to be tested are owned by test subject(s)
  • Level matching is not done properly.
  • Testing involves component rolling or modifications so A/B may not even be possible since A is not available anymore.
  • Modification process takes too long to have meaningful results (i.e. takes longer than auditory memory).

Any listening test that possesses any of these characteristics, the absence of an X, or where the listener or assistant knows what variant is being listened to at any given time, cannot be considered conclusive. Anything that can possibly influence the outcome beyond the characteristics of the equipment itself ruins the reliability.

There is a very good reason testing in various fields uses the DBT method - it's the only way the results have meaning.
 
Last edited:
Status
Not open for further replies.