Ultimate listening test ... test your ears and audio chain

Which File Do You Prefer

  • Blue

    Votes: 0 0.0%
  • Green

    Votes: 0 0.0%
  • I can not decide

    Votes: 0 0.0%

  • Total voters
    0
  • Poll closed .
Status
Not open for further replies.
Afair this ITU-R was based on the method used from mid 80´s in audio compression development. You may have been involved or somebody got the basic idea from your input or it was a parallel independent invention.
I have some friends that were heavily involved with compression development and have discussed this extensively with them.

But AFAIK, our tests were developed independently. Absolute Listening Tests-Further Progress was a VERY early step in is evolution and in fact, the complex protocol described was much less useful than the simple protocol I posted. (The other points and the hardware etc are all still valid & useful ... as is the Room Interface Profile

It depends on the goal of the test.
Obviously we do have similar observations with participants; as i´ve written a couple of times imho it is important for listeners to remain in a state of awareness to notice every possible difference if he does not know what to listen for.

On the other hand, as for example jj pointed out several times, if listeners are trained and know what effect is under test, they can achieve an incredible degree of sensitivity.
If the effect can't be picked out unless it is demonstrated ad nausuem first, it is inconsequential.

BTW, I am ALWAYS after preference but ONLY from those who express this reliably. Remember, my object is to design stuff which sounds better.

For those who are not consistent, it is more profitable to stress Virgins & Unobtainium. 🙂

If my true golden pinnae note a consistent difference but express no preference, this is also an important finding ... MUCH more important than Chalk & Cheese comments from deaf Golden Pinnae who can't assign these characteristics reliably.

Your tweeter example is a good one, as it illustrates the difficulties.
If the loudspeaker is for example a typical two way design, it might be that a different tweeter will nevertheless lead to a different perception of bass reproduction.

If listeners were told upfront that the EUT is the tweeter they might discard their different perception of the bass reproduction, because they could consider it as unlikely.
The 'correct' conclusion from this result is that the choice of treble unit makes NO significant difference ... or that other factors, eg improper matching of xover to the 2 different units and their integration to the bass unit, are the dominating factor

... or that the listener is a deaf Golden Pinnae. The repeat test(s) will sort this out if the ABC doesn't already.

As really a speaker man, I've a lot of experience with this last example of yours.
 
Last edited:
I strongly believe that in case of this current test any preliminary info about what is tested would be counterproductive.

Yes that's also what I though. People will try to find out which is which, which strangely is possible, instead of trying to choose their preference.

Even if this is only an AB test, I believe the third preference (C) could be exist in other threads!!
 
And sometimes you just need to let people know what it is, so that they will take the time to listen. E.G. my Mud vs Wires test or Mooly's opamp test. Since we aren't paying people to sit down and listen, we need some way to entice them. 🙂

Very true. In a real blind test I have seen some old geeks didn't want their votes to be mentioned in public. And same here, some members will never want to vote. Yes, why should they risk ruining their CREDIBILITY? 😀
 
Very true. In a real blind test I have seen some old geeks didn't want their votes to be mentioned in public. And same here, some members will never want to vote. Yes, why should they risk ruining their CREDIBILITY?
Its not like they're going to announce each individuals choice.
I've tested quite a few HiFi Reviewers, some of whom claim to be Golden Pinnae.

I always give them a choice of remaining anonymous or letting their names be on our Files. I tell them this before I tell them their results.

Mooly & Pano, I think you should give all listeners the same choice. It would be good to have all individual results on a spreadsheet and the results of other tests incorporated.

Then we amass evidence that 'A is a true golden Pinnae', 'John Smith is a deaf Golden Pinnae' etc

PS The comments of the true golden pinnae are often as useful as their scores so please make room on the spreadsheet for them.
 
Last edited:
Pano said:
And sometimes you just need to let people know what it is, so that they will take the time to listen. E.G. my Mud vs Wires test or Mooly's opamp test. Since we aren't paying people to sit down and listen, we need some way to entice them.
I strongly believe that in case of this current test any preliminary info about what is tested would be counterproductive.
The ONLY type of info we can tell listeners is something that is SO FAR from the truth that it can't possibly affect listeners eg

Tell them its SE triode vs Bob Cordell's 1984 amp.

Da deaf Golden Pinnae will immediately hear Chalk & Cheese differences. True golden pinnae will say, "I think they sound very similar but ... " cos they trust their ears.

BTW, this is all from experience over nearly 2 decades.
 
If the effect can't be picked out unless it is demonstrated ad nausuem first, it is inconsequential.
IMHO, that may be, or may not be true.
It is those seemingly minor nuances that on early listenings may not be noticed, that however can build to contempt on extended listening/living with a particular system/item.
On the other hand, this extended listening may also build admiration.

Dan.
 
That's one very important thing that I have often tried to stress.
Thank you, and yes, that is a downfall of relatively short period ABX testing.
Unfamiliarity will expose gross characteristics in short period testing with decently skilled listeners, but longer term (even sighted) testing might be required to tease out the fine differences.
It can be those fine differences that make or break a system/item.

Dan.
 
IMHO, that may be, or may not be true.
It is those seemingly minor nuances that on early listenings may not be noticed, that however can build to contempt on extended listening/living with a particular system/item.
On the other hand, this extended listening may also build admiration.
A single 'trial' in my tests can take 1/2 a day. ie the listener can take 1/2 a day to make as many comparisons of the 3 'presentations' as he likes WITH HIS CHOICE OF MUSIC.

In nearly 2 decades of conducting DBLTs, I have not found any nuance that can't be picked out in 1/2 day that proved false for more extended listening .. that's provided the 'nuance' is reliably detectable in the first place.

If the listener extends the 'trial' to 1/2 a day, it means he really likes at least one of the 'presentations'.

It's the same phenomena when a reviewer says, the DUT is so good, he was persuaded to listen to his whole record collection again.

The 1/2 day limit is purely arbitrary cos its difficult to tie up expensive people and equipment just for 1 trial for one listener for longer periods. But no one has asked for more time.

But if they can't make up their mind after 1/2 day, they are not going to do better with more time.

I have results for a small number of tests (on purely electronic stuff) where the ABC equipment was set up in the listener's domestic system allowing him to do the test at his own convenience in his own home for several days but this did not show any better discrimination than the 1/2 day test in our R&D listening room.

This was done to answer the deaf Golden Pinnae claims that they can't possible decide on sound quality without using the DUT at home for a zillion days. 😱
_____________

Max Headroom said:
... but longer term (even sighted) testing might be required to tease out the fine differences.
No need for longer term or sighted tests. Just put the 'Hand carved by Virgins from solid Unobtainium' label on the correct 'button' for each trial. 🙂

Instant detection of even the finest differences. 😀
_____________
PMA said:
You got it !!! 😉
DAMN! Sorry for spoiling your test. 😱
 
Last edited:
All, I think we could close the poll. Any comments?

The incoming votes have dried up through today so perhaps now is the time.

Would it be an idea for those that want to, to pm their impressions (just a couple of lines) on why they voted as they did and what they picked out sonically in the tracks to arrive at that choice ?
 
Status
Not open for further replies.