I was referring to "professionals" that make this for a living, not enthusiasts that make tests in a forum. In any case though, in ANY test, there is a level of bias. With enthusiasts, simply the level of bias can only be traced to involuntary bias. You can google more about "test bias" and see more about it. It is proved that even the preconcept of a tester can influence the result, even if he isn't the one who decided how to conduct a test. (this is why pharmaceutical companies use "blind" and "double blind tests", where the tester or both the tester and the tested subject don't know what they are testing). The way to conduct a test, has itself a bias. Why choose tests 1,2,3 and not 1,2, and 4 which is used by someone other. This is also interesting to see: http://www.bbc.co.uk/science/horizon/2002/homeopathy.shtml For the history, the result was that there was no proof of homeopathy working. Despite what other testers have found previously. There's also one such tester in the documentary who couldn't believe her eyes. The explanation is that her bias (she wanted to prove that homeopathy works), influenced the test and she got "proof" that it was working. While her colleauges in the BBC test, who didn't know what they were doing, proved otherwise. The more evident bias finally is in the final report. Two different people, getting the same test results, may produce a final conclusion completely different, based on what they think as more important. (which is more or less obvious in Matousec, who sets a level for very good, a level for good, for any type of product, while someone else may consider some tests more important than others or set different limits or don't rank products in the same ranking or put different value of tests for Comodo compared to Mamutu. Meaning, one may expect Mamutu to perform differently in different tests). Another "Matousec" can come up with other tests that can "change" ranking, because they target more the vulnerabilities of a product or... surprise, surprise, don't focus so much on HIPS but on packet filtering! What's the "safest" firewall at the end? The one who passes more leak tests? The one with best inbound protection? The one with SPI? The one with ARP? Is the "Wallbreaker" as important as the "PC Audit" test or in real life their importance should be different? How many leak tests should be considered in a ranking? 10? 20? 30? What's the level of "best" , "good"? Is it still "recommended" firewall even if it causes your connection a 20% slowdown? Is it "recommdended" even if it eats your CPU cycles for fun? Similar things happen with AV tests. The same av scored 99% in one test and 85% in another. The answer lies in a sampled bias and possible unconscious testers' bias. OFF TOPIC START This is the latest on my list. I have just ordered this Hitachi Hard drive (well it's "B" version, which is pretty much the same). Although "testers" measure more or less the same things, it's "mysterious" how they "see" different things. Just some samples, you can find differencies in every test in the internet, while they use the same software and hardware usually! Access Time, different programs, give very different results: 13.8 ms in Tom's hardware. Clearly the drive sucks. http://www.tomshardware.com/reviews/hitachi-western-digital-terabyte,2017-5.html 12.55 in Xbit labs (one of the best access times specially if you test read too!!!) http://www.xbitlabs.com/articles/storage/display/1tb-14hdd-roundup_10.html#sect0 Tom's hardware: PC Mark 2005 test (file write) 76,1 MB/s http://www.tomshardware.com/reviews/hitachi-western-digital-terabyte,2017-7.html XBit labs: PC Mark 2005 test (file write): 84.08 MB/s http://www.xbitlabs.com/articles/storage/display/1tb-14hdd-roundup_18.html#sect0 The best comes in the "conclusions" (like in "what's safest"): In Xbit labs, the Hitachi takes the Editor's choice (reccommended by "Matousec A"): "Hitachi E7K1000 and Western Digital Caviar Black with our Editor's Choice title as the best HDD choice for a performance home computer system" http://www.xbitlabs.com/articles/storage/display/1tb-14hdd-roundup_22.html In Tom's Hardware, it's not reccommended for performance, but for storage (not reccommended by "Matousec B"): Hitachi's new Deskstar 7K1000 is clearly worth recommending for those with huge storage requirements. Its 1 TB represents a 33% increase over Seagate's 750 GB, which is substantial, and it even outperforms the Seagate Barracuda 7200.10. However, it is not the perfect hard drive at all. Performance users should still go for a WD Raptor drive at 10,000 RPM to host the operating system, and add a second 7,200 RPM for storage. In such a case, the 7K1000 is awesome, but it also gets noticeably hotter than other 7,200 RPM drives, so it should be properly cooled for the sake of data safety. http://www.tomshardware.com/reviews/hitachi-7k1000-terabyte-hard-drive,1584-9.html Then the funniest part comes to the review of the same HD but "B" version. The summary is oustanding: While "All Deskstar 7K1000.B drives spin at the standard 7,200 RPM speed, but they are much more efficient than their predecessors as a result of the decreased platter count." we have: "this is as fast as a 5,400 RPM notebook hard drive and hence not very impressive at all." http://www.tomshardware.com/reviews/hitachi-western-digital-terabyte,2017-2.html How odd. It's an evoluted version of the previous Hitachi, but now it's as fast as a 5400 rpm notebook harddrive... Also interestingly, for the "B" model: Tom's hardware gives: Access time, 17.1 ms http://www.tomshardware.com/reviews/hitachi-western-digital-terabyte,2017-5.html Xbit Labs, gives: Access Time: 12.62 ms http://www.xbitlabs.com/articles/storage/display/1tb-14hdd-roundup_10.html#sect0 That's quite a difference... One got the miracle disk and the other got the lazy disk? And you should see how different chipset tests are and even worse the conclusions! In one review the AMD 970gx chipset was consistently beating the nv8300 and the conclusion was the the "nv was best for games, while the AMD for home cinema". OFF TOPIC END I think you are seeing personal attacks everywhere, while you shouldn't. Well, unless you 're Matousec... (it's a joke). If this can make you feel any better, i exclude you or other amateur testers from what i said.