NSS Labs Admits Its Test of CrowdStrike Falcon Was 'Inaccurate'

guest · May 24, 2019

NSS Labs Admits Its Test of CrowdStrike Falcon Was 'Inaccurate'
CrowdStrike, NSS Labs reach confidential settlement over 2017 endpoint product testing dispute
May 24, 2019
https://www.darkreading.com/endpoin...wdstrike-falcon-was-inaccurate/d/d-id/1334810

NSS Labs has retracted its 2017 publicly reported and disputed test results of CrowdStrike's Falcon endpoint security product as part of a confidential lawsuit settlement reached with the security vendor.

The February 2017 advanced endpoint protection test report, which graded Falcon poorly, was challenged in court by CrowdStrike in a lawsuit, which alleged that the testing was incomplete and conducted using illegally obtained Falcon software, and defied CrowdStrike's request for NSS Labs to halt the testing.
In a statement posted on its website this week, NSS Labs said that its 2017 test results of CrowdStrike Falcon were inaccurate and had been retracted.

"NSS's testing of the CrowdStrike Falcon platform was incomplete and the product was not properly configured with prevention capabilities enabled. In addition to the results having already been acknowledged as partially incomplete, we now acknowledge they are not accurate and confirm that they do not meet our standards for publication," NSS Labs said in the statement, which also included an apology to CrowdStrike for the "inaccurate" test results.
Click to expand...

itman · May 24, 2019

The question is if this settlement has any bearing on the later "collusion" lawsuit filed by NSS Labs in which CloudStrike was a named party. "My gut" is telling me CloudStrike might have "sold out" the other parties in order to get this settlement.

guest · May 24, 2019

See... Testlabs have to bow under vendors, don't expect credible results from labs...reason why samples are never disclosed so the public can't crosscheck...
Labs = vendors' marketing proxies, if not, they get sued at worst or the vendors withdraw at best.

guest · Jul 19, 2019

The Problem with Proprietary Testing: NSS Labs vs. CrowdStrike
July 19, 2019
https://www.darkreading.com/risk/th...esting-nss-labs-vs-crowdstrike/a/d-id/1335259

When a company is researching options for network security tools, it needs to be able to weigh a number of factors, including cost, effectiveness, compatibility, integration with current or third-party tools and platforms, and — perhaps most important — impact on network performance.
What's Wrong with Network Security Testing
The situation involving NSS Labs and CrowdStrike is a perfect example of what's wrong with network security testing. In a Dark Reading column earlier this year, I described network security testing as the Wild West, noting that proprietary testing methods conducted under uniquely optimized conditions create a chaotic scenario in which everyone plays by their own rules and customers are left struggling to sort it all out.

The flip side of the coin is that closed and proprietary testing standards also create the potential for vendors to game the system or gain an advantage over rival companies.
Vendors frequently impose conditions on how their products can be tested and demand that testing labs design environments and tests that focus on areas in which the product excels, minimizing scenarios in which the product does not perform well.
Click to expand...

guest · Jul 19, 2019

Don't be fools, stop reading test labs results.

itman · Jul 19, 2019

mood said: ↑

The Problem with Proprietary Testing: NSS Labs vs. CrowdStrike
Click to expand...

Excellent article; especially the last part of it:

The Importance of Open Security Testing Standards

The answer is to adopt open network security testing standards.

NetSecOPEN (like AMTSO, a vendor-led organization) was formed in 2017 to address issues and challenges related to the current proprietary testing environment. We believe that the network and security industries must go beyond simply validating test results and, instead, establish new tests that are open, transparent, and created through a cooperative, collaborative effort.
Click to expand...

Log in or Sign up

NSS Labs Admits Its Test of CrowdStrike Falcon Was 'Inaccurate'

guest Guest

itman Registered Member

guest Guest

guest Guest

guest Guest

itman Registered Member

Log in or Sign up

NSS Labs Admits Its Test of CrowdStrike Falcon Was 'Inaccurate'

guest Guest

itman Registered Member

guest Guest

guest Guest

guest Guest

itman Registered Member

Useful Searches