May 1st, 2003, 08:32 PM
Eset Staff Account
Join Date: Apr 2006
Resolution: Does NOD32 Personnel Agree With (Virus Test by GEGA IT-Solutions)??
Preface added: March 14, 2008
[This message has been added to the beginning of this historical thread to document the final resolution reached between the main parties involved in the discussion that follows.]
Some recent questions have been asked about this very old message thread, so to clarify how the issue was resolved, here is the actual agreement reached by all of the involved parties, below. As everyone can see, it was done in quite an amicable fashion, and all parties involved have moved forward and often interact with each other on malware-related issues. While the original agreement stipulated that the message thread would be removed, it is being left intact for historical purposes.
NOD32 Antivirus and GEGA IT-Solutions GbR 2% BAT detection rate
On May 9, 2003 GEGA IT-Solutions GbR published to Wilders forum (http://www.wilderssecurity.com) two log files showing that NOD32 version 1.329 (20021115) achieved a detection rate of 2% of GEGA-IT's test set of BAT files.
In these logs all file names have the form *.BAT.
The log files were from a test published by GEGA-IT in PC-WELT (The German version of PC-World.
In spite of prolonged efforts GEGA-IT's test results could not be reproduced, and other discrepancies in the log file indicate that there was an error in this particular aspect of the test.
The detection in retesting with identical update versions taken from archive was 80% of the infected BAT files, if the extension was .BAT. With a .BA$ or .CMD extension the result was identical to the 2% result. It should also be noted that in the test immediately after the one in question, NOD32 achieved around an 80% detection rate against the same test set.
After sharing all samples used for the test with ESET, GEGA-IT tested Nod32 2.0 version 1.417 (Beta 5) and NOD32 detected 100% of the .BAT files in the test set (in 2003), just like all tested future versions of Nod32 2.0 (Final).
To complicate the situation, GEGA-IT lost the stored image containing their copy of the updates, due to a hard drive failure in December 2002, so were not able to demonstrate that their result was valid. To avoid such problems in future GEGA-IT significantly improved their infrastructure at this time.
GEGA IT-Solutions GbR no longer exists as an entity. However, two persons of the original staff and some equipment were transferred to AV-Test GmbH in 2004.
ESET has reviewed the processes of AV-Test GmbH in June 2005 and visited their laboratory in Magdeburg, and are satisfied that the methodologies and mechanisms of testing are of acceptable standard.
As part of this agreement, the Wilders forum thread concerning this matter will be removed and replaced with this statement.
All parties involved (ESET Llc, DATSEC (ESETís German partner) and AV-Test GmbH) have agreed to this joint statement, and are happy that this concludes the matter.
ESET and AV-Test look forward to working together with a fresh understanding and improved relationship in future.
Dr. Anton Zajac
1172, Orange Avenue
DATSEC Data Security e.k.
Last edited by agoretsky : March 14th, 2008 at 08:17 PM.
Reason: added this preface posting to thread