Deleting old .dat files

Discussion in 'ESET Server & Remote Administrator' started by javon7065, Oct 26, 2012.

Thread Status:
Not open for further replies.
  1. javon7065

    javon7065 Registered Member

    Joined:
    Oct 26, 2012
    Posts:
    4
    Location:
    USA
    hello. recently been handed the keys to a Eset environment. I noticed that the following folder structure has over 1 million files in it!! It appears to be every dat file ever downloaded since Eset was installed in 2008. the path is:

    D:\Documents and Settings\All Users\Application Data\ESET\ESET Remote Administrator\Server\storage\ThreatSense2_Data\00

    Inside the 00 directory there are 24 directories, named starting with 00 and ending with 17. All have .dat files in there. In the Server Options page in the ERA Console, I see a bunch of options to trim logs but nothing about how many days/weeks/months to keep .dat files.

    Anyone know of where I can set this? Running ERA console version 5.0.242

    thanks,

    Joe
     
  2. JesusV

    JesusV Former ESET Support Rep

    Joined:
    Jan 21, 2010
    Posts:
    93

    Joe,

    The data in this folders are the same data which are sent from the client (ESS/EAV/EES/EEA) when you choose in advanced settings on client option Tools/ThreatSense.Net/Advanced Setup... button/Submission tab/ option "By means of Remote Administrator" (on v4 products) or Tools/ESET Live Grid/Advanced Setup ... button/ option "By means of Remote Administrator" (on EES/EEA products).

    In other words, here is the info what LiveGrid sends to ESET or to ERA and than to ESET.
    ESET Live Grid (the next generation of ESET ThreatSense.Net) is an advanced warning system against emerging threats based on reputation. Utilizing real-time streaming of threat-related information from the cloud, ESET virus lab keeps the defenses up-to-date for a constant level of protection. User can check the reputation of running processes and files directly from the program's interface or contextual menu with additional information available from ESET Live Grid

    The data can be trimmed down by modifying the logging values in the server maintenance tab.

    Regards,
    Jesus
     
  3. javon7065

    javon7065 Registered Member

    Joined:
    Oct 26, 2012
    Posts:
    4
    Location:
    USA
    Jesus, thanks for the reply. I am still waiting on an answer from Eset on the ticket I have open about this.

    What items in server maintenance tab relate to this? I already set all of the log settings down quite a bit and I still have over 1 million files in the D:\Documents and Settings\All Users\Application Data\ESET\ESET Remote Administrator\Server\storage\ThreatSense2_Data path.
     
  4. JesusV

    JesusV Former ESET Support Rep

    Joined:
    Jan 21, 2010
    Posts:
    93
    PM sent.
     
  5. RobJanssen

    RobJanssen Registered Member

    Joined:
    Jul 15, 2011
    Posts:
    55
    Can you please answer in public?
    I have the same problem (over 400.000 files totaling 1.53 GB)
     
  6. javon7065

    javon7065 Registered Member

    Joined:
    Oct 26, 2012
    Posts:
    4
    Location:
    USA
    The tech ended up telling me do delete anything older than 6 months as most of these files were probably from an older version. We started out at version 3 and now are on 5 so it makes sense that there could be a ton of old files laying around.
     
  7. RobJanssen

    RobJanssen Registered Member

    Joined:
    Jul 15, 2011
    Posts:
    55
    Ok so there is no automatic cleanup of those files?
    (there is a list of maintenance intervals on the Server Maintenance tab, all set to 3 or 6 months in our server, but "threatsense data" is not amongst them)

    Did you only remove the files or also the empty directories?
     
  8. javon7065

    javon7065 Registered Member

    Joined:
    Oct 26, 2012
    Posts:
    4
    Location:
    USA
    right, I was first told to turn down the amount of logs kept via the server maintenance tab but after several days, I still had the same amount of files.

    I didn't delete anything yet. I need to find an accurate way of getting all files that are older than 6 months
     
  9. RobJanssen

    RobJanssen Registered Member

    Joined:
    Jul 15, 2011
    Posts:
    55
    Of course that is a challenge in Windows...
    In Linux: find /dirname -mtime +30 -exec rm {} \;
    (to remove all files in /dirname older than 30 days)
    I see that there exists a similar tool for Windows called FORFILES
    (with a similar intricate syntax)

    However, let's first await an answer from ESET about this, maybe there
    is some index that does not get updated when just removing files.

    In our case it caused problems with the daily backup, and I have circumvented
    those by excluding that directory from backup. However, something has
    to be done or in due time it will fill the C: partition.
     
  10. RobJanssen

    RobJanssen Registered Member

    Joined:
    Jul 15, 2011
    Posts:
    55
    Any chance of a reply on the forum, or do I have to go the painful way through the customer support ticket again?
     
  11. RobJanssen

    RobJanssen Registered Member

    Joined:
    Jul 15, 2011
    Posts:
    55
    I have already found the solution myself. Thanks for all the support! :mad:
     
  12. Marcos

    Marcos Eset Staff Account

    Joined:
    Nov 22, 2002
    Posts:
    14,374
    If you notice that the size of the storage\ThreatSense* folders grows too much, we'd need you to send us some files from there for examination. Basically files in these folders should be deleted automatically but there can be rare cases when the files work as a LiveGrid cache when they are not removed.
     
Thread Status:
Not open for further replies.