Are PG Protection Statistics Misleading?

Discussion in 'ProcessGuard' started by worldcitizen, Aug 31, 2005.

Thread Status:
Not open for further replies.
  1. SpikeyB

    SpikeyB Registered Member

    Joined:
    Mar 20, 2005
    Posts:
    479
    On my system, blocking a program from starting does not increase the number in my Protection Statistics. From the above, I would have expected your count to go up by 2 even though you had 4 more log entries.
     
  2. richrf

    richrf Registered Member

    Joined:
    Dec 11, 2003
    Posts:
    1,907
    Tests, such as the AV tests are probably the worse way to verify the ability of programs. These tests are based upon "already happened" events and all that is being verified is that an AV product can detect an event that already occurred. For most people this is "too late".

    Luckily, PG can be verified in a much more basic and predictable manner. PG's capabiliites, can be verified at an "architectural level" - that is, whether it indeed monitors the events that it is supposed to be monitoring, and whether it correctly "alerts" on all occurrences of these events. As far as can be determined at this point, PG is in fact doing this. Should someone come across a case that an event that PG is suppose to alert on occurs, and PG doesn't alert, then we can say that PG has a bug and is not doing its job. At this time, no such breach in PG has occurred. So we can say that PG is doing its job.

    Now, it is true, that there are people who do not want to be alerted whenever a critical program changes or a new program is introduced into the system, and for these people PG is probably inappropriate. But for those who do want to monitor all changes to critical programs or newly introduced programs, PG is extremely beneficial.

    I am like others on this forum. I have much more trust in programs that provide me with positive alerts on all important changes to my system, so that I can make the decision on whether to allow it to happen, than I trust programs where some other person in some software company (e.g. MS) is making this decision for me (via signatures).

    Yes, most definitely, DCS should change their counter from 'attacks" to "alerts" as RegDefend does.

    Rich
     
  3. jwcca

    jwcca Registered Member

    Joined:
    Dec 6, 2003
    Posts:
    772
    Location:
    Toronto
    Look at the logs.

    (unless the free version doesn't provide logs, in which case, buy PG, then look at the logs)

    Jim
     
  4. SpikeyB

    SpikeyB Registered Member

    Joined:
    Mar 20, 2005
    Posts:
    479
    I bought PG to replace my AV not to look at logs. Unfortunately my logs are not saved because I use Deep Freeze. Anyway, I had a look at todays log. What do you want me to do now?
     
  5. BlueZannetti

    BlueZannetti Registered Member

    Joined:
    Oct 19, 2003
    Posts:
    6,590
    I guess I don't see replacement of an AV with PG as a necessarily wise direction at this point in time, especially if you use DeepFreeze. Perhaps in the future, but not at the current state of development and product scope. Just my personal opinion...

    Blue
     
  6. jwcca

    jwcca Registered Member

    Joined:
    Dec 6, 2003
    Posts:
    772
    Location:
    Toronto
    Hi SpikeyB
    The logs show which 'things' have been blocked from doing something, supposedly they support the total on the Alerts page. But they don't, and you're absolutely right, I expected the count to go up by 2 (not 4, in the post above: there were 2 allows and 3 blocks), but it didn't, leaving me wondering why? Wondering what the count is a 'count of'.
    I did some more sleuthing and found that, for all the counts of different things blocked, I could not rationalize anything. What I mean is that (preferably) the sum of all alerts is equal to the Alert page count, but if not that, then at least some of the individual counts should add up to the Alerts count. They didn't, so to me the Alerts count is 'wrong' at this point. Or I don't know what's being counted. My figure of 154, which is now 156 with the 2 new ones, may represent counts from other months, for a smaller number of types of blocks. I just don't know. And the Help file doesn't help explain this.

    Now as to replacing your AV with PG, I wouldn't do that. Keep both. The AV will catch most, maybe all. PG is the insurance policy in case something gets by the AV or is introduced some other way, such as from a CD for a new application. Just recently there was some noise about Creative releasing a CD for their product that 'somehow got a baddie on it' and they're rushing to get a clean CD to their customers. So, keep the AV. And keep PG. And, look at the logs, you may see where you need to revise your configuration a bit.

    Enjoy, be happy, and most of all, be vigilant,

    Jim
     
  7. SpikeyB

    SpikeyB Registered Member

    Joined:
    Mar 20, 2005
    Posts:
    479
    Thanks Blue and JW Clements

    I've only replaced the real time component. I still have on-demand for downloads and e-mail attachments. The logic behind the decision is given in this thread: https://www.wilderssecurity.com/showthread.php?t=92487
     
    Last edited: Sep 3, 2005
  8. jwcca

    jwcca Registered Member

    Joined:
    Dec 6, 2003
    Posts:
    772
    Location:
    Toronto
    SpikeyB, I did get you PM, but thought that I'd publish my stats here.

    I imported my September PG log into excel, had to move some data around to make sense of it and then ran totals as follows:
    count = 2 blocked from accessing physical memory c:\appssoft\security\ssd\spybotsd.exe
    count = 15 blocked from running c:\program files\java\j2re1.4.2_06\bin\jusched.exe
    count = 2 blocked from running c:\winnt\hh.exe
    count = 1 blocked from running c:\winnt\system32\winhlp32.exe
    count = 124 blocked from running f:\appssoft\msoffice\office\1033\msohelp.exe
    count = 26 blocked from terminating c:\winnt\system32\cidaemon.exe by c:\winnt\system32\cisvc.exe
    count = 3 blocked from terminating c:\winnt\system32\spoolsv.exe by c:\winnt\system32\services.exe
    count = 8 Tried to modify an existing driver/service named vsdatant by c:\winnt\system32\winlogon.exe
    HKEY_LOCAL_MACHINE\SOFTWARE\Diamond Computer Systems\ProcessGuard v3.0 value name is AlertCount, and mine still says 154.

    the largest total is blocked from running = 142
    eliminate that total from the Alerts total of 154. (this is prior to the extra two)
    154 - 142 = 12 which is less than blocked from terminating (26 + 3 = 29)
    so the difference must come from any others, which are:
    2 + 8 = 10 which is not enough to cover the 12 required.

    As you can see, nothing adds up, like when someone says they have a $.47 and only have quarters and dimes and nickles. No pennies to make $.47.

    If there is some portion of the Alerts Count that applies to other month's logs, then it becomes more impossible to rationalize. DCS needs to explain.

    Hope this helps but I'm not sure it can, it hasn't helped me understand.

    Jim
     
  9. SpikeyB

    SpikeyB Registered Member

    Joined:
    Mar 20, 2005
    Posts:
    479
    I would count that as 39 (2+26+3+8 ) attacks because the "blocked from running" don't count as attacks.

    As far as I am aware, the Protection Statistics count from the day the program is installed, so it will be higher than for the September log alone.
     
  10. BlueZannetti

    BlueZannetti Registered Member

    Joined:
    Oct 19, 2003
    Posts:
    6,590
    SpikeyB,

    I guess I still wouldn't be completely comfortable, but if I was heading in the DF direction, I guess I'd try for the integrated solution with running AntiExecutable along side DF, but this is nominally off-topic in the current thread, which is focused on PG and its detection statistics.

    Maybe I'm a bit of a throwback, but I only appeal to logs if I sense an ongoing problem. For assessment of performance, I use a combination of any publicly available test (formal or informal), compatibility with my system, and infrequent personal challenge-response testing.

    Blue
     
  11. Peter2150

    Peter2150 Global Moderator

    Joined:
    Sep 20, 2003
    Posts:
    20,590
    First you absolutely right what I do isn't "important" only an example of an approach that frankly wouldn't work for many people. I recognize that. You are also quite right you can go the other way with scanners, and I have been that way. You are right you are fine, but I found for my machine setup that approach was much more of a burden on the computer then the current approach.

    But figuring out what works shouldn't be that hard. I install a new program or update one and PG alerts me. If I haven't given it permission to install global hooks, it challenges it. One of the dangers in IE is the use of hidden windows. Every time IE goes to open an extra window Safe'n'Sec alerts me to this potentially dangerous action among others. Any time an applet or active X item tries to run Online Armor alerts or blocks it. This is why I say it isn't hard to figure out that these programs are indeed working. And yes occasionally when I've wondered into questionable websites, they have indeed protected me.

    As to the fact I beta test for these products let me just explain the relationship, so there is no doubt. I've only gotten involved with products that I see as having a real value to me. Based on that I've purchased them. I have paid licenses for all of them and then because they have value to me I have chose to involve myself with improving them via beta testing. So no I don't run them because of testing, but test them because I run and value them.

    Pete
     
  12. Peter2150

    Peter2150 Global Moderator

    Joined:
    Sep 20, 2003
    Posts:
    20,590
    Comparing the logs and the "attack" count needs to be done with a bit of care. I never bother resetting the counter, but with the logs, I delete them regularily. If you are going to compare, you need to besure of what you are counting in that respect.
     
  13. poll2

    poll2 Guest

    Don't get me wrong. I'm not saying you support these products because they are paying you, or that you get then free. I'm talking about emotional reasons. You are clearly proud of being a "official beta tester".
     
  14. Peter2150

    Peter2150 Global Moderator

    Joined:
    Sep 20, 2003
    Posts:
    20,590
    Dave

    Frankly I am bit puzzled by this. Dropping the semantics of terminology, let me ask by example. I use Microsoft Office and Outlook. Outlook.exe is obviously a key program. When I do an office update and see a new version of Outlook.exe wanting permission, of course this isn't an attack. But suppose I visit miss frilly jane's website, and a little while later PG pops and says a Outlook.exe has change do you want to allow it run. Clearly I would call this an attack, but what is the malware. I don't know, but I do know (hopefully)I've got a big problem, that isn't going away. The need to know it depends on how you can respond. If you have to scan and clean you then probably will learn the malware and see if you can clean it. Might have to reinstall Office. In my case I would restore with First Defense. Just depends on the situation.

    Conversly every now and them KAV(or other AV's) flag a file as containing xyz malware. First I never let the AV delete anything. I will note what it is and watch my system closely, and then after the AV updates, check again. So far in each case the AV Fp has gone away.

    Are both programs doing their job. I would say yes. Does knowing what the malware help. Obviously once infected clearly the answer to that is yes. But if the infection is blocked as in the first example, why does it really matter.
     
  15. Peter2150

    Peter2150 Global Moderator

    Joined:
    Sep 20, 2003
    Posts:
    20,590
    Okay I'll plead guilty to that, and why not. I enjoy helping make good stuff better.

    Not to stray to far off topic, but let just say there is both a big upside and downside to this beta testing thing.

    One of the products is planning a release of some new and neat features. I chose not to reveal which at this point.

    Downside: First beta of the new version was crash city on my machine. A pain.

    Upside: Second beta is running slick and I have the new protection features now.

    If you enjoy beta testing and can, you should give it a try. Just be aware going in of some of the difficulties.

    Anyone curious PM me as this really is sort of off topic
     
  16. poll2

    poll2 Guest

    No problem, but IMHO it also makes the opinions of "betatesters" a little suspect. They can't really help it.

    Espically those who are closely associated with the companies working in closed betas.



    Not curious, I've done it quite a bit myself, that is why I can understand how it feels. People give me copies of software and request that I write a review for example.
     
  17. dboley

    dboley Registered Member

    Joined:
    Aug 21, 2005
    Posts:
    10
    I fail to see the reason for expending time discussing one counter that clearly counts good and bad. This is silly. If it was not there, how many of you would have demanded it. This is one reason many producers of programs do show extensive information that only 10% of their customers have any interest in.

    Maybe the author can simply delete it for the short term and efforts can move on to something useful. Things such as what can sneak past Process Guard? How can Process Guard become more user friendly? How can more meaningful statistics that are less "raw" be produced?

    This counter thing is trivial at best. The producer of the software needs to widen the market for the program. There is a need to improve the user interface to allow it to be more intuitive to use Process Guard. If the market is not extended support will go away as the team seeks more fertile avenues. It is in your self-interest to make Process Guard better. To rant over a counter that is totally a non-functional element, is _______________________.

    Dick
     
  18. jwcca

    jwcca Registered Member

    Joined:
    Dec 6, 2003
    Posts:
    772
    Location:
    Toronto
    Quite right, but not friendly, I think. Ignore threads that bother you this much. Personally, I learned to ignore the counts long ago. But someone had a concern. and in this forum, people listen and try to help. Your concern for 'improvements' in PG is shared by many, others are quite happy with it as it is. They don't challenge you to stop expressing your ideas and you've hardly contributed anything new.

    Jim
     
  19. dboley

    dboley Registered Member

    Joined:
    Aug 21, 2005
    Posts:
    10
    Jim,
    I heartily apologize for offending you in any way. You are obviously an individual that is sensitive to the content of messages that may, in any way, contain offensive or challenging view points. I assume that you are the manager of the forum or at least a senior and respected member that has assumed the role of filtering out undesirable messages. Perhaps the forum can make a formal appointment of you to act as a filter to prevent further breaches of etiquette. Or perhaps you could head a lobby for a task force that is empowered to censor insensitive posts, such as mine, before they assail the eyes of others.

    I shall refrain from further postings until such safeguards are in place..

    In closing, I only hope that Process Guard is improved in a manner that attracts a larger market so that it will be continued as a supported product. Yes, the counter is broken and so is the logic that discusses it.

    Regards from,
    A paying customer that is offensive
     
  20. jwcca

    jwcca Registered Member

    Joined:
    Dec 6, 2003
    Posts:
    772
    Location:
    Toronto
    Your last post was very friendly and appreciated, so I hope you do paticipate. It was the word "silly" that was a bit out of place.
    Good constructive comment and suggestions and helping by sharing knowledge and experience are realy quite rewarding. There are a lot of folks with much less knowledge and that can sometimes be very worrying to them. When one thing doesn't look right, then they may think that there's more that's not right.
    But, undaunted, I will clear my logs and I will clear my registry counter, just to learn a bit more, just in case I do want to watch the 'counts' someday.

    Keep near,

    Jim
     
  21. Bubba

    Bubba Updates Team

    Joined:
    Apr 15, 2002
    Posts:
    11,271
    I would hope no one except a select few would carry that opinion. IMHO....those that feel the opinions of "betatesters" are suspect just because they are Betatesters would more than likely question that the Sun rises in the East :eek: Heck....we are all Betatesters in one form or another which means all opinons would be suspect :doubt:
     
  22. WSFuser

    WSFuser Registered Member

    Joined:
    Oct 7, 2004
    Posts:
    10,639
    i guess partial would have been a better word than suspect.
     
  23. richrf

    richrf Registered Member

    Joined:
    Dec 11, 2003
    Posts:
    1,907
    Everyone, I feel, has their biases, partialities, perspectivies, leanings, etc., and I recognize. No problem, as far as I am concern. However, I have chosen to completely ignore "anonymous" opinions. For me, this is really "suspect". Could be a developer of a competing product. A programmer/consultant with definite economic interests. Someone who just likes causing trouble. Whatever. Anonymous to me equates to ignore.

    Rich
     
  24. Notok

    Notok Registered Member

    Joined:
    May 28, 2004
    Posts:
    2,969
    Location:
    Portland, OR (USA)
    Everyone champions their favorite software, whether they have a rapport with the developers or not. As long as people can keep it in perspective, and realize that their favorite isn't necessarily the best for everyone, I see no problem with it.. these forums are all about opinions, after all, and everyone is entitled to theirs.

    I tend to agree.. not entirely, but for the most part.

    As for the attack stats.. I tend to think that anyone really using PG will understand what it's about, although it certainly wouldn't hurt to add in the word "potential".
     
  25. Peter2150

    Peter2150 Global Moderator

    Joined:
    Sep 20, 2003
    Posts:
    20,590
    Hi Poll2

    I can't change your mind if it's made up, but consider this before you consider my(or any beta tester) opinion. If you read some of my other posts you would see I was also running the Prevx1 beta(this is a public beta) but dropped it, because as I stated it was annoying me. Again I have the license, and I did work with them. Just didn't like the direction.

    Also If I told you support from these companies was excellent you would probably also consider this to be suspicious, but all threads on Wilders would lead to one reach the same conclusion. (I'll bet someones going to jump here because of TDS, but if you look at whole record....)


    To round out my participation in this thread: I started beta testing on PG 1.3, cause it had problems on my machine. A whole crew of testers beat on PG testing thru many many versions on the way to 3.15 as it currently stands. A lot of people trying to break it. The counter was added at the very end almost as window dressing. I can understand Bubba being suspicious of the motive, because frankly the whole thing is almost silly.

    Cheers one and all,

    Pete
     
Thread Status:
Not open for further replies.
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.