Always. But even a System Restore point would have restored the registry to a point before it was installed. It does not always remove all of the files but they're not terribly hard to find and with no registry entries they shouldn't be loaded so finding any leftovers and deleting them isn't as terrible as not having the option.
