Friday, June 29, 2007

Antivirus Comparison Report (Jun 28, 2007)

Updated: July 5, 2007

In this report, the terminology, malware, includes virus, trojan, worm, backdoor, spyware, adware, dialer, keylogger, hack tool and so on. The samples we use are collected daily from Honeypot, the total malware count is 267,287, total file size is about 34,156 MB.

The following table shows detection rate and scan performance for antivirus software:




For detailed information, please refer to PDF file.

If you want to verify our test result, we provide the following data, please feel free to contact us:

  • All malware files’ SHA1 value.
  • All antivirus scan logs.
Note: This report is for reference only. Nowadays antivirus softwares have provided total protection for malware, but antivirus test organizations still use old test methodologies to evaluate them, they cannot reflect antivirus softwares' capabilities, so we will use other test methodologies to evaluate antivirus softwares in the future.

Saturday, May 5, 2007

Antivirus Comparison Report (Feb 26, 2007)

Update: "New" to be added on March 2, 2007

Antivirus Detection Rate:

  • AVIRA Premium Security Suite 7.0: 95.09% New
  • Fortinet FortiClient Host Security 3.0: 94.70%
  • BitDefender Internet Security v10: 92.36%
  • AOL Active Virus Shield (Free): 89.02%
  • AVIRA AntiVir PersonalEdition Classic 7.0 (Free): 88.44%
  • GRISOFT AVG Internet Security 7.5: 88.37%
  • Norman Virus Control Plus 5.82: 86.64% New
  • BitDefender 8 Free Edition (Free): 86.52%
  • Rising Antivirus 2007: 84.78%
  • Kaspersky Internet Security 6.0: 84.77%
  • Panda Internet Security 2007: 79.16%
  • MicroWorld eScan Internet Security 8.0: 77.68%
  • ClamWin Free Antivirus 0.90 (Free): 76.57%
  • Sunbelt CounterSpy V2: 76.39%
  • ALWIL avast Professional 4.7: 73.41%
  • F-Prot Antivirus 3.16f: 72.75%
  • Filseclab Twister Anti-TrojanVirus V7: 62.66%
  • Trend Micro Internet Security 2007: 60.53%
  • CA Internet Security 2007: 58.61%
  • AhnLab V3 Internet Security 2007 Platinum: 56.44%
  • Kingsoft Internet Security 2007: 55.55%
  • ESET NOD32 2.7: 49.17%
  • Jiangmin Antivirus KV 2007: 45.16%
  • Webroot Spy Sweeper with Antivirus: 40.71%
  • CAT Quick Heal Total Security 2006: 37.29%
  • Hauri Virobot Desktop 5.0: 34.38%
  • Microsoft Windows Live OneCare 1.5: 12.68% New
  • Comodo Antivirus 1.1 (Free): 9.92%
For detailed information, please refer to PDF file.

Note:
  • some antivirus softwares are not listed above because they causes some problems, so that we cannot continue to test them, please refer to detailed information.
  • Because three antivirus softwares are added into this report, so that the ranking produces the changes, but in original report, Fortinet FortiClient is ranked No. 1. In the future, we will use Ghost software to make sure update schedule is at the same day.

Antivirus Comparison Report (Dec 11, 2006)

Antivirus Detection Rate:

  • Fortinet FortiClient Host Security 3.0: 94.33%
  • GRISOFT AVG Internet Security 7.5: 92.75%
  • Dr.Web Antivirus 4.33: 87.44%
  • AVIRA AntiVir ProfessionalEdition 7.0: 87.01%
  • Kaspersky Internet Security 6.0: 83.45%
  • Rising Antivirus 2006: 82.40%
  • ALWIL avast Professional 4.7: 79.16%
  • MicroWorld eScan Internet Security 8.0: 76.31%
  • Panda Internet Security 2007: 72.45%
  • McAfee Internet Security 2007: 71.55%
  • Microsoft Windows Live OneCare: 70.41%
  • Symantec Internet Security 2007: 69.96%
  • F-Secure Internet Security 2007: 57.89%
  • CA Internet Security 2007: 55.74%
  • AhnLab V3 Internet Security 2007: 53.78%
  • Trend Micro Internet Security 2007: 53.71%
  • ESET NOD32 2.5: 49.51%
  • Kingsoft Internet Security 2007: 47.21%
For detailed information, please refer to PDF file.

Note that some antivirus softwares are not listed above because they causes some problems, so that we cannot continue to test them, please refer to detailed information.

Antispyware Comparison Report (January 3, 2007)

Antispyware Detection Rate:

  • BitDefender Internet Security v10: 94.85%
  • ESET NOD32 2.7: 89.12%
  • Kaspersky Internet Security 6.0: 88.86%
  • Grisoft AVG Anti-Spyware 7.5 (ewido anti-spyware 4.0): 88.50%
  • Alwil avast! 4.7 Home Edition (free): 84.47%
  • Norman Virus Control 5.82: 79.41%
  • Rising Antivirus 2006: 69.11%
  • F-Secure Internet Security 2007: 68.20%
  • Sunbelt CounterSpy 1.5: 67.51%
  • Panda Internet Security 2007: 65.79%
  • Spyware Terminator 1.5 (with WinClamAV 1.1): 65.57%
  • AVIRA AntiVir PersonalEdition Classic 7.0 (free): 57.57%
  • Trend Micro PC-cillin Internet Security 2007: 49.18%
  • EMSISoftware a-square free 2.1 (free): 40.61%
  • McAfee Internet Security 2007: 38.35%
  • Microsoft Windows Defender 1.1 (free): 33.88%
  • ZoneAlarm Security Suite 6.5: 32.12%
  • PC Tools Spyware Doctor 4.0: 31.70%
  • Trend Micro Anti-Spyware 3.5: 28.30%
  • SUPERAntiSpyware 3.4: 23.75%
  • AhnLab SpyZero 2007: 23.45%
  • Comodo AntiVirus 1.1 (free): 17.57%
  • Webroot Spy Sweeper 5.2: 16.51%
  • Symantec Norton Internet Security 2007: 13.33%
  • Lavasoft Ad-Aware SE Personal (free): 12.42%
  • CA Internet Security 2007 (antispyware part only): 9.92%
  • CyberDefender AntiSpyware 2006: 3.08%
  • Outpost Firewall Pro 4.0: 0.93%
  • Tenebril SpyCatcher Express 4.0 (free): 0.52%
  • TrojanHunter 4.6: 0.00%
For detailed information, please refer to PDF file.

Note that spyware samples in this round is collected from Honeynet.

12th-round Antispyware Comparison Report (November 21, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • PC Tools Spyware Doctor: 49.64%
  • F-Secure Internet Security: 44.53%
  • Norton Internet Security: 40.88%
  • Ahnlab SpyZero: 40.88%
  • SUPERAntispyware: 40.15%
  • Microsoft Windows Defender: 39.42%
  • Trend Micro Anti-Spyware: 37.96%
  • Agnitum Outpost Firewall Pro: 33.58%
  • ZoneAlarm Anti-spyware: 31.39%
  • Computer Associate Anti-Spyware: 30.66%
  • McAfee antispyware: 29.20%
  • Webroot Spy Sweeper: 27.01%
  • ewido anti-spyware: 25.55%
  • Lavasoft Ad-Aware: 21.17%
  • Kaspersky Internet Security: 18.25%
  • ZeroSpyware: 15.33%
  • SpywareTerminator: 14.60%
  • BitDefender Internet Security: 13.87%
  • FaceTime X-Cleaner: 13.87%
  • Spybot S&D: 13.14%
  • Rising Antivirus: 7.30%
  • Panda Platinum Internet Security: 6.57%
  • NOD32: 6.57%
  • CyberDefender: 6.57%
  • TrojanHunter: 5.11%
  • Comodo AntiVirus: 5.11%
  • Aluria Anti-Spyware: 2.19%
For detailed information, please refer to PDF file.

Note that spyware samples in this round is collected from Honeynet.

11th-round Antispyware Comparison Report (September 26, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • Sunbelt CounterSpy: 35.71%
  • Norton Internet Security: 33.33%
  • PC Tools Spyware Doctor: 31.75%
  • ZeroSpyware: 30.16%
  • McAfee antispyware: 28.57%
  • Computer Associate Anti-Spyware: 28.57%
  • Webroot Spy Sweeper: 27.78%
  • ewido anti-spyware: 27.78%
  • Ahnlab SpyZero: 26.98%
  • Spybot S&D: 25.40%
  • Kaspersky Internet Security: 24.60%
  • SUPERAntispyware: 24.60%
  • F-Secure Internet Security: 22.22%
  • Panda Platinum Internet Security: 21.43%
  • TrojanHunter: 21.43%
  • Trend Micro Anti-Spyware: 20.63%
  • FaceTime X-Cleaner: 20.63%
  • ZoneAlarm Anti-spyware: 16.67%
  • BitDefender Internet Security: 15.87%
  • Microsoft Windows Defender: 15.87%
  • Lavasoft Ad-Aware: 15.87%
  • a-squared Anti-Malware: 15.87%
  • Agnitum Outpost Firewall Pro: 15.08%
  • Rising Antivirus: 15.08%
  • SpywareTerminator: 15.08%
  • NOD32: 11.90%
  • Ashampoo AntiSpyWare: 11.11%
  • Arovax AntiSpyware: 10.32%
  • Aluria Anti-Spyware: 7.94%
  • Comodo AntiVirus: 5.56%
For detailed information, please refer to PDF file.

Note that spyware samples in this round is collected from Honeynet.

10th-round Antispyware Comparison Report (August 26, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • Trend Micro Anti-Spyware: 71.17%
  • Sunbelt CounterSpy: 68.47%
  • Webroot Spy Sweeper: 65.77%
  • ewido anti-spyware: 62.16%
  • McAfee antispyware: 62.16%
  • PC Tools Spyware Doctor: 59.46%
  • Norton Internet Security: 54.05%
  • Computer Associate Anti-Spyware: 49.55%
  • BitDefender Internet Security: 48.65%
  • Microsoft Windows Defender: 44.14%
  • F-Secure Internet Security: 44.14%
  • a-squared Anti-Malware: 43.24%
  • SpywareTerminator: 41.44%
  • ZeroSpyware: 41.44%
  • Lavasoft Ad-Aware: 39.64%
  • Panda Platinum Internet Security: 38.74%
  • ZoneAlarm Anti-spyware: 38.74%
  • Spybot S&D: 38.74%
  • SUPERAntispyware: 36.94%
  • Arovax AntiSpyware: 35.14%
  • Ashampoo AntiSpyWare: 33.33%
  • Kaspersky Internet Security: 32.43%
  • NOD32: 30.63%
  • Agnitum Outpost Firewall Pro: 22.52%
  • Comodo AntiVirus: 18.02%
  • Aluria Anti-Spyware: 9.00%
For detailed information, please refer to PDF file.

9th-round Antispyware Comparison Report (August 7, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • Trend Micro Anti-Spyware: 74.02%
  • Webroot Spy Sweeper: 58.27%
  • McAfee antispyware: 56.69%
  • Sunbelt CounterSpy: 53.54%
  • PC Tools Spyware Doctor: 50.39%
  • Lavasoft Ad-Aware: 48.82%
  • F-Secure Internet Security: 46.47%
  • ZoneAlarm Anti-spyware: 43.31%
  • Panda Platinum Internet Security: 40.16%
  • Norton Internet Security: 38.58%
  • Microsoft Windows Defender: 38.58%
  • ewido anti-malware: 37.80%
  • Agnitum Outpost Firewall Pro: 35.43%
  • SUPERAntispyware: 35.43%
  • Kaspersky Internet Security: 25.98%
  • Aluria Anti-Spyware: 25.20%
  • Computer Associate Anti-Spyware: 22.83%
  • NOD32: 17.32%
  • Spybot S&D: 11.81%
For detailed information, please refer to PDF file.

8th-round Antispyware Comparison Report (July 18, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • Trend Micro Anti-Spyware: 79.62%
  • Webroot Spy Sweeper: 61.15%
  • PC Tools Spyware Doctor: 57.96%
  • Sunbelt CounterSpy: 55.41%
  • Norton Internet Security: 52.23%
  • McAfee antispyware: 45.86%
  • Computer Associate Anti-Spyware: 41.40%
  • Panda Platinum Internet Security: 28.66%
  • ewido anti-malware: 28.66%
  • Microsoft Windows Defender: 24.84%
  • Lavasoft Ad-Aware: 14.65%
  • Spybot S&D: 12.74%
  • Aluria Anti-Spyware: 2.50%
For detailed information, please refer to PDF file.

7th-round Antispyware Comparison Report (June 24, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • Trend Micro Anti-Spyware: 78.15%
  • Sunbelt CounterSpy: 55.19%
  • Webroot Spy Sweeper: 54.07%
  • Norton Internet Security: 53.70%
  • McAfee antispyware: 50.00%
  • PC Tools Spyware Doctor: 43.33%
  • Computer Associate Anti-Spyware: 37.41%
  • ewido anti-malware: 34.81%
  • Lavasoft Ad-Aware: 32.96%
  • Spybot S&D: 28.52%
  • Microsoft Windows Defender: 22.59%
  • Panda Platinum Internet Security: 10.00%
  • Aluria Anti-Spyware: 4.40%
For detailed information, please refer to PDF file.

Note that we will remove process-based viewpoint from this round on because it cannot reflect real situation.

6th-round Antispyware Comparison Report (June 1, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • Sunbelt CounterSpy: 46.10%
  • Trend Micro Anti-Spyware: 29.55%
  • Webroot Spy Sweeper: 28.25%
  • McAfee antispyware: 28.25%
  • PC Tools Spyware Doctor: 26.30%
  • Microsoft AntiSpyware: 23.38%
  • Computer Associate Anti-Spyware: 21.10%
  • Microsoft Windows Defender: 20.78%
  • Norton Internet Security: 20.13%
  • Lavasoft Ad-Aware: 18.51%
  • Panda Platinum Internet Security: 14.61%
  • ewido anti-malware: 14.29%
  • Spybot S&D: 10.39%
  • Aluria Anti-Spyware: 5.84%
Cleanup Success Rate for Process-based Viewpoint:
  • Webroot Spy Sweeper: 46.43%
  • PC Tools Spyware Doctor: 42.86%
  • Trend Micro Anti-Spyware: 42.86%
  • Sunbelt CounterSpy: 39.29%
  • Microsoft AntiSpyware: 39.29%
  • Computer Associate Anti-Spyware: 39.29%
  • McAfee antispyware: 32.14%
  • ewido anti-malware: 32.14%
  • Microsoft Windows Defender: 28.57%
  • Panda Platinum Internet Security: 28.57%
  • Lavasoft Ad-Aware: 28.57%
  • Norton Internet Security: 25.00%
  • Spybot S&D: 25.00%
  • Aluria Anti-Spyware: 17.86%
For detailed information, please refer to PDF file.

5th-round Antispyware Comparison Report (May 3, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • Webroot Spy Sweeper: 50.49%
  • Trend Micro Anti-Spyware: 50.16%
  • Microsoft AntiSpyware: 35.60%
  • PC Tools Spyware Doctor: 34.30%
  • Computer Associate Anti-Spyware: 31.39%
  • McAfee antispyware: 30.10%
  • Microsoft Windows Defender: 27.83%
  • Lavasoft Ad-Aware: 24.60%
  • Sunbelt CounterSpy: 22.65%
  • Spybot S&D: 10.36%
  • Aluria Anti-Spyware: 8.09%
Cleanup Success Rate for Process-based Viewpoint:
  • Trend Micro Anti-Spyware: 70.97%
  • McAfee antispyware: 64.52%
  • PC Tools Spyware Doctor: 64.52%
  • Sunbelt CounterSpy: 64.52%
  • Webroot Spy Sweeper: 61.29%
  • Microsoft AntiSpyware: 61.29%
  • Microsoft Windows Defender: 58.06%
  • Lavasoft Ad-Aware: 54.84%
  • Computer Associate Anti-Spyware: 51.61%
  • Aluria Anti-Spyware: 41.94%
  • Spybot S&D: 38.71%
For detailed information, please refer to PDF file.

4th-round Antispyware Comparison Report (April 3, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • PC Tools Spyware Doctor: 10.23%
  • Lavasoft Ad-Aware: 10.23%
  • Sunbelt CounterSpy: 9.09%
  • Computer Associate Anti-Spyware: 7.95%
  • McAfee antispyware: 3.98%
  • Aluria Anti-Spyware: 3.41%
  • Trend Micro Anti-Spyware: 2.84%
  • Microsoft AntiSpyware: 0.00%
  • Spybot S&D: 0.00%
  • Webroot Spy Sweeper: 0.00%
  • Microsoft Windows Defender: 0.00%
Cleanup Success Rate for Process-based Viewpoint:
  • Lavasoft Ad-Aware: 13.79%
  • PC Tools Spyware Doctor: 10.34%
  • Computer Associate Anti-Spyware: 10.34%
  • Sunbelt CounterSpy: 10.34%
  • McAfee antispyware: 6.90%
  • Aluria Anti-Spyware: 3.45%
  • Trend Micro Anti-Spyware: 3.45%
  • Microsoft AntiSpyware: 0.00%
  • Spybot S&D: 0.00%
  • Webroot Spy Sweeper: 0.00%
  • Microsoft Windows Defender: 0.00%
For detailed information, please refer to PDF file.

3rd-round Antispyware Comparison Report (March 26, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • Webroot Spy Sweeper: 9.88%
  • Computer Associate Anti-Spyware: 8.40%
  • Trend Micro Anti-Spyware: 8.07%
  • Sunbelt CounterSpy: 6.43%
  • PC Tools Spyware Doctor: 5.60%
  • Lavasoft Ad-Aware: 5.44%
  • McAfee antispyware: 2.14%
  • Spybot S&D: 2.14%
  • Microsoft AntiSpyware: 1.98%
  • Aluria Anti-Spyware: 1.65%
  • Microsoft Windows Defender: 0.00%
Cleanup Success Rate for Process-based Viewpoint:
  • Computer Associate Anti-Spyware: 21.74%
  • Webroot Spy Sweeper: 14.39%
  • Lavasoft Ad-Aware: 13.04%
  • Sunbelt CounterSpy: 13.04%
  • PC Tools Spyware Doctor: 8.70%
  • McAfee antispyware: 4.35%
  • Microsoft AntiSpyware: 4.35%
  • Trend Micro Anti-Spyware: 4.35%
  • Spybot S&D: 4.35%
  • Aluria Anti-Spyware: 0.00%
  • Microsoft Windows Defender: 0.00%
For detailed information, please refer to PDF file.

2nd-round Antispyware Comparison Report (Feb 22, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • Webroot Spy Sweeper: 76.29%
  • PC Tools Spyware Doctor: 75.35%
  • Trend Micro Anti-Spyware: 69.95%
  • Sunbelt CounterSpy: 66.67%
  • Computer Associate Anti-Spyware: 66.43%
  • Spybot S&D: 60.09%
  • McAfee antispyware: 57.98%
  • Microsoft AntiSpyware: 56.10%
  • Aluria Anti-Spyware: 55.16%
  • Lavasoft Ad-Aware: 48.12%
Cleanup Success Rate for Process-based Viewpoint:
  • Webroot Spy Sweeper: 76.47%
  • PC Tools Spyware Doctor: 76.47%
  • Trend Micro Anti-Spyware: 70.59%
  • Computer Associate Anti-Spyware: 70.59%
  • Sunbelt CounterSpy: 70.59%
  • McAfee antispyware: 58.82%
  • Microsoft AntiSpyware: 52.94%
  • Spybot S&D: 52.94%
  • Lavasoft Ad-Aware: 47.06%
  • Aluria Anti-Spyware: 41.18%
For detailed information, please refer to PDF file.

1st-round Antispyware Comparison Report (Feb 22, 2006)

Cleanup Success Rate for Entry-based Viewpoint:

  • Trend Micro Anti-Spyware: 78.96%
  • PC Tools Spyware Doctor: 70.79%
  • McAfee antispyware: 62.62%
  • Microsoft AntiSpyware: 53.71%
  • Lavasoft Ad-Aware: 52.72%
  • Aluria Anti-Spyware: 36.14%
Cleanup Success Rate for Process-based Viewpoint:
  • PC Tools Spyware Doctor: 76%
  • Trend Micro Anti-Spyware: 72%
  • McAfee antispyware: 72%
  • Lavasoft Ad-Aware: 52%
  • Microsoft AntiSpyware: 52%
  • Aluria Anti-Spyware: 12%
For detailed information, please refer to PDF file.

Thursday, May 3, 2007

Home

Any online systems are insecure even if they have installed information security softwares. If you know your information security softwares or your enemies, your systems will be more secure. Remember that prevention is better than cure.

Contact

If you have any questions about this web site, please don't hesitate to contact us by email.

E-mail: service@malware-test.com

About

Malware-Test Lab is an independent, accurate, sharing organization of information security software testing. We will not be controlled by any vendors, we provide accurate test reports of information security softwares and we love to share our knowledge and experiences.

Due to some comparison reports just provide some information to end users and tend to mislead end users, so we decide to share our experiences on testing information security softwares to everyone, hope everyone can understand how to test information security software more than before.

About us, we love to test information security softwares, analyze malicious code and share our experiences.

Founder: Roger Chiu
Scan Engine Department of Trend Micro Incorporated from June 1999 to June 2006, etc.

He takes charge of the following:
* Malware scan & cleanup engine
* Spyware scan & cleanup engine
* Rootkit scan & cleanup engine
* Vulnerability assessment engine
* Bootable rescue system
* Maintaining some products and antivirus scan engine etc.

He is familiar with the following skills:
* Project management
* People management
* Software development processes including development, quality assurance, maintenance, service etc.
* Software testing
* Malware and spyware analysis
* Knowledge of network and security.
* UNIX, Linux, Windows 9x/Me/NT4/2000/XP/2003 etc.

Location: Taipei, Taiwan

Links

Service

Malware-Test Lab accepts the assignment of individual vendors to test detection and cleanup rate (or others) of AntiVirus, AntiSpyware, AntiSpam, AntiPhishing softwares, and so on. If you are interested in this service, please contact us by email. Thanks.

E-mail: service@malware-test.com

Reports

Mission

  • Ensure the quality of information security softwares.
  • Publish accurate test reports.
  • Let you know test secrets.

Sunday, April 1, 2007

Test Schedule

Antivirus Test Schedule

  • June 20, 2008 (Platform: Winodws XP or Windows Vista SP1, Product: Antivirus Software for consumer/end user)
Antispyware Test Schedule (due to we will merge antispyware test into antivirus test, so this test will be suspend temporarily)