Windows Secrets

Subscribers: Sign in

Enter your e-mail address to get a free subscription.
We guarantee your privacy
Skip to content
  • Home
  • Newsletter Archives
    • Current
    • LangaList Plus
    • Patch Watch
    • Wacky Web Week
    • Security Baseline
  • E-Books
  • Lounge
  • About us
    • Refunds
    • Privacy Policy
    • Advertise
  • Contact
  • Your Account
    • Upgrade
    • Preferences
    • Bonus Download
    • Unsubscribe
Home>Windows Secrets>How reliable are antivirus lab tests?

How reliable are antivirus lab tests?

Tweet

Mark edwards By Mark Joseph Edwards

Several different labs conduct tests that pit antivirus solutions against various sets of malware circulating in the wilds of the Internet.

Now questions are being raised about the effectiveness of the tests in representing real-world PC threats and how accurately they reflect an antivirus program’s ability to prevent infections.


Antivirus testing procedures come under fire

In my May 1 column, I described the five antivirus programs that aced Virus Bulletin’s PC defense tests. Virus Bulletin is probably the biggest name in the field of such testing; the service’s results are highly credible.

Antivirus tests are useful as long as you know the basis of the tests and what it takes to achieve a given score. To conduct its tests, Virus Bulletin uses a set of malware selected from what is called the WildList, which is essentially a set of malware known to be circulating in the wilds of the Internet.

For years, the WildList has been the de facto standard for measuring the effectiveness of antivirus tools. The list dates back to the mid-1990s and is currently maintained by ICSA Labs, which is owned by Cybertrust. Cybertrust was bought by Verizon about a year ago.

Various antivirus labs use the WildList as part of their testing of an antivirus product’s ability to detect and remove malware. In 2007, some antivirus makers began to complain that the WildList was no longer sufficient for antivirus tests. Several companies suggest that a more complete set of tests should be run to examine a security suite’s entire arsenal of protection.

This article is part of our paid content. Subscribe.

Already a paid subscriber? Click here to login.

Related posts:

  1. How reliable are PC security products?
  2. Five antivirus programs ace the PC-defense test
  3. Questions arise on PC World tests
  4. Even antivirus software can’t be 100% secure
  5. New Firewall Leak Tests
= Paid content

All Windows Secrets articles posted on 2008-06-12:

  • Introduction Get our free search add-ins for Firefox and IE 7
  • Top Story Free add-ons teach Windows Explorer new tricks
  • Wacky Web Week ‘Hi, I’m popping corn — can I call you back?’
  • Best Software Two top defraggers speed your disk accesses
  • Windows Secrets How reliable are antivirus lab tests?
  • Patch Watch Windows XP Service Pack 3 gets official fixes
  •  Show all articles on a single page
E-books

We’ve pored through years of back issues, picking the best tips, to create these ebooks:

E-book series
  • PC Maintenance Guide
  • PC Security Guide
  • Windows 7 Guide Vol 1
  • Windows 7 Guide Vol 2
  • Win XP Survival Guide
See the e-book series
Top-scoring articles in the past 12 months
  • Leaving long cookie trails throughout the Web 5.00
  • Windows-like security for Android devices 5.00
  • Win7′s no-reformat, nondestructive reinstall 4.53
  • The sorry tale of the (un)Secure Sockets Layer 4.42
  • RPV: Win7′s least-known data-protection system 4.33
  • Recovery: the last step in total data security 4.30
  • Time for a .NET update we can’t ignore 4.30
  • Getting the most from Windows Search — Part 1 4.25
  • Revising printing habits saves money and trees 4.25
  • Upgrades end in erratic, partial hangs 4.25
  • Pros and cons of a ‘keyfile’ password 4.21
  • Beating back Duku and a plethora of other threats 4.20
  • Office 2007 gets its final service pack 4.19
  • Putting Registry-/system-cleanup apps to the test 4.19
  • One year and 99 security bulletins later 4.18
  • 1.8TB external drive goes down hard 4.17
  • Don’t pay for software you don’t need — Part 3 4.16
  • Internet Explorer gets another round of patches 4.15
  • Is your free AV tool a ‘resource pig?’ 4.15
  • Vacation’s over; it’s a big round of patches 4.15
  • Remote access leads to remote attacks 4.15
  • Keeping you up to date: say no to .NET — again 4.14
  • Take control of Google’s privacy policy settings 4.14
  • Office File Validation patch leads to problems 4.14
  • The advanced system-recover toolkit 4.13
  • New “419″ scam involves PayPal and Western Union 4.12
  • Readers’ best personal-privacy tips 4.11
  • Getting the most from Windows Search — Part 2 4.11
  • Re-examining Dropbox and its alternatives 4.10
  • Easily edit Windows’ right-click context menus 4.09
Connect with us Follow us on Twitter Connect with us on Facebook View our RSS Feeds
  • Home|
  • Newsletter|
  • About Windows Secrets|
  • Advertise with us|
  • Unsubscribe|
  • Sitemap|
  • Affiliates|
Trademarks: Microsoft and Windows are registered trademarks of Microsoft Corporation. The Windows Secrets series of books is published by Wiley Publishing Inc. The Windows Secrets Newsletter, WindowsSecrets.com, WinFind, Windows Gizmos, Security Baseline, Patch Watch, Perimeter Scan, Wacky Web Week, the Logo Design (W, S or road, and Star), and the slogan Everything Microsoft Forgot to Mention all are trademarks and service marks of iNET Interactive. All other marks are the trademarks or service marks of their respective owners.
iNET Interactive Copyright © 2011 iNET Interactive.
All rights reserved.
Terms of Use  |  Privacy Policy
Internet Services
  • Web Hosting Talk
  • HostingCon
  • Hosting Catalog
  • Host Voice
Web Development
  • Hot Scripts
  • DB Forums
Digital Marketing
  • ABestWeb
  • Search Marketing Standard
  • PayPerClickUniverse
  • SEMCompare
Consumer Tech
  • Windows Secrets
  • Overclockers
  • Mac Forums

Learn more about
advertising opportunities across the iNET Interactive Network.

LiquidWeb