PCSL Greater China Region False Positive Testdownload.zillya.com/2010_JAN_Greater_China_Region... · static False Positive Test PCSL scans our extensive base of clean files with each

PCSL Greater China Region False Positive Test

(2011 January)

PC Security Labs

PC Security Labswww.pcsecuritylabs.net

1. Test introduction and highlights

2. Test set and award criteria

3. Participating vendors and products

4. Detailed test results

5. Monthly award logo

6. Disclaimer

MenuMenu

We Understand China

www.pcsecuritylabs.net

3

PC Security Labs

We Understand China

1. TesT InTroducTIon and HIgHlIgHTsA "false positive" is when antivirus software reports a clean file or a non-malicious activity as

malicious. False positives can cause system crashes and other severe problems that may

directly lead to serious economic losses.

Please note that the false positive test does not tell you anything about the effectiveness of

protection that any participating product may provide.

For this new test:A. Our set of popular software has been updated.

B. For the first time, the test bed also covers popular software from Taiwan, especially

banking and securities software.

C. We chose 30 types of commonly used applications, in order to check whether security

software blocks the installation of normal applications besides the normal static scan of our

clean file database.

D. We will quote the data from this test and use it in the coming China region malware

comparatives test and the total protection test.

2. TesT seT and award crITerIaThe sample set covers recent newly added software and popular software in the Greater

China region (Mainland China, Hong Kong, Macau and Taiwan). The following clean files were

reported by security software during this test:


4

PC Security Labs

We Understand China

False alarms in the static false positive testwww.pcsecuritylabs.net PC Security Labs

MD5 Hash File Name 0f38d469e473c2c1953a60b31839a6d4 BIXUEQINGTIAN 349ad2d4f5d6f6e6c666e816e995cbc0 360 Security Guard 7.3.0.2003 9e65ad3aa7674bfe854a94b6a27a17ca 360 Security Guard 7.3.0.2003 09a58fecd1138e6bb5bc22be0a609953 Arctic Fox Desktop Wizard V4.1 d6054fe17044e6eed44e0dbfe808a2a2 Housekeeper Edition for Textile and Shoe Businesses v8.16 526d3af37815854b45c3968e0a1087f0 China Telecom Tianyi Live 1.16 2be0902045ec835e8b2d1b7dbcb540a3 XINFEIFEI 29c72195850835532fa188b605b884b5 FlashGet 3.7 f7c2b3c3b7cfd2a0c24bc62449b36e19 ICBC Corporate Net-Pass V1.2.3.1 ebb634d5de705e31751cbbc1b0eb9f64 ICBC Personal Net-Pass ef39c8f91d595f51514f3e5564625ddb Changjiang Securities Golden Online Smart Trader 8.1 552f404a418073a4fdbe0d05ed04378d Straight Flush Trend Pioneer Supreme Edition V7.60.32 6d64483024226ec3e68a8ca63256848e Agricultural Bank of China Internet Banking - World Finance 59d8a1274b711d1626dd23011afb68b4 Kingdee KIS Prof. Ed. V10.0SP1 9843f3c120b327f67ad082d0d0ab1688 Kingsoft Quick Games World 2010.10.29.932 d71ca20fc633bb8e856ec8e707df5869 Leawo Total Video Converter 11ca0eac890eb6338a31cfaa97db95c6 Kugou Player 42d4999c4848911e6d6bfad4a886e993 Mymir653b3c557330035491672db5645d3efd Qilu Securities Straight Flush Online Trading System 4.60.19.2 Ed.b6cbad8c6f9679cd3329dce77f542cd6 Dongxing Securities Prof. Ed. 4.60.14 Ed.9e47c1abe702fd2597cb15ab4fd71f55 Guosen Securities Golden Sunshine Online Trading System V6.08 80eef40b16ff7458c9ba9850f128f86f Feidian ITV 1.7 ee7c93f27c2f874a82dabfb4f3f4e802 Esunny Trading 8.0 17ff23fa353ed6b9f24ba61bbb2fe478 Bawang 2.2 External Version dcdad352187b6e283bd559f75524a8af Agricultural Bank of China Internet Banking - World Finance 0efc2cd726bc566415a74b4e3d2d1867 XIANTU e69a8d71cec13827cccbe5fb201bb070 FOD Online 8b9664c8a1e123921f6673c6e08784e2 Guodu Securities VIP Management Platform3a34bdb68614160e8be63c114fd42c75 WebPlayer9 1ae330727911ffd5f89e7ddd63ed99c6 Chuancai Securities Great Wisdom 77477bb73cbe07eac9f1cd439531b628 Haitong Online Trading Client 24ea4ddd8909bc38367d891dd0c50b84 XUNYOU 0e2bd6871b1defef98c81452ac292792 XUNYOU 53c0c912d35613da4539593f547a1ecb XUNYOU 677a5528d2783e640e459fcfd7346e3e XY Online II c393ef8f7f5bf8c5cf7b8001e6a2cdff Kingdee KIS Prof. V10.0 c031b5d4b40caa9e4cbb6c280d8f82de Chuancai Securities Great Wisdom 70cb9583b40efbe50baee699d48ac88d Photostudio Electronic Album Maker


5

PC Security Labs

We Understand China

Remarks:

static False Positive Test

PCSL scans our extensive base of clean files with each tested product.

dynamic False Positive Test

PCSL installs 30 types of commonly used applications after the tested software is installed

and checks whether the security software blocks the installation of normal applications.

dynamic alarms in the static false positive test

www.pcsecuritylabs.net PC Security Labs

BitComet Test Ed. 20110111 CITIC B2C PayGate CNTV-CBox ITvClient -2.0.0.1 Opera11.01-11.1.1164.0 PPS Video Official Edition 2.7.0.1208 PPTV ITv -2.7.0.0031 QQ Tornado3.0-3.0.672.402 QQ Browser 5-5.0.6648.400 WinRAR4.00beta3 Chinese Edition LeTV -4.8.0.1 Renren Desktop2.3 Maxthon Browser 33 Mega Securities Wonderful-3.1.6.0 Everbright Bank Sunbeam Webshield Driver Huanan Futures F1 Order-0.53.0.0 Land Bank of Taiwan Security Control Addon-1.0.0.0 Guotai Futures -8.2010.430.1 GF SecuritiesVIP Fast Trading EditionV6.01 China Merchants Securities Wealth Edition V9.02 Sogou High Speed Browser-2.2.0.1713 Youdao Dictionary 4.0-4.0.22.5570 SinoPac Securities Get rich quick worker -1.0.0.1 MEITU XIUXIU 2.5.7-2.5.7.1000 Stock Market Tycoon -3.1.6.0 Tencent QQ2011-1.60.2012.192 Wandoujia Phone Wizard 1.8-1.8.121.565 Xunlei7-7.1.4.2112 Changjiang Securities Golden Online Smart Trader 8.3ALI Wangwang 2010 Ed.SP1-1.0.0.1 Ludashi -2.76.11.103


BitComet Test Ed. 20110111 CITIC B2C PayGate CNTV-CBox ITvClient -2.0.0.1 Opera11.01-11.1.1164.0 PPS Video Official Edition 2.7.0.1208 PPTV ITv -2.7.0.0031 QQ Tornado3.0-3.0.672.402 QQ Browser 5-5.0.6648.400 WinRAR4.00beta3 Chinese Edition LeTV -4.8.0.1 Renren Desktop2.3 Maxthon Browser 33 Mega Securities Wonderful-3.1.6.0 Everbright Bank Sunbeam Webshield Driver Huanan Futures F1 Order-0.53.0.0 Land Bank of Taiwan Security Control Addon-1.0.0.0 Guotai Futures -8.2010.430.1 GF SecuritiesVIP Fast Trading EditionV6.01 China Merchants Securities Wealth Edition V9.02 Sogou High Speed Browser-2.2.0.1713 Youdao Dictionary 4.0-4.0.22.5570 SinoPac Securities Get rich quick worker -1.0.0.1 MEITU XIUXIU 2.5.7-2.5.7.1000 Stock Market Tycoon -3.1.6.0 Tencent QQ2011-1.60.2012.192 Wandoujia Phone Wizard 1.8-1.8.121.565 Xunlei7-7.1.4.2112 Changjiang Securities Golden Online Smart Trader 8.3ALI Wangwang 2010 Ed.SP1-1.0.0.1 Ludashi -2.76.11.103

2. award crITerIa

Five star award:

Total false positives ≤2

Four star award:

Total false positives: 3-4

Three star award:

Total false positives: 5-6

All awards are valid for a period of 6 months, until the next PCSL false positive test.


6

PC Security Labs

We Understand China

3. ParTIcIPaTIng Vendors and ProducTs

Signatures updated: January 20th, 2011


3.

Vendor Product Antiy Antiy GHOSTBUSTER 7 ArcaBit ArcaBit System Protection AVAST Avast! Free Antivirus 5.1 AVG AVG Internet Security 2011 AVIRA AVIRA Antivir Premium Security Suite 10.0 BitDefender BitDefender Total Security 2011 COMODO COMODO Internet Security Coranti Coranti 2010 Dr.WEB Dr.WEB ANTI-VIRUS 6.0 Emsisoft Emsisoft Anti Malware 5.0 ESET ESET Smart Security 4 Filseclab Twister Anti-TrojanVirus V7 F-Secure F-Secure Internet Security 2011 G DATA G DATA Internet Security 2011 IKARUS IKARUS Virus Utilities Jiangmin KV Antivirus 2011 Kaspersky Kaspersky Internet Security 2011 Kingsoft Kingsoft Internet Security 2011 McAfee McAfee Total Security Micro World eScan Internet Security Suite Microsoft Microsoft Security Essentials NETGATE Spy Emergency Panda Panda Internet Security 2011 Qihoo 360 Antivirus 2.0 Quick Heal Quick Heal AntiVirus 2010 Rising Rising Antivirus 2011 SOPHOS SOPHOS Anti-Virus 9.5 Sunbelt VIPRE Antivirus Symantec Norton Internet Security Trend Micro Trend Micro Titanium Internet Security TrustPort TrustPort PC Security 2010 VBA32 Vba32 Anti-virus Zillya Zillya! Antivirus

2011 1 20


7

PC Security Labs

We Understand China

4. deTaIled TesT resulTs


8

PC Security Labs

We Understand China


9

PC Security Labs

We Understand China


10

PC Security Labs

We Understand China


11

PC Security Labs

We Understand China


12

PC Security Labs

We Understand China


13

PC Security Labs

We Understand China

Antiy GHOSTBUSTER 7 is a pure scanner.


Vendor Static FPs Dynamic FPs Total FPs

BitDefender 0 0 0MicroWorld 0 0 0F-Secure 0 1 1Jiangmin 2 0 2KingSoft 2 0 2Microsoft 2 0 2

NETGATE 3 0 3Qihoo 2 2 4Rising 2 2 4

Trend Micro 4 0 4AVG 5 0 5

Dr.Web 4 1 5ESET 5 0 5

G DATA 5 0 5Panda 4 1 5

TrustPort 5 0 5Zillya 4 1 5

ArcaBit 5 1 6AVAST 7 0 7

Kaspersky 5 2 7Filseclab 8 0 8IKARUS 7 1 8

QuickHeal 8 0 8SOPHOS 7 1 8Symantec 8 0 8

Antiy 9 0* 9Emsisoft 4 6 10McAfee 12 0 12Sunbelt 11 1 12VBA32 11 4 15

COMODO 13 5 18Avira 21 0 21

Coranti 18 3 21


14

PC Security Labs

We Understand China

5. awards


5.

5

BitDefender MicroWorld F-Secure Jiangmin KingSoft Microsoft

4

NETGATE Qihoo Rising

Trend Micro

3

AVG Dr.Web ESET

G DATA Panda

TrustPort Zillya

ArcaBit

[d2]: Logo 3 4


5.

5


4


Trend Micro

3

AVG Dr.Web ESET

G DATA Panda

TrustPort Zillya

ArcaBit

[d2]: Logo 3 4


5.

5


4


Trend Micro

3

AVG Dr.Web ESET

G DATA Panda

TrustPort Zillya

ArcaBit

[d2]: Logo 3 4

14

PCSL Greater China Region False Positive Test

● Domestic VenDor ( Headquarter inside Greater China Region )

● Foreign VenDor ( Headquarter outside Greater China Region )

6. dIsclaIMer It is not permitted to extract parts from our test results and transfer them into your own

tests or to use the final data without written permission from PC Security Labs. We cannot be held liable for any damage or loss, which might result from the use of information provided on our website or in our test reports. We do our best to ensure the correctness of test results, but we do not at any time provide a guaranty for the correctness or completeness of the information published on our website or in our test reports. You are allowed to download, view, print and copy the material from our site to the hard disk of your computer and use it in good faith only for your personal, non-commercial purpose as information resource. It is forbidden to transmit or re-circulate any material obtained from PC Security Labs (including from any email delivered by PC Security Labs) to any third party without our prior written consent. We focus on computer security and we do our best to try and protect PC security. All samples are gathered from the Internet. All our research is undertaken in a secure environment and to prevent any manipulation, we remove all extensions of a sample.

Any commercial organization that wishes to cite findings contained in the report should contact Jeffrey on his email address ([email protected]). Any antivirus vendor may use our monthly or annual testing award logo free of charge on the Internet, on marketing material and on product packaging. For more detailed information about the annual certification, please contact Jeffrey Wu via email: [email protected]. We reserve the right of withdrawing the license of monthly award and annual certification in case of improper use by an antivirus vendor.

15

www.pcsecuritylabs.netPC Security Labs

We Understand China

PC Security Labs (PCSL) was established in March, 2008 in Beijing, China. PCSL is a privately owned independent research organization, focusing on security software tests and test standard development. Our motto is “scientific, precise and independent”. Over 30 security manufacturers from mainland China and abroad are using PCSL’s testing services. As the only test organization to join AMTSO from mainland China, PCSL’s has established a reputation of unbiased testing in the world wide security industry.

about Pcsl

Documents

PCSL Greater China Region False Positive Testdownload.zillya.com/2010_JAN_Greater_China_Region... · static False Positive Test PCSL scans our extensive base of clean files with each