Transcript
Page 1: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Mobile Security Apps

Hendrik Pilz

Director Technical Lab / Mobile Security

[email protected]

Page 2: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

The test report is also available on

www.av-test.org

Page 3: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

About AV-TEST

• 24 employees in Magdeburg and Leipzig

• Tests of security solutions for consumers and enterprise

• 300 TB test data (malware and clean files)

• Certification program

Page 4: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Agenda

• The Android threat landscape

• Common mobile security features

• Testing mobile security Apps

• Comparison of detection rates

• How to protect yourself?

Page 5: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

The Android threat landscape

• Android is the most popular Smartphone OS

• It’s easy to install apps from 3rd party app stores

• The Android Market was not very restrictive-> Google Bouncer was recently introduced

Page 6: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

The Android threat landscape

0

2000

4000

6000

8000

10000

12000

14000

Android Malware Collection Growth

New Samples Total # Samples

Page 7: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

The Android threat landscape

• Phishing-/Banking Trojans• Spyware• Bots• SMS Fraud• Premium Dialers• Root Exploits• Fake Installers• Download Trojans

Page 8: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

The Android threat landscape

• Phishing-/Banking Trojans• Spyware• Bots• SMS Fraud• Premium Dialers• Root Exploits• Fake Installers• Download Trojans

Page 9: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Common mobile security features

• Anti-Malware scanner, Privacy scanner• Real-time protection• Anti-Theft: remote wipe, remote lock,

localization of lost devices• Message filter for SMS/mail• Safe browsing, Parental control• Data Encryption• Backup

Page 10: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Common mobile security features

41

24

18

11 9 8

2

0

5

10

15

20

25

30

35

40

Features among all testedMobile Security Apps

# Products

Page 11: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Testing mobile security Apps

• Our goal: determining malware detection rate

• Test environment: Android Emulator with API-level 10, Samsung GalaxyTab, Samsung Galaxy Nexus, Motorola Xoom

• Emulator snapshots were used to freeze signatures

• All emulator tests were cross checked on a real device

Page 12: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Testing mobile security Apps

Page 13: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Testing mobile security Apps

• Scan sample set on SD card

• Use real-time protection, to check all remaining files

Page 14: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Testing mobile security Apps

• Scan sample set on SD card

• Use real-time protection, to check all remaining files -> Install each sample one by one!

Page 15: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Testing mobile security Apps

• Scan sample set on SD card

• Use real-time protection, to check all remaining files -> Install each sample one by one!-> In addition to the scans we’ve performed thousands of real-time tests!-> Used ADB to automate tasks

Page 16: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Testing mobile security Apps

Page 17: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Testing mobile security Apps

Some Problems:

• No consistent reporting

• No “Delete all” buttons

• Cloud queries didn’t always work on the emulator due to high latency

• Different implementations of on-demand and real-time scans

Page 18: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Testing mobile security Apps

Future tests

• Anti-Theft

• Message filters

• Safe browsing

• Performance / Battery usage

Page 19: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Comparison of detection rates

10

133

13

2

Detection rate distribution

> 90% > 65% > 40% > 0% 0%

Page 20: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Comparison of detection ratesDetection rate > 90%

avast! Mobile Security

Dr.Web anti-virus

F-Secure Mobile Security

IKARUS mobile.security

Kaspersky Mobile Security

Lookout Security & Antivirus

McAfee Mobile Security

MYAndroid Protection

NQ Mobile Security

Zoner AntiVirus

Page 21: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Comparison of detection rates

Traditional Anti-Virus vendors

Detection rate > 90%

avast! Mobile Security

Dr.Web anti-virus

F-Secure Mobile Security

IKARUS mobile.security

Kaspersky Mobile Security

Lookout Security & Antivirus

McAfee Mobile Security

MYAndroid Protection

NQ Mobile Security

Zoner AntiVirus

Page 22: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Comparison of detection rates

Anti-Virus vendors focused on Mobile Security and other areas

Detection rate > 90%

avast! Mobile Security

Dr.Web anti-virus

F-Secure Mobile Security

IKARUS mobile.security

Kaspersky Mobile Security

Lookout Security & Antivirus

McAfee Mobile Security

MYAndroid Protection

NQ Mobile Security

Zoner AntiVirus

Page 23: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Comparison of detection ratesDetection rate > 65%

AegisLab Antivirus

AVG Mobilation Anti-Virus

Bitdefender Mobile Security

BullGuard Mobile Security

Comodo Mobile Security

ESET Mobile Security

Norton Mobile Security

Quick Heal Mobile Security

Super Security

Trend Micro Mobile Security

Total Defense Mobile Security

Vipre Mobile Security

Webroot SecureAnywhere Mobile

Page 24: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Comparison of detection ratesDetection rate > 65%

AegisLab Antivirus

AVG Mobilation Anti-Virus

Bitdefender Mobile Security

BullGuard Mobile Security

Comodo Mobile Security

ESET Mobile Security

Norton Mobile Security

Quick Heal Mobile Security

Super Security

Trend Micro Mobile Security

Total Defense Mobile Security

Vipre Mobile Security

Webroot SecureAnywhere Mobile

Page 25: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Comparison of detection ratesDetection rate > 65%

AegisLab Antivirus

AVG Mobilation Anti-Virus

Bitdefender Mobile Security

BullGuard Mobile Security

Comodo Mobile Security

ESET Mobile Security

Norton Mobile Security

Quick Heal Mobile Security

Super Security

Trend Micro Mobile Security

Total Defense Mobile Security

Vipre Mobile Security

Webroot SecureAnywhere Mobile

Page 26: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Comparison of detection ratesDetection rate > 40%

BluePoint Security Free

G Data MobileSecurity

Kinetoo Malware Scan

Page 27: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Comparison of detection ratesDetection rate > 0%

ALYac Android

Android Antivirus

Android Defender / Virus Shield

Antivirus Free

BlackBelt AntiVirus

CMC Mobile Security

Fastscan Anti-Virus

GuardX Antivirus

MobiShield Mobile Security

MT Antivirus

Privateer LITE

Snap Secure

TrustGo Mobile Security

Page 28: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Comparison of detection ratesDetection rate > 0%

ALYac Android

Android Antivirus

Android Defender / Virus Shield

Antivirus Free

BlackBelt AntiVirus

CMC Mobile Security

Fastscan Anti-Virus

GuardX Antivirus

MobiShield Mobile Security

MT Antivirus

Privateer LITE

Snap Secure

TrustGo Mobile Security

Page 29: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Comparison of detection ratesDetection rate = 0%

LabMSF Antivirus beta

MobileBot Antivirus

Page 30: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

How to protect yourself?

• Install apps from trusted sources!

• Check the permissions!

• Check the reliability with help of ratings, user comments, reviews or the developer website!

Page 31: Mobile Security Apps - AV-TEST · PDF fileTesting mobile security Apps ... ESET MobileSecurity Norton Mobile Security QuickHeal Mobile Security Super Security Trend Micro Mobile Security

Mobile Security Apps www.av-test.org

Questions?


Recommended