1

ICT ANALYSISICT ANALYSIS “Application of Information and Communication Technology to

Production and Dissemination of Official statistics”10 May – 11 July 2007

M Q Hasan

Lecturer/ Statistician

UN Statistical Institute for Asia and the Pacific

Chiba, Japan

Email : hasan@unsiap.or.jp

2

ObjectiveObjective

To gain knowledge on– ICT in general– Key ICT indicators– Situation analysis

3

ContentsContentsICT in generalICT in an organisationICT in a particular contextSome softwareDiscussionsReferences

4

ICT DefinitionICT Definition

ICT consists of hardware, software, networks, and media for collection, storage, processing, transmission, and presentation of information (voice, data, text, images)

Information & Communication Technology Sector Strategy Paper of the World Bank Group, April 2002, http://info.worldbank.org/ict/ICT_ssp.html

5

ICT ICT SectorSector

ICT sectors are defined by the OECD as a combination of manufacturing and services industries that capture, transmit and display data and information electronically.

6

OECD Key ICT indicatorsOECD Key ICT indicators

1. Access lines and channels in total /per 100 inhabitants for OECD

2. Mobile subscribers in total / per 100 inhabitants for OECD

3. Internet subscribers in total for OECD4a. Broadband subscribers per 100

inhabitants in OECD   countries4b.Availability of Digital Subscriber Lines

(DSL) in OECD countries

7

OECD Key ICT indicatorsOECD Key ICT indicators

5. Cable TV subscribers in total for OECD

6a Households with access to the Internet in selected OECD countries

6b Households with access to a home computer

8

OECD Key ICT indicatorsOECD Key ICT indicators

7a Internet penetration by size class. Percentage of businesses with ten or more employees using the Internet  

7b Businesses using the Internet and businesses receiving orders over the Internet   

8.  Share of ICT-related occupations in the total economy in selected countries

9

OECD Key ICT indicatorsOECD Key ICT indicators

9a.  Telecommunication services revenue in total for OECD

9b.  Mobile telecommunication services revenue in total for OECD

9c.  Telecommunication infrastructure investment in total for OECD

10

OECD Key ICT indicatorsOECD Key ICT indicators

11a.  ICT patents as a percentage of national total (EPO) in selected countries

11b.  Share of countries in ICT patents at the EPO

12.  Trade in ICT goods and services

11

OECD Key ICT indicatorsOECD Key ICT indicators

13.  Top 50 telecommunications firms and IT firms

14.  Contribution of ICT-using services to value added per person engaged

15.  Contributions of ICT investment to GDP growth

Source: http://www.oecd.org/

12

Evolutions in Technology Evolutions in Technology Optimisation and Performance

(mainframes LANs) Integration of components

Operating systems etc. Client server based systems Increased ‘simplicity’ of applications

Specialized software for statistical processing Functionality/Price Accessibility

13

ICT and the NSOICT and the NSO

14

Missions of NSOMissions of NSO

Providing statistical data for policy formation– Managing IT

Planning Implementation Evaluation etc

15

Missions of NSOMissions of NSO

Managing ITData collection

Data processing including validations

Data Analysis

Data archiving

Data dissemination

16

Missions of NSOMissions of NSO

Data collectionCensus

Sample survey

Administrative records

Others

17

Questionnaire Design

Data Processing Planning

Pre- processing activities

Data collection

Data Conversion

Data Analysis

Data Cleaning

Define Data Requirements

Finalise Indicators

Activities, such as Sample design, Pilot

survey etc.

Report Writing

FinalReport

ST

RO

RA

GE

O

F F

ILE

S A

ND

TH

EIR

D

ISS

EM

INA

TIO

N

Possible Stages in data collection procedure

18

Data InputData Input Electronic Forms Computer Assisted Interviewing (CAI) Computer assisted data entry Administrative records Imaging/OMR/OCR etc Keying

19

ThroughputThroughput Data integration and data processing Classification Imputation Analysis

20

Data outputData output Data archiving Data mining Data confidentiality Electronic online dissemination

– Real time, etc. Electronic offline dissemination

– Manual intervention Publication Etc.

21

Further outputFurther output Data management

– DBMS etc. Content Management

– System analysis

22

ICT ANALYSISICT ANALYSIS

23

ICT and the NSOICT and the NSO

Computer hardware – CPU Computer hardware - accessories Computer software

– Operating systems

– Applications Software

– Development Software

– Resource sharing tools

– Etc. Computer network equipments

24

ICT and the NSOICT and the NSO

Available Expertise Development Trainings Cost

– Establishment– Procurement

H/W, S/W, L/W

– Maintenance

NSO Concerns

25

ICT and the NSOICT and the NSO

Functionality Robust and Reliable Easy to learn/operate/maintain Hardware platform Human resources Affordable Training Previous knowledge/reference

Factors influencing the choice of software

26

ICT and the NSOICT and the NSO

Hardware and operating system Communication (software side) Communication (network side) Storage Security Data Conversion Back-end Servers Report Preparations and Presentations Graphics

Selected areas of interest

27

ICT and the NSOICT and the NSO

Hardware and operating system– Operating systems

Different flavors of Unix– Sun Solaris, HP Unix etc

Linux Windows based system Apple Macintosh based systems Etc.

28

ICT and the NSOICT and the NSO

Computer software– Application / Development software

Data entry, processing, management Statistical Analysis Data Dissemination Database Compilers AntiVirus and Security Content Management

29

Free softwareFree software Users' have freedom to run, copy, distribute, study, change

and improve the software.

More precisely, it refers to four kinds of freedom– The freedom to run the program, for any purpose

(freedom 0). – The freedom to study how the program works, and adapt

it to your needs (freedom 1). Access to the source code is a precondition for this.

– The freedom to redistribute copies so you can help your neighbor (freedom 2).

– The freedom to improve the program, and release your improvements to the public, so that the whole community benefits (freedom 3). Access to the source code is a precondition for this.

http://www.gnu.org/philosophy/free-sw.html

30

Open Source Initiative (OSI)Open Source Initiative (OSI) Non-profit corporation dedicated to managing and

promoting the Open Source Definition for the good of the community, specifically through the OSI Certified Open Source Software certification mark and program. You can read about successful software products that have these properties, and about our certification mark and program, which allow you to be confident that software really is "Open Source." We also make copies of approved open source licenses here.

http://www.opensource.org

31

Apache Web Server

Product maintained by the Apache HTTP Server Project

Open-source HTTP server for modern operating systems including UNIX and Windows NT.

Apache has been the most popular web server on the Internet since April of 1996.

The February 2005 “Netcraft Web Server Survey” found that more than 68% of the web sites on the Internet are using Apache

http://httpd.apache.org/

32

Operating systems - Operating systems - LinuxLinux

"open source" software project is developed by an online community of volunteers

Backed by big and small corporate players (like IBM and Red Hat) who provide support and tailor the software for individual business needs.

Linux, its champions say, is more stable and secure than anything Microsoft has ever produce

33

Linux ..in shortLinux ..in short

Runs on more CPUs and platforms than any other computer operating system.

Multi-tasking operating system. Comes with documentation. Immune to most viruses. Commercial versions (e.g. Red Hat) supports

24/7 customer service. Many bugs are fixed by on-line users very

quickly.

34

K Desktop Environment

K Desktop Environment KDE is a powerful graphical desktop environment

for Linux and Unix workstations. It is Free Software Combines ease of use, contemporary functionality,

and outstanding graphical design with the technological superiority of the Unix operating system.

http://www.kde.org/

35

Free office suite …OpenOfficeFree office suite …OpenOffice

Multi-platform Multilingual Version 2.2 Text document Spreadsheet Presentation

36

Free office suite …OpenOfficeFree office suite …OpenOffice

Office suite An open-source project Compatible with all other major office suites http://www.openoffice.org/

37

Editing pictures suiteEditing pictures suite

GIMP stands for GNU Image Manipulation Program

Photo retouching, image composition and image authoring.

It works on many operating systems, in many languages.

The open source "Gimp" is powerful - http://www.gimp.org/

Google's free Picasa

38

File and Print services:File and Print services:

Samba is an Open Source/Free Software suite Samba is freely available under the GNU

General Public License. Since 1992, provided file and print services to

all manner of SMB/CIFS clients, including the numerous versions of Microsoft Windows operating systems.

39

Statistical SoftwareStatistical Software

Epi Info is a trademark of the Centers for Disease Control and Prevention (CDC) http://www.cdc.gov/epiinfo/epiinfo.htm

“Cspro" is a trademark of the US Census Bureau

http://www.census.gov/ipc/www

40

Browser statistics : April 2007*Browser statistics : April 2007*

*Ref : http://www.w3schools.com/browsers/browsers_stats.asp

Microsoft's Internet Explorer 7.0 19.2%

Microsoft IE 6. 37.3%

IE 5.0 1.7%

Firefox 32.9%

Mozilla 1.3%

Safari (identified as Mozilla before 2007) 1.7%

Opera 1.7%

41

Browser .. FirefoxBrowser .. Firefox

Mozilla Firefox, the open source web browser. “Firefox empowers you to browse faster, more

safely and more efficiently than with any other browser” – Firefox website

Available for Windows, Mac OS X and Linux. 9 million download in 9 months, standing

around 50 million users at the moment Reference http://www.mozilla.com/firefox

42

OCR softwareOCR software

Readiris pro 11 Convert your paper documents and PDF

files into editable text Available for Windows, Mac OS

– http://www.irislink.com/opt/uk/products/download/downgoogle.html

43

Anti virus …ClamwinAnti virus …Clamwin

Anti-virus software Scanning Scheduler Standalone Virus Scanner Automatic Virus Database Updates.

ClamAV team updates Virus Databases on a regular basis and almost immediately after a new virus/variant is out;

Need to manually scan a file in order to detect a virus

44

Database …MySQLDatabase …MySQL

Available free under GPL - database enable your web site.

Allows different level of access control. Portable. Fast. Easy to download and install.

45

Data conversion …DBMS/CopyData conversion …DBMS/Copy

Not a free software. Point-and-click file format conversion.

– 80 different native file formats. SAS, SPSS, etc. Access, Oracle, etc. Excel, Access and ODBC.

Fundamental data analysis capabilities. Drill-down data analysis and discovery, including

graphing, charting and reporting capabilities

46

MicrOsiris Statistical and Data MicrOsiris Statistical and Data Management Software SystemManagement Software Systemhttp://www.microsiris.com/MicrOsiris.htmhttp://www.microsiris.com/MicrOsiris.htm

Handles any size data set. Interactive dialogs and batched run files. Data entry with Excel Imports and exports to SAS, SPSS, STATA Special Data Mining techniques for market

analysis (SEARCH --very fast for large datasets).

47

MicrOsiris Statistical and Data MicrOsiris Statistical and Data Management Software System Management Software System

Interactive statistical decision tree for selecting appropriate statistics.

Special nominal and ordinal statistical analysis techniques (MCA, MNA).

Can read OSIRIS data sets from the Institute for Political and Social Research (ICPSR).

Reads UNESCO IDAMS datasets. Online manual

48

MicrOsiris Statistical and Data MicrOsiris Statistical and Data Management Software System Management Software System

Decision Tree for choosing statistics and commands to compute them

Online context sensitive help system with additional links to manual.

Requires only 6MB when fully loaded; additional memory allocated as needed depending on number of variables used.

Less than 12MB on disk--including manual and Statistical Decision Tree.

49

ReferencesReferences

1. Open Source Initiative - http://www.opensource.org/

2. K Desktop Environment - http://www.kde.org/

3. Samba - http://us3.samba.org/samba/docs/GPL.html

4. The Free Software Definition - http://www.gnu.org/philosophy/free-sw.html

5. OpenOffice - http://www.openoffice.org/

6. GNU Image Manipulation Program - http://www.gimp.org/

7. Information & Communication Technology Sector Strategy Paper of the World Bank Group, http://info.worldbank.org/ict/ICT_ssp.html

50

References ….contd.References ….contd.

8. Organisation for Economic Co-operation and Development - http://www.oecd.org/home/

9. BBC news 9 May 2005, http://news.bbc.co.uk/2/hi/business/4508897.stm

10. INFORMATION INSECURITY- A survival guide to the uncharted territories of cyber-threats and cyber-security, Eduardo Gelbstein &Ahmad Kamal, United Nations ICT Task Force and United Nations Institute of Training and Research

11. Epi Info - the Centers for Disease Control and Prevention (CDC) -http://www.cdc.gov/epiinfo/epiinfo.htm

12. Cspro - http://www.census.gov/ipc/www

51

References ….contd.References ….contd.

13. The Apache Software Foundation - http://www.apache.org/14. the Apache HTTP Server Project - http://httpd.apache.org15. ClamWin - http://www.clamwin.com16. DBMS/Copy-

http://www.dataflux.com/Product-Services/Products/dbms.asp17. MySQL - http://www.mysql.com18. MicrOsiris - http://www.microsiris.com/MicrOsiris.htm