Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
Intergovernmental Oceanographic Commission
Training Course Reports 50
IOCIODE - NIO Training Course onOceanographic Data and InformationManagement
National Institute of Oceanography Goa India17-27 October 1998
UNESCO
IOC Training Course Report No 50 Page (i)
TABLE OF CONTENTS
1 INTRODUCTION 1
2 PARTICIPANTS 1
3 THE COURSE PROGRAMME 1
4 LECTURE NOTES 3
5 COURSE EVALUATION 3
6 CLOSING OF THE SESSION 4
ANNEX I AGENDA AND TIMETABLE
ANNEX II LIST OF PARTICIPANTS AND RESOURCE PERSONS
ANNEX III LECTURE NOTES1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
ANNEX IV LIST OF ACRONYMS
IOC Training Course Report No 50Page 1
1 INTRODUCTION
During the International Oceanographic Data and Information Exchange (IODE) Officers held inGoa India between 10 and 13 February 1998 the National Institute of Oceanography offered to host aregional data management training course for countries in the IOCINDIO (IOC Regional Committee forthe Central Indian Ocean ) region Responding to this kind offer the IOC was able to allocate funds forsupporting travel and accommodation for participants and international resource persons NIO offered tocover local organizational expenses and travel and accommodation expenses for local resource persons
The objectives of the Training Course were
to provide an introduction to and raise awareness for the IODE Programme to familiarize participants with IODE projects and products to provide participants with basic knowledge and experience about data management systems and their
utilization in oceanographic data metadata and information management to provide participants with basic knowledge about new technologies related to serving users with
information and data over the Internet to stimulate intra-regional collaboration in the field of oceanographic data and information
management to provide training to recently established National Oceanographic Data Centres (NODC) and
Designated National Agencies (DNA) to stimulate countries in the region to establish National Oceanographic Data Centres (NODC) or
Designated National Agencies (DNA)
The Course was also used as a second occasion to receive comments and recommendations on theIODE Resource Kit through the draft product ODINEA CD-ROM which was developed during the IOCRegional Training Course in Oceanographic Data Management for the IOCINCWIO region held inMombasa Kenya (1-11December 1997) On the basis of the collected comments and recommendation acomprehensive training tool will be developed to be used during (and after) IODE training courses toensure long-term impact of IODE training activities
The Course was opened on Saturday 17 October at 0900
2 PARTICIPANTS
Eleven participants were selected from 7 countries in the Indian Ocean region (and Western Pacific)namely Bangladesh India Malaysia Mauritius Qatar Sri Lankaand Vietnam Participants were allactively involved in marine science marine services or related specialties Unfortunately the participantsfrom Pakistan and Iran were not able to participate due to late reception of their application by the IOC
A total of 12 resource persons from Australia India The Netherlands and IOC (lecturers and practicalexercise support) participated in the Course
The List of Participants and Resource Persons is provided in Annex II
3 THE COURSE PROGRAMME
The Course Programme attempted to provide an as wide possible overview of the tasks and operationsof National Oceanographic Data Centres and hereby trying to conserve a balance between theoreticallectures and practical exercises within the (short) available timeframe The Course Programme was
IOC Training Course Report No 50Page 2
developed jointly between IOC and NIO with IOC selecting the international lecturers and NIO identifyingIndian lecturers and resource persons
The following topics were covered during the Training Course
SESSION 1 THE IODE SYSTEM
lt Introduction to IODE and the IOC Regional Programmeslt The IODE institutional components and the international ocean data systemlt The IODE data flow and monitoring procedureslt IODE Data Products and Operational Projectslt Establishing a National Oceanographic Data Centre
SESSION 2 DATA METADATA AND INFORMATION MANAGEMENT
lt New technologies for data acquisition remote sensinglt Global Oceanographic Data Archeology and Rescue (GODAR)lt Marine data management at the RNODC-INDOlt The continuum data metadata and informationlt Metadata management the MEDI Pilot Projectlt Information management the IODE Marine Information Management programme
SESSION 3 DATABASE MANAGEMENT SYSTEMS
lt Advances in database management systems from relational to object-oriented and beyondlt Advances in database management systems distributed database management systemslt Numerical databases vs text-oriented databases
SESSION 4 USING RDBMS IN OCEANOGRAPHIC DATA MANAGEMENT
lt Introduction to Microsoft Accesslt Searching the database introduction to SQLlt Examples of databases and data products GEBCO GLOSS etc
SESSION 5 DATA PROCESSING AND PRODUCT DEVELOPMENT
lt Oceanographic Data Exchange formatslt Quality Control Procedureslt Data Processing and statisticslt Data product development tools GIS
SESSION 6 IODE AND THE INTERNET
lt Introduction to the Internetlt Serving information to users over the WWWlt Serving numerical databases to users over the WWWlt Serving textualfactual information databases over the WWW
SESSION 7 SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT
lt The IODE Resource Kit
IOC Training Course Report No 50Page 3
lt The IODC NIO CDROMlt The IODE XBT quality control software
A detailed timetable of the course is added as Annex I
4 LECTURE NOTES
In order to provide a clear overview of the wide variety and scope of the Training Course and toprovide an opportunity to those who were not able to participate to share in the many interesting lectureswe are providing some copies (or summaries) of the lectures given during the Course in Annex III
5 COURSE EVALUATION
In order to constantly improve the quality of the IODE training courses participants were requestedto evaluate the lectures in terms of
- the relevance of the lecture to the course objectives- the clarity of the presentation- the quality of the presentation
The most appreciated lectures (gt= 810) in terms of their relevance to the course objectives were
- Introduction to IODE and the IOC Regional Programmes- The continuum data metadata and information- Practical exercise on MEDI- Practical exercise on MS Access amp Practical exercise on SQL- Oceanographic Data Exchange formats- Introduction to the Internet- Practical exercise on HTML- The IODE Resource Kit
The least appreciated lectures (lt= 410) in terms of their relevance to the course objectives were
- IODE Data Products and Operational Projects- Numerical Databases vs text-oriented databases (traditionally interest of data managers for
text-based information management is low)- Web databases (this lecture was considered too theoretical)- Demonstration INODC on INGRES DBMS (it was observed that none of the participants used
the INGRES DBMS and as such relevance was considered as small)- Data Processing and statistics (this lecture was considered too theoretical)- Demonstration ArcView at INODC- Serving numerical databases to users over the WWW (this low score was attributed to the
observation that insufficient time was spent on this subject)
Additional comments provided on the evaluation sheet and during the discussions are summarized asfollows
lt More emphasis should be put on practical exercises
IOC Training Course Report No 50Page 4
lt There were too many lectures and lecturerslt In some cases it was regretted that the presentations (slides) were of poor quality Presentations
should be of high qualitylt Presentation hand-outs should be distributed prior to the lecture so participants with language
problems can better preparelt Lecturers should use real-world exampleslt The course should include individual or group projectslt More attention should be given on how to establish an NODC or DNA with special emphasis on
minimum requirements and possibilities for institutions with minimal resources
6 CLOSING OF THE SESSION
During his closing speech Mr Peter Pissierssens on behalf of the IOC Executive Secretarythanked Dr E Desa Director of the National Institute of Oceanography Goa for the substantial supportprovided by NIO which enabled IOC to organize this course He also thanked the lecturers and otherresource persons as well as all NIO staff who had been involved in the excellent support for the trainingcourse
He noted that the IOCINDIO region was still a relatively young regional body which hadregrettably not been very active so far However he stressed that personal contacts established duringtraining courses such as this one are instrumental in generating collaboration and exchange and he invitedthe participants to share their experiences with colleagues back home
Dr JS Sarupria announced that NIO will set up a listserv to enable participants to the trainingcourse to continue communicating and to create a platform which can be used for future collaborationassistance and exchange of experience
In their closing comments on the Course the participants were all unanimous in their highappreciation for the course which they considered as a most useful contribution to their professionalactivities Several participants pledged to contact the relevant authorities in their country to promote theestablishment of a National Oceanographic Data Centre (NODC) or Designated National Agency (DNA)
Dr E Desa Director NIO invited the participants to visit NIO again and welcomed them to spendsome time at NIO
All participants were provided with a certificate of participation
The IOCIODE - NIO Training Course on Oceanographic Data and Information Exchange wasclosed on Tuesday 27 October 1998 at 11h00
IOC Training Course Report No 50Annex I - page 1
ANNEX I
AGENDA AND TIMETABLE
SATURDAY - 17 OCTOBER 19980900 - 0915 REGISTRATION 0915 - 1030 Presentation of the participants1030 - 1100 TEA BREAK
SESSION A IOCIODE SYSTEM (TRAINING HALL)1100 - 1115 Introduction to IODE amp IOC regional policy (P Pissierssens) [ paper presented duringITO98]1115 - 1200 IODE s institutional components and international ocean data system (P Geerders)1200 - 1230 IODE data flow monitoring procedures (P Geerders)1230 - 1300 IODE data products and operational projects (P Geerders)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on ROSCOP forms (Geerders)1500 - 1530 TEA BREAK1530 - 1615 Establishing an IODE NODC (G Reed)
SUNDAY - 18 OCTOBER 1998 - HOLIDAY
MONDAY - 19 OCTOBER 1998
SESSION B DATA METADATA AND INFORMATION MANAGEMENT0925 - 1020 New technology for data acquisition remote sensing data buoys etc (P Geerders)1020 - 1045 GODAR project and achievements (P Geerders)1045 - 1115 The continuum data metadata and information (G Reed)1115 1200 Metadata The MEDI pilot project (GReed)
6(6621amp26()257+(5(672)7+($lt$38amp+2$lt
TUESDAY - 20 OCTOBER 19980930 - 1000 Marine Information Management (Pissierssens)1000 - 1100 Marine data management system at RNODC-INDO (JS Sarupria)1100 - 1130 TEA BREAK1130 - 1300 PRACTICAL EXERCISE Metadata Practical exercise (G Reed) 1300 - 1400 LUNCH BREAK
SESSION C DATABASE MANAGEMENT SYSTEMS1400 - 1430 Numerical DBMS vs textual DBMS (MP Tapaswi)1430 - 1500 Advances in DBMS distributed database management systems (G Reed)1500 - 1530 TEA BREAK1530 - 1700 DBMS systems - Database directions (P Sadanandan NCST Bangalore)
IOC Training Course Report No 50Annex I - page 2
WEDNESDAY - 21 OCTOBER 1998
SESSION D USING RDBMS IN OCEANOGRAPHY0900 - 1000 Data warehousing (P Sadanandan NCST Bangalore)1000 - 1100 Web databases (P Sadanandan NCST Bangalore)
1100 - 1130 TEA BREAK
1130 - 1300 PRACTICAL EXERCISE MS Access Creating database tables Searching thedatabase (J Pattainak JS Sarupria PPissierssens)
1300 - 1400 LUNCH BREAK1400 - 1430 Demonstration to other global data sets such as GEBCO etc (PD Kunte)1430 - 1500 Introduction to global data sets and demonstration (CD-ROM - WDC-A etc) (GVReddy)1500 - 1530 TEA BREAK1530 - 1700 PRACTICAL EXERCISE MS Access self training
THURSDAY - 22 OCTOBER 1998
SESSION E DATA PROCESSING AND PRODUCT DEVELOPMENT (TRAINING HALL)0900 - 1000 Oceanographic data exchange formats (JS Sarupria)1000 - 1100 Quality control procedures (T Pankajakshan)1100 - 1130 TEA BREAK1130 - 1200 Data product development tools (GIS etc) (PD Kunte)1200 - 1300 Visit to IODC (Demonstration use of INGRES DBMS (L Ratnakaran) and ArcView GIS
(J Pattanaik))1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on MS Access amp SQL1500 - 1530 TEA BREAK1530 - 1730 PRACTICAL EXERCISE (continued)
FRIDAY - 23 OCTOBER 1998
SESSION F IODE AND THE WWW0900 - 1000 Data processing tools interpolation interpolation etc (R Mahadevan)1000 - 1045 The Internet - Introduction Evolution and Tools (A Ghosh)1045 - 1115 TEA BREAK1115 - 1145 Serving information to users over the WWW HTML (PPissierssens)1145 - 1200 Serving numerical databases over the WWW (V Chavan)1200 - 1300 Serving textualfactual database over the WWW (MP Tapaswi PPissierssens)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on HTML1500 - 1530 TEA BREAK1530 - 1630 PRACTICAL EXERCISE (continued)1630 1700 The IODC NIO CDROM Demo (PD Kunte)
SATURDAY - 24 OCTOBER 1998 - HOLIDAYSUNDAY - 25 OCTOBER 1998 - HOLIDAY
IOC Training Course Report No 50Annex I - page 3
MONDAY - 26 OCTOBER 1998
SESSION G SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT (IODC)0900 - 1100 PRACTICAL EXERCISE on format conversion (JS Sarupria)1100 - 1130 TEA BREAK1130 1230 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit)(PPissierssens)1230 - 1300 Library visit (Tapaswi)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit) continued1500 - 1530 TEA BREAK1530 - 1630 The IODE XBT quality control software demo (Pankajakshan)1630 - 1730 Evaluation of the Training course
TUESDAY - 27 OCTOBER 1998
0930 - 1100 Discussions on evaluation and receommendations1100 CLOSING CEREMONY (SEMINAR HALL)
IOC Training Course Report No 50Annex II - page 1
ANNEX II
LIST OF PARTICIPANTS AND RESOURCE PERSONS
A PARTICIPANTS
Mr Mohamed Said Al MohanadiMarine Science DepartmentUniversity of QatarPO Box 2713 DohaQATARFax (974) 892135Email alshoqeriqueduqa
Mr Thilakasiri MendisOceanography Division of NARAMattakkuliya Colombo 15SRI LANKAFax (94) 1522 932 or (94) 1522 699Email jayasirinaraaclk
Dr Trinh The HieuInstitute of Oceanography01 Canada - NhatrangVIETNAMFax (84 58) 881 152Email haiduongdngvnnvn
Ms Nasreen Islam KhanAssistant ProfessorDept of Geography amp EnvironmentDhaka University - 1000BANGLADESHFax (880 2) 86 55 83Email nasreengegduccagnicom Nasreen_ikhanyahoocom geographydubanglanet
Lt Cdr Zaharuddin MaideenHydrographic DirectorateRoyal Malaysian Navy Ministry of DefenceJalan padang Tembak 50634 Kuala LumpurMALAYSIATel 603-2313700Fax 603 2987972Email zahalintmnetmy
Mr Goonasilan SoopramaniaMauritius Meteorological ServicesVacoasMAURITIUSFax (230) 686 1033Email meteointernetmu
Cdr A BhushanNaval Hydrographic OfficePost Box No 75 107-A Rajpur RoadDEHRADUN - 248 001 INDIAFax 0091 (135) 748373
Shri MM Malleswara RaoNational Institute of OceanographyRegional Centre176 Lawsons Bay ColonyVISAKHAPATNAM - 530 017 INDIAFax 0891-543595Email mmmraokadalinioorg
Lt Cdr IN JobINS HansaGOA - 403 802 INDIAEmail simulatebom2vsnlnetinTel 0834-51 8441
Lt TP MahatoNational Hydrographic SchoolCo Heaquarters Goa Naval AreaVasco-da-GamaGOA - 403 802 INDIAFax 0834 - 513419Tel 0834 - 51395051 Extn 242344347Email nhsgoabom2vsnlnetin
IOC Training Course Report No 50Annex II - page 2
B RESOURCE PERSONS
Mr Vishwas ChavanScientistCentre for Cellular and Molecular BiologyUppal RoadHYDERABAD - 500 007 INDIATel +91-40-7172241Fax +91-40-7171195Email vishwasyahoocom vishccmbarpnicin
Ir Paul GeerdersConsultant amp training on remote sensing amp data management for marine and coastal applicationsKobaltpad 16 3402 JL IJsselsteinTHE NETHERLANDSFax 31 (30) 688 49 42Email pgconswxsnl
Mr Aravind Ghosh KScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email garvindcsniorennicin garvinddaryanioorg
Prof R MahadevanScientific AdvisorNational Institute of Ocean TechnologyIIT Madras CampusMADRAS - 600 036 INDIAEmail devansamratnioternetin
Mr Peter PissierssensProgramme Specialist IODEMIMIntergovernrmental OceanographicCommission of UNESCO1 rue Miollis75732 Paris Cedex 15FRANCEFax 33 145685812Tel 33 145684046Email ppissierssensunescoorg
Mr GV ReddyScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email reddycsniorennicin reddydaryanioorg
Dr Greg ReedAustralian Oceanographic Data CentreMaritime Headquarters Wylde StPotts Point NSW 2011AUSTRALIAFax + 612 9359 3120Email gregaodcgovauTel + 612 9359 3141
Prof P SadanandanAssociate DirectorNational Centre for Software Technology6th Floor Main Tower Visvesvaraya CentreDr BR Ambedkar VeedhiBANGALORE - 560 001 INDIAEmail psncsternetinFax 286 2531
Mr JS SarupriaHead Data amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email sarujsdaryanioorg sarujscsniorennicin
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50 Page (i)
TABLE OF CONTENTS
1 INTRODUCTION 1
2 PARTICIPANTS 1
3 THE COURSE PROGRAMME 1
4 LECTURE NOTES 3
5 COURSE EVALUATION 3
6 CLOSING OF THE SESSION 4
ANNEX I AGENDA AND TIMETABLE
ANNEX II LIST OF PARTICIPANTS AND RESOURCE PERSONS
ANNEX III LECTURE NOTES1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
ANNEX IV LIST OF ACRONYMS
IOC Training Course Report No 50Page 1
1 INTRODUCTION
During the International Oceanographic Data and Information Exchange (IODE) Officers held inGoa India between 10 and 13 February 1998 the National Institute of Oceanography offered to host aregional data management training course for countries in the IOCINDIO (IOC Regional Committee forthe Central Indian Ocean ) region Responding to this kind offer the IOC was able to allocate funds forsupporting travel and accommodation for participants and international resource persons NIO offered tocover local organizational expenses and travel and accommodation expenses for local resource persons
The objectives of the Training Course were
to provide an introduction to and raise awareness for the IODE Programme to familiarize participants with IODE projects and products to provide participants with basic knowledge and experience about data management systems and their
utilization in oceanographic data metadata and information management to provide participants with basic knowledge about new technologies related to serving users with
information and data over the Internet to stimulate intra-regional collaboration in the field of oceanographic data and information
management to provide training to recently established National Oceanographic Data Centres (NODC) and
Designated National Agencies (DNA) to stimulate countries in the region to establish National Oceanographic Data Centres (NODC) or
Designated National Agencies (DNA)
The Course was also used as a second occasion to receive comments and recommendations on theIODE Resource Kit through the draft product ODINEA CD-ROM which was developed during the IOCRegional Training Course in Oceanographic Data Management for the IOCINCWIO region held inMombasa Kenya (1-11December 1997) On the basis of the collected comments and recommendation acomprehensive training tool will be developed to be used during (and after) IODE training courses toensure long-term impact of IODE training activities
The Course was opened on Saturday 17 October at 0900
2 PARTICIPANTS
Eleven participants were selected from 7 countries in the Indian Ocean region (and Western Pacific)namely Bangladesh India Malaysia Mauritius Qatar Sri Lankaand Vietnam Participants were allactively involved in marine science marine services or related specialties Unfortunately the participantsfrom Pakistan and Iran were not able to participate due to late reception of their application by the IOC
A total of 12 resource persons from Australia India The Netherlands and IOC (lecturers and practicalexercise support) participated in the Course
The List of Participants and Resource Persons is provided in Annex II
3 THE COURSE PROGRAMME
The Course Programme attempted to provide an as wide possible overview of the tasks and operationsof National Oceanographic Data Centres and hereby trying to conserve a balance between theoreticallectures and practical exercises within the (short) available timeframe The Course Programme was
IOC Training Course Report No 50Page 2
developed jointly between IOC and NIO with IOC selecting the international lecturers and NIO identifyingIndian lecturers and resource persons
The following topics were covered during the Training Course
SESSION 1 THE IODE SYSTEM
lt Introduction to IODE and the IOC Regional Programmeslt The IODE institutional components and the international ocean data systemlt The IODE data flow and monitoring procedureslt IODE Data Products and Operational Projectslt Establishing a National Oceanographic Data Centre
SESSION 2 DATA METADATA AND INFORMATION MANAGEMENT
lt New technologies for data acquisition remote sensinglt Global Oceanographic Data Archeology and Rescue (GODAR)lt Marine data management at the RNODC-INDOlt The continuum data metadata and informationlt Metadata management the MEDI Pilot Projectlt Information management the IODE Marine Information Management programme
SESSION 3 DATABASE MANAGEMENT SYSTEMS
lt Advances in database management systems from relational to object-oriented and beyondlt Advances in database management systems distributed database management systemslt Numerical databases vs text-oriented databases
SESSION 4 USING RDBMS IN OCEANOGRAPHIC DATA MANAGEMENT
lt Introduction to Microsoft Accesslt Searching the database introduction to SQLlt Examples of databases and data products GEBCO GLOSS etc
SESSION 5 DATA PROCESSING AND PRODUCT DEVELOPMENT
lt Oceanographic Data Exchange formatslt Quality Control Procedureslt Data Processing and statisticslt Data product development tools GIS
SESSION 6 IODE AND THE INTERNET
lt Introduction to the Internetlt Serving information to users over the WWWlt Serving numerical databases to users over the WWWlt Serving textualfactual information databases over the WWW
SESSION 7 SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT
lt The IODE Resource Kit
IOC Training Course Report No 50Page 3
lt The IODC NIO CDROMlt The IODE XBT quality control software
A detailed timetable of the course is added as Annex I
4 LECTURE NOTES
In order to provide a clear overview of the wide variety and scope of the Training Course and toprovide an opportunity to those who were not able to participate to share in the many interesting lectureswe are providing some copies (or summaries) of the lectures given during the Course in Annex III
5 COURSE EVALUATION
In order to constantly improve the quality of the IODE training courses participants were requestedto evaluate the lectures in terms of
- the relevance of the lecture to the course objectives- the clarity of the presentation- the quality of the presentation
The most appreciated lectures (gt= 810) in terms of their relevance to the course objectives were
- Introduction to IODE and the IOC Regional Programmes- The continuum data metadata and information- Practical exercise on MEDI- Practical exercise on MS Access amp Practical exercise on SQL- Oceanographic Data Exchange formats- Introduction to the Internet- Practical exercise on HTML- The IODE Resource Kit
The least appreciated lectures (lt= 410) in terms of their relevance to the course objectives were
- IODE Data Products and Operational Projects- Numerical Databases vs text-oriented databases (traditionally interest of data managers for
text-based information management is low)- Web databases (this lecture was considered too theoretical)- Demonstration INODC on INGRES DBMS (it was observed that none of the participants used
the INGRES DBMS and as such relevance was considered as small)- Data Processing and statistics (this lecture was considered too theoretical)- Demonstration ArcView at INODC- Serving numerical databases to users over the WWW (this low score was attributed to the
observation that insufficient time was spent on this subject)
Additional comments provided on the evaluation sheet and during the discussions are summarized asfollows
lt More emphasis should be put on practical exercises
IOC Training Course Report No 50Page 4
lt There were too many lectures and lecturerslt In some cases it was regretted that the presentations (slides) were of poor quality Presentations
should be of high qualitylt Presentation hand-outs should be distributed prior to the lecture so participants with language
problems can better preparelt Lecturers should use real-world exampleslt The course should include individual or group projectslt More attention should be given on how to establish an NODC or DNA with special emphasis on
minimum requirements and possibilities for institutions with minimal resources
6 CLOSING OF THE SESSION
During his closing speech Mr Peter Pissierssens on behalf of the IOC Executive Secretarythanked Dr E Desa Director of the National Institute of Oceanography Goa for the substantial supportprovided by NIO which enabled IOC to organize this course He also thanked the lecturers and otherresource persons as well as all NIO staff who had been involved in the excellent support for the trainingcourse
He noted that the IOCINDIO region was still a relatively young regional body which hadregrettably not been very active so far However he stressed that personal contacts established duringtraining courses such as this one are instrumental in generating collaboration and exchange and he invitedthe participants to share their experiences with colleagues back home
Dr JS Sarupria announced that NIO will set up a listserv to enable participants to the trainingcourse to continue communicating and to create a platform which can be used for future collaborationassistance and exchange of experience
In their closing comments on the Course the participants were all unanimous in their highappreciation for the course which they considered as a most useful contribution to their professionalactivities Several participants pledged to contact the relevant authorities in their country to promote theestablishment of a National Oceanographic Data Centre (NODC) or Designated National Agency (DNA)
Dr E Desa Director NIO invited the participants to visit NIO again and welcomed them to spendsome time at NIO
All participants were provided with a certificate of participation
The IOCIODE - NIO Training Course on Oceanographic Data and Information Exchange wasclosed on Tuesday 27 October 1998 at 11h00
IOC Training Course Report No 50Annex I - page 1
ANNEX I
AGENDA AND TIMETABLE
SATURDAY - 17 OCTOBER 19980900 - 0915 REGISTRATION 0915 - 1030 Presentation of the participants1030 - 1100 TEA BREAK
SESSION A IOCIODE SYSTEM (TRAINING HALL)1100 - 1115 Introduction to IODE amp IOC regional policy (P Pissierssens) [ paper presented duringITO98]1115 - 1200 IODE s institutional components and international ocean data system (P Geerders)1200 - 1230 IODE data flow monitoring procedures (P Geerders)1230 - 1300 IODE data products and operational projects (P Geerders)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on ROSCOP forms (Geerders)1500 - 1530 TEA BREAK1530 - 1615 Establishing an IODE NODC (G Reed)
SUNDAY - 18 OCTOBER 1998 - HOLIDAY
MONDAY - 19 OCTOBER 1998
SESSION B DATA METADATA AND INFORMATION MANAGEMENT0925 - 1020 New technology for data acquisition remote sensing data buoys etc (P Geerders)1020 - 1045 GODAR project and achievements (P Geerders)1045 - 1115 The continuum data metadata and information (G Reed)1115 1200 Metadata The MEDI pilot project (GReed)
6(6621amp26()257+(5(672)7+($lt$38amp+2$lt
TUESDAY - 20 OCTOBER 19980930 - 1000 Marine Information Management (Pissierssens)1000 - 1100 Marine data management system at RNODC-INDO (JS Sarupria)1100 - 1130 TEA BREAK1130 - 1300 PRACTICAL EXERCISE Metadata Practical exercise (G Reed) 1300 - 1400 LUNCH BREAK
SESSION C DATABASE MANAGEMENT SYSTEMS1400 - 1430 Numerical DBMS vs textual DBMS (MP Tapaswi)1430 - 1500 Advances in DBMS distributed database management systems (G Reed)1500 - 1530 TEA BREAK1530 - 1700 DBMS systems - Database directions (P Sadanandan NCST Bangalore)
IOC Training Course Report No 50Annex I - page 2
WEDNESDAY - 21 OCTOBER 1998
SESSION D USING RDBMS IN OCEANOGRAPHY0900 - 1000 Data warehousing (P Sadanandan NCST Bangalore)1000 - 1100 Web databases (P Sadanandan NCST Bangalore)
1100 - 1130 TEA BREAK
1130 - 1300 PRACTICAL EXERCISE MS Access Creating database tables Searching thedatabase (J Pattainak JS Sarupria PPissierssens)
1300 - 1400 LUNCH BREAK1400 - 1430 Demonstration to other global data sets such as GEBCO etc (PD Kunte)1430 - 1500 Introduction to global data sets and demonstration (CD-ROM - WDC-A etc) (GVReddy)1500 - 1530 TEA BREAK1530 - 1700 PRACTICAL EXERCISE MS Access self training
THURSDAY - 22 OCTOBER 1998
SESSION E DATA PROCESSING AND PRODUCT DEVELOPMENT (TRAINING HALL)0900 - 1000 Oceanographic data exchange formats (JS Sarupria)1000 - 1100 Quality control procedures (T Pankajakshan)1100 - 1130 TEA BREAK1130 - 1200 Data product development tools (GIS etc) (PD Kunte)1200 - 1300 Visit to IODC (Demonstration use of INGRES DBMS (L Ratnakaran) and ArcView GIS
(J Pattanaik))1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on MS Access amp SQL1500 - 1530 TEA BREAK1530 - 1730 PRACTICAL EXERCISE (continued)
FRIDAY - 23 OCTOBER 1998
SESSION F IODE AND THE WWW0900 - 1000 Data processing tools interpolation interpolation etc (R Mahadevan)1000 - 1045 The Internet - Introduction Evolution and Tools (A Ghosh)1045 - 1115 TEA BREAK1115 - 1145 Serving information to users over the WWW HTML (PPissierssens)1145 - 1200 Serving numerical databases over the WWW (V Chavan)1200 - 1300 Serving textualfactual database over the WWW (MP Tapaswi PPissierssens)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on HTML1500 - 1530 TEA BREAK1530 - 1630 PRACTICAL EXERCISE (continued)1630 1700 The IODC NIO CDROM Demo (PD Kunte)
SATURDAY - 24 OCTOBER 1998 - HOLIDAYSUNDAY - 25 OCTOBER 1998 - HOLIDAY
IOC Training Course Report No 50Annex I - page 3
MONDAY - 26 OCTOBER 1998
SESSION G SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT (IODC)0900 - 1100 PRACTICAL EXERCISE on format conversion (JS Sarupria)1100 - 1130 TEA BREAK1130 1230 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit)(PPissierssens)1230 - 1300 Library visit (Tapaswi)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit) continued1500 - 1530 TEA BREAK1530 - 1630 The IODE XBT quality control software demo (Pankajakshan)1630 - 1730 Evaluation of the Training course
TUESDAY - 27 OCTOBER 1998
0930 - 1100 Discussions on evaluation and receommendations1100 CLOSING CEREMONY (SEMINAR HALL)
IOC Training Course Report No 50Annex II - page 1
ANNEX II
LIST OF PARTICIPANTS AND RESOURCE PERSONS
A PARTICIPANTS
Mr Mohamed Said Al MohanadiMarine Science DepartmentUniversity of QatarPO Box 2713 DohaQATARFax (974) 892135Email alshoqeriqueduqa
Mr Thilakasiri MendisOceanography Division of NARAMattakkuliya Colombo 15SRI LANKAFax (94) 1522 932 or (94) 1522 699Email jayasirinaraaclk
Dr Trinh The HieuInstitute of Oceanography01 Canada - NhatrangVIETNAMFax (84 58) 881 152Email haiduongdngvnnvn
Ms Nasreen Islam KhanAssistant ProfessorDept of Geography amp EnvironmentDhaka University - 1000BANGLADESHFax (880 2) 86 55 83Email nasreengegduccagnicom Nasreen_ikhanyahoocom geographydubanglanet
Lt Cdr Zaharuddin MaideenHydrographic DirectorateRoyal Malaysian Navy Ministry of DefenceJalan padang Tembak 50634 Kuala LumpurMALAYSIATel 603-2313700Fax 603 2987972Email zahalintmnetmy
Mr Goonasilan SoopramaniaMauritius Meteorological ServicesVacoasMAURITIUSFax (230) 686 1033Email meteointernetmu
Cdr A BhushanNaval Hydrographic OfficePost Box No 75 107-A Rajpur RoadDEHRADUN - 248 001 INDIAFax 0091 (135) 748373
Shri MM Malleswara RaoNational Institute of OceanographyRegional Centre176 Lawsons Bay ColonyVISAKHAPATNAM - 530 017 INDIAFax 0891-543595Email mmmraokadalinioorg
Lt Cdr IN JobINS HansaGOA - 403 802 INDIAEmail simulatebom2vsnlnetinTel 0834-51 8441
Lt TP MahatoNational Hydrographic SchoolCo Heaquarters Goa Naval AreaVasco-da-GamaGOA - 403 802 INDIAFax 0834 - 513419Tel 0834 - 51395051 Extn 242344347Email nhsgoabom2vsnlnetin
IOC Training Course Report No 50Annex II - page 2
B RESOURCE PERSONS
Mr Vishwas ChavanScientistCentre for Cellular and Molecular BiologyUppal RoadHYDERABAD - 500 007 INDIATel +91-40-7172241Fax +91-40-7171195Email vishwasyahoocom vishccmbarpnicin
Ir Paul GeerdersConsultant amp training on remote sensing amp data management for marine and coastal applicationsKobaltpad 16 3402 JL IJsselsteinTHE NETHERLANDSFax 31 (30) 688 49 42Email pgconswxsnl
Mr Aravind Ghosh KScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email garvindcsniorennicin garvinddaryanioorg
Prof R MahadevanScientific AdvisorNational Institute of Ocean TechnologyIIT Madras CampusMADRAS - 600 036 INDIAEmail devansamratnioternetin
Mr Peter PissierssensProgramme Specialist IODEMIMIntergovernrmental OceanographicCommission of UNESCO1 rue Miollis75732 Paris Cedex 15FRANCEFax 33 145685812Tel 33 145684046Email ppissierssensunescoorg
Mr GV ReddyScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email reddycsniorennicin reddydaryanioorg
Dr Greg ReedAustralian Oceanographic Data CentreMaritime Headquarters Wylde StPotts Point NSW 2011AUSTRALIAFax + 612 9359 3120Email gregaodcgovauTel + 612 9359 3141
Prof P SadanandanAssociate DirectorNational Centre for Software Technology6th Floor Main Tower Visvesvaraya CentreDr BR Ambedkar VeedhiBANGALORE - 560 001 INDIAEmail psncsternetinFax 286 2531
Mr JS SarupriaHead Data amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email sarujsdaryanioorg sarujscsniorennicin
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Page 1
1 INTRODUCTION
During the International Oceanographic Data and Information Exchange (IODE) Officers held inGoa India between 10 and 13 February 1998 the National Institute of Oceanography offered to host aregional data management training course for countries in the IOCINDIO (IOC Regional Committee forthe Central Indian Ocean ) region Responding to this kind offer the IOC was able to allocate funds forsupporting travel and accommodation for participants and international resource persons NIO offered tocover local organizational expenses and travel and accommodation expenses for local resource persons
The objectives of the Training Course were
to provide an introduction to and raise awareness for the IODE Programme to familiarize participants with IODE projects and products to provide participants with basic knowledge and experience about data management systems and their
utilization in oceanographic data metadata and information management to provide participants with basic knowledge about new technologies related to serving users with
information and data over the Internet to stimulate intra-regional collaboration in the field of oceanographic data and information
management to provide training to recently established National Oceanographic Data Centres (NODC) and
Designated National Agencies (DNA) to stimulate countries in the region to establish National Oceanographic Data Centres (NODC) or
Designated National Agencies (DNA)
The Course was also used as a second occasion to receive comments and recommendations on theIODE Resource Kit through the draft product ODINEA CD-ROM which was developed during the IOCRegional Training Course in Oceanographic Data Management for the IOCINCWIO region held inMombasa Kenya (1-11December 1997) On the basis of the collected comments and recommendation acomprehensive training tool will be developed to be used during (and after) IODE training courses toensure long-term impact of IODE training activities
The Course was opened on Saturday 17 October at 0900
2 PARTICIPANTS
Eleven participants were selected from 7 countries in the Indian Ocean region (and Western Pacific)namely Bangladesh India Malaysia Mauritius Qatar Sri Lankaand Vietnam Participants were allactively involved in marine science marine services or related specialties Unfortunately the participantsfrom Pakistan and Iran were not able to participate due to late reception of their application by the IOC
A total of 12 resource persons from Australia India The Netherlands and IOC (lecturers and practicalexercise support) participated in the Course
The List of Participants and Resource Persons is provided in Annex II
3 THE COURSE PROGRAMME
The Course Programme attempted to provide an as wide possible overview of the tasks and operationsof National Oceanographic Data Centres and hereby trying to conserve a balance between theoreticallectures and practical exercises within the (short) available timeframe The Course Programme was
IOC Training Course Report No 50Page 2
developed jointly between IOC and NIO with IOC selecting the international lecturers and NIO identifyingIndian lecturers and resource persons
The following topics were covered during the Training Course
SESSION 1 THE IODE SYSTEM
lt Introduction to IODE and the IOC Regional Programmeslt The IODE institutional components and the international ocean data systemlt The IODE data flow and monitoring procedureslt IODE Data Products and Operational Projectslt Establishing a National Oceanographic Data Centre
SESSION 2 DATA METADATA AND INFORMATION MANAGEMENT
lt New technologies for data acquisition remote sensinglt Global Oceanographic Data Archeology and Rescue (GODAR)lt Marine data management at the RNODC-INDOlt The continuum data metadata and informationlt Metadata management the MEDI Pilot Projectlt Information management the IODE Marine Information Management programme
SESSION 3 DATABASE MANAGEMENT SYSTEMS
lt Advances in database management systems from relational to object-oriented and beyondlt Advances in database management systems distributed database management systemslt Numerical databases vs text-oriented databases
SESSION 4 USING RDBMS IN OCEANOGRAPHIC DATA MANAGEMENT
lt Introduction to Microsoft Accesslt Searching the database introduction to SQLlt Examples of databases and data products GEBCO GLOSS etc
SESSION 5 DATA PROCESSING AND PRODUCT DEVELOPMENT
lt Oceanographic Data Exchange formatslt Quality Control Procedureslt Data Processing and statisticslt Data product development tools GIS
SESSION 6 IODE AND THE INTERNET
lt Introduction to the Internetlt Serving information to users over the WWWlt Serving numerical databases to users over the WWWlt Serving textualfactual information databases over the WWW
SESSION 7 SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT
lt The IODE Resource Kit
IOC Training Course Report No 50Page 3
lt The IODC NIO CDROMlt The IODE XBT quality control software
A detailed timetable of the course is added as Annex I
4 LECTURE NOTES
In order to provide a clear overview of the wide variety and scope of the Training Course and toprovide an opportunity to those who were not able to participate to share in the many interesting lectureswe are providing some copies (or summaries) of the lectures given during the Course in Annex III
5 COURSE EVALUATION
In order to constantly improve the quality of the IODE training courses participants were requestedto evaluate the lectures in terms of
- the relevance of the lecture to the course objectives- the clarity of the presentation- the quality of the presentation
The most appreciated lectures (gt= 810) in terms of their relevance to the course objectives were
- Introduction to IODE and the IOC Regional Programmes- The continuum data metadata and information- Practical exercise on MEDI- Practical exercise on MS Access amp Practical exercise on SQL- Oceanographic Data Exchange formats- Introduction to the Internet- Practical exercise on HTML- The IODE Resource Kit
The least appreciated lectures (lt= 410) in terms of their relevance to the course objectives were
- IODE Data Products and Operational Projects- Numerical Databases vs text-oriented databases (traditionally interest of data managers for
text-based information management is low)- Web databases (this lecture was considered too theoretical)- Demonstration INODC on INGRES DBMS (it was observed that none of the participants used
the INGRES DBMS and as such relevance was considered as small)- Data Processing and statistics (this lecture was considered too theoretical)- Demonstration ArcView at INODC- Serving numerical databases to users over the WWW (this low score was attributed to the
observation that insufficient time was spent on this subject)
Additional comments provided on the evaluation sheet and during the discussions are summarized asfollows
lt More emphasis should be put on practical exercises
IOC Training Course Report No 50Page 4
lt There were too many lectures and lecturerslt In some cases it was regretted that the presentations (slides) were of poor quality Presentations
should be of high qualitylt Presentation hand-outs should be distributed prior to the lecture so participants with language
problems can better preparelt Lecturers should use real-world exampleslt The course should include individual or group projectslt More attention should be given on how to establish an NODC or DNA with special emphasis on
minimum requirements and possibilities for institutions with minimal resources
6 CLOSING OF THE SESSION
During his closing speech Mr Peter Pissierssens on behalf of the IOC Executive Secretarythanked Dr E Desa Director of the National Institute of Oceanography Goa for the substantial supportprovided by NIO which enabled IOC to organize this course He also thanked the lecturers and otherresource persons as well as all NIO staff who had been involved in the excellent support for the trainingcourse
He noted that the IOCINDIO region was still a relatively young regional body which hadregrettably not been very active so far However he stressed that personal contacts established duringtraining courses such as this one are instrumental in generating collaboration and exchange and he invitedthe participants to share their experiences with colleagues back home
Dr JS Sarupria announced that NIO will set up a listserv to enable participants to the trainingcourse to continue communicating and to create a platform which can be used for future collaborationassistance and exchange of experience
In their closing comments on the Course the participants were all unanimous in their highappreciation for the course which they considered as a most useful contribution to their professionalactivities Several participants pledged to contact the relevant authorities in their country to promote theestablishment of a National Oceanographic Data Centre (NODC) or Designated National Agency (DNA)
Dr E Desa Director NIO invited the participants to visit NIO again and welcomed them to spendsome time at NIO
All participants were provided with a certificate of participation
The IOCIODE - NIO Training Course on Oceanographic Data and Information Exchange wasclosed on Tuesday 27 October 1998 at 11h00
IOC Training Course Report No 50Annex I - page 1
ANNEX I
AGENDA AND TIMETABLE
SATURDAY - 17 OCTOBER 19980900 - 0915 REGISTRATION 0915 - 1030 Presentation of the participants1030 - 1100 TEA BREAK
SESSION A IOCIODE SYSTEM (TRAINING HALL)1100 - 1115 Introduction to IODE amp IOC regional policy (P Pissierssens) [ paper presented duringITO98]1115 - 1200 IODE s institutional components and international ocean data system (P Geerders)1200 - 1230 IODE data flow monitoring procedures (P Geerders)1230 - 1300 IODE data products and operational projects (P Geerders)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on ROSCOP forms (Geerders)1500 - 1530 TEA BREAK1530 - 1615 Establishing an IODE NODC (G Reed)
SUNDAY - 18 OCTOBER 1998 - HOLIDAY
MONDAY - 19 OCTOBER 1998
SESSION B DATA METADATA AND INFORMATION MANAGEMENT0925 - 1020 New technology for data acquisition remote sensing data buoys etc (P Geerders)1020 - 1045 GODAR project and achievements (P Geerders)1045 - 1115 The continuum data metadata and information (G Reed)1115 1200 Metadata The MEDI pilot project (GReed)
6(6621amp26()257+(5(672)7+($lt$38amp+2$lt
TUESDAY - 20 OCTOBER 19980930 - 1000 Marine Information Management (Pissierssens)1000 - 1100 Marine data management system at RNODC-INDO (JS Sarupria)1100 - 1130 TEA BREAK1130 - 1300 PRACTICAL EXERCISE Metadata Practical exercise (G Reed) 1300 - 1400 LUNCH BREAK
SESSION C DATABASE MANAGEMENT SYSTEMS1400 - 1430 Numerical DBMS vs textual DBMS (MP Tapaswi)1430 - 1500 Advances in DBMS distributed database management systems (G Reed)1500 - 1530 TEA BREAK1530 - 1700 DBMS systems - Database directions (P Sadanandan NCST Bangalore)
IOC Training Course Report No 50Annex I - page 2
WEDNESDAY - 21 OCTOBER 1998
SESSION D USING RDBMS IN OCEANOGRAPHY0900 - 1000 Data warehousing (P Sadanandan NCST Bangalore)1000 - 1100 Web databases (P Sadanandan NCST Bangalore)
1100 - 1130 TEA BREAK
1130 - 1300 PRACTICAL EXERCISE MS Access Creating database tables Searching thedatabase (J Pattainak JS Sarupria PPissierssens)
1300 - 1400 LUNCH BREAK1400 - 1430 Demonstration to other global data sets such as GEBCO etc (PD Kunte)1430 - 1500 Introduction to global data sets and demonstration (CD-ROM - WDC-A etc) (GVReddy)1500 - 1530 TEA BREAK1530 - 1700 PRACTICAL EXERCISE MS Access self training
THURSDAY - 22 OCTOBER 1998
SESSION E DATA PROCESSING AND PRODUCT DEVELOPMENT (TRAINING HALL)0900 - 1000 Oceanographic data exchange formats (JS Sarupria)1000 - 1100 Quality control procedures (T Pankajakshan)1100 - 1130 TEA BREAK1130 - 1200 Data product development tools (GIS etc) (PD Kunte)1200 - 1300 Visit to IODC (Demonstration use of INGRES DBMS (L Ratnakaran) and ArcView GIS
(J Pattanaik))1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on MS Access amp SQL1500 - 1530 TEA BREAK1530 - 1730 PRACTICAL EXERCISE (continued)
FRIDAY - 23 OCTOBER 1998
SESSION F IODE AND THE WWW0900 - 1000 Data processing tools interpolation interpolation etc (R Mahadevan)1000 - 1045 The Internet - Introduction Evolution and Tools (A Ghosh)1045 - 1115 TEA BREAK1115 - 1145 Serving information to users over the WWW HTML (PPissierssens)1145 - 1200 Serving numerical databases over the WWW (V Chavan)1200 - 1300 Serving textualfactual database over the WWW (MP Tapaswi PPissierssens)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on HTML1500 - 1530 TEA BREAK1530 - 1630 PRACTICAL EXERCISE (continued)1630 1700 The IODC NIO CDROM Demo (PD Kunte)
SATURDAY - 24 OCTOBER 1998 - HOLIDAYSUNDAY - 25 OCTOBER 1998 - HOLIDAY
IOC Training Course Report No 50Annex I - page 3
MONDAY - 26 OCTOBER 1998
SESSION G SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT (IODC)0900 - 1100 PRACTICAL EXERCISE on format conversion (JS Sarupria)1100 - 1130 TEA BREAK1130 1230 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit)(PPissierssens)1230 - 1300 Library visit (Tapaswi)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit) continued1500 - 1530 TEA BREAK1530 - 1630 The IODE XBT quality control software demo (Pankajakshan)1630 - 1730 Evaluation of the Training course
TUESDAY - 27 OCTOBER 1998
0930 - 1100 Discussions on evaluation and receommendations1100 CLOSING CEREMONY (SEMINAR HALL)
IOC Training Course Report No 50Annex II - page 1
ANNEX II
LIST OF PARTICIPANTS AND RESOURCE PERSONS
A PARTICIPANTS
Mr Mohamed Said Al MohanadiMarine Science DepartmentUniversity of QatarPO Box 2713 DohaQATARFax (974) 892135Email alshoqeriqueduqa
Mr Thilakasiri MendisOceanography Division of NARAMattakkuliya Colombo 15SRI LANKAFax (94) 1522 932 or (94) 1522 699Email jayasirinaraaclk
Dr Trinh The HieuInstitute of Oceanography01 Canada - NhatrangVIETNAMFax (84 58) 881 152Email haiduongdngvnnvn
Ms Nasreen Islam KhanAssistant ProfessorDept of Geography amp EnvironmentDhaka University - 1000BANGLADESHFax (880 2) 86 55 83Email nasreengegduccagnicom Nasreen_ikhanyahoocom geographydubanglanet
Lt Cdr Zaharuddin MaideenHydrographic DirectorateRoyal Malaysian Navy Ministry of DefenceJalan padang Tembak 50634 Kuala LumpurMALAYSIATel 603-2313700Fax 603 2987972Email zahalintmnetmy
Mr Goonasilan SoopramaniaMauritius Meteorological ServicesVacoasMAURITIUSFax (230) 686 1033Email meteointernetmu
Cdr A BhushanNaval Hydrographic OfficePost Box No 75 107-A Rajpur RoadDEHRADUN - 248 001 INDIAFax 0091 (135) 748373
Shri MM Malleswara RaoNational Institute of OceanographyRegional Centre176 Lawsons Bay ColonyVISAKHAPATNAM - 530 017 INDIAFax 0891-543595Email mmmraokadalinioorg
Lt Cdr IN JobINS HansaGOA - 403 802 INDIAEmail simulatebom2vsnlnetinTel 0834-51 8441
Lt TP MahatoNational Hydrographic SchoolCo Heaquarters Goa Naval AreaVasco-da-GamaGOA - 403 802 INDIAFax 0834 - 513419Tel 0834 - 51395051 Extn 242344347Email nhsgoabom2vsnlnetin
IOC Training Course Report No 50Annex II - page 2
B RESOURCE PERSONS
Mr Vishwas ChavanScientistCentre for Cellular and Molecular BiologyUppal RoadHYDERABAD - 500 007 INDIATel +91-40-7172241Fax +91-40-7171195Email vishwasyahoocom vishccmbarpnicin
Ir Paul GeerdersConsultant amp training on remote sensing amp data management for marine and coastal applicationsKobaltpad 16 3402 JL IJsselsteinTHE NETHERLANDSFax 31 (30) 688 49 42Email pgconswxsnl
Mr Aravind Ghosh KScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email garvindcsniorennicin garvinddaryanioorg
Prof R MahadevanScientific AdvisorNational Institute of Ocean TechnologyIIT Madras CampusMADRAS - 600 036 INDIAEmail devansamratnioternetin
Mr Peter PissierssensProgramme Specialist IODEMIMIntergovernrmental OceanographicCommission of UNESCO1 rue Miollis75732 Paris Cedex 15FRANCEFax 33 145685812Tel 33 145684046Email ppissierssensunescoorg
Mr GV ReddyScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email reddycsniorennicin reddydaryanioorg
Dr Greg ReedAustralian Oceanographic Data CentreMaritime Headquarters Wylde StPotts Point NSW 2011AUSTRALIAFax + 612 9359 3120Email gregaodcgovauTel + 612 9359 3141
Prof P SadanandanAssociate DirectorNational Centre for Software Technology6th Floor Main Tower Visvesvaraya CentreDr BR Ambedkar VeedhiBANGALORE - 560 001 INDIAEmail psncsternetinFax 286 2531
Mr JS SarupriaHead Data amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email sarujsdaryanioorg sarujscsniorennicin
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Page 2
developed jointly between IOC and NIO with IOC selecting the international lecturers and NIO identifyingIndian lecturers and resource persons
The following topics were covered during the Training Course
SESSION 1 THE IODE SYSTEM
lt Introduction to IODE and the IOC Regional Programmeslt The IODE institutional components and the international ocean data systemlt The IODE data flow and monitoring procedureslt IODE Data Products and Operational Projectslt Establishing a National Oceanographic Data Centre
SESSION 2 DATA METADATA AND INFORMATION MANAGEMENT
lt New technologies for data acquisition remote sensinglt Global Oceanographic Data Archeology and Rescue (GODAR)lt Marine data management at the RNODC-INDOlt The continuum data metadata and informationlt Metadata management the MEDI Pilot Projectlt Information management the IODE Marine Information Management programme
SESSION 3 DATABASE MANAGEMENT SYSTEMS
lt Advances in database management systems from relational to object-oriented and beyondlt Advances in database management systems distributed database management systemslt Numerical databases vs text-oriented databases
SESSION 4 USING RDBMS IN OCEANOGRAPHIC DATA MANAGEMENT
lt Introduction to Microsoft Accesslt Searching the database introduction to SQLlt Examples of databases and data products GEBCO GLOSS etc
SESSION 5 DATA PROCESSING AND PRODUCT DEVELOPMENT
lt Oceanographic Data Exchange formatslt Quality Control Procedureslt Data Processing and statisticslt Data product development tools GIS
SESSION 6 IODE AND THE INTERNET
lt Introduction to the Internetlt Serving information to users over the WWWlt Serving numerical databases to users over the WWWlt Serving textualfactual information databases over the WWW
SESSION 7 SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT
lt The IODE Resource Kit
IOC Training Course Report No 50Page 3
lt The IODC NIO CDROMlt The IODE XBT quality control software
A detailed timetable of the course is added as Annex I
4 LECTURE NOTES
In order to provide a clear overview of the wide variety and scope of the Training Course and toprovide an opportunity to those who were not able to participate to share in the many interesting lectureswe are providing some copies (or summaries) of the lectures given during the Course in Annex III
5 COURSE EVALUATION
In order to constantly improve the quality of the IODE training courses participants were requestedto evaluate the lectures in terms of
- the relevance of the lecture to the course objectives- the clarity of the presentation- the quality of the presentation
The most appreciated lectures (gt= 810) in terms of their relevance to the course objectives were
- Introduction to IODE and the IOC Regional Programmes- The continuum data metadata and information- Practical exercise on MEDI- Practical exercise on MS Access amp Practical exercise on SQL- Oceanographic Data Exchange formats- Introduction to the Internet- Practical exercise on HTML- The IODE Resource Kit
The least appreciated lectures (lt= 410) in terms of their relevance to the course objectives were
- IODE Data Products and Operational Projects- Numerical Databases vs text-oriented databases (traditionally interest of data managers for
text-based information management is low)- Web databases (this lecture was considered too theoretical)- Demonstration INODC on INGRES DBMS (it was observed that none of the participants used
the INGRES DBMS and as such relevance was considered as small)- Data Processing and statistics (this lecture was considered too theoretical)- Demonstration ArcView at INODC- Serving numerical databases to users over the WWW (this low score was attributed to the
observation that insufficient time was spent on this subject)
Additional comments provided on the evaluation sheet and during the discussions are summarized asfollows
lt More emphasis should be put on practical exercises
IOC Training Course Report No 50Page 4
lt There were too many lectures and lecturerslt In some cases it was regretted that the presentations (slides) were of poor quality Presentations
should be of high qualitylt Presentation hand-outs should be distributed prior to the lecture so participants with language
problems can better preparelt Lecturers should use real-world exampleslt The course should include individual or group projectslt More attention should be given on how to establish an NODC or DNA with special emphasis on
minimum requirements and possibilities for institutions with minimal resources
6 CLOSING OF THE SESSION
During his closing speech Mr Peter Pissierssens on behalf of the IOC Executive Secretarythanked Dr E Desa Director of the National Institute of Oceanography Goa for the substantial supportprovided by NIO which enabled IOC to organize this course He also thanked the lecturers and otherresource persons as well as all NIO staff who had been involved in the excellent support for the trainingcourse
He noted that the IOCINDIO region was still a relatively young regional body which hadregrettably not been very active so far However he stressed that personal contacts established duringtraining courses such as this one are instrumental in generating collaboration and exchange and he invitedthe participants to share their experiences with colleagues back home
Dr JS Sarupria announced that NIO will set up a listserv to enable participants to the trainingcourse to continue communicating and to create a platform which can be used for future collaborationassistance and exchange of experience
In their closing comments on the Course the participants were all unanimous in their highappreciation for the course which they considered as a most useful contribution to their professionalactivities Several participants pledged to contact the relevant authorities in their country to promote theestablishment of a National Oceanographic Data Centre (NODC) or Designated National Agency (DNA)
Dr E Desa Director NIO invited the participants to visit NIO again and welcomed them to spendsome time at NIO
All participants were provided with a certificate of participation
The IOCIODE - NIO Training Course on Oceanographic Data and Information Exchange wasclosed on Tuesday 27 October 1998 at 11h00
IOC Training Course Report No 50Annex I - page 1
ANNEX I
AGENDA AND TIMETABLE
SATURDAY - 17 OCTOBER 19980900 - 0915 REGISTRATION 0915 - 1030 Presentation of the participants1030 - 1100 TEA BREAK
SESSION A IOCIODE SYSTEM (TRAINING HALL)1100 - 1115 Introduction to IODE amp IOC regional policy (P Pissierssens) [ paper presented duringITO98]1115 - 1200 IODE s institutional components and international ocean data system (P Geerders)1200 - 1230 IODE data flow monitoring procedures (P Geerders)1230 - 1300 IODE data products and operational projects (P Geerders)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on ROSCOP forms (Geerders)1500 - 1530 TEA BREAK1530 - 1615 Establishing an IODE NODC (G Reed)
SUNDAY - 18 OCTOBER 1998 - HOLIDAY
MONDAY - 19 OCTOBER 1998
SESSION B DATA METADATA AND INFORMATION MANAGEMENT0925 - 1020 New technology for data acquisition remote sensing data buoys etc (P Geerders)1020 - 1045 GODAR project and achievements (P Geerders)1045 - 1115 The continuum data metadata and information (G Reed)1115 1200 Metadata The MEDI pilot project (GReed)
6(6621amp26()257+(5(672)7+($lt$38amp+2$lt
TUESDAY - 20 OCTOBER 19980930 - 1000 Marine Information Management (Pissierssens)1000 - 1100 Marine data management system at RNODC-INDO (JS Sarupria)1100 - 1130 TEA BREAK1130 - 1300 PRACTICAL EXERCISE Metadata Practical exercise (G Reed) 1300 - 1400 LUNCH BREAK
SESSION C DATABASE MANAGEMENT SYSTEMS1400 - 1430 Numerical DBMS vs textual DBMS (MP Tapaswi)1430 - 1500 Advances in DBMS distributed database management systems (G Reed)1500 - 1530 TEA BREAK1530 - 1700 DBMS systems - Database directions (P Sadanandan NCST Bangalore)
IOC Training Course Report No 50Annex I - page 2
WEDNESDAY - 21 OCTOBER 1998
SESSION D USING RDBMS IN OCEANOGRAPHY0900 - 1000 Data warehousing (P Sadanandan NCST Bangalore)1000 - 1100 Web databases (P Sadanandan NCST Bangalore)
1100 - 1130 TEA BREAK
1130 - 1300 PRACTICAL EXERCISE MS Access Creating database tables Searching thedatabase (J Pattainak JS Sarupria PPissierssens)
1300 - 1400 LUNCH BREAK1400 - 1430 Demonstration to other global data sets such as GEBCO etc (PD Kunte)1430 - 1500 Introduction to global data sets and demonstration (CD-ROM - WDC-A etc) (GVReddy)1500 - 1530 TEA BREAK1530 - 1700 PRACTICAL EXERCISE MS Access self training
THURSDAY - 22 OCTOBER 1998
SESSION E DATA PROCESSING AND PRODUCT DEVELOPMENT (TRAINING HALL)0900 - 1000 Oceanographic data exchange formats (JS Sarupria)1000 - 1100 Quality control procedures (T Pankajakshan)1100 - 1130 TEA BREAK1130 - 1200 Data product development tools (GIS etc) (PD Kunte)1200 - 1300 Visit to IODC (Demonstration use of INGRES DBMS (L Ratnakaran) and ArcView GIS
(J Pattanaik))1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on MS Access amp SQL1500 - 1530 TEA BREAK1530 - 1730 PRACTICAL EXERCISE (continued)
FRIDAY - 23 OCTOBER 1998
SESSION F IODE AND THE WWW0900 - 1000 Data processing tools interpolation interpolation etc (R Mahadevan)1000 - 1045 The Internet - Introduction Evolution and Tools (A Ghosh)1045 - 1115 TEA BREAK1115 - 1145 Serving information to users over the WWW HTML (PPissierssens)1145 - 1200 Serving numerical databases over the WWW (V Chavan)1200 - 1300 Serving textualfactual database over the WWW (MP Tapaswi PPissierssens)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on HTML1500 - 1530 TEA BREAK1530 - 1630 PRACTICAL EXERCISE (continued)1630 1700 The IODC NIO CDROM Demo (PD Kunte)
SATURDAY - 24 OCTOBER 1998 - HOLIDAYSUNDAY - 25 OCTOBER 1998 - HOLIDAY
IOC Training Course Report No 50Annex I - page 3
MONDAY - 26 OCTOBER 1998
SESSION G SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT (IODC)0900 - 1100 PRACTICAL EXERCISE on format conversion (JS Sarupria)1100 - 1130 TEA BREAK1130 1230 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit)(PPissierssens)1230 - 1300 Library visit (Tapaswi)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit) continued1500 - 1530 TEA BREAK1530 - 1630 The IODE XBT quality control software demo (Pankajakshan)1630 - 1730 Evaluation of the Training course
TUESDAY - 27 OCTOBER 1998
0930 - 1100 Discussions on evaluation and receommendations1100 CLOSING CEREMONY (SEMINAR HALL)
IOC Training Course Report No 50Annex II - page 1
ANNEX II
LIST OF PARTICIPANTS AND RESOURCE PERSONS
A PARTICIPANTS
Mr Mohamed Said Al MohanadiMarine Science DepartmentUniversity of QatarPO Box 2713 DohaQATARFax (974) 892135Email alshoqeriqueduqa
Mr Thilakasiri MendisOceanography Division of NARAMattakkuliya Colombo 15SRI LANKAFax (94) 1522 932 or (94) 1522 699Email jayasirinaraaclk
Dr Trinh The HieuInstitute of Oceanography01 Canada - NhatrangVIETNAMFax (84 58) 881 152Email haiduongdngvnnvn
Ms Nasreen Islam KhanAssistant ProfessorDept of Geography amp EnvironmentDhaka University - 1000BANGLADESHFax (880 2) 86 55 83Email nasreengegduccagnicom Nasreen_ikhanyahoocom geographydubanglanet
Lt Cdr Zaharuddin MaideenHydrographic DirectorateRoyal Malaysian Navy Ministry of DefenceJalan padang Tembak 50634 Kuala LumpurMALAYSIATel 603-2313700Fax 603 2987972Email zahalintmnetmy
Mr Goonasilan SoopramaniaMauritius Meteorological ServicesVacoasMAURITIUSFax (230) 686 1033Email meteointernetmu
Cdr A BhushanNaval Hydrographic OfficePost Box No 75 107-A Rajpur RoadDEHRADUN - 248 001 INDIAFax 0091 (135) 748373
Shri MM Malleswara RaoNational Institute of OceanographyRegional Centre176 Lawsons Bay ColonyVISAKHAPATNAM - 530 017 INDIAFax 0891-543595Email mmmraokadalinioorg
Lt Cdr IN JobINS HansaGOA - 403 802 INDIAEmail simulatebom2vsnlnetinTel 0834-51 8441
Lt TP MahatoNational Hydrographic SchoolCo Heaquarters Goa Naval AreaVasco-da-GamaGOA - 403 802 INDIAFax 0834 - 513419Tel 0834 - 51395051 Extn 242344347Email nhsgoabom2vsnlnetin
IOC Training Course Report No 50Annex II - page 2
B RESOURCE PERSONS
Mr Vishwas ChavanScientistCentre for Cellular and Molecular BiologyUppal RoadHYDERABAD - 500 007 INDIATel +91-40-7172241Fax +91-40-7171195Email vishwasyahoocom vishccmbarpnicin
Ir Paul GeerdersConsultant amp training on remote sensing amp data management for marine and coastal applicationsKobaltpad 16 3402 JL IJsselsteinTHE NETHERLANDSFax 31 (30) 688 49 42Email pgconswxsnl
Mr Aravind Ghosh KScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email garvindcsniorennicin garvinddaryanioorg
Prof R MahadevanScientific AdvisorNational Institute of Ocean TechnologyIIT Madras CampusMADRAS - 600 036 INDIAEmail devansamratnioternetin
Mr Peter PissierssensProgramme Specialist IODEMIMIntergovernrmental OceanographicCommission of UNESCO1 rue Miollis75732 Paris Cedex 15FRANCEFax 33 145685812Tel 33 145684046Email ppissierssensunescoorg
Mr GV ReddyScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email reddycsniorennicin reddydaryanioorg
Dr Greg ReedAustralian Oceanographic Data CentreMaritime Headquarters Wylde StPotts Point NSW 2011AUSTRALIAFax + 612 9359 3120Email gregaodcgovauTel + 612 9359 3141
Prof P SadanandanAssociate DirectorNational Centre for Software Technology6th Floor Main Tower Visvesvaraya CentreDr BR Ambedkar VeedhiBANGALORE - 560 001 INDIAEmail psncsternetinFax 286 2531
Mr JS SarupriaHead Data amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email sarujsdaryanioorg sarujscsniorennicin
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Page 3
lt The IODC NIO CDROMlt The IODE XBT quality control software
A detailed timetable of the course is added as Annex I
4 LECTURE NOTES
In order to provide a clear overview of the wide variety and scope of the Training Course and toprovide an opportunity to those who were not able to participate to share in the many interesting lectureswe are providing some copies (or summaries) of the lectures given during the Course in Annex III
5 COURSE EVALUATION
In order to constantly improve the quality of the IODE training courses participants were requestedto evaluate the lectures in terms of
- the relevance of the lecture to the course objectives- the clarity of the presentation- the quality of the presentation
The most appreciated lectures (gt= 810) in terms of their relevance to the course objectives were
- Introduction to IODE and the IOC Regional Programmes- The continuum data metadata and information- Practical exercise on MEDI- Practical exercise on MS Access amp Practical exercise on SQL- Oceanographic Data Exchange formats- Introduction to the Internet- Practical exercise on HTML- The IODE Resource Kit
The least appreciated lectures (lt= 410) in terms of their relevance to the course objectives were
- IODE Data Products and Operational Projects- Numerical Databases vs text-oriented databases (traditionally interest of data managers for
text-based information management is low)- Web databases (this lecture was considered too theoretical)- Demonstration INODC on INGRES DBMS (it was observed that none of the participants used
the INGRES DBMS and as such relevance was considered as small)- Data Processing and statistics (this lecture was considered too theoretical)- Demonstration ArcView at INODC- Serving numerical databases to users over the WWW (this low score was attributed to the
observation that insufficient time was spent on this subject)
Additional comments provided on the evaluation sheet and during the discussions are summarized asfollows
lt More emphasis should be put on practical exercises
IOC Training Course Report No 50Page 4
lt There were too many lectures and lecturerslt In some cases it was regretted that the presentations (slides) were of poor quality Presentations
should be of high qualitylt Presentation hand-outs should be distributed prior to the lecture so participants with language
problems can better preparelt Lecturers should use real-world exampleslt The course should include individual or group projectslt More attention should be given on how to establish an NODC or DNA with special emphasis on
minimum requirements and possibilities for institutions with minimal resources
6 CLOSING OF THE SESSION
During his closing speech Mr Peter Pissierssens on behalf of the IOC Executive Secretarythanked Dr E Desa Director of the National Institute of Oceanography Goa for the substantial supportprovided by NIO which enabled IOC to organize this course He also thanked the lecturers and otherresource persons as well as all NIO staff who had been involved in the excellent support for the trainingcourse
He noted that the IOCINDIO region was still a relatively young regional body which hadregrettably not been very active so far However he stressed that personal contacts established duringtraining courses such as this one are instrumental in generating collaboration and exchange and he invitedthe participants to share their experiences with colleagues back home
Dr JS Sarupria announced that NIO will set up a listserv to enable participants to the trainingcourse to continue communicating and to create a platform which can be used for future collaborationassistance and exchange of experience
In their closing comments on the Course the participants were all unanimous in their highappreciation for the course which they considered as a most useful contribution to their professionalactivities Several participants pledged to contact the relevant authorities in their country to promote theestablishment of a National Oceanographic Data Centre (NODC) or Designated National Agency (DNA)
Dr E Desa Director NIO invited the participants to visit NIO again and welcomed them to spendsome time at NIO
All participants were provided with a certificate of participation
The IOCIODE - NIO Training Course on Oceanographic Data and Information Exchange wasclosed on Tuesday 27 October 1998 at 11h00
IOC Training Course Report No 50Annex I - page 1
ANNEX I
AGENDA AND TIMETABLE
SATURDAY - 17 OCTOBER 19980900 - 0915 REGISTRATION 0915 - 1030 Presentation of the participants1030 - 1100 TEA BREAK
SESSION A IOCIODE SYSTEM (TRAINING HALL)1100 - 1115 Introduction to IODE amp IOC regional policy (P Pissierssens) [ paper presented duringITO98]1115 - 1200 IODE s institutional components and international ocean data system (P Geerders)1200 - 1230 IODE data flow monitoring procedures (P Geerders)1230 - 1300 IODE data products and operational projects (P Geerders)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on ROSCOP forms (Geerders)1500 - 1530 TEA BREAK1530 - 1615 Establishing an IODE NODC (G Reed)
SUNDAY - 18 OCTOBER 1998 - HOLIDAY
MONDAY - 19 OCTOBER 1998
SESSION B DATA METADATA AND INFORMATION MANAGEMENT0925 - 1020 New technology for data acquisition remote sensing data buoys etc (P Geerders)1020 - 1045 GODAR project and achievements (P Geerders)1045 - 1115 The continuum data metadata and information (G Reed)1115 1200 Metadata The MEDI pilot project (GReed)
6(6621amp26()257+(5(672)7+($lt$38amp+2$lt
TUESDAY - 20 OCTOBER 19980930 - 1000 Marine Information Management (Pissierssens)1000 - 1100 Marine data management system at RNODC-INDO (JS Sarupria)1100 - 1130 TEA BREAK1130 - 1300 PRACTICAL EXERCISE Metadata Practical exercise (G Reed) 1300 - 1400 LUNCH BREAK
SESSION C DATABASE MANAGEMENT SYSTEMS1400 - 1430 Numerical DBMS vs textual DBMS (MP Tapaswi)1430 - 1500 Advances in DBMS distributed database management systems (G Reed)1500 - 1530 TEA BREAK1530 - 1700 DBMS systems - Database directions (P Sadanandan NCST Bangalore)
IOC Training Course Report No 50Annex I - page 2
WEDNESDAY - 21 OCTOBER 1998
SESSION D USING RDBMS IN OCEANOGRAPHY0900 - 1000 Data warehousing (P Sadanandan NCST Bangalore)1000 - 1100 Web databases (P Sadanandan NCST Bangalore)
1100 - 1130 TEA BREAK
1130 - 1300 PRACTICAL EXERCISE MS Access Creating database tables Searching thedatabase (J Pattainak JS Sarupria PPissierssens)
1300 - 1400 LUNCH BREAK1400 - 1430 Demonstration to other global data sets such as GEBCO etc (PD Kunte)1430 - 1500 Introduction to global data sets and demonstration (CD-ROM - WDC-A etc) (GVReddy)1500 - 1530 TEA BREAK1530 - 1700 PRACTICAL EXERCISE MS Access self training
THURSDAY - 22 OCTOBER 1998
SESSION E DATA PROCESSING AND PRODUCT DEVELOPMENT (TRAINING HALL)0900 - 1000 Oceanographic data exchange formats (JS Sarupria)1000 - 1100 Quality control procedures (T Pankajakshan)1100 - 1130 TEA BREAK1130 - 1200 Data product development tools (GIS etc) (PD Kunte)1200 - 1300 Visit to IODC (Demonstration use of INGRES DBMS (L Ratnakaran) and ArcView GIS
(J Pattanaik))1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on MS Access amp SQL1500 - 1530 TEA BREAK1530 - 1730 PRACTICAL EXERCISE (continued)
FRIDAY - 23 OCTOBER 1998
SESSION F IODE AND THE WWW0900 - 1000 Data processing tools interpolation interpolation etc (R Mahadevan)1000 - 1045 The Internet - Introduction Evolution and Tools (A Ghosh)1045 - 1115 TEA BREAK1115 - 1145 Serving information to users over the WWW HTML (PPissierssens)1145 - 1200 Serving numerical databases over the WWW (V Chavan)1200 - 1300 Serving textualfactual database over the WWW (MP Tapaswi PPissierssens)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on HTML1500 - 1530 TEA BREAK1530 - 1630 PRACTICAL EXERCISE (continued)1630 1700 The IODC NIO CDROM Demo (PD Kunte)
SATURDAY - 24 OCTOBER 1998 - HOLIDAYSUNDAY - 25 OCTOBER 1998 - HOLIDAY
IOC Training Course Report No 50Annex I - page 3
MONDAY - 26 OCTOBER 1998
SESSION G SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT (IODC)0900 - 1100 PRACTICAL EXERCISE on format conversion (JS Sarupria)1100 - 1130 TEA BREAK1130 1230 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit)(PPissierssens)1230 - 1300 Library visit (Tapaswi)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit) continued1500 - 1530 TEA BREAK1530 - 1630 The IODE XBT quality control software demo (Pankajakshan)1630 - 1730 Evaluation of the Training course
TUESDAY - 27 OCTOBER 1998
0930 - 1100 Discussions on evaluation and receommendations1100 CLOSING CEREMONY (SEMINAR HALL)
IOC Training Course Report No 50Annex II - page 1
ANNEX II
LIST OF PARTICIPANTS AND RESOURCE PERSONS
A PARTICIPANTS
Mr Mohamed Said Al MohanadiMarine Science DepartmentUniversity of QatarPO Box 2713 DohaQATARFax (974) 892135Email alshoqeriqueduqa
Mr Thilakasiri MendisOceanography Division of NARAMattakkuliya Colombo 15SRI LANKAFax (94) 1522 932 or (94) 1522 699Email jayasirinaraaclk
Dr Trinh The HieuInstitute of Oceanography01 Canada - NhatrangVIETNAMFax (84 58) 881 152Email haiduongdngvnnvn
Ms Nasreen Islam KhanAssistant ProfessorDept of Geography amp EnvironmentDhaka University - 1000BANGLADESHFax (880 2) 86 55 83Email nasreengegduccagnicom Nasreen_ikhanyahoocom geographydubanglanet
Lt Cdr Zaharuddin MaideenHydrographic DirectorateRoyal Malaysian Navy Ministry of DefenceJalan padang Tembak 50634 Kuala LumpurMALAYSIATel 603-2313700Fax 603 2987972Email zahalintmnetmy
Mr Goonasilan SoopramaniaMauritius Meteorological ServicesVacoasMAURITIUSFax (230) 686 1033Email meteointernetmu
Cdr A BhushanNaval Hydrographic OfficePost Box No 75 107-A Rajpur RoadDEHRADUN - 248 001 INDIAFax 0091 (135) 748373
Shri MM Malleswara RaoNational Institute of OceanographyRegional Centre176 Lawsons Bay ColonyVISAKHAPATNAM - 530 017 INDIAFax 0891-543595Email mmmraokadalinioorg
Lt Cdr IN JobINS HansaGOA - 403 802 INDIAEmail simulatebom2vsnlnetinTel 0834-51 8441
Lt TP MahatoNational Hydrographic SchoolCo Heaquarters Goa Naval AreaVasco-da-GamaGOA - 403 802 INDIAFax 0834 - 513419Tel 0834 - 51395051 Extn 242344347Email nhsgoabom2vsnlnetin
IOC Training Course Report No 50Annex II - page 2
B RESOURCE PERSONS
Mr Vishwas ChavanScientistCentre for Cellular and Molecular BiologyUppal RoadHYDERABAD - 500 007 INDIATel +91-40-7172241Fax +91-40-7171195Email vishwasyahoocom vishccmbarpnicin
Ir Paul GeerdersConsultant amp training on remote sensing amp data management for marine and coastal applicationsKobaltpad 16 3402 JL IJsselsteinTHE NETHERLANDSFax 31 (30) 688 49 42Email pgconswxsnl
Mr Aravind Ghosh KScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email garvindcsniorennicin garvinddaryanioorg
Prof R MahadevanScientific AdvisorNational Institute of Ocean TechnologyIIT Madras CampusMADRAS - 600 036 INDIAEmail devansamratnioternetin
Mr Peter PissierssensProgramme Specialist IODEMIMIntergovernrmental OceanographicCommission of UNESCO1 rue Miollis75732 Paris Cedex 15FRANCEFax 33 145685812Tel 33 145684046Email ppissierssensunescoorg
Mr GV ReddyScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email reddycsniorennicin reddydaryanioorg
Dr Greg ReedAustralian Oceanographic Data CentreMaritime Headquarters Wylde StPotts Point NSW 2011AUSTRALIAFax + 612 9359 3120Email gregaodcgovauTel + 612 9359 3141
Prof P SadanandanAssociate DirectorNational Centre for Software Technology6th Floor Main Tower Visvesvaraya CentreDr BR Ambedkar VeedhiBANGALORE - 560 001 INDIAEmail psncsternetinFax 286 2531
Mr JS SarupriaHead Data amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email sarujsdaryanioorg sarujscsniorennicin
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Page 4
lt There were too many lectures and lecturerslt In some cases it was regretted that the presentations (slides) were of poor quality Presentations
should be of high qualitylt Presentation hand-outs should be distributed prior to the lecture so participants with language
problems can better preparelt Lecturers should use real-world exampleslt The course should include individual or group projectslt More attention should be given on how to establish an NODC or DNA with special emphasis on
minimum requirements and possibilities for institutions with minimal resources
6 CLOSING OF THE SESSION
During his closing speech Mr Peter Pissierssens on behalf of the IOC Executive Secretarythanked Dr E Desa Director of the National Institute of Oceanography Goa for the substantial supportprovided by NIO which enabled IOC to organize this course He also thanked the lecturers and otherresource persons as well as all NIO staff who had been involved in the excellent support for the trainingcourse
He noted that the IOCINDIO region was still a relatively young regional body which hadregrettably not been very active so far However he stressed that personal contacts established duringtraining courses such as this one are instrumental in generating collaboration and exchange and he invitedthe participants to share their experiences with colleagues back home
Dr JS Sarupria announced that NIO will set up a listserv to enable participants to the trainingcourse to continue communicating and to create a platform which can be used for future collaborationassistance and exchange of experience
In their closing comments on the Course the participants were all unanimous in their highappreciation for the course which they considered as a most useful contribution to their professionalactivities Several participants pledged to contact the relevant authorities in their country to promote theestablishment of a National Oceanographic Data Centre (NODC) or Designated National Agency (DNA)
Dr E Desa Director NIO invited the participants to visit NIO again and welcomed them to spendsome time at NIO
All participants were provided with a certificate of participation
The IOCIODE - NIO Training Course on Oceanographic Data and Information Exchange wasclosed on Tuesday 27 October 1998 at 11h00
IOC Training Course Report No 50Annex I - page 1
ANNEX I
AGENDA AND TIMETABLE
SATURDAY - 17 OCTOBER 19980900 - 0915 REGISTRATION 0915 - 1030 Presentation of the participants1030 - 1100 TEA BREAK
SESSION A IOCIODE SYSTEM (TRAINING HALL)1100 - 1115 Introduction to IODE amp IOC regional policy (P Pissierssens) [ paper presented duringITO98]1115 - 1200 IODE s institutional components and international ocean data system (P Geerders)1200 - 1230 IODE data flow monitoring procedures (P Geerders)1230 - 1300 IODE data products and operational projects (P Geerders)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on ROSCOP forms (Geerders)1500 - 1530 TEA BREAK1530 - 1615 Establishing an IODE NODC (G Reed)
SUNDAY - 18 OCTOBER 1998 - HOLIDAY
MONDAY - 19 OCTOBER 1998
SESSION B DATA METADATA AND INFORMATION MANAGEMENT0925 - 1020 New technology for data acquisition remote sensing data buoys etc (P Geerders)1020 - 1045 GODAR project and achievements (P Geerders)1045 - 1115 The continuum data metadata and information (G Reed)1115 1200 Metadata The MEDI pilot project (GReed)
6(6621amp26()257+(5(672)7+($lt$38amp+2$lt
TUESDAY - 20 OCTOBER 19980930 - 1000 Marine Information Management (Pissierssens)1000 - 1100 Marine data management system at RNODC-INDO (JS Sarupria)1100 - 1130 TEA BREAK1130 - 1300 PRACTICAL EXERCISE Metadata Practical exercise (G Reed) 1300 - 1400 LUNCH BREAK
SESSION C DATABASE MANAGEMENT SYSTEMS1400 - 1430 Numerical DBMS vs textual DBMS (MP Tapaswi)1430 - 1500 Advances in DBMS distributed database management systems (G Reed)1500 - 1530 TEA BREAK1530 - 1700 DBMS systems - Database directions (P Sadanandan NCST Bangalore)
IOC Training Course Report No 50Annex I - page 2
WEDNESDAY - 21 OCTOBER 1998
SESSION D USING RDBMS IN OCEANOGRAPHY0900 - 1000 Data warehousing (P Sadanandan NCST Bangalore)1000 - 1100 Web databases (P Sadanandan NCST Bangalore)
1100 - 1130 TEA BREAK
1130 - 1300 PRACTICAL EXERCISE MS Access Creating database tables Searching thedatabase (J Pattainak JS Sarupria PPissierssens)
1300 - 1400 LUNCH BREAK1400 - 1430 Demonstration to other global data sets such as GEBCO etc (PD Kunte)1430 - 1500 Introduction to global data sets and demonstration (CD-ROM - WDC-A etc) (GVReddy)1500 - 1530 TEA BREAK1530 - 1700 PRACTICAL EXERCISE MS Access self training
THURSDAY - 22 OCTOBER 1998
SESSION E DATA PROCESSING AND PRODUCT DEVELOPMENT (TRAINING HALL)0900 - 1000 Oceanographic data exchange formats (JS Sarupria)1000 - 1100 Quality control procedures (T Pankajakshan)1100 - 1130 TEA BREAK1130 - 1200 Data product development tools (GIS etc) (PD Kunte)1200 - 1300 Visit to IODC (Demonstration use of INGRES DBMS (L Ratnakaran) and ArcView GIS
(J Pattanaik))1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on MS Access amp SQL1500 - 1530 TEA BREAK1530 - 1730 PRACTICAL EXERCISE (continued)
FRIDAY - 23 OCTOBER 1998
SESSION F IODE AND THE WWW0900 - 1000 Data processing tools interpolation interpolation etc (R Mahadevan)1000 - 1045 The Internet - Introduction Evolution and Tools (A Ghosh)1045 - 1115 TEA BREAK1115 - 1145 Serving information to users over the WWW HTML (PPissierssens)1145 - 1200 Serving numerical databases over the WWW (V Chavan)1200 - 1300 Serving textualfactual database over the WWW (MP Tapaswi PPissierssens)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on HTML1500 - 1530 TEA BREAK1530 - 1630 PRACTICAL EXERCISE (continued)1630 1700 The IODC NIO CDROM Demo (PD Kunte)
SATURDAY - 24 OCTOBER 1998 - HOLIDAYSUNDAY - 25 OCTOBER 1998 - HOLIDAY
IOC Training Course Report No 50Annex I - page 3
MONDAY - 26 OCTOBER 1998
SESSION G SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT (IODC)0900 - 1100 PRACTICAL EXERCISE on format conversion (JS Sarupria)1100 - 1130 TEA BREAK1130 1230 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit)(PPissierssens)1230 - 1300 Library visit (Tapaswi)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit) continued1500 - 1530 TEA BREAK1530 - 1630 The IODE XBT quality control software demo (Pankajakshan)1630 - 1730 Evaluation of the Training course
TUESDAY - 27 OCTOBER 1998
0930 - 1100 Discussions on evaluation and receommendations1100 CLOSING CEREMONY (SEMINAR HALL)
IOC Training Course Report No 50Annex II - page 1
ANNEX II
LIST OF PARTICIPANTS AND RESOURCE PERSONS
A PARTICIPANTS
Mr Mohamed Said Al MohanadiMarine Science DepartmentUniversity of QatarPO Box 2713 DohaQATARFax (974) 892135Email alshoqeriqueduqa
Mr Thilakasiri MendisOceanography Division of NARAMattakkuliya Colombo 15SRI LANKAFax (94) 1522 932 or (94) 1522 699Email jayasirinaraaclk
Dr Trinh The HieuInstitute of Oceanography01 Canada - NhatrangVIETNAMFax (84 58) 881 152Email haiduongdngvnnvn
Ms Nasreen Islam KhanAssistant ProfessorDept of Geography amp EnvironmentDhaka University - 1000BANGLADESHFax (880 2) 86 55 83Email nasreengegduccagnicom Nasreen_ikhanyahoocom geographydubanglanet
Lt Cdr Zaharuddin MaideenHydrographic DirectorateRoyal Malaysian Navy Ministry of DefenceJalan padang Tembak 50634 Kuala LumpurMALAYSIATel 603-2313700Fax 603 2987972Email zahalintmnetmy
Mr Goonasilan SoopramaniaMauritius Meteorological ServicesVacoasMAURITIUSFax (230) 686 1033Email meteointernetmu
Cdr A BhushanNaval Hydrographic OfficePost Box No 75 107-A Rajpur RoadDEHRADUN - 248 001 INDIAFax 0091 (135) 748373
Shri MM Malleswara RaoNational Institute of OceanographyRegional Centre176 Lawsons Bay ColonyVISAKHAPATNAM - 530 017 INDIAFax 0891-543595Email mmmraokadalinioorg
Lt Cdr IN JobINS HansaGOA - 403 802 INDIAEmail simulatebom2vsnlnetinTel 0834-51 8441
Lt TP MahatoNational Hydrographic SchoolCo Heaquarters Goa Naval AreaVasco-da-GamaGOA - 403 802 INDIAFax 0834 - 513419Tel 0834 - 51395051 Extn 242344347Email nhsgoabom2vsnlnetin
IOC Training Course Report No 50Annex II - page 2
B RESOURCE PERSONS
Mr Vishwas ChavanScientistCentre for Cellular and Molecular BiologyUppal RoadHYDERABAD - 500 007 INDIATel +91-40-7172241Fax +91-40-7171195Email vishwasyahoocom vishccmbarpnicin
Ir Paul GeerdersConsultant amp training on remote sensing amp data management for marine and coastal applicationsKobaltpad 16 3402 JL IJsselsteinTHE NETHERLANDSFax 31 (30) 688 49 42Email pgconswxsnl
Mr Aravind Ghosh KScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email garvindcsniorennicin garvinddaryanioorg
Prof R MahadevanScientific AdvisorNational Institute of Ocean TechnologyIIT Madras CampusMADRAS - 600 036 INDIAEmail devansamratnioternetin
Mr Peter PissierssensProgramme Specialist IODEMIMIntergovernrmental OceanographicCommission of UNESCO1 rue Miollis75732 Paris Cedex 15FRANCEFax 33 145685812Tel 33 145684046Email ppissierssensunescoorg
Mr GV ReddyScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email reddycsniorennicin reddydaryanioorg
Dr Greg ReedAustralian Oceanographic Data CentreMaritime Headquarters Wylde StPotts Point NSW 2011AUSTRALIAFax + 612 9359 3120Email gregaodcgovauTel + 612 9359 3141
Prof P SadanandanAssociate DirectorNational Centre for Software Technology6th Floor Main Tower Visvesvaraya CentreDr BR Ambedkar VeedhiBANGALORE - 560 001 INDIAEmail psncsternetinFax 286 2531
Mr JS SarupriaHead Data amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email sarujsdaryanioorg sarujscsniorennicin
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Annex I - page 1
ANNEX I
AGENDA AND TIMETABLE
SATURDAY - 17 OCTOBER 19980900 - 0915 REGISTRATION 0915 - 1030 Presentation of the participants1030 - 1100 TEA BREAK
SESSION A IOCIODE SYSTEM (TRAINING HALL)1100 - 1115 Introduction to IODE amp IOC regional policy (P Pissierssens) [ paper presented duringITO98]1115 - 1200 IODE s institutional components and international ocean data system (P Geerders)1200 - 1230 IODE data flow monitoring procedures (P Geerders)1230 - 1300 IODE data products and operational projects (P Geerders)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on ROSCOP forms (Geerders)1500 - 1530 TEA BREAK1530 - 1615 Establishing an IODE NODC (G Reed)
SUNDAY - 18 OCTOBER 1998 - HOLIDAY
MONDAY - 19 OCTOBER 1998
SESSION B DATA METADATA AND INFORMATION MANAGEMENT0925 - 1020 New technology for data acquisition remote sensing data buoys etc (P Geerders)1020 - 1045 GODAR project and achievements (P Geerders)1045 - 1115 The continuum data metadata and information (G Reed)1115 1200 Metadata The MEDI pilot project (GReed)
6(6621amp26()257+(5(672)7+($lt$38amp+2$lt
TUESDAY - 20 OCTOBER 19980930 - 1000 Marine Information Management (Pissierssens)1000 - 1100 Marine data management system at RNODC-INDO (JS Sarupria)1100 - 1130 TEA BREAK1130 - 1300 PRACTICAL EXERCISE Metadata Practical exercise (G Reed) 1300 - 1400 LUNCH BREAK
SESSION C DATABASE MANAGEMENT SYSTEMS1400 - 1430 Numerical DBMS vs textual DBMS (MP Tapaswi)1430 - 1500 Advances in DBMS distributed database management systems (G Reed)1500 - 1530 TEA BREAK1530 - 1700 DBMS systems - Database directions (P Sadanandan NCST Bangalore)
IOC Training Course Report No 50Annex I - page 2
WEDNESDAY - 21 OCTOBER 1998
SESSION D USING RDBMS IN OCEANOGRAPHY0900 - 1000 Data warehousing (P Sadanandan NCST Bangalore)1000 - 1100 Web databases (P Sadanandan NCST Bangalore)
1100 - 1130 TEA BREAK
1130 - 1300 PRACTICAL EXERCISE MS Access Creating database tables Searching thedatabase (J Pattainak JS Sarupria PPissierssens)
1300 - 1400 LUNCH BREAK1400 - 1430 Demonstration to other global data sets such as GEBCO etc (PD Kunte)1430 - 1500 Introduction to global data sets and demonstration (CD-ROM - WDC-A etc) (GVReddy)1500 - 1530 TEA BREAK1530 - 1700 PRACTICAL EXERCISE MS Access self training
THURSDAY - 22 OCTOBER 1998
SESSION E DATA PROCESSING AND PRODUCT DEVELOPMENT (TRAINING HALL)0900 - 1000 Oceanographic data exchange formats (JS Sarupria)1000 - 1100 Quality control procedures (T Pankajakshan)1100 - 1130 TEA BREAK1130 - 1200 Data product development tools (GIS etc) (PD Kunte)1200 - 1300 Visit to IODC (Demonstration use of INGRES DBMS (L Ratnakaran) and ArcView GIS
(J Pattanaik))1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on MS Access amp SQL1500 - 1530 TEA BREAK1530 - 1730 PRACTICAL EXERCISE (continued)
FRIDAY - 23 OCTOBER 1998
SESSION F IODE AND THE WWW0900 - 1000 Data processing tools interpolation interpolation etc (R Mahadevan)1000 - 1045 The Internet - Introduction Evolution and Tools (A Ghosh)1045 - 1115 TEA BREAK1115 - 1145 Serving information to users over the WWW HTML (PPissierssens)1145 - 1200 Serving numerical databases over the WWW (V Chavan)1200 - 1300 Serving textualfactual database over the WWW (MP Tapaswi PPissierssens)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on HTML1500 - 1530 TEA BREAK1530 - 1630 PRACTICAL EXERCISE (continued)1630 1700 The IODC NIO CDROM Demo (PD Kunte)
SATURDAY - 24 OCTOBER 1998 - HOLIDAYSUNDAY - 25 OCTOBER 1998 - HOLIDAY
IOC Training Course Report No 50Annex I - page 3
MONDAY - 26 OCTOBER 1998
SESSION G SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT (IODC)0900 - 1100 PRACTICAL EXERCISE on format conversion (JS Sarupria)1100 - 1130 TEA BREAK1130 1230 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit)(PPissierssens)1230 - 1300 Library visit (Tapaswi)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit) continued1500 - 1530 TEA BREAK1530 - 1630 The IODE XBT quality control software demo (Pankajakshan)1630 - 1730 Evaluation of the Training course
TUESDAY - 27 OCTOBER 1998
0930 - 1100 Discussions on evaluation and receommendations1100 CLOSING CEREMONY (SEMINAR HALL)
IOC Training Course Report No 50Annex II - page 1
ANNEX II
LIST OF PARTICIPANTS AND RESOURCE PERSONS
A PARTICIPANTS
Mr Mohamed Said Al MohanadiMarine Science DepartmentUniversity of QatarPO Box 2713 DohaQATARFax (974) 892135Email alshoqeriqueduqa
Mr Thilakasiri MendisOceanography Division of NARAMattakkuliya Colombo 15SRI LANKAFax (94) 1522 932 or (94) 1522 699Email jayasirinaraaclk
Dr Trinh The HieuInstitute of Oceanography01 Canada - NhatrangVIETNAMFax (84 58) 881 152Email haiduongdngvnnvn
Ms Nasreen Islam KhanAssistant ProfessorDept of Geography amp EnvironmentDhaka University - 1000BANGLADESHFax (880 2) 86 55 83Email nasreengegduccagnicom Nasreen_ikhanyahoocom geographydubanglanet
Lt Cdr Zaharuddin MaideenHydrographic DirectorateRoyal Malaysian Navy Ministry of DefenceJalan padang Tembak 50634 Kuala LumpurMALAYSIATel 603-2313700Fax 603 2987972Email zahalintmnetmy
Mr Goonasilan SoopramaniaMauritius Meteorological ServicesVacoasMAURITIUSFax (230) 686 1033Email meteointernetmu
Cdr A BhushanNaval Hydrographic OfficePost Box No 75 107-A Rajpur RoadDEHRADUN - 248 001 INDIAFax 0091 (135) 748373
Shri MM Malleswara RaoNational Institute of OceanographyRegional Centre176 Lawsons Bay ColonyVISAKHAPATNAM - 530 017 INDIAFax 0891-543595Email mmmraokadalinioorg
Lt Cdr IN JobINS HansaGOA - 403 802 INDIAEmail simulatebom2vsnlnetinTel 0834-51 8441
Lt TP MahatoNational Hydrographic SchoolCo Heaquarters Goa Naval AreaVasco-da-GamaGOA - 403 802 INDIAFax 0834 - 513419Tel 0834 - 51395051 Extn 242344347Email nhsgoabom2vsnlnetin
IOC Training Course Report No 50Annex II - page 2
B RESOURCE PERSONS
Mr Vishwas ChavanScientistCentre for Cellular and Molecular BiologyUppal RoadHYDERABAD - 500 007 INDIATel +91-40-7172241Fax +91-40-7171195Email vishwasyahoocom vishccmbarpnicin
Ir Paul GeerdersConsultant amp training on remote sensing amp data management for marine and coastal applicationsKobaltpad 16 3402 JL IJsselsteinTHE NETHERLANDSFax 31 (30) 688 49 42Email pgconswxsnl
Mr Aravind Ghosh KScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email garvindcsniorennicin garvinddaryanioorg
Prof R MahadevanScientific AdvisorNational Institute of Ocean TechnologyIIT Madras CampusMADRAS - 600 036 INDIAEmail devansamratnioternetin
Mr Peter PissierssensProgramme Specialist IODEMIMIntergovernrmental OceanographicCommission of UNESCO1 rue Miollis75732 Paris Cedex 15FRANCEFax 33 145685812Tel 33 145684046Email ppissierssensunescoorg
Mr GV ReddyScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email reddycsniorennicin reddydaryanioorg
Dr Greg ReedAustralian Oceanographic Data CentreMaritime Headquarters Wylde StPotts Point NSW 2011AUSTRALIAFax + 612 9359 3120Email gregaodcgovauTel + 612 9359 3141
Prof P SadanandanAssociate DirectorNational Centre for Software Technology6th Floor Main Tower Visvesvaraya CentreDr BR Ambedkar VeedhiBANGALORE - 560 001 INDIAEmail psncsternetinFax 286 2531
Mr JS SarupriaHead Data amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email sarujsdaryanioorg sarujscsniorennicin
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Annex I - page 2
WEDNESDAY - 21 OCTOBER 1998
SESSION D USING RDBMS IN OCEANOGRAPHY0900 - 1000 Data warehousing (P Sadanandan NCST Bangalore)1000 - 1100 Web databases (P Sadanandan NCST Bangalore)
1100 - 1130 TEA BREAK
1130 - 1300 PRACTICAL EXERCISE MS Access Creating database tables Searching thedatabase (J Pattainak JS Sarupria PPissierssens)
1300 - 1400 LUNCH BREAK1400 - 1430 Demonstration to other global data sets such as GEBCO etc (PD Kunte)1430 - 1500 Introduction to global data sets and demonstration (CD-ROM - WDC-A etc) (GVReddy)1500 - 1530 TEA BREAK1530 - 1700 PRACTICAL EXERCISE MS Access self training
THURSDAY - 22 OCTOBER 1998
SESSION E DATA PROCESSING AND PRODUCT DEVELOPMENT (TRAINING HALL)0900 - 1000 Oceanographic data exchange formats (JS Sarupria)1000 - 1100 Quality control procedures (T Pankajakshan)1100 - 1130 TEA BREAK1130 - 1200 Data product development tools (GIS etc) (PD Kunte)1200 - 1300 Visit to IODC (Demonstration use of INGRES DBMS (L Ratnakaran) and ArcView GIS
(J Pattanaik))1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on MS Access amp SQL1500 - 1530 TEA BREAK1530 - 1730 PRACTICAL EXERCISE (continued)
FRIDAY - 23 OCTOBER 1998
SESSION F IODE AND THE WWW0900 - 1000 Data processing tools interpolation interpolation etc (R Mahadevan)1000 - 1045 The Internet - Introduction Evolution and Tools (A Ghosh)1045 - 1115 TEA BREAK1115 - 1145 Serving information to users over the WWW HTML (PPissierssens)1145 - 1200 Serving numerical databases over the WWW (V Chavan)1200 - 1300 Serving textualfactual database over the WWW (MP Tapaswi PPissierssens)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE on HTML1500 - 1530 TEA BREAK1530 - 1630 PRACTICAL EXERCISE (continued)1630 1700 The IODC NIO CDROM Demo (PD Kunte)
SATURDAY - 24 OCTOBER 1998 - HOLIDAYSUNDAY - 25 OCTOBER 1998 - HOLIDAY
IOC Training Course Report No 50Annex I - page 3
MONDAY - 26 OCTOBER 1998
SESSION G SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT (IODC)0900 - 1100 PRACTICAL EXERCISE on format conversion (JS Sarupria)1100 - 1130 TEA BREAK1130 1230 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit)(PPissierssens)1230 - 1300 Library visit (Tapaswi)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit) continued1500 - 1530 TEA BREAK1530 - 1630 The IODE XBT quality control software demo (Pankajakshan)1630 - 1730 Evaluation of the Training course
TUESDAY - 27 OCTOBER 1998
0930 - 1100 Discussions on evaluation and receommendations1100 CLOSING CEREMONY (SEMINAR HALL)
IOC Training Course Report No 50Annex II - page 1
ANNEX II
LIST OF PARTICIPANTS AND RESOURCE PERSONS
A PARTICIPANTS
Mr Mohamed Said Al MohanadiMarine Science DepartmentUniversity of QatarPO Box 2713 DohaQATARFax (974) 892135Email alshoqeriqueduqa
Mr Thilakasiri MendisOceanography Division of NARAMattakkuliya Colombo 15SRI LANKAFax (94) 1522 932 or (94) 1522 699Email jayasirinaraaclk
Dr Trinh The HieuInstitute of Oceanography01 Canada - NhatrangVIETNAMFax (84 58) 881 152Email haiduongdngvnnvn
Ms Nasreen Islam KhanAssistant ProfessorDept of Geography amp EnvironmentDhaka University - 1000BANGLADESHFax (880 2) 86 55 83Email nasreengegduccagnicom Nasreen_ikhanyahoocom geographydubanglanet
Lt Cdr Zaharuddin MaideenHydrographic DirectorateRoyal Malaysian Navy Ministry of DefenceJalan padang Tembak 50634 Kuala LumpurMALAYSIATel 603-2313700Fax 603 2987972Email zahalintmnetmy
Mr Goonasilan SoopramaniaMauritius Meteorological ServicesVacoasMAURITIUSFax (230) 686 1033Email meteointernetmu
Cdr A BhushanNaval Hydrographic OfficePost Box No 75 107-A Rajpur RoadDEHRADUN - 248 001 INDIAFax 0091 (135) 748373
Shri MM Malleswara RaoNational Institute of OceanographyRegional Centre176 Lawsons Bay ColonyVISAKHAPATNAM - 530 017 INDIAFax 0891-543595Email mmmraokadalinioorg
Lt Cdr IN JobINS HansaGOA - 403 802 INDIAEmail simulatebom2vsnlnetinTel 0834-51 8441
Lt TP MahatoNational Hydrographic SchoolCo Heaquarters Goa Naval AreaVasco-da-GamaGOA - 403 802 INDIAFax 0834 - 513419Tel 0834 - 51395051 Extn 242344347Email nhsgoabom2vsnlnetin
IOC Training Course Report No 50Annex II - page 2
B RESOURCE PERSONS
Mr Vishwas ChavanScientistCentre for Cellular and Molecular BiologyUppal RoadHYDERABAD - 500 007 INDIATel +91-40-7172241Fax +91-40-7171195Email vishwasyahoocom vishccmbarpnicin
Ir Paul GeerdersConsultant amp training on remote sensing amp data management for marine and coastal applicationsKobaltpad 16 3402 JL IJsselsteinTHE NETHERLANDSFax 31 (30) 688 49 42Email pgconswxsnl
Mr Aravind Ghosh KScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email garvindcsniorennicin garvinddaryanioorg
Prof R MahadevanScientific AdvisorNational Institute of Ocean TechnologyIIT Madras CampusMADRAS - 600 036 INDIAEmail devansamratnioternetin
Mr Peter PissierssensProgramme Specialist IODEMIMIntergovernrmental OceanographicCommission of UNESCO1 rue Miollis75732 Paris Cedex 15FRANCEFax 33 145685812Tel 33 145684046Email ppissierssensunescoorg
Mr GV ReddyScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email reddycsniorennicin reddydaryanioorg
Dr Greg ReedAustralian Oceanographic Data CentreMaritime Headquarters Wylde StPotts Point NSW 2011AUSTRALIAFax + 612 9359 3120Email gregaodcgovauTel + 612 9359 3141
Prof P SadanandanAssociate DirectorNational Centre for Software Technology6th Floor Main Tower Visvesvaraya CentreDr BR Ambedkar VeedhiBANGALORE - 560 001 INDIAEmail psncsternetinFax 286 2531
Mr JS SarupriaHead Data amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email sarujsdaryanioorg sarujscsniorennicin
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Annex I - page 3
MONDAY - 26 OCTOBER 1998
SESSION G SOFTWARE FOR OCEAN DATA AND INFORMATION MANAGEMENT (IODC)0900 - 1100 PRACTICAL EXERCISE on format conversion (JS Sarupria)1100 - 1130 TEA BREAK1130 1230 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit)(PPissierssens)1230 - 1300 Library visit (Tapaswi)1300 - 1400 LUNCH BREAK1400 - 1500 PRACTICAL EXERCISE The ODINEA CD-ROM (IODE Resource Kit) continued1500 - 1530 TEA BREAK1530 - 1630 The IODE XBT quality control software demo (Pankajakshan)1630 - 1730 Evaluation of the Training course
TUESDAY - 27 OCTOBER 1998
0930 - 1100 Discussions on evaluation and receommendations1100 CLOSING CEREMONY (SEMINAR HALL)
IOC Training Course Report No 50Annex II - page 1
ANNEX II
LIST OF PARTICIPANTS AND RESOURCE PERSONS
A PARTICIPANTS
Mr Mohamed Said Al MohanadiMarine Science DepartmentUniversity of QatarPO Box 2713 DohaQATARFax (974) 892135Email alshoqeriqueduqa
Mr Thilakasiri MendisOceanography Division of NARAMattakkuliya Colombo 15SRI LANKAFax (94) 1522 932 or (94) 1522 699Email jayasirinaraaclk
Dr Trinh The HieuInstitute of Oceanography01 Canada - NhatrangVIETNAMFax (84 58) 881 152Email haiduongdngvnnvn
Ms Nasreen Islam KhanAssistant ProfessorDept of Geography amp EnvironmentDhaka University - 1000BANGLADESHFax (880 2) 86 55 83Email nasreengegduccagnicom Nasreen_ikhanyahoocom geographydubanglanet
Lt Cdr Zaharuddin MaideenHydrographic DirectorateRoyal Malaysian Navy Ministry of DefenceJalan padang Tembak 50634 Kuala LumpurMALAYSIATel 603-2313700Fax 603 2987972Email zahalintmnetmy
Mr Goonasilan SoopramaniaMauritius Meteorological ServicesVacoasMAURITIUSFax (230) 686 1033Email meteointernetmu
Cdr A BhushanNaval Hydrographic OfficePost Box No 75 107-A Rajpur RoadDEHRADUN - 248 001 INDIAFax 0091 (135) 748373
Shri MM Malleswara RaoNational Institute of OceanographyRegional Centre176 Lawsons Bay ColonyVISAKHAPATNAM - 530 017 INDIAFax 0891-543595Email mmmraokadalinioorg
Lt Cdr IN JobINS HansaGOA - 403 802 INDIAEmail simulatebom2vsnlnetinTel 0834-51 8441
Lt TP MahatoNational Hydrographic SchoolCo Heaquarters Goa Naval AreaVasco-da-GamaGOA - 403 802 INDIAFax 0834 - 513419Tel 0834 - 51395051 Extn 242344347Email nhsgoabom2vsnlnetin
IOC Training Course Report No 50Annex II - page 2
B RESOURCE PERSONS
Mr Vishwas ChavanScientistCentre for Cellular and Molecular BiologyUppal RoadHYDERABAD - 500 007 INDIATel +91-40-7172241Fax +91-40-7171195Email vishwasyahoocom vishccmbarpnicin
Ir Paul GeerdersConsultant amp training on remote sensing amp data management for marine and coastal applicationsKobaltpad 16 3402 JL IJsselsteinTHE NETHERLANDSFax 31 (30) 688 49 42Email pgconswxsnl
Mr Aravind Ghosh KScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email garvindcsniorennicin garvinddaryanioorg
Prof R MahadevanScientific AdvisorNational Institute of Ocean TechnologyIIT Madras CampusMADRAS - 600 036 INDIAEmail devansamratnioternetin
Mr Peter PissierssensProgramme Specialist IODEMIMIntergovernrmental OceanographicCommission of UNESCO1 rue Miollis75732 Paris Cedex 15FRANCEFax 33 145685812Tel 33 145684046Email ppissierssensunescoorg
Mr GV ReddyScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email reddycsniorennicin reddydaryanioorg
Dr Greg ReedAustralian Oceanographic Data CentreMaritime Headquarters Wylde StPotts Point NSW 2011AUSTRALIAFax + 612 9359 3120Email gregaodcgovauTel + 612 9359 3141
Prof P SadanandanAssociate DirectorNational Centre for Software Technology6th Floor Main Tower Visvesvaraya CentreDr BR Ambedkar VeedhiBANGALORE - 560 001 INDIAEmail psncsternetinFax 286 2531
Mr JS SarupriaHead Data amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email sarujsdaryanioorg sarujscsniorennicin
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Annex II - page 1
ANNEX II
LIST OF PARTICIPANTS AND RESOURCE PERSONS
A PARTICIPANTS
Mr Mohamed Said Al MohanadiMarine Science DepartmentUniversity of QatarPO Box 2713 DohaQATARFax (974) 892135Email alshoqeriqueduqa
Mr Thilakasiri MendisOceanography Division of NARAMattakkuliya Colombo 15SRI LANKAFax (94) 1522 932 or (94) 1522 699Email jayasirinaraaclk
Dr Trinh The HieuInstitute of Oceanography01 Canada - NhatrangVIETNAMFax (84 58) 881 152Email haiduongdngvnnvn
Ms Nasreen Islam KhanAssistant ProfessorDept of Geography amp EnvironmentDhaka University - 1000BANGLADESHFax (880 2) 86 55 83Email nasreengegduccagnicom Nasreen_ikhanyahoocom geographydubanglanet
Lt Cdr Zaharuddin MaideenHydrographic DirectorateRoyal Malaysian Navy Ministry of DefenceJalan padang Tembak 50634 Kuala LumpurMALAYSIATel 603-2313700Fax 603 2987972Email zahalintmnetmy
Mr Goonasilan SoopramaniaMauritius Meteorological ServicesVacoasMAURITIUSFax (230) 686 1033Email meteointernetmu
Cdr A BhushanNaval Hydrographic OfficePost Box No 75 107-A Rajpur RoadDEHRADUN - 248 001 INDIAFax 0091 (135) 748373
Shri MM Malleswara RaoNational Institute of OceanographyRegional Centre176 Lawsons Bay ColonyVISAKHAPATNAM - 530 017 INDIAFax 0891-543595Email mmmraokadalinioorg
Lt Cdr IN JobINS HansaGOA - 403 802 INDIAEmail simulatebom2vsnlnetinTel 0834-51 8441
Lt TP MahatoNational Hydrographic SchoolCo Heaquarters Goa Naval AreaVasco-da-GamaGOA - 403 802 INDIAFax 0834 - 513419Tel 0834 - 51395051 Extn 242344347Email nhsgoabom2vsnlnetin
IOC Training Course Report No 50Annex II - page 2
B RESOURCE PERSONS
Mr Vishwas ChavanScientistCentre for Cellular and Molecular BiologyUppal RoadHYDERABAD - 500 007 INDIATel +91-40-7172241Fax +91-40-7171195Email vishwasyahoocom vishccmbarpnicin
Ir Paul GeerdersConsultant amp training on remote sensing amp data management for marine and coastal applicationsKobaltpad 16 3402 JL IJsselsteinTHE NETHERLANDSFax 31 (30) 688 49 42Email pgconswxsnl
Mr Aravind Ghosh KScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email garvindcsniorennicin garvinddaryanioorg
Prof R MahadevanScientific AdvisorNational Institute of Ocean TechnologyIIT Madras CampusMADRAS - 600 036 INDIAEmail devansamratnioternetin
Mr Peter PissierssensProgramme Specialist IODEMIMIntergovernrmental OceanographicCommission of UNESCO1 rue Miollis75732 Paris Cedex 15FRANCEFax 33 145685812Tel 33 145684046Email ppissierssensunescoorg
Mr GV ReddyScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email reddycsniorennicin reddydaryanioorg
Dr Greg ReedAustralian Oceanographic Data CentreMaritime Headquarters Wylde StPotts Point NSW 2011AUSTRALIAFax + 612 9359 3120Email gregaodcgovauTel + 612 9359 3141
Prof P SadanandanAssociate DirectorNational Centre for Software Technology6th Floor Main Tower Visvesvaraya CentreDr BR Ambedkar VeedhiBANGALORE - 560 001 INDIAEmail psncsternetinFax 286 2531
Mr JS SarupriaHead Data amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email sarujsdaryanioorg sarujscsniorennicin
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Annex II - page 2
B RESOURCE PERSONS
Mr Vishwas ChavanScientistCentre for Cellular and Molecular BiologyUppal RoadHYDERABAD - 500 007 INDIATel +91-40-7172241Fax +91-40-7171195Email vishwasyahoocom vishccmbarpnicin
Ir Paul GeerdersConsultant amp training on remote sensing amp data management for marine and coastal applicationsKobaltpad 16 3402 JL IJsselsteinTHE NETHERLANDSFax 31 (30) 688 49 42Email pgconswxsnl
Mr Aravind Ghosh KScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email garvindcsniorennicin garvinddaryanioorg
Prof R MahadevanScientific AdvisorNational Institute of Ocean TechnologyIIT Madras CampusMADRAS - 600 036 INDIAEmail devansamratnioternetin
Mr Peter PissierssensProgramme Specialist IODEMIMIntergovernrmental OceanographicCommission of UNESCO1 rue Miollis75732 Paris Cedex 15FRANCEFax 33 145685812Tel 33 145684046Email ppissierssensunescoorg
Mr GV ReddyScientist EIData amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email reddycsniorennicin reddydaryanioorg
Dr Greg ReedAustralian Oceanographic Data CentreMaritime Headquarters Wylde StPotts Point NSW 2011AUSTRALIAFax + 612 9359 3120Email gregaodcgovauTel + 612 9359 3141
Prof P SadanandanAssociate DirectorNational Centre for Software Technology6th Floor Main Tower Visvesvaraya CentreDr BR Ambedkar VeedhiBANGALORE - 560 001 INDIAEmail psncsternetinFax 286 2531
Mr JS SarupriaHead Data amp Information DivisionNational Institute of OceanographyDona Paula GOA - 403 004 INDIAFax 91(0) 832-223340 91(0) 832-229102Email sarujsdaryanioorg sarujscsniorennicin
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Annex III - page 1
ANNEX III LECTURE NOTES
LIST OF ATTACHED LECTURE NOTES
1 Session A Introduction to IODE amp IOC regional policy (PPissierssens)2 Session A IODE Institutional Components and the International Ocean Data System (P Geerders)3 Session A IODE Data Flow and Monitoring Procedures (P Geerders)4 Session A IODE Operational Projects (P Geerders)5 Session A NODC Tasks amp Responsibilities (G Reed)6 Session B Data Information and Metadata (G Reed)7 Session B A Metadata Directory System for Marine Data (G Reed)8 Session C Numerical Vs Textual Databases (MP Tapaswi)9 Session C Distributed Database Management Systems (G Reed)10 Session E Quality and Quality Control of Oceanographic Data (Pankajakshan Thadathil)11 Session E Geographic Information System (GIS) (PD Kunte)12 Session F Internet Evolution Spread Prospects and Tools (A Ghosh)13 Session F HyperText Markup Language (PPissierssens)14 Session F Numerical Databases Over WWW (V Chavan)15 Session F Serving Textual Factual databases on the web (MP Tapaswi)16 Session F Dynamic Database publishing using Filemaker Pro (PPissierssens)
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Annex III ndash page 2
1 INTRODUCTION TO IODE amp IOC REGIONAL POLICY(PPissierssens IOC)
Slide 1
ITOrsquo98- October 1998 IODE Growing towards a new era
URZLQJWRZDUGVDURZLQJWRZDUGVDQHZHUDQHZHUD
Slide 2
ITOrsquo98- October 1998 IODE Growing towards a new era
2(ltHVWHUGD2(7RGD2(7RPRUURZ
In order to address the question lsquowhat will IODE be tomorrowrsquo we first need to look atIODE yesterday and IODE today
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Annex III - page 3
Slide 3
ITOrsquo98- October 1998 IODE Growing towards a new era
ampUHDWLRQ2amp
IODE History
Going back 37 years IODE is one of the oldest IOC programmes established in 1961The IOC (Intergovernmental Oceanographic Commission) is a part of UNESCO Therelationship with UNESCO is a bit more complicated than that because although IOCis part of UNESCO it has its own governing bodies an assembly and executive councilIOC also has its own Member States which are sometimes different from the UNESCOMember States (eg the United States are a Member State of IOC but not of UNESCO)Currently the IOC has 126 Member States
Slide 4
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC
What is unique about the IOC is that it is the ONLY United Nations body that dealsONLY with the Oceans Many other UN agencies have activities related to the Oceansbut the Oceans are only part of their mandatesometimes peripheral The IOC deals onlywith the Oceans
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web
IOC Training Course Report No 50Annex III ndash page 4
Slide 5
ITOrsquo98- October 1998 IODE Growing towards a new era
OREDO3URJUDPPHVplusmn 2FHDQ6FLHQFH
26526152FHDQ0DSSLQJ0DULQH3ROOXWLRQamp=0
plusmn 2(plusmn 7VXQDPLDUQLQJ6VWHPplusmn OREDO2FHDQ2EVHUYDWLRQ226266plusmn 7UDLQLQJ(GXFDWLRQ7(0$
5HJLRQDO3URJUDPPHV
IOC Activities
Slide 6
ITOrsquo98- October 1998 IODE Growing towards a new era
IOC Regional Programmes
IOC Training Course Report No 50Annex III - page 5
Slide 7
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Milestones1956-59 International Geophysical Year Established WDCs
for Oceanography amp Marine Geology amp Geophysics1960 IOC Establishment
Oct 1961 Establishment of a Working group on Exchangeof Oceanographic Data Call on Member States toestablish national data centres
1965 Publication of the first edition of the IODE Manual
1973 Establishment of the IODE Working Committee withnew Terms of Reference
OctNov 77 Established Joint IOC-WMO IGOSS Committee
1979 Publication of the first issue of the MEDI Catalogue
1970s Operation of the RNODC pilot scheme
1978-90s Development of the GF3 format amp publication ofGF3 Manual (6 volumes) Establishment of theRNODC for GF3 at ICES Headquarters
1981 RNODC scheme becomes operational
1987 IODE becomes the International Oceanographic Data ampInformation Exchange System (acronym has beenretained)
1988 Launching the GTSPP project
1990 Publication of the GTSPP Manual
Nov 90 OceanPC project approved for implementation
1991 Publication of the revised version of the IODE Manualjointly with ICSU Panel on WDCs
1992 Launching GOOS
Feb 92 Ocean Climate Data Workshop
Dec 92 Adoption of the IODE data management policy
1993 GODAR project approved for implementation
1993 Publication of the OceanPC software amp Manual
1993 Publication of the third edition of the MEDI Catalogue
1994 GEBCO CD-ROM
1995 World Ocean Atlas 94 set of CD-ROMs
Mar 95 Think Tank Meeting
1996 Publication of the IGOSS-IODE Data ManagementStrategy in support of GOOS
May 1996 Workshop on Manag of Biological amp ChemicalData
1996 GTSPP amp GLOSS CD-ROMs
1996 IODE Home Page on WWW server
IODE has also been one of the most active programmes of the IOC I am showingyou a list of IODE milestones I will not even try to go through all of these
Slide 8
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Objectives
7KHQWHUQDWLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ([FKDQJH2(VVWHPKDVEHHQHVWDEOLVKHGLQWRplusmn HQKDQFHPDULQHUHVHDUFKH[SORUDWLRQDQGGHYHORSPHQWEIDFLOLWDWLQJWKHH[FKDQJHRIRFHDQRJUDSKLFGDWDDQGLQIRUPDWLRQEHWZHHQSDUWLFLSDWLQJ0HPEHU6WDWHV
The IODE has been established with the objective to enhance marine researchexploration and development by facilitating the exchange of oceanographic dataand information between participating Member States
IOC Training Course Report No 50Annex III ndash page 6
Slide 9
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE StructurebulllsquoPhysicalrsquo Structure
bullWorld Data Centre OceanographybullNational Oceanographic Data Centre or DesignatedNational Agency (NODC DNA)bullResponsible NODC (RNODC)
bulllsquoOrganizationalrsquo StructurebullIODE CommitteebullIODE OfficersbullIODE Groups of Experts (GE-)
bulllsquoOperationalrsquo Structurebulldata flow
Now let us have a look at the structure of the IODE system We can distinguish threetypes of structure1- the physical structure2- the organizational structure3- the operational structure
1- physical structure here we have to remember that the IODE system wasdeveloped in a time when there was no Internet Physical structures therefore had tobe built in a centralized manner we had world data centres national oceanographicdata centres and responsible NODCs (I am coming back to these individually in amoment)2- organizational structure in order to develop maintain and manage the systemIODE set up an IODE Committee appointed IODE Officers and brought together a number of Groups of Experts3- operational structure defining the data flow
IOC Training Course Report No 50Annex III - page 7
Slide 10
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 72$lt
56 Data centres in 53 countries
Looking at the physical structure during its 37 years of existence the IODE systemhas been able to set up 56 national data centres (including NODCs and DNAs) in 53countries - Oceanography
There are 56 National Oceanographic Data Centres Designated National Agenciesand World Data Centre (Oceanography) in 53 countries Argentina Australia BrazilBulgaria Canada Chile Peoplersquos Republic of China Colombia Republic of CroatiaEcuador Arab Republic of Egypt Finland France Germany Ghana GreeceGuatemala Guineacutee Iceland India Islamic Republic of Iran Ireland Italy JapanKenya Peoples Democratic Republic of Korea Republic of Korea MalaysiaMexico Morocco Netherlands Nigeria Norway Pakistan Peru PhilippinesPoland Portugal Romania Russian Federation Seychelles South Africa SpainSweden United Republic of Tanzania Trinidad amp Tobago Turkey Ukraine UnitedKingdom United States of America Uruguay Venezuela VietnamNone in Mauritius Qatar Bangladesh
IOC Training Course Report No 50Annex III ndash page 8
Slide 11
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Centre Tasks
12amp1$plusmn DFTXLUHSURFHVVTXDOLWFRQWUROLQYHQWRUDUFKLYHDQGGLVVHPLQDWHGDWD
plusmn VHHNDQGDFTXLUHGDWDIURPQDWLRQDOVRXUFHVIRULQWHUQDWLRQDOH[FKDQJH
plusmn VXEPLWGDWDWRampRU512ampplusmn SURYLGHRFHDQGDWDLQIRUPDWLRQLQDXVDEOHIRUPWRDZLGHXVHUFRPPXQLW
plusmn SDUWLFLSDWHLQPHHWLQJVRI2(
Letrsquos look at the Data Centre tasksA National Oceanographic Data Centre (NODC) willbull acquire process quality control inventory archive and disseminate data in
accordance with national responsibilitiesbull be responsible for conducting international exchangebull actively seek and acquire from national sources those data which are
exchangeable internationally and to process and quality control the data andsubmit them in a timely fashion to the appropriate WDC for Oceanography orRNODC
bull provide ocean datainformation in a usable form to a wide user communitybull participate in meetings of IODESome Member States that have not established an NODC have instead identifiedDesignated National Agencies (DNAs)NODC can receive data or inventory information from the WDCs for Oceanographyor RNODCs
IOC Training Course Report No 50Annex III - page 9
Slide 12
ITOrsquo98- October 1998 IODE Growing towards a new era
WDCs 86$5XVVLDQ)HGHUDWLRQ
ampKLQD
5HFHLYHDUFKLYHRFHDQRJUDSKLFGDWDLQYHQWRULHVIURP12ampV512ampVPDULQHVFLHQFHRUJDQL]DWLRQVDQGLQGLYLGXDOVFLHQWLVWV
SURYLGHGDWDLQYHQWRULHVDQGSXEOLFDWLRQVWR12ampV1$VWR512ampVWRLQWHUQDWLRQDOFRRSHUDWLYHSURJUDPPHV
0RQLWRUSHUIRUPDQFH2(VVWHP
bull USA Russian Federation Chinabull Receive amp archive oceanographic data amp inventories from NODCs RNODCs
marine science organizations and individual scientistsbull provide data inventories and publications to NODCs DNAs to RNODCs amp to
international co-operative programmesbull Monitor performance IODE system
Slide 13
ITOrsquo98- October 1998 IODE Growing towards a new era
RNODCs
5HVSRQVLEOH1DWLRQDO2FHDQRJUDSKLFDWDampHQWUHVWDNHUHVSRQVLELOLWIRUplusmnVSHFLILFGDWDWSHV
512ampIRUULIWLQJXRVDWD512ampIRU266$7+ltDQG7(6$amp512amp6IRU0$532021512ampIRUDYHV512ampIRU-$61512amp)RUPDWV512amp$amp3
plusmnVSHFLILFJHRJUDSKLFUHJLRQV 512amp62amp512amp12512ampIRU(673$amp
A special case is the RNODC They are NODCs which have also accepted someadditional responsibilities These can be to deal with specific data types eg driftingbuoys data marine pollution data etcor they can take responsibility for specific geographic regions eg Southern OceansIndian Ocean (such as the IODC) Western Pacific etc
IOC Training Course Report No 50Annex III ndash page 10
Slide 14
ITOrsquo98- October 1998 IODE Growing towards a new era
Organization 2(ampRPPLWWHHplusmn +HDGV12ampV2(2IILFHUV
2(2IILFHUVplusmn ampKDLUPDQ9LFHampKDLUPDQampKDLUVURXSVRI([SHUWVLUHFWRUVampV
2(URXSVRI([SHUWVplusmn (00(7$(
2(7DVN7HDPVplusmn 5HP6HQVDWDampHQWUH6HUY0DULRODWD
Letrsquos proceed with the Organizational structureFirst of all we have an IODE Committee This is composed of representatives fromeach data centre and of course also the IODE officersThe IODE officers include a Chairman and Vice-Chairman elected by the Committee(the current Chairman is Ben Searle who is with us this week) Officers also includethe Chairpersons of the Groups of Experts and the Heads of the 3 WDCsWe also have Groups of Experts For specific areas within the mandate of IODE theCommittee has established Groups of Experts As the name implies these Groupsare composed of experts They are people identified by their own country following arequest from the IOC secretariat They then meet at regular periods (every 2-3 years)to discuss specific issues They often prepare action plans and carry outprogrammesOne example is the GE-MIM of which we have a member here ie MrMurari TapaswiFinally we have a few task teams These deal with specific topics and usually have alimited lifespan
IOC Training Course Report No 50Annex III - page 11
Slide 15
ITOrsquo98- October 1998 IODE Growing towards a new era
Ships Moorings Satellites
NationalInstitutions
USERSUSERS
NODCDNA
RNODC
WDC-Oceanogr
USERS
USERS
IODE Data Flow
Just a few words about the operational structure ie the data flow In this verysimplified diagram you can see how data flow through the IODE system
Slide 16
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Policy )XOODQGRSHQVKDULQJ )UHHRUORZFRVWGDWDVHUYLFHV DWDDYDLODEOHZLWKLQHDUDIWHUFROOHFWLRQ
DWDDUFKLYLQJFRPPLWPHQW $SSO6WDQGDUGV
Full and open sharingFree or low-cost data servicesData available within 1 year after collectionData archiving commitmentApply Standards
IOC Training Course Report No 50Annex III ndash page 12
Slide 17
ITOrsquo98- October 1998 IODE Growing towards a new era
The Continuum
DWD0HWDGDWDQIRUPDWLRQ KRRHVKDW
Now through the years a giant distinction has been made between datamanagement on one side (numerical data) and information management on theother side (textual information) Rarely would these two meet However in the pastfew years a new creature (or so it seems) has surfaced ie meta data TextualInformation describing Numerical Data and data sets We therefore need to considerthese three as a continuum
Slide 18
ITOrsquo98- October 1998 IODE Growing towards a new era
Data Types
0DULQH+GURORJLFDO 0DULQHHRORJLFDOHRSKVLFDO 0DULQHampKHPLFDO 0DULQH3ROOXWLRQ 5HPRWH6HQVLQJQHZ 0DULQHLRORJLFDOQHZ
Data Management data typesIODE deals with a wide variety of data types
IOC Training Course Report No 50Annex III - page 13
Slide 19
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE Activities
0DULQHDWD0DQDJHPHQWplusmnOREDO76332662$5PHWKRGVVWDQGDUGV4ampFRRUGLQDWLRQZLWKRWKHUDJHQFLHV
plusmn5HJLRQDO2FHDQRJUDSKLFDWDDQGQIRUPDWLRQ1HWZRUNIRU$IULFD21$)5amp$
plusmnampDSDFLWEXLOGLQJ
Are data centres just archives of data No although many started out that waymany data centres now produce data productsGEBCO many other examples around us this week
Slide 20
ITOrsquo98- October 1998 IODE Growing towards a new era
0DULQHQIRUPDWLRQ0DQDJHPHQW
6WDQGDUGVIRU0DULQHQIRUPDWLRQ0DQDJHPHQW
HYHORSPHQWRI001HWZRUNVLQGHYHORSLQJUHJLRQV
OREDOLUHFWRURI0DULQHDQG)UHVKZDWHU3URIHVVLRQDOV
2FHDQ3LORWGDWDEDVH
0DULQH0HWDGDWD0DQDJHPHQW6VWHP0(
0DULQHLEOLRJUDSKLF7RROVampRRSHUDWLRQLQ$6)$
ampRRSHUDWLRQZLWK$06ampDQGLWVUHJLRQDOJURXSV
QIRUPDWLRQ7HFKQRORJNQRZKRZVKDULQJ
IODE Activities
Standards library management systems (eg software) standards for directory typedatabases monitoring of technological advancements for information exchange suchas ILLMIM networks RECOSCIX-WIO -CEA GLODIR OceanPilot MEDI ASFA
IOC Training Course Report No 50Annex III ndash page 14
Slide 21
ITOrsquo98- October 1998 IODE Growing towards a new era
Capacity Building
$VVLVWDQFHGHYHORSPHQWRI12ampV 7UDLQLQJDQG(GXFDWLRQ microGDWDPDQDJHPHQWIDPLOpara
Assistance the IOC assists member states that wish to set up national datamanagement infrastructure by sending experts (from within the system) to assessthe national situation discuss options and assist with the planningTraining and Education training courses and workshops at national or regional level(next week) Eg these can be organized following the mission I just mentionedNew NODCs are welcomed into the data management family more mature NODCsaccept internships from newly established NODCs for periods of 2-3 months Most ofthe time the NODCs donrsquot charge for this assistance although it must be consideredas on-the-job training IOC provides the air ticket and living expensesNew strategy training and education should be organized within project frameworkabandon one-hit training activities without follow-up (eg ODINAFRICA)
IOC Training Course Report No 50Annex III - page 15
Slide 22
ITOrsquo98- October 1998 IODE Growing towards a new era
Sharing
12ampVSURGXFWDQGVHUYLFHGHYHORSPHQW
6KDULQJRIUHVRXUFHV
WE have all witnessed the wide variety of products and services developed in manyof the NODCs present here with us
Slide 23
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE 7202552
RZHVHUYHRXUFXVWRPHUVKRDUHRXUFXVWRPHUV
Do we serve our customers First who are our customers
IOC Training Course Report No 50Annex III ndash page 16
Slide 24
ITOrsquo98- October 1998 IODE Growing towards a new era
IODE UserCommunities
HIRUHVFLHQWLVWV 1RZDQGWRPRUURZplusmnVFLHQWLVWVplusmnLQGXVWUJRYHUQPHQWplusmnGHFLVLRQSROLFPDNHUV
Yesterday and today mainly scientistsToday and tomorrow
Slide 25
ITOrsquo98- October 1998 IODE Growing towards a new era
Datarequirements
2SHUDWLRQDO2FHDQRJUDSK 2(GHODHGPRGHKLJKTXDOLW4amp
5HDOWLPH02paraV266
The new customers will increasingly want lsquooperational oceanographyrsquo dataTraditionally IODE deals with delayed-mode data often cruise based The IODEsystemrsquos major added value is the quality control mechanism set up throughout theIODE systemA programme which is much more aimed at real-time data management is theWMOrsquos Integratedl Global Ocean Services System IGOSSTo get the both of both worlds IODE and IGOSS are therefore growing closer to eachother
IOC Training Course Report No 50Annex III - page 17
Slide 26
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODE
0DULQHDWD0DQDJHPHQW([FKDQJH0LVVLRQ6WDWHPHQW
0DULQHDWD([FKDQJHDQG0DQDJHPHQW2EMHFWLYH
This has led to the drafting of joint IGOSSIODE Marine Data Management andExchange Statement which says that
Slide 27
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEMission Statement
sup3266DQG2(ZLOOFRQWLQXHHIIRUWVLQJDLQLQJDUHSXWDWLRQIRUH[FHOOHQFHLQWKHPDQDJHPHQWDQGSURFHVVLQJRIPDULQHGDWDDQGLQWKHJHQHUDWLRQDQGGLVWULEXWLRQRIGDWDLQIRUPDWLRQDQGSURGXFWVWKURXJKDZHOOVXSSRUWHGVFLHQFHHQGRUVHGKLJKOIRFXVVHGDQGWHFKQLFDOOFRPSHWHQWGLVWULEXWHGJURXSRIGDWDFHQWUHVDQGUHODWHGDJHQFLHVacute
IOC Training Course Report No 50Annex III ndash page 18
Slide 28
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEObjective
sup37RFUHDWHDQLQWHJUDWHGDQGWHFKQRORJLFDOODGYDQFHGGDWDPDQDJHPHQWSURFHVVLQJDQGGLVWULEXWLRQVVWHPLQRUGHUWRPHHWWKHQHHGVRIWKHLQWHUQDWLRQDOPDULQHLQFO226DQGPHWHRURORJLFDOFRPPXQLWLHVFRPSDWLEOHZLWKamp26GDWDPDQDJHPHQWVVWHPDQGLQSDUWLFXODUVXSSRUWLQJWKHGHFLVLRQPDNLQJSURFHVVRIQDWLRQDOJRYHUQPHQWVLQGHWHUPLQLQJHQYLURQPHQWDOOVXVWDLQDEOHGHYHORSPHQWSROLFacute
Slide 29
ITOrsquo98- October 1998 IODE Growing towards a new era
IGOSS-IODEGoals
0DNHFROOHFWHGGDWDDYDLODEOHWRZLGHVWUDQJHRIXVHUV
ampUHDWHGLVWULEXWHGGDWDQHWZRUN 3URYLGHSURGXFWV 3URYLGHTXDOLWFRQWUROPHFKDQLVPV
Add Regional and global marine related programmes are seen as major customersfor both IGOSS and IODE data management and exchange capabilities This is inaddition to the more traditional needs of supporting national interests
IOC Training Course Report No 50Annex III - page 19
Slide 30
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
Cruise orientation
Platformlsquosystemrsquo approach
There will thus be a major and fundamental change in IODE The main data streamswill result from lsquopermanentrsquo monitoring activities rather than from the traditional lsquoadhocrsquo research cruise Of course the cruise based data streams will still exist and willremain very important
Slide 31
ITOrsquo98- October 1998 IODE Growing towards a new era
Changes
IGOSS
IODEGOOS
Data management data distribution and provision of products are key result areasfor GOOS In fact what is GOOSGOOS is conceived as
IOC Training Course Report No 50Annex III ndash page 20
Slide 32
ITOrsquo98- October 1998 IODE Growing towards a new era
What is GOOS
DVXVWDLQHGFRRUGLQDWHGLQWHUQDWLRQDOVVWHPIRUJDWKHULQJGDWDDERXWWKHRFHDQVDQGVHDV
DVVWHPIRUSURFHVVLQJVXFKGDWDZLWKRWKHUUHOHYDQWGDWDIURPRWKHUGRPDLQVWRHQDEOHWKHJHQHUDWLRQRIEHQHILFLDODQDOWLFDODQGSURJQRVWLFHQYLURQPHQWDOLQIRUPDWLRQVHUYLFHV
hellip created by the IOC Assembly in 1991
Slide 33
ITOrsquo98- October 1998 IODE Growing towards a new era
GOOS Objectives
6SHFLIGDWDQHHGHGEXVHUVRIRFHDQHQYLURQPHQW
GHYHORSVWUDWHJIRUJDWKHULQJDQGH[FKDQJHRIGDWD
IDFLOLWDWHSURGXFWGHYHORSPHQW IDFLOLWDWHDFFHVVEGHYFRXQWULHV HQVXUH226LQWHJUDWLRQLQJOREDOVWUDWHJLHV
IOC Training Course Report No 50Annex III - page 21
Slide 34
ITOrsquo98- October 1998 IODE Growing towards a new era
End-to-End DataManagement
3UHSDUHIRU226(7(0FRQFHSWXVHGE7633
The ETEDM implies a known or definable pathway of connections between a basicobservational element and the end use or purpose to which the observation isapplied Typically each type of observation has a range of potential applications andmost applications need more than one observation type So in designing a system toserve a given range of end-uses it is important to know how the observation will beused processed and combined with other observations to deliver and observationalproduct of value to the end userThe ETED concept is already used by GTSPP (global temperature and salinityprofile program) operated jointly by IGOSS and IODE GTSPP uses a continuouslymanaged database to provide for the integration of the real-time (low resolution) datastream with the delayed mode (generally high resolution) data stream
IOC Training Course Report No 50Annex III ndash page 22
Slide 35
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
CRUISE
Low-resreal-timeIGOSS
helliphellip
Lab work
IODE system
helliphellipHigh-resdelayed-modeIODE
hellipMetadata
t
Observation
Slide 36
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM
ldquoCruise Structurerdquo
real-time helliphellip
Monitoring activity
IODE system
helliphellipQC flags
hellipMetadata
t
Observation
But here the concept of the cruise will be replaced with a specific monitoring activityat the instrument or system level
IOC Training Course Report No 50Annex III - page 23
Slide 37
ITOrsquo98- October 1998 IODE Growing towards a new era
ETEDM goals
DWDPDQDJHPHQWVHQVRU 4ampPHWDGDWD LQWHJUDWLRQUHDOWLPHGHODHGPRGH LQFUHDVHFRRUGLQDWLRQGDWDFHQWUHV VLPSOLIPHUJLQJORFDOGDWDVHWV GHYHORSFRQWLQXRXVOXSGDWHGGE VXSSRUWPHUJHRFHDQLFDWPRVSKHULFWHUUHVWULDOGDWD226amp26726
hellipmove the data management closer to the sensorsupport quality control of ocean data and retain all available metadataintegrate real-time and delayed mode data and information processingincrease coordination between data centres and promote the sharing of datasoftware and responsibilities between centressimplify merging local data sets to form global data sets anddevelop a continuously updated databasesupport merge oceanic with atmospheric amp terrestrial data to link GOOS with WWWGCOS GTOS and Distributed Data Base
IOC Training Course Report No 50Annex III ndash page 24
Slide 38
ITOrsquo98- October 1998 IODE Growing towards a new era
Where are wetoday
2662(amp65PHWDGDWD0(7633FRQWLQXRXVOPDQDJHGGE
ampKDOOHQJHEXLOGRQWKLVPRGHO
What has been done today
IGOSSIODE use cruise summary reportsWe have the Marine Environmental Data Inventory (MEDI) which has been given anew lease of life through efforts by the AODC and BODCAnd we have the continuously managed database of GTSPP monitoring the captureof real-time and their transmission around the worldThe challenge for the IGOSSIODE tandem is therefore to build on this modelimproving the linkages removing bottlenecks caused by duplication or data formatincompatibility problems and develop capabilities (eg establishing new data centres)through capacity building
IOC Training Course Report No 50Annex III - page 25
Slide 39
ITOrsquo98- October 1998 IODE Growing towards a new era
) H[WHQVLYHQHWZRUNRIGDWDFHQWUHV
IUHHIORZRIGDWD JOREDOQHWZRUNRIH[SHUWLVH
PHWKRGVVWDQGDUGVSURGXFWV
87 QRVWDQGDUGWUDLQLQJWRRONLW
QRJOREDOVWDQGDUGIRUPDWIRUGDWDH[FKDQJH
YROXQWHHUZRUNRQO
Successes andShortcomings
Readadd volunteer work The fact that we deal with volunteer work has the advantagethat we can access a tremendous amount of know how For example whenever wehold group of experts meetings or we organize the IODE Officers or IODECommittee meeting extremely fascinating issues are discussed often it the reallytechnical level However although we then draft really interesting workplans theday-to-day duties of the experts make that progress is very slow We do really needan implementation mechanism such as the one proposed by Ben SearleThe fact that we donrsquot have a standard training toolkit is really an impediment to thedevelopment of new data centres
IOC Training Course Report No 50Annex III ndash page 26
2 IODE INSTITUTIONAL COMPONENTS AND THEINTERNATIONAL OCEAN DATA SYSTEM(P Geerders)
Slide 1
1P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Institutional Components and theInternational Ocean Data System
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
2P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE ObjectivesThe International Oceanographic Data and Information Exchange (IODE) system has been
established in 1961 to
enhance marine research exploration and development by facilitating the exchange ofoceanographic data and information between participating Member States
Rationale
ocean basin and global processes
availability of an international exchange system to provide data and information from allavailable sources
local processes
access to data collected by other Member States in their area of interest
The economic benefit of obtaining data by exchange as opposed to collecting it oneself ishuge
Critical succes factors
support of participating Member States
involvement of many individual institutions and marine scientists
contribution of data and the necessary expertise to maintain and further develop the IODEsystem
IOC Training Course Report No 50Annex III - page 27
Slide 3
3P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE provides
bull an infrastructure a network not only ofpeople but also physcial eg through theInternet (E-mail Web Sites FTP)
bull tools such as procedures and guidelines forinformation and data handling (submissionof planned research completed researchavailable datasets publications formats forexchange and archival)
bull services such as information datareferral advice and assistance
potential commercial value of information and data needs to be kept in mind
Slide 4
4P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network
bull managed and guided by committee underIOC of UNESCO
bull maintains close links with otherintergovernmental and international bodies(UN WMO UNEP EC IAEA IMOFAO )
bull focuses on scientific aspects butincreasingly also supports management ofthe marine and coastal environment and itsresources
IOC Training Course Report No 50Annex III ndash page 28
Slide 5
5P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE network consists of
bull WDCrsquos World Data Centres (SilverSpring-USA Moscow-Russia Tianjin-China)
bull NODCrsquos National Oceanographic DataCentres (56 around the world)
bull RNODCrsquos Responsible NODCrsquos (10)
Slide 6
6P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of WDC
bull receive oceanographic data and inventories from NODCs RNODCs marine science organizations and individual scientists These data are collected and submitted voluntarily from national programmes or arise from international co-operative ventures
bull provide copies of data inventories and publications to NODCsDNAs to RNODCs and to international co-operative programmes as appropriate in exchange or with a charge not to exceed the cost of providing the service
bull monitor the performance of the international data exchange system and report their findings to the IOC Secretariat and the C-IODE The Committee can use this information to take appropriate action to correct deficiencies in the international exchange system
NOTE In general the exchange of internationally significant data holdings and data inventory information between WDCs for Oceanography and their counterparts is expected to take place on a regular basis without charge in order to keep the data holdings of the Centres identical
IOC Training Course Report No 50Annex III - page 29
Slide 7
7P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of NODC
bull centralized facility bull providing ocean datainformation bull on a continuing basis bull in a usable form bull to a wide user community bull acquires processes quality controls inventories archives and disseminates data in accordance with national responsibilities bull normally charged with the responsibility for conducting international exchange bull actively seek and acquire from national sources those data which are exchangeable internationally and to process and quality control the data and submit them in a timely fashion to the appropriate WDC for Oceanography or RNODC bull can request and receive from the WDCs for Oceanography or RNODCs similar data or inventory information which they need for their own (national) requirements
Some Member States that have not established an NODC have instead officially assigned the responsibility of international exchange of oceanographic data and information to a Designated National Agency (DNA)
Slide 8
8P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
Tasks of RNODC
Responsible National Oceanographic Data Centres are National Oceanographic Data Centres who have accepted additional special responsibilities These can include specific data types (eg Drifting Buoys data) or specific regions (eg Southern Oceans)
RNODC-SOC (Southern Oceans)
RNODC for Drifting Buoys Data
RNODC for IGOSS (BATHY and TESAC)
RNODCS for MARPOLMON
RNODC for WESTPAC (Western Pacific)
RNODC for Waves
RNODC for JASIN
RNODC - Formats
RNODC - ADCP (Acoustic Doppler Current Profiler)
IOC Training Course Report No 50Annex III ndash page 30
Slide 9
9P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE committee work done by
bull Groups of Experts
[meet periodically continuous activity]
bull Task Teams
[work only by correspondence worklimited in time]
bull Plenary Session (about every 2-3 years)
[representatives of WDCrsquos NODCrsquos andRNODCrsquos with observers of relatedorganisations]
SEE IODE HANDBOOK
Slide 10
10P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Activities
Marine Data Management
Global Oceanographic Data Archaeology and Rescue Project (GODAR)
Oceanographic Data and Information Network for Africa (ODINAFRICA)
Marine Information Management
Development of Standards for Marine Information Management
Development of Marine Information Management Networks in developingregions
Development of Global Directory of Marine (and Freshwater) Scientists
Development of Ocean Pilot database
Development of Marine Metadata Management System
Development of Marine Bibliographic Tools Cooperation in ASFA
Cooperation with IAMSLIC and its regional groups
Information Technology know-how sharing
Development Electronic Information Services
IOC Training Course Report No 50Annex III - page 31
Slide 11
11P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Tools for
METADATA MANAGEMENT
Blue Pages
Irish EDMED
DATA MANAGEMENT
ArcExplorer
ATLAST
OceanPC
ROSWin
SURFER
Slide 12
12P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODErsquos Data and Information Sources
IODE helps you to find
bull marine scientists and institutions (GLODIR)
bull marine science related web sites (OceanPilot)
bull marine science related Internet discussion lists (ListServs)
bull information on marine science related conferences and meetings
bull what does an abbreviation (acronym) stand for (OceanAcronyms)
bull a scientific publication (bibliography)
bull marine science libraries (IDALIC)
bull useful websites (Training amp Tools KnowHow-KnowNow)
bull ocean data (Datasets)
IOC Training Course Report No 50Annex III ndash page 32
Slide 13
13P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998
IODE Training Tools
IODE Resource Kit
middot specific methods tools and systems (principally concerned with databases and software) that can be applied to all types of coastal programs middot a broad suite of training and orientation services middot the web version is a demonstration model of the full version which is being made available on CD-ROM
KnowHow-KnowNow
In this quick referral section you will find places to go when you need know-how to carry out marine information or marine data related tasks
Data amp Information Management Tools
middot specific marine data or marine information management methodology and technology middot information on a wide variety of software tools where to get information how much they cost middot in some cases the software tools are available from our server In other cases we provide links to the author or company that distributessells the product
IOC Training Course Report No 50Annex III - page 33
3 IODE DATA FLOW AND MONITORING PROCEDURES(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Data Flow and MonitoringProcedures
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
Phases of a data acquisition activity
bull planning =gt DNPNOP
bull completion =gt ROSCOP
bull pre-processing =gt QAQC
bull processing =gt MEDIBlue Pages
bull interpretation
bull publication =gt ASFAASFIS
bull archival
bull exchange =gt IODE network
data access conditionsbull free and open sharingbull at no or low costbull available lt 1 year after collectionbull commitment for permanent archivalbull application of standards
IOC Training Course Report No 50Annex III ndash page 34
4 IODE OPERATIONAL PROJECTS(P Geerders)
Slide 1
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 1
IODE Operational Projects
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 2
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 2
IODE Projects
bull GTSPP Global Temperature and SalinityProject
bull IGOSS Integrated Global Ocean ServicesSystem (with WMO)
bull GOOS Global Ocean Observing System
bull GODAR Global Ocean Data Archeologyand Rescue Project
bull QC Quality Control Manual
bull periodic training opportunities ininformation and data management
bull advice on and assistance with informationand data management
IOC Training Course Report No 50Annex III - page 35
Slide 3
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 3
GODAR Project and Achievements
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 4
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 4
IODE GODAR project
GODAR - WHAT IS GODAR
IOCrsquos GLOBAL OCEANOGRAPHIC DATA ARCHAEOLOGY AND RESCUE PROJECT
GODAR - WHY
bull fundamental importance and value of the databull risk of being lost to future usebull for compilation of global oceanographic databases
GODAR - AIMS
bull digitisation of data which is still in manuscript formbull archival of the data at two or more international data centres in digital formbull compilation of catalogues (inventories) of
- data now available only in manuscript form - data now available only in analogue form - digital data not presently available
bull making all data accessible on various media including CD-ROMs
GODAR - WHICH DATA HAS PRIORITY
bull hydrographic casts including all chemical and biological observations bull salinity-conductivity temperature-depth casts bull expendable bathythermograph casts bull mechanical bathythermograph casts
GODAR - RESULTS AT PRESENT
bull atlasesbull technical reports bull workshop reports (5)bull CD-ROMrsquos
IOC Training Course Report No 50Annex III ndash page 36
Slide 5
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 5
New technology for data acquisitionRemote Sensing
Data Buoys
Paul GeerdersP Geerders Consultancy
IJsselsteinThe Netherlands
Slide 6
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 6
New technologies
some examples
bull Remote Sensing from aircraft and fromspace
bull Automated Systems on data buoys andremote fixed platforms
bull ADCP
bull towed ondulating systems
common aspects
bull high spatial coverage andor
bull high temporal coverage but mostly
bull non-standard output products
IOC Training Course Report No 50Annex III - page 37
Slide 7
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 7
Common system elements
bull transducer (from geophysical variable to electronic variablecurrent voltage frequency)
bull digitising (from analogue to digital form)
bull multiplexing (combine several datastreams into one)
bull recording (record data on board for later transmission orretrieval)
bull transmission (transmission of full datastream to receivingcentre)
bull reception (reception of transmitted datastream)
bull de-multiplexing (separation of data from differentsensorstransducers)
bull pre-processing (translation of data into geophysical units andquality control)
bull processing (conversion into required format includingcomputation of averages etc)
bull presentation (display of the data in various forms and formatsfor specific applications)
bull archival (permanent or semi-permanent archival of the data)
bull distribution (to users and applications)
Slide 8
P Geerders Consultancy IOC Training Course Goa India 17-27 October 1998 8
Some aspects of Remote Sensing
bull 3 windowsvisible 400-800 nm =gt colour
infrared 1-100 micron =gt temperature
microwaves 1-100 cm =gt ldquowaterstructurerdquo
bull passive versus active techniques
bull platformssatellite (geostationary or polar orbit)
aircraft
high towers or locations
bull sensors and their data structure
radiometers =gt point data
scanners =gt line data
CCD matrix =gt image
Synthetic aperture =gt image
bull product generation requires
field data for calibration and validation
atmospheric correction (espvisible and infrared)
algorithm to translate RS data into relevant geophysical parameter
IOC Training Course Report No 50Annex III ndash page 38
6 Data Information and Metadata(G Reed AODC Australia)
Slide 1
Data Information and MetadataData Information and Data Information and MetadataMetadata
Slide 2
2
Data and InformationData and InformationData and Information
bull Data is the raw material
bull The raw material is processed
bull The result is information
IOC Training Course Report No 50Annex III - page 39
Slide 3
3
An Information SystemAn Information SystemAn Information System
bull An information system is defined as a set of rules usedto process data and convert it into information
bull The information system processes the raw data isuseful people
bull The relationship between data and information is oftensummarised in the Input-Process-Output Model
Input Process Output
Slide 4
4
What is Data ManagementWhat is Data ManagementWhat is Data Management
ldquo Data ManagementData Management is the process of planning
coordinating and controlling an organisations
datardquo
IOC Training Course Report No 50Annex III ndash page 40
Slide 5
5
What is Data ManagementWhat is Data ManagementWhat is Data Management
bull Data management is a philosophy ofndash managing data as an organisational resource
ndash treating data as an important sharable resource
bull Data management is the mechanism for deliveringinformation to decision makers
Slide 6
6
Data ManagementData ManagementData Management
bull The scope of data management ranges from dataacquisition to the production of some kind of output
bull Data management covers the storage transporttransformation combination aggregation of data andmaking it available to those who need it and have theright to access it
bull Data management ends when data becomesinformation
IOC Training Course Report No 50Annex III - page 41
Slide 7
7
What are MetadataWhat are MetadataWhat are Metadata
bull ldquoInformation about datardquo
bull Metadata describes the content quality condition andother characteristics of data
bull Not the actual dataset itself
Slide 8
8
Example of MetadataExample ofExample of Metadata Metadata
bull A library cataloguendash Title of book
ndash Author
ndash Publication date
ndash Unique reference number
ndash Where to find it
IOC Training Course Report No 50Annex III ndash page 42
Slide 9
9
Importance of MetadataImportance ofImportance of Metadata Metadata
bull Provides a means to discover that a dataset exists andhow it can be accessed
bull Documents the content quality and features of adataset and gives an indication of its usefulness
bull Makes data more accessible
bull Reduces duplication of data collection
Slide 10
10
Metadata for Marine DataMetadataMetadata for Marine Data for Marine Data
Metadata elements include
bull Identificationndash name of dataset geographic area of coverage themes
currency restrictions
bull Data qualityndash positional and attribute accuracy completeness
bull Distributionndash who holds the data formats and media
IOC Training Course Report No 50Annex III - page 43
Slide 11
11
Two different approaches
bull Comprehensive definition of data elements to definemetadata including data transfer
bull Minimum number of core elements to adequatelydescribe metadata
Metadata StandardsMetadataMetadata Standards Standards
Slide 12
12
bull Federal Geographic Data Committee (FGDC)ndash standard specifies structure and content of some 220
items to describe digital datasets
ndash lengthy
ndash compliance is difficult to achieve
ndash terminology and length of standard discourages its use
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III ndash page 44
Slide 13
13
bull International Organisation for Standardisation (ISO)ndash draft international standard for metadata
ndash defines 2 levels of compliance
Compliance Level 1 - minimum metadata required touniquely identify a dataset
ndash title responsible party date language abstract purposeprogress extent keywords use constraints spatial referencesystem distribution media and format
Compliance Level 2 - metadata to fully describe adataset
ndash Level 1 plus detailed data quality processing and citationinformation
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
Slide 14
14
bull Australia New Zealand Land Information Council(ANZLIC)ndash uses a ldquopagesrdquo concept to describe spatial information
ndash Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
ndash Page 1 describes additional thematic metadata
ndash Page 2 describes additional agency metadata
Examples of Metadata StandardsExamples ofExamples of Metadata Metadata Standards Standards
IOC Training Course Report No 50Annex III - page 45
Slide 15
15
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Slide 16
16
IODE and MetadataIODE and IODE and MetadataMetadata
bullbull MEDI - Marine Environmental Data InformationMEDI - Marine Environmental Data InformationReferral SystemReferral System
bull MEDI Objectives ldquoMEDI will provide the marine community with referrals
concerning the availability location andcharacteristics of marine environmental data to meettheir specific needsrdquo (1979)
IOC Training Course Report No 50Annex III ndash page 46
Slide 17
17
MEDI CatalogueMEDI CatalogueMEDI Catalogue
bull First published in 1979 - contained 86 datasetdescriptions from 40 institutions in 20 countries
bull Second edition published in 1985 - contained 219datasets from 64 institutions in 32 countries
bull Third edition published in 1993 - contained 247datasets from 40 institutions in 27 countries
bull All three editions were made available in printedformat only (as IOC Manual and Guides)
Slide 18
18
MEDI Pilot ProjectMEDI Pilot ProjectMEDI Pilot Project
bull 15th Session of IODE (1996) recommended thesetting up of a pilot project to ldquoTest ways and means of applying modern technology to
the further development of the MEDI system and on thebasis of these investigations to draft a specification fora revised MEDIrdquo
IOC Training Course Report No 50Annex III - page 47
Slide 19
19
Existing Marine Metadata SystemsExisting Marine Metadata SystemsExisting Marine Metadata Systems
bull Review of three marine metadata directory systemshas been undertakenndash European Directory of Marine Environmental Data
(EDMED)
ndash Marine amp Coastal Data Directory of Australia (BluePages)
ndash Extended EDMED for Ireland
bull Similar structure for all these directories - only minorvariations
Slide 20
20
The Blue Pages Data DirectoryTheThe Blue PagesBlue Pages Data Directory Data Directory
bull Main function is management of marine metadata
bull Contains only the metadata needed to decide if adataset exists and is useful
bull Compliant with ANZLIC ldquoPage 0rdquo metadata guidelines
bull Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 48
Slide 21
21
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 22
22
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 49
Slide 23
23
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software
bull Uses MS Access 7 as the DBMS
bull Includes a spatial query tool written in Visual C++
bull Two versions of the softwarendash compiled version requires MS Access 7 licence7
ndash run-time version does not require MS Access
bull Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
IOC Training Course Report No 50Annex III ndash page 50
7 A Metadata Directory System for Marine Data(G Reed AODC Australia)
Slide 1
1International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
A Metadata Directory System forMarine Data
A Metadata Directory System forA Metadata Directory System forMarine DataMarine Data
Greg ReedAustralian Oceanographic Data Centre
Slide 2
2International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
What are MetadataWhat are MetadataWhat are Metadata
Data about data
Metadata describes the content quality conditionand other characteristics of data
Not the actual dataset itself
IOC Training Course Report No 50Annex III - page 51
Slide 3
3International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Example of MetadataExample of MetadataExample of Metadata
A library catalogue Title of book
Author
Publication date
Unique reference number
Where to find it
Slide 4
4International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Importance of MetadataImportance of MetadataImportance of Metadata
Provides a means to discover that a dataset existsand how it can be accessed
Documents the content quality and features of adataset and gives an indication of its usefulness
Makes data more accessible
Reduces duplication of data collection
IOC Training Course Report No 50Annex III ndash page 52
Slide 5
5International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata for Marine DataMetadata for Marine DataMetadata for Marine DataMetadata elements include
Identificationname of dataset geographic area of coverage themes
currency restrictions
Data qualitypositional and attribute accuracy completeness
Distributionwho holds the data formats and media
Slide 6
6International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Metadata StandardsMetadata StandardsMetadata Standards
Two different approaches
Comprehensive definition of data elements todefine metadata including data transfer
Minimum number of core elements to adequatelydescribe metadata
IOC Training Course Report No 50Annex III - page 53
Slide 7
7International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
Federal Geographic Data Committee (FGDC)standard specifies structure and content of some 220
items to describe digital datasets
lengthy
compliance is difficult to achieve
terminology and length of standard discourages its use
Slide 8
8International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards
International Organisation for Standardisation (ISO)draft international standard for metadata (Geographic
Information - 15046 Part 15 Metadata)
defines 2 levels of compliance Compliance Level 1 - minimum metadata required to uniquely
identify a datasetndash title responsible party date language abstract purpose progress
extent keywords use constraints spatial reference systemdistribution media and format
Compliance Level 2 - metadata to fully describe a datasetndash Level 1 plus detailed data quality processing and citation
information
IOC Training Course Report No 50Annex III ndash page 54
Slide 9
9International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Examples of Metadata StandardsExamples of Metadata StandardsExamples of Metadata Standards Australia New Zealand Land Information Council
(ANZLIC)uses a ldquopagesrdquo concept to describe spatial information
Page 0 defines the mandatory elements to allow users toidentify and determine suitability of a dataset
Page 1 describes additional thematic metadata
Page 2 describes additional agency metadata
Slide 10
10International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The ldquoPagesrdquo ConceptThe ldquoPagesrdquo ConceptThe ldquoPagesrdquo Concept
Page 1
Page 0
Page 1
Page 2
NationalMetadataDirectory
Jurisdictional or ThemeMetadataDirectories
AgencyMetadataDirectories
Dataset A Dataset B Dataset C Dataset n
Page 0
Page 0
System
IOC Training Course Report No 50Annex III - page 55
Slide 11
11International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Directories for Marine DataDirectories for Marine DataDirectories for Marine Data
A successful Marine Data Directory must becomplete
easy to use
reliable
Should contain enough information for a user todetermine the suitability of a dataset
Slide 12
12International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages Data DirectoryThe The Blue PagesBlue Pages Data Directory Data Directory Main function is management of marine metadata
Contains only the metadata needed to decide if adataset exists and is useful
Compliant with ANZLIC ldquoPage 0rdquo metadataguidelines
Additional ldquoPage 1rdquo metadata to describe marinedatasets
IOC Training Course Report No 50Annex III ndash page 56
Slide 13
13International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Core MetadataBlue PagesBlue Pages Core Metadata Core Metadata
Lineage
Data Quality
PositionalAccuracy
AttributeAccuracy
Dataset
Data Currency
BeginningDate
End Date
Dataset Status
Progress
Maintenance andUpdate Frequency
Category
Field
KEY
LogicalConsistency
Completeness
Contact Information
Metadata Date
Additional Metadata
Metadata Person
Jurisdiction
Custodian
Title
Dataset Description
Abstract
Search Words
Geographic ExtentPolygon
or
Geographic ExtentName
Stored Format
Access
AccessConstraint
AvailableFormat Type
Contact OrganisationContact PositionContact Person
Mail AddressDetails
PhoneFax
Metadata Organisation
Slide 14
14International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
Blue Pages Additional MetadataBlue PagesBlue Pages Additional Metadata Additional MetadataDataset
Data Content Program Information
Equipment
Category
Field
KEY
Parameter Description
Sampling Intensity
Sampling Method
Habitat Description
Taxonomic Group
Program CoordinatorOrganisation
Program Name
Program Coordinator
Platform Name
Publication Information
Documentation Reference
Online Link
Monitoring
Parent Organisation
Principal Organisation
Collaborative Organisation
Objectives
Clients
IOC Training Course Report No 50Annex III - page 57
Slide 15
15International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
The Blue Pages SoftwareThe The Blue PagesBlue Pages Software Software Uses MS Access 7 as the DBMS
Includes a spatial query tool written in Visual C++
Two versions of the softwarecompiled version requires MS Access 7 licence
run-time version does not require MS Access
Software can be downloaded from
httpwwwAODChttpwwwAODCgovgovauau
Slide 16
16International Symposium on Information Technology in Oceanography (ITO98)International Symposium on Information Technology in Oceanography (ITO98)
ConclusionConclusionConclusion
Metadata is fundamental - not incidental
Metadata directories should contain sufficient detailfor users to identify suitable datasets
Metadata directories containing only core metadataelements are easier to populate and maintain
Ease of use and flexible search tools are essential toencourage use of metadata directories
IOC Training Course Report No 50Annex III ndash page 58
8 Numerical Vs Textual Databases(MP Tapaswi NIO Goa India)
Slide 1
Numerical Vs TextualDatabases
Murari P Tapaswimuraricsniorennicin
Slide 2
DBMS
bull Structured information storage amp retrievalsoftware
bull Initially came into being for handling ofnumerical data like
rArr Stores inventory controlrArr Salary management
rArr Accountancy etc
bull Notable examples of well known softwares Dbase FoxPro Access
IOC Training Course Report No 50Annex III - page 59
Slide 3
TEXTUAL DBMS
bull Deal with data whose major constituent istext
bull Offer many features normally found inword processing softwares
rArr Cut - PasterArr Insert - Replace moderArr Cursor movement
bull by arrow keysbull word by wordbull to beginning amp end of the field
rArr Delete field contents from cursor positiononwards or whole field
Slide 4
bull Handle fields of varying length
rArr Optimal utilization of HD space
rArr Freedom for defining maximum length of afield
rArr Freedom of defining databases for complexstructure
rArr Linking two records from same database
rArr Storage of data in ISO - 2709 format
textual DBMS
IOC Training Course Report No 50Annex III ndash page 60
Slide 5
rArr Conglomerate date elements of singleconcept under one roof (field) keepingtheir identity
rArr Generate indexes on the desiredsubfields only
bull Offer repeatable field facility
rArrTo accommodate data elements of thesame field occurring more than once
bull Offer sub-field facility
textual DBMS
Slide 6
DATA ENTRY
bull Support multiple data entry worksheets
bull Automatically recall of last modifiedrecord or search result(s) for editing
bull Control characters for filing informationand search term delimiters
rArr using lt gt within the data fields
bull Scrolling fields for data entry of longerelements
IOC Training Course Report No 50Annex III - page 61
Slide 7
bull Pick-list assistance for data withstandard structure
bull Help messages to assist data entry
data entry
Slide 8
DISPLAY FORMATS
bull Multiple display formats
bull Line break at word level
bull Data display formats to includecommands which produce
rArr Data (contents of given field)
rArr Actions (skipping to new line leavingblank lines amp columns lower - uppercase etc)
IOC Training Course Report No 50Annex III ndash page 62
Slide 9
rArr Numerical
rArr String
rArr Boolean
rArr String function help to link two records todisplay data as if it is from single record
bull Support different type of expressionsamp functions
display formats
Slide 10
bull Allow escape sequences to printdata in bold italics etc
bull Sorted output
display formats
IOC Training Course Report No 50Annex III - page 63
Slide 11
DATA INVERSION INDEXING
bull Use of single index to allow search fora given term in any field
bull Index on
rArr Whole field
rArr Specific subfield(s) of a field
rArr Words in a field
rArr Phrases
Slide 12
bull Index terms for efficient retrievalbacked up by efficient index notingrArr Record number
rArr Field of occurrence
rArr Occurrence number
rArr Sequence number
bull lsquoStopwordrsquo file to prevent indexing ofwords not likely to be searched (like aan the or not and their these etc)
data inversion
IOC Training Course Report No 50Annex III ndash page 64
Slide 13
SEARCH
bull Search expressions based onBoolean algebra consisting of searchoperators OR AND NOT
bull Search expressions built onrArr Precise terms (words phrases numbers
etc)
rArr Right truncated terms
rArr lsquoAnyrsquo terms (a collective term standing forset of predefined search terms)
Slide 14
bull Field level and proximity searchoperatorsrArr Same field
rArr All repeatable fields as single field (G)
rArr Within a single repeatable field (F)
rArr Terms within the field not longer than lsquonrsquowords apart (eg AhellipB (maximum twowords between A amp B)
rArr Terms within the field exact lsquonrsquo wordsapart (eg A$$B (exactly one word apart)
search
IOC Training Course Report No 50Annex III - page 65
Slide 15
bull Parenthesis for expressive syntax
bull Specified field or group of fields inwhich the term to appear (egA(350 351)
bull Free text search for fields notindexed beyond Boolean logic
bull Display of searched results indesired format
search
Slide 16
bull Search byrArr Typing search expression
rArr Picking up terms from the dictionary(indexed list of terms)
rArr Recalling previous search expression (andediting if required)
rArr Recalling previous search set
search
IOC Training Course Report No 50Annex III ndash page 66
Slide 17
bull Sort and print retrieved records indesired format
bull The desired format can be predefinedor to be defined for case specific
RETRIEVAL
Slide 18
bull Printing to support page layoutparameters required for a particularprint runrArr Headings sub-headings
rArr Page numbers or no page number
rArr Number of columns
rArr Line width column width
rArr Lines page
rArr End of column tolerance
rArr Data indention
retrieval
IOC Training Course Report No 50Annex III - page 67
Slide 19
DATA TRANSFER ANDPROGRAMMING
bull Import amp export records from toother databases
bull Take backup
bull Programming with high levellanguages with additional library ofcertain functions and procedures
IOC Training Course Report No 50Annex III ndash page 68
9 Distributed Database Management Systems(G Reed AODC Australia)
Slide 1
Distributed Database ManagementSystems
Distributed Database ManagementDistributed Database ManagementSystemsSystems
Slide 2
2
BackgroundBackgroundBackground
IOC Training Course Report No 50Annex III - page 69
Slide 3
3
What is a Distributed Database SystemWhat is a Distributed Database SystemWhat is a Distributed Database System
bull A distributed database (DDB) is a collection ofmultiple logically interrelated databases distributedover a computer network
bull A distributed database management system (D-DBMS)is the software that manages the DDB and provides anaccess mechanism that makes the distributiontransparent to the users
bull Distributed database system (DDBS)=DDB+D-DBMS
Slide 4
4
Centralised DBMS on a NetworkCentralised Centralised DBMS on a NetworkDBMS on a Network
IOC Training Course Report No 50Annex III ndash page 70
Slide 5
5
Distributed DBMS EnvironmentDistributed DBMS EnvironmentDistributed DBMS Environment
Slide 6
6
Distributed DBMSDistributed DBMSDistributed DBMS
bull A DBMS manages data stored on several computers(usually geographically distributed) through variouscommunication media (usually networks)
bull Types of transactionsndash Local Transaction accesses data only at one site which
it was submitted
ndash Global Transaction Accesses data either at differentsite than the submission site or accesses data at severalsites
IOC Training Course Report No 50Annex III - page 71
Slide 7
7
Applications of DDBSApplications of DDBSApplications of DDBS
bull Electronic Funds Transfer (EFT)
bull Airlines
bull Hotel chains
bull Corporate MIS
bull Military command and control
bull Any organisation which has a decentralisedorganisation structure
Slide 8
8
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Data sharingndash users at one site can easily access data at other sites
bull Greater availabilityndash failure at one site does not mean that the whole
database is unavailable
bull Autonomy of operation and control of local datandash reduces problems of data management and data access
to local component of DBMS
IOC Training Course Report No 50Annex III ndash page 72
Slide 9
9
Advantages of DDBSAdvantages of DDBSAdvantages of DDBS
bull Ease of reconfiguration and extensionndash new databases and processors can be added to the
network without changing existing systems
bull Lower costsndash smaller computers can be used at each site
Slide 10
10
Disadvantages of DDBSDisadvantages of DDBSDisadvantages of DDBS
bull Complexityndash network architecture
bull Costndash additional hardware required communication costs
bull Distribution of controlndash no one persondepartment in control
bull Lack of experiencendash need specialised skills to implement and run
IOC Training Course Report No 50Annex III - page 73
Slide 11
11
Network ArchitectureNetwork ArchitectureNetwork Architecture
bull Specifies how sites in the system are connected toeach otherndash fully connected
ndash tree
ndash star
ndash ring
ndash partially connected
bull Network typesndash LAN - local area network
ndash WAN - wide area network
Slide 12
12
Distributed DBMS ArchitectureDistributed DBMS ArchitectureDistributed DBMS Architecture
bull autonomy - the degree to which the DBMSs ateach site have control over their operation
bull distribution - the degree towhich the database isdistributed
bull heterogeneity - the degreeto which the DBMSs ateach site are different
IOC Training Course Report No 50Annex III ndash page 74
Slide 13
13
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replicationndash stores a relation at two or more sites
bull Advantagesndash availability
bull Disadvantagesndash increased overhead on update
Slide 14
14
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull horizontal
IOC Training Course Report No 50Annex III - page 75
Slide 15
15
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data fragmentation
bull vertical
Slide 16
16
Distribution StrategiesDistribution StrategiesDistribution Strategies
Data replication and fragmentation
bull combination of the two
bull fragments can be replicated
bull replicates can be fragmented
IOC Training Course Report No 50Annex III ndash page 76
Slide 17
17
Network TransparencyNetwork TransparencyNetwork Transparency
Transparency
bull the degree to which users can remain unaware of thedetails of the design of the distributed system
Goal
bull to maximise transparency so that users view thedistributed database as a single database
Slide 18
18
Distributed Query ProcessingDistributed Query ProcessingDistributed Query Processing
The distributed database should look like a singledatabase to users (transparency)
bull a query may require data from several sites
bull factors to considerndash cost of data transmission
ndash reliability of data communications
IOC Training Course Report No 50Annex III - page 77
10 Quality and Quality Control of Oceanographic Data(Pankajakshan Thadathil Goa India)
Slide 1
Quality and Quality Control ofOceanographic Data
Pankajakshan ThadathilRNODC-INDO
National Institute ofOceanography
Dona Paula Goa
Slide 2
ldquo Oceanographic data is like an infant Unless care is taken it issusceptible to injuries ( errors) However unlike infants data is
immortal Once it is collected it remains as a source ofinformation for everrdquo
IOC Training Course Report No 50Annex III ndash page 78
Slide 3
Data Collection preparation
Instruments CalibrationReagents Preparation etc H - Factor
Different Stages Sources of Errors Human ( H) Non -H facor
Data Collection Instrument Mulfunctions N-H Factor
Data RecordingDegitisation of Analougeto digital parallelax errorerror in analysis etc
H and N-H
Data TransferFrom hard copy to computerfrom remote sensors to receiving stationrsquos computer
H and N-H
Slide 4
Errors in general can be classified as
Random Errorand
Systematic Error
IOC Training Course Report No 50Annex III - page 79
Slide 5
General Quality Checks Involved in Oceanographic Data
Inventory Level Checks
Position Datetime Vessel Speed Duplicateand Sounding
Data Level Checks
Visual Inspection Range Check Climatology CheckInversion Check Neighbourhood Check Spikes Stability Check Depth Reversal Duplicate etc
Slide 6
Typical Random and Systemtic Error
bull Random error = (St Dev Sq rt of No Obs )
bull Systematic Error = Bias
26 27 28 29 30 31 32Bucket SST ( C )
26
27
28
29
30
31
32
CTD
- S
ST
( C
)
IOC Training Course Report No 50Annex III ndash page 80
Slide 7
Vertical Profile
Vertical Section
Horizontal Distribution
Data - Level Check
Visual Inspection
Surface Transient
Spikes Fall Rate
Temperature Inversion
Neighbourhood
Climatology Nub
Wire StretchWire Break
Assignment ofQuality Code
IODC XBT
Data Base
XBT Data
Inventory-level Check
Position
Duplicates
Date-Time
Vessel Speed
Station Sounding
Quality Control Module
Visualisation
An Interactive System for XBT QualityControl and Visualisation
Slide 8
IGOOS Quality Codes
0 No Quality Control ( QC) has been performed on this element1 QC has been performed Element appears to be correct2 QC has been performed Element appears to be inconsistent with other elements3 QC has been performed Element appears to be doubtful4 QC has been performed Element appears to be erroneous5 The value has been changed as a result of QC6 7 and 8 Reserved9 The value of the element is missing
IOC Training Course Report No 50Annex III - page 81
11 Geographic Information System (GIS)(PD Kunte NIO Goa India)
Slide 1
Data Product Development Tools
Pravin D Kunte
e-mail kuntecsniorennicinData amp Information Div
National Institute of OceanographyDona Paula Goa - 403 004
Geographic Information System (GIS)
Slide 2
Geographic Information System
is a suit of hardware amp software which has capability to handle bothspatial and Non-spatial data concurrently
Four Major components are
bull Database Module bull Analysis Modulebull Presentation Modulebull Capture Module
IOC Training Course Report No 50Annex III ndash page 82
Slide 3
G I S Data types and Modules
Geographic data
Physical DimensionGeographic locationAny Qualifying data
ATTRIBUTE DATA -- Qualifies Spatial dataSPATIAL DATA -- Physical Dimension amp Location
Geometric Entities Point line Polygon
Representation of Data VECTOR Vs RASTER
Slide 4
DATA CAPTURE
bullKey board entrybullManual digitizationbullAutomated input
bullImporting ImagesbullImporting DatabullVoice Input
Steps in Data Inputting
1 a) Digitizing Operation b) Auto Scanning (Point or stream mode)2 Import data from other sources 1 Projection 2) Scale3 Raster amp Vector
IOC Training Course Report No 50Annex III - page 83
Slide 5
G I S DATABASE DESIGN
ATTRIBUTE DATABASE CREATION
Conceptual DesignbullApplication RequirementsbullEnd-utilization GoalsbullTarget Users
Logical DesignbullDatabase specificationbullDatabase ElementsbullDatabase StructurebullDatabase updation procedure
Physical Design Hardware Software requirements
G I S Package Dependent -----
||
Slide 6
SPATIAL DATABASE CREATION
bullDefine reference point and extent for study sitebullCreate Map in Polyconic UnitbullDigitize Theme from Thematic databullEdit and Topology BuildingbullCheck for ErrorsbullCreate separate Themes hellip Theme1 Theme2 etcbullAssociate other Attributes if anyhellipbullTheme ready for Analysis
Define Relation between Spatial and Non-Spatial data
IOC Training Course Report No 50Annex III ndash page 84
Slide 7
SPATIAL ANALYSIS TECHNIQUES
Overlay Operations in Raster amp Vector based System
1 Feature Combination ---- Union amp Intersect
2 Feature Extraction --- Erase --- Clip ampSplit
3 Feature Combination amp Extraction 1 Update 2 Indentity3 Proximity Aggregation4 Spatial Aggregation5 Generalization
Slide 8
MODELING IN G I S
Modeling is a process of doing a systematic and logicalenquiry of the data for establishing the relationshipsbetween the variables
1 Methodological Models How a desired function could be workedout wing different operations in a sequen-tial or in a logically related manner
2 Mathematical Model1 Binary models using nominal variables2 Weighting models at an ordinal level3 Quantitative models using intervals amp ratio
IOC Training Course Report No 50Annex III - page 85
Slide 9
QUERIES IN G I S
All Kinds of S Q L Queries at following three levels
1 Point mode2 line mode3 Polygon mode
Three levels of Queries
1 Logical 2 Spatio-logical 3 Model base
Slide 10
3 D IN G I S
Digital Surface Modeling (DSM) encompasses task like Understanding of Surface Characteristics
bullD S M GenerationbullD S M analysis for derivativesbullD S M Application
The Derivatives Obtained arebull3D visualization of SurfacebullPlanner derivatives like slops aspects ranges etcbullSpot heights amp surface distances
Applicationbull3D display of bottom topographybullCut amp Fill estimationsbullComparisons of different terrain
IOC Training Course Report No 50Annex III ndash page 86
Slide 11
NET WORKING IN G I S
Network is a set of connected lines which are conduitsfor resources movement and are connected to each other at nodes
Elements are
1 Lines 2 Resistance 3 Resource demand 4 Turns5 Stops 6 Facility - Point 7 Blocks
Applications of Networking
1 Path determination 2 Resource allocation3 Distribution analysis 4 Utility locating
Slide 12
G I S can be used in numerous wayshellip
-- for processing amp integrating spatial data-- archiving amp managing data-- for displaying amp generating thematic maps-- for building scenarios-- for predicting impacts-- to simulate amp animate operations amp processes
and also to develop models to represent REALlife situation
IOC Training Course Report No 50Annex III - page 87
Slide 13
G I S in Oceanography
Oceanography being a multidisciplinary study ofdynamic media within which various processes takeplace and interact over a wide range of space and timehas tremendous potential
State-of-the-art
ASFA indicates only 55 studies in Oceanography as comparedto over 2000 land-based application
Out of 55 studies --- 1 63 (35) studies pertain to coast2 16 ( 9) Near shore region3 9 (5) Open Ocean
Slide 14
G I S in Oceanography
Hurdles
1 GIS are designed and built for land application
2 Limited availability of good quality data of temporal nature and uniform density coverage
3 Diversified parameters lat-long time season depth
4 Relatively less physical objects few topo features
5 Media is highly volatile dynamic complex 4 dimensional
IOC Training Course Report No 50Annex III ndash page 88
Slide 15
Thanks
IOC Training Course Report No 50Annex III - page 89
12 Internet Evolution Spread Prospects and Tools(A Ghosh NIO Goa India)
Slide 1
QWHUQHW(YROXWLRQ6SUHDGQWHUQHW(YROXWLRQ6SUHDG3URVSHFWVDQG7RROV3URVSHFWVDQG7RROV
Aravind GhoshAravind Ghosh K KNational Institute of OceanographyNational Institute of OceanographyDona Paula Goa 403 004 IndiaDona Paula Goa 403 004 Indiae-mail e-mail garvindgarvindcsniocsniorenrennicnicinin
URL httpURL httpwwwwwwnionioorgorg
Slide 2
KDWLVQWHUQHWKDWLVQWHUQHW
Collection of thousands of computerCollection of thousands of computernetworksnetworks
More than 100 million users More than 100 million users
Growth rate 10 per monthGrowth rate 10 per month
IOC Training Course Report No 50Annex III ndash page 90
Slide 3
7KLQJVWRNQRZDERXWQWHUQHW7KLQJVWRNQRZDERXWQWHUQHW
Medium for effective communicationMedium for effective communication
Research Support with informationResearch Support with informationretrieval mechanismretrieval mechanism
Cost and Feature flexibilityCost and Feature flexibility
Local as well as International EntityLocal as well as International Entity
Heterogeneous infrastructure andHeterogeneous infrastructure andappearance and usageappearance and usage
Not owned by any oneNot owned by any one
Slide 4
QWHUQHW2ULJLQQWHUQHW2ULJLQ
2 Jan 69 - Work on ARPANET started2 Jan 69 - Work on ARPANET started
2 Sept 69 - Four ARPANET sites started2 Sept 69 - Four ARPANET sites startedoperatingoperating
1970rsquos - NCP was replaced by TCPIP1970rsquos - NCP was replaced by TCPIP
1983 - ARPANET and MILNET1983 - ARPANET and MILNET
July 88 - NSF upgraded backbone to 15July 88 - NSF upgraded backbone to 15MbpsMbps
1985 - Agreement with 4 corporate agencies1985 - Agreement with 4 corporate agenciesto strengthen NSFNETto strengthen NSFNET
April 95 - NSFNET was replaced with NAPSApril 95 - NSFNET was replaced with NAPS
IOC Training Course Report No 50Annex III - page 91
Slide 5
QWHUQHW)URQWHDGHUVQWHUQHW)URQWHDGHUV
The Internet SocietyThe Internet Society
Commercial Internet ExchangeCommercial Internet Exchange
FARNETFARNET
Slide 6
QWHUQHW6RFLDOHYHORSPHQWVQWHUQHW6RFLDOHYHORSPHQWV
Internet WormInternet Worm
Slovenia IndependenceSlovenia Independence
Russian CoupRussian Coup
Internet amp PersonalityInternet amp Personality
IOC Training Course Report No 50Annex III ndash page 92
Slide 7
QWHUQHW5HWULHYDO7RROVQWHUQHW5HWULHYDO7RROV
E-mailE-mail
Telnet - Remote LoginTelnet - Remote Login
FTP - File Transfer ProtocolFTP - File Transfer Protocol
ARCHIEARCHIE
GOPHER and VeronicaGOPHER and Veronica
USENET and Discussion ListsUSENET and Discussion Lists
Wide Area Information ServersWide Area Information Servers
Internet Relay ChatInternet Relay Chat
World Wide Web (WWW)World Wide Web (WWW)
TalkTalk
Slide 8
RUOGLGHHERUOGLGHHE
legitimate way of publishinglegitimate way of publishing
distributed object management systemdistributed object management system
unstructured and serendipitousunstructured and serendipitousbrowsingbrowsing
Search ToolsEnginesSearch ToolsEngines
IOC Training Course Report No 50Annex III - page 93
Slide 9
6($5amp+72267lt3(66($5amp+72267lt3(6
SUBJECT TREESSUBJECT TREES structured and organized hierarchystructured and organized hierarchy
of categoriesof categories Maintained manuallyMaintained manually Keyword searchable indexesKeyword searchable indexes
Slide 10
6($5amp+72267lt3(66($5amp+72267lt3(6
6($5amp+(11(66($5amp+(11(6 LQGH[VL]HLQGH[VL]H XSGDWHIUHTXHQFXSGDWHIUHTXHQF VHDUFKRSWLRQVVHDUFKRSWLRQV VHDUFKUHWULHYDOVSHHGVHDUFKUHWULHYDOVSHHG UHVXOWVHWSUHVHQWDWLRQUHVXOWVHWSUHVHQWDWLRQ UHOHYDQFHRILWHPVLQUHVXOWVHWUHOHYDQFHRILWHPVLQUHVXOWVHW HDVHRIXVHHDVHRIXVH
IOC Training Course Report No 50Annex III ndash page 94
Slide 11
6($5amp+(11(6amp$7(25(66($5amp+(11(6amp$7(25(6
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
6HDUFK(QJLQH6HDUFK(QJLQH
0HWD0HWD6HDUFKHUV6HDUFKHUV
636HDUFK(QJLQH636HDUFK(QJLQH
86(1(76HDUFK(QJLQH86(1(76HDUFK(QJLQH
)736RIWZDUH6HDUFK(QJLQH)736RIWZDUH6HDUFK(QJLQH
ltHOORZ3DJHV6HDUFK(QJLQHltHOORZ3DJHV6HDUFK(QJLQH
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHV
0DLOLQJLVWLUHFWRULHV0DLOLQJLVWLUHFWRULHV
6XEMHFW7UHHV6XEMHFW7UHHV
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
5HYLHZLQJVLWHV5HYLHZLQJVLWHV
6SHFLDOL]HG6XEMHFWXLGHV6SHFLDOL]HG6XEMHFWXLGHV
Slide 12
6SLGHUV5RERWVRUPV6SLGHUV5RERWVRUPV
Spiders Robot WormsAltaVista httpwwwaltavistadigitalcom Excite httpwwwexcitecom HotBot httpwwwhotbotcom InfoSeek httpwwwinfoseekcom Lycos httpwwwlycoscom OpenText httpwwwopentextuunetca8080 WebCrawler httpwwwwebcrawlercom
IOC Training Course Report No 50Annex III - page 95
Slide 13
LUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHVLUHFWRUEDVHG6XEMHFW7UHHVampDWDORJXHV
A2Z httpa2zlycoscom EINet Galaxy httpgalaxyeinetnet InfoSeek httpwwwinfoseekcom Magellan httpwwwmckinleycom Pointcom httpwwwpointcomcom Tradewave Galaxy httpgalaxyeinetnet Yahoo httpwwwyahoocom
Slide 14
6($5amp+(11(66($5amp+(11(6 $OWD9LVWD$OWD9LVWD KWWSKWWSZZZZZZDOWDYLVWDDOWDYLVWDGLJLWDOFRPGLJLWDOFRP ([FLWH([FLWH KWWSKWWSZZZZZZH[FLWHFRPH[FLWHFRP +DUYHVWURNHU+DUYHVWURNHU KWWSWRZQKDOORUJKWWSWRZQKDOORUJ
+RWRW+RWRW KWWSKWWSZZZZZZKRWERWKRWERWFRPFRP GHQWLIGHQWLI KWWSKWWSZZZZZZLGHQWLIFRPLGHQWLIFRP ([SORUHU([SORUHU KWWSKWWSZZZZZZLH[SORUHUFRPLH[SORUHUFRP QIRKLZDQIRKLZD KWWSKWWSZZZZZZLQIRKLZDLQIRKLZDFRPFRP QIR6HHNQIR6HHN KWWSKWWSZZZZZZLQIRVHHNLQIRVHHNFRPFRP QNWRPLQNWRPL KWWSKWWSLQNWRPLLQNWRPLEHUNHOHEHUNHOHHGXHGX QWXLWLYHHEQGH[QWXLWLYHHEQGH[ KWWSKWWSZZZZZZLH[SLH[SFRPLQGH[FRPLQGH[
-DGH-DGH KWWSKWWSZZZZZZMDGHMDGHFRPFRP (2(2 KWWSKWWSZZZZZZOHROHRRUJRUJFJLFJLELQELQOHROHRVHDUFKVHDUFK
LQN0DVWHULQN0DVWHU KWWSKWWSZZZZZZOLQNPDVWHUOLQNPDVWHUFRPFRP
LQN0RQVWHULQN0RQVWHU KWWSKWWSZZZZZZOLQNPRQVWHUOLQNPRQVWHUFRPFRP
LQN6WDULQN6WDU KWWSKWWSZZZZZZOLQNVWDUOLQNVWDUFRPFRP FRVFRV KWWSKWWSZZZZZZOFRVOFRVFRPFRP 0DJHOODQ0DJHOODQ KWWSKWWSZZZZZZPFNLQOHPFNLQOHFRPFRP
1HUGRUOG1HUGRUOG KWWSKWWSZZZZZZQHUGZRUOGQHUGZRUOGFRPFRP 1HWampHQWUH1HWampHQWUH KWWSKWWSQHWFHQWUHQHWFHQWUHFRPQHZVHDUFKFRPQHZVHDUFKKWPOKWPO
1HW+DSSHQLQJV1HW+DSSHQLQJV KWWSKWWSZZZZZZJLJLQHWQHW 1HW1DYLJDWRU1HW1DYLJDWRU KWWSKWWSZZZZZZQDYLJDWHQHWQDYLJDWHQHW
1H[RUmiddotV$OLZHE1H[RUmiddotV$OLZHEKWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFDOLZHEDOLZHEGRFVHDUFKGRFVHDUFKKWPOKWPO
1OLJKW11OLJKW1 KWWSKWWSQOLJKWQQOLJKWQFRPFRP 2SHQ7H[W2SHQ7H[W KWWSKWWSZZZZZZRSHQWH[WRSHQWH[WXXQHWXXQHWFDFD 3DWKILQGHU3DWKILQGHU KWWSSDWKILQGHUFRPKWWSSDWKILQGHUFRP 5(5( KWWSKWWSZZZZZZVNOLQHQHW5(VNOLQHQHW5( 7UDGHD7UDGHDDOD[DOD[ KWWSJDOD[KWWSJDOD[WUDGHZDYHWUDGHZDYHFRPFRP
7ULEDO9RLFH7ULEDO9RLFHKWWSKWWSZZZZZZWULEDOFRPWULEDOFRP 857UHH857UHH KWWSKWWSZZZZZZLHDLHDFRPaFRPaSHWHUGSHWHUGWUHHWUHH HEHE KWWSKWWSZZZZZZVVHUYVVHUYFRPZHEFRPZHE KWWSKWWSSDEORSDEORXEXXEXUXXUXXQOQO HEampUDZOHUHEampUDZOHU KWWSKWWSZZZZZZZHEFUDZOHUZHEFUDZOHUFRPFRP
RUOG$QQRXQFH$UFKRUOG$QQRXQFH$UFK KWWSKWWSZZZZZZDDDDDDFRPDXFRPDX
RUPRUPKWWSKWWSZZZPFEZZZPFEFVFVFRORUDGRFRORUDGRHGXHGXKRPHKRPHPFEUDQPFEUDQKWPOKWPO
ltDKRRltDKRR KWWSKWWSZZZZZZDKRRFRPDKRRFRP
IOC Training Course Report No 50Annex III ndash page 96
Slide 15
0(7$6($5amp+(560(7$6($5amp+(56 $OOLQ2QH$OOLQ2QH KWWSKWWSZZZZZZDOEDQDOEDQQHWQHWDOOLQRQHDOOLQRQH $OO2QH$OO2QH KWWSKWWSZZZZZZDOORQHFRPDOORQHFRP $FFX)LQG$FFX)LQG KWWSKWWSQOQQOQFRPFRP amp86amp86 KWWSZHEKWWSZHEQH[RUQH[RUFRFRXNXNSXEOLFSXEOLFFXVLFXVLFXVLFXVLKWPOKWPORURU
KWWSKWWSZZZZZZHHFVHHFVQZXQZXHGXHGXFXVLFXVLKWPOKWPO amp8amp8 +WWS+WWSFXLZZZFXLZZZXQLJHXQLJHFKFKPHWDPHWDLQGH[LQGH[KWPOKWPO
ampEHUampEHU KWWSFEHUFRPKWWSFEHUFRP RJSLOHRJSLOH KWWSKWWSZZZZZZGRJSLOHGRJSLOHFRPFRP L)LQGL)LQG KWWSPLQIHUHQFHFRPKWWSPLQIHUHQFHFRPLILQGLILQG )UDPH6HDUFK)UDPH6HDUFK KWWSKWWSZZZZZZZFRPFRPZFRPFRPIVHDUFKIVHDUFK
00QIRPDUNHWQIRPDUNHW KWWSKWWSZZZZZZLQIRPDUNHWLQIRPDUNHWLEPLEPFRPFRP
QWHUQHW6OHXWKQWHUQHW6OHXWK KWWSKWWSZZZZZZLVOHXWKLVOHXWKFRPFRP
+LJKZD+LJKZD KWWSKWWSZZZZZZKLJKZDFRPKLJKZDFRP
0DPPD0DPPD KWWSKWWSZZZZZZPDPPDFRPPDPPDFRP 0HWDampUDZOHU0HWDampUDZOHU
+WWS+WWSPHWDFUDZOHUPHWDFUDZOHUFVFVZDVKLQJWRQZDVKLQJWRQHGXHGXRURU
KWWSKWWSZZZZZZPHWDFUDZOHUPHWDFUDZOHUFRPLQGH[FRPLQGH[KWPOKWPO
0HWD6HDUFK0HWD6HDUFKKWWSKWWSPHWDVHDUFKPHWDVHDUFKFRPFRP 0RWKHURDGQVDQH6HDUFK0RWKHURDGQVDQH6HDUFK
KWWSKWWSZZZZZZFRVPL[FRVPL[FRPFRPPRWKHUORDGPRWKHUORDGLQVDQHLQVDQH 0XOWL7KUHDGHG4XHU3DJH0XOWL7KUHDGHG4XHU3DJH KWWSKWWSZZZZZZVXQFRPVXQFRPFJLFJL
ELQVKRZVHDUFKELQVKRZVHDUFKPWTXHUPWTXHULQGH[ERGLQGH[ERG 6HDUFKRQUDPSQHW6HDUFKRQUDPSQHW KWWSVHDUFKRQUDPSQHWKWWSVHDUFKRQUDPSQHW
3ULPH6HDUFK3ULPH6HDUFKKWWSKWWSZZZZZZGHOWDFRPSULPHFRPGHOWDFRPSULPHFRPSVVHDUFKSVVHDUFKKWPKWP
3UR)XVLRQ3UR)XVLRQ KWWSKWWSZZZZZZGHVLJQODEGHVLJQODEXNDQVXNDQVHGXHGXSURIXVLRQSURIXVLRQ
6DYY6DYY KWWSKWWSZZZZZZFVFVFRORVWDWHFRORVWDWHHGXHGXaaGUHLOLQJGUHLOLQJVPDUWIRUPVPDUWIRUPKWPOKWPO
6HDUFKFRP6HDUFKFRPKWWSKWWSZZZZZZVHDUFKFRPVHDUFKFRP 6HDUFK3OH[6HDUFK3OH[ KWWSKWWSZZZZZZZHVWQHWaZHVWQHWaMEFMEFWRROVVHDUFKWRROVVHDUFKKWPOKWPO
6XSHU6HDUFK6XSHU6HDUFK KWWSKWWSUREWH[UREWH[FRPVHDUFKFRPVHDUFKKWPKWP
6XSHU6HHN6XSHU6HHN KWWSZKWWSZVXSHUVHHNVXSHUVHHNFRPFRPVXSHUVHHNVXSHUVHHN 72667266 KWWSKWWSZZZZZZVHUYVHUYQHWaQHWBQHWaQHWBXVDXVDWRVVWRVV 8VHW8VHW KWWSKWWSZZZZZZFDPRUJaFDPRUJaSVDUHQDSVDUHQDLWLWKWPOKWPO 6HDUFK(QJLQH6HDUFK(QJLQH KWWSKWWSFXLZZZFXLZZZXELJHXELJHFKFKPHWDPHWD
LQGH[LQGH[KWPOKWPO
Slide 16
636($5amp+(11(6636($5amp+(11(6
Boardwatch Map httpwwwboardwatchcomispusisphtm Thedirectory httpwwwthedirectoryorgareacodehtm The List httpthelistinternetcomReferencecom httpwwwreferencecom MetaList httpwwwherbisoncomherbisoniap_meta_list
html
IOC Training Course Report No 50Annex III - page 97
Slide 17
86(1(76($5amp+(11(686(1(76($5amp+(11(6
AltaVista (Usenet) httpwwwaltavistadigitalcomDejaNews httpwwwdejanewscom Infoseek (Usenet) httpwwwinfoseekcomReferencecom httpwwwreferencecom NetNews httpharvestcscoloradoeduHarvestbrokersuse
netUsenet Info Centre httpsunsiteunceduusenet-i
Slide 18
)WSVRIWZDUHVHDUFKHQJLQHV)WSVRIWZDUHVHDUFKHQJLQHV
ArchiePlex at NASA httpwwwlercnasagovarchieplexdocformht ml
DOWNLOADCOM httpwwwdownloadcom Filez httpwwwfilezcom FTPSearch95 httpftpsearchunitnoftpsearch Jumbo httpwwwjumbocom Sharewarecom httpwwwsharewarecom Snoopie httpwwwsnoopiecomqueryhtml Software Sharing Resource Library httpssrlrtpcom443 TwoCow httpwwwtwocowcom ZD Net Software Library httpwwwhotfilescom
IOC Training Course Report No 50Annex III ndash page 98
Slide 19
ltHOORZ3DJHV6HDUFK(QJLQHVltHOORZ3DJHV6HDUFK(QJLQHV
American Yellow Pages httpwwwlookupusacomlookupusaoypoypht m
AampT800 httpwwwtollfreeattnetdir800BigBook httpwwwbigbookcom BigYellow https17bigyellowcom World Pages httpwwwworldpagescomONrsquoVILLAGErsquos Yellow Pages httpwwwonvillagecomonvillageonypSuperPages httpypgtenet
Slide 20
KLWH3DJHV6HDUFK(QJLQHVKLWH3DJHV6HDUFK(QJLQHVAltaVista httpwwwaltavistadigitalcomCCSO Phonebook Gateway httpwwwuiuceducgi-binphlookupCanada411 httpcanada411sympaticscaESP httpwwwespcoukFinger Gateway at MIT httpwwwmitedu8001fingerFour11 httpwwwfour11comSledhtml InfoSpace People Search http206129166101peoplehtml Internet Address Finder httpwwwifanet Netfind httpds2internicnetwpnetfindhtml Switchboard People httpwwwswitchboardcomUFN X500 httpechobrunelacuk4040WebPh httpwwwmiddleburyeduWebphWHOIS httpds2internicnetwpwhoishtml WhoWhere httpwwwwhowherecomWorld E-mail Directory httpwwwworldemailcomX500 httpds2internicnetwpx500html Yahoo People Search Phoneyahoocom
IOC Training Course Report No 50Annex III - page 99
Slide 21
0$1675(amp725(60$1675(amp725(6
Liszt httpwwwlisztcom TileNet httpwwwtilenettilelistservviewlisthtml
Slide 22
6XEMHFW7UHVV6XEMHFW7UHVVCanadian Information by Subject httpwwwnlc-bnccacaninfoecaninfohtm EINET Galaxy httpgalaxyEinetnetgalaxyhtml Internet Public Library httpiplsilsumicheduInternet Sleuth httpwwwintbccomsleuth Maple Square httpwwwcanadasnetMapleSquarePlanet Earth httpwwwnoscmilPlanet_earthinfomodernht
mlScott Yanoffrsquos Internet Services List httpwwwuwmeduMirrorinetserviceshtml WWW Virtual Library httpwwww3orghypertextDataSourcesbySubj
ectoverviewhtml WebSurfer httpwwwinfohiwaycomwayYahoo httpwwwyahoocom
IOC Training Course Report No 50Annex III ndash page 100
Slide 23
HRJUDSKLFDO6HDUFK7RROVHRJUDSKLFDO6HDUFK7RROV
CityNet httpwwwcitynetGeoSurfer httpwwwinfohiwaycomwayVirtual Tourist2 httpwwwvtouristcomvt
Slide 24
5HYLHZLQJ6LWHV5HYLHZLQJ6LWHV
Magellan httpwwwmckinelycomNetReviews httpwwwexcitecomSubjectPoint Communications httpwwwpointcomcom Whole Internet Catalogue httpwww-elcgnncomgnnwicwicsindexhtml
IOC Training Course Report No 50Annex III - page 101
Slide 25
6SHFLDOL]HG6XEMHFWampDWHJRULHV6SHFLDOL]HG6XEMHFWampDWHJRULHV
ArchNet httpspiritlibuconneduarchaeologyhtml Billrsquos World httpwwwioorg~jgcomOverviewhtml Clearinghouse httpwwwlibumiceduchhomehtml Argus Clearing House httpwwwclearinghousenet
Slide 26
6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV6HDUFK(QJLQH(YDOXDWLRQampRQVWUDLQWV
URZWKUDWHRIVHDUFKWRROVURZWKUDWHRIVHDUFKWRROV GLVGLVVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJVLPLODULWLQFRQWHQWDQGIXQFWLRQLQJ QRQXQLIRUPVHDUFKRSWLRQVQRQXQLIRUPVHDUFKRSWLRQVERROHDQERROHDQFRQFHSWFRQFHSWSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJSKUDVHIX]]PDWFKLQJUHOHYDQFHUDQNLQJ
GHJUHHRISUHFLVLRQGHJUHHRISUHFLVLRQ SHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKSHUIRUPDQFHRIWRROVGXHWRH[SRQHQWLDOJURZWKUHILQHPHQWRIVHDUFKDOJRULWKPVUHILQHPHQWRIVHDUFKDOJRULWKPV
EOXUUEOXUULQVHDUFKHQJLQHDQGVXEMHFWWUHHVLQVHDUFKHQJLQHDQGVXEMHFWWUHHV
IOC Training Course Report No 50Annex III ndash page 102
Slide 27
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
YVYVQWHUQHW5HVRXUFH6HDUFKQWHUQHW5HVRXUFH6HDUFK 0HWDVHDUFKHUV0HWDVHDUFKHUVVLQJOHPXOWLSOHFRPELQDWLRQVVLQJOHPXOWLSOHFRPELQDWLRQV IDVWFRPSUHKHQVLYHFXUUHQWIDVWFRPSUHKHQVLYHFXUUHQWYVYVQRLVHVLJQDOQRLVHVLJQDOUDWLRHJUDWLRHJDOWDYLVWDDOWDYLVWD
WH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWWH[WDQGVXEMHFWLQGLFHVNHZRUGRUFRQFHSWVHDUFKLQJHJH[FLWHVHDUFKLQJHJH[FLWH
QDWXUDOQDWXUDOODQJDXJHODQJDXJHVHDUFKLQJHJVHDUFKLQJHJZHEFUDZOHUZHEFUDZOHU PXOWLSOHPXOWLSOHTXHUULHVTXHUULHVLQUDSLGVXFFHVVLRQHJ(=LQUDSLGVXFFHVVLRQHJ(=)LQG)LQG
ampRQWGampRQWGlaquolaquo
Slide 28
6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV6HDUFK(QJLQHV3URPLQHQWampKDUDFWHULVWLFV
ampDVH6HQVLWLYHHJQIRVHHNampDVH6HQVLWLYHHJQIRVHHN 3RLQWUDWLQJVVWHPHJFRV3RLQWUDWLQJVVWHPHJFRV ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85ampROODWLRQRIUHVXOWVDQGUHGXQGDQW85HOLPLQDWLRQHJHOLPLQDWLRQHJ0HWDampUDZOHU0HWDampUDZOHU
DELOLWWRPXOWLSOHILHOGVHDUFKHJDELOLWWRPXOWLSOHILHOGVHDUFKHJ2SHQ7H[W2SHQ7H[W KHLUDUFKLDOKHLUDUFKLDOUHYLHZHGDUUDQJHPHQWUHYLHZHGDUUDQJHPHQWHJHJltDKRRltDKRR IXOOWH[WSDJHVDQGXSGDWHIUHTXHQFIXOOWH[WSDJHVDQGXSGDWHIUHTXHQFHJHJ$OWDYLVWD$OWDYLVWDKRWERWKRWERW
IOC Training Course Report No 50Annex III - page 103
Slide 29
1$16($5amp+72261$16($5amp+7226
KRMKRM KWWSKWWSZZZZZZNKRMNKRMFRPFRP
6DPDFKDU6DPDFKDU KWWSKWWSZZZZZZVDPDFKDUVDPDFKDUFRPFRP
KHOKHO KWWSKWWSZZZZZZNKHONKHOFRPFRP
QGLDLQHQGLDLQH KWWSKWWSZZZZZZLQGLDOLQHLQGLDOLQHFRPFRP
DZDUFKLDZDUFKL KWWSKWWSZZZZZZEDZDUFKLEDZDUFKLFRPFRP
QGLDQGLD KWWSKWWSZZZZZZLQGLDFRPLQGLDFRP
$JQL$JQL KWWSKWWSZZZZZZLQGLDZDWFKLQGLDZDWFKRUJLQRUJLQDJQLDJQL
6$56$5 KWWSKWWSZZZZZZVDPLODQVDPLODQFRPFRP
QGLDHEampKDNUDQGLDHEampKDNUD KWWSKWWSZZZZZZLQGLDZHEFKDNUDLQGLDZHEFKDNUDFRPZHEVHDUFKFRPZHEVHDUFK
$=LQGLD$=LQGLD KWWSKWWSZZZZZZLQGLDFRQQHFWLQGLDFRQQHFWFRPD]LQGLDFRPD]LQGLDKWPKWP
6HHN6HHN KWWSKWWSZZZZZZQHZLQGLDQHZLQGLDFRPVHHNFRPVHHN
QGLDYHQWXUHVQGLDYHQWXUHV KWWSKWWSZZZZZZLQGLDYHQWXUHVLQGLDYHQWXUHVFRPVHDUFKFRPVHDUFKKWPKWP
0DQWKDQ0DQWKDQ KWWSKWWSZZZZZZQLRQLRRUJRUJPDQWKDQPDQWKDQ
Slide 30
)XWXUHRI6HDUFKWRROV)XWXUHRI6HDUFKWRROV
0HWD0HWDVHDUFKHUVWRSODYLWDOUROHVHDUFKHUVWRSODYLWDOUROH LQWHJUDWHGWRROVELQGLYLGXDOVHDUFKLQWHJUDWHGWRROVELQGLYLGXDOVHDUFKHQJLQHVHQJLQHV
VXEMHFWUHJLRQVXEMHFWUHJLRQODQJDXJHODQJDXJHVSHFLILFVHDUFKVSHFLILFVHDUFKHQJLQHVHQJLQHV
8VHRIH[SHUWVVWHPV8VHRIH[SHUWVVWHPV 6SHHFKUHFRJQLWLRQDQG6SHHFKUHFRJQLWLRQDQGPXWLPXWLOLQJXDOOLQJXDOVHDUFKHVVHDUFKHV
IOC Training Course Report No 50Annex III ndash page 104
13 HyperText Markup Language(PPissierssens IOC)
Slide 1
1
HyperText Markup Language
Slide 2
2
HyperText Markup Language
HEVHUYHUHEVHUYHU plusmn3ampRURWKHUFRPSXWLQJVVWHPplusmn2SHUDWLQJVVWHPLQGRZV17VHUYHURU81
plusmnHEVHUYHUVRIWZDUH6$SDFKHlaquoplusmnFRQWHQWKWPOSDJHVGDWDEDVHVlaquoplusmn QWHUQHWOLQN
6SHFLDOFDVHSHUVRQDORIIOLQHZHEVHUYHU
IOC Training Course Report No 50Annex III - page 105
Slide 3
3
HyperText Markup Language
+70+70 6LPSOH6LPSOH +RZWRFUHDWH+70SDJHV+RZWRFUHDWH+70SDJHVplusmn1RWHSDGRUDQWH[WHGLWRUplusmn+70HGLWRU
Slide 4
4
HyperText Markup Language
+70
+($
77(0ILUVWZHESDJH77(
+($
2lt
+HOORWKHUH
2lt
+70
6DYHDVQDPHBRIBILOHKWP
Tell the browser that this is webpage
Title Header
Content starts here
Content stops here
Tell the browser that webpage ends
IOC Training Course Report No 50Annex III ndash page 106
Slide 5
5
HyperText Markup Language
UHVVLQJLWXS VWDUWDWWULEXWH VWRSDWWULEXWH S QHZSDUDJUDSK GHIDXOW EU QHZOLQH KU KRUL]RQWDOUXOH
Slide 6
6
HTML Header Styles
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
+6WOH+
31RUPDO
IOC Training Course Report No 50Annex III - page 107
Slide 7
7
HTML Attributes
31RUPDO
3ROG
3WDOLFV
Slide 8
8
HTMLColor
3)217amp225 ))7KLVOLQHLVUHG)217
3)217amp225 ampamp7KLVOLQHLVJUHHQ)217)))) HOORZ
ampamp SXUSOH
)) EOXH
EODFN
IOC Training Course Report No 50Annex III ndash page 108
Slide 9
9
HTML Lists
2
QXPEHUHGOLVWOLQH)217
QXPEHUHGOLVWOLQH)217
2
8
EXOOHWHGOLVWOLQH)217
EXOOHWHGOLVWOLQH)217
8
Ordered list
Un-Ordered list
Slide 10
10
HTML Alignment
3$1 ULJKW7KLVLVULJKWDOLJQHG
amp(17(57KLVLVFHQWHUDOLJQHGamp(17(5
IOC Training Course Report No 50Annex III - page 109
Slide 11
11
HTML Tables
7$(25(5
7573FROXPQURZ773FROXPQURZ775
757
3FROXPQURZ773FROXPQURZ7757$(
Border size
New row
New column
Slide 12
12
7$(25(5 7+ 7577+ 31U777+ 3HVFULSWLRQ7757577+ 3777+ 3VDPSOLQJDWKDUERXU7757577+ 3777+ 3VDPSOLQJDWEXR7757577+ 3777+ 3VDPSOLQJDWVDQGEDQN7757$(
IOC Training Course Report No 50Annex III ndash page 110
Slide 13
13
HTML Hyperlink
3$+5() SHUVRQDOBSDJHKWPampOLFNKHUHWRYLVLWPSHUVRQDOSDJH$
3$+5() KWWSLRFXQHVFRRUJGHIDXOWKWPampOLFNKHUH$WRYLVLWWKH2ampKRPHSDJH
CLICK
Slide 14
14
HTML including images
)UDSKLFVQWHUFKDQJH)RUPDW -3VKRUWIRU-3(-RLQW3KRWRJUDSK([SHUWVUDSKLFV065amp acuteLPDJHVLRVPJLI
IOC Training Course Report No 50Annex III - page 111
Slide 15
15
Website managers
Slide 16
16
Frontpage Editor
IOC Training Course Report No 50Annex III ndash page 112
Slide 17
17
Time to try
IOC Training Course Report No 50Annex III - page 113
14 Numerical Databases Over WWW(V Chavan CMMB Hyderabad India)
Slide 1
Numerical Databases OverWWW
Vishwas ChavanScientist
Centre for Cellular and Molecular BiologyHyderabad India
Slide 2
Databases over Web Approaches
db files to flatascii files Import and Host Live Connectivity
IOC Training Course Report No 50Annex III ndash page 114
Slide 3
Flat ascii files on WWW
Oceanline ver 10 Publications ver 10
Slide 4
Oceanline ver 10 OCEANLINE is an online public access catalogue of books monographs
technical reports conference proceedings maps and atlases etcavailable at NIO Library
Files in Oceanline HTML files in varwwwhtdocsOceanline 1indexhtml is the main page
2classearchhtml allows you to perform search Oceanlineaccording to the variou classes
CGI scripts in varwwwcgi-binOceanline 1For the main search
fsearchcgi performs the start search nsearchcgi performs the search for next set of matches psearchcgi performs the search for previous set of
matches 2For the search according to classes
fclassearchcgi performs the start search nclassearchcgi performs the search for next set of
matches pclassearchcgi performs the search for previous set of
matches
IOC Training Course Report No 50Annex III - page 115
Slide 5
Oceanline ver 10 DATA files in varwwwhtdocsOceanlinedata
Category Data file All areas totiso BooksMonographs biso Standards ciso Maps amp Atlases giso Conf preceedings Volumes kiso Dictionaries liso Numerics amp tables niso Technical Reports riso Thesis uiso Bibliographies amp Abstracts ziso isisfdt is the field tags identification file To add new data to Oceanline use the following commands at the prompt 1 cp olddataiso tempiso 2 cat newdataiso tempiso gtolddataiso 3 rm tempiso
Slide 6
Import and Host
Stores db - FoxPro Import to Lotus 123 Fetch into Notes Document base Host on WWW through Domino Server
IOC Training Course Report No 50Annex III ndash page 116
Slide 7
Live Connectivity
mSQL MS ACCESS ORACLE
Slide 8
mSQL
Manthan ver 10 Daryavardi ver 10 Animalia ver 10
IOC Training Course Report No 50Annex III - page 117
Slide 9
Manthan ver 10
Directory-based search engine forOceanographic information over theweb
Implemented using msql has adatabase called rsquomanthanrsquo and has asingle table called rsquoman1rsquo
Database = manthan Table = man1
Slide 10
Manthan ver 10
In varwwwhtdocsmanthanindexhtml is the main pageman1puthtml allows you to add records to manthan database
editmanhtml can be used to edit the records already entered in the databaseocnlnkshtml lists some oceanography and marine related sites on the web
manthanhtml gives mythological background of samudra manthanAbout_Manthanhtml this document
Lite scripts are in samudraHugheswwwmanthan
man1inhtml for accepting data into the databaseman1outhtml for querying the database
man1edthtml for editing the recordsman1uphtml for updating the records
showallhtml displays all records in the database
IOC Training Course Report No 50Annex III ndash page 118
Slide 11
Manthan ver 10
Database is in samudraHughesmsqldbmanthan and has following filesman1dat is the main data fileman1def is field definition file
man1idx index field fileman1idx-url_in is the main index file
Slide 12
MS ACCESS
Plantae ver 10Win NT (Server Version) - 40Internet Information Server (IIS) ver 30 - Web
ServerMS-Accessrsquo97 (ver 80) - Database Active Server Pages (ASP) - Scripting language
IOC Training Course Report No 50Annex III - page 119
Slide 13
ORACLE
SPMIS at CCMBWorkgroup version of Oracle 80 as RDBMS
MS Visual Basic 60 as front endActiveX controls (OLE controls) facilitate
visualization of Visual Basic application onWWW
ActiveX controls are in-built with MS VisualBasic 60
Slide 14
Thank You
Have a HappyData Management
IOC Training Course Report No 50Annex III ndash page 120
15 Serving Textual Factual databases on the web(MP Tapaswi NIO Goa India)
Slide 1
Serving Textual Factualdatabases on the web
Murari P Tapaswimuraricsniorennicin
Slide 2
TEXTUAL FACTUALDATABASES
bull Primary resources
rArr Living resources eg Flora Fauna(taxonomic morphological distribution gene-banks etc)
rArr Non-living resources eg Geographicallyreferenced databases (satellite images ofphysiography temperature salinity etc)
IOC Training Course Report No 50Annex III - page 121
Slide 3
Textual Factual databases
bull Secondary resourcesrArr Metadata Catalogue of cruise tracks
sampling stations etcrArr Human institutional Personnel directory
research projects job opportunities etcrArr Bibliographic OPAC published literaturerArr Links to websites Related institutions
Electronic journals Full text documentsetc
Slide 4
Textual Factual databases
bull Tertiary resources
rArr Socio-economic resources Policyinstruments treaties Fish marketinformation Exporters Importers etc
IOC Training Course Report No 50Annex III ndash page 122
Slide 5
KEY ITEMS
bull Databasebull Search retrieve and display software
(CGI)bull User interface (HTML pages)
Slide 6
DATABASE
bull Structured information in any formbull Reliable databull Sizeable number of recordsbull Frequency of updatebull Multimedia component
rArr Graphics JPEG GIF files of pictures and filmclippings
rArr Audio clippings 5 minutes audio capturedat22 kHz in 16 bit stereo - 5mb WAV or AUfiles
IOC Training Course Report No 50Annex III - page 123
Slide 7
AUDIO CLIPPING FREEWARE
bull Real Audio Encoder(httpwwwrealcom) to generatecompressed RA files from WAV and AU
bull For best results install Real Audio Playerplug on the users browser
bull HTTP streaming to enable reasonable fastloading of audio files to the clientmachines
bull Real Audio Streaming server High Costs
Slide 8
SEARCH RETRIEVE ANDDISPLAY INTERFACE
bull Dictionary of keywords termsrArr Keywords from all fields specific field
bull Open search expressionsbull Boolean logicbull Ideal to retain information about previoustransactionsrArr Use of lsquoInput Type Hiddenrsquo feature supported
by HTML and to carry the details of queryterms in HTML forms through the searchsession
IOC Training Course Report No 50Annex III ndash page 124
Slide 9
Search retrieve anddisplay interfacebull Search on index files pointing to
appropriate records in the database forretrieval
bull Programs linked to HTML search formsas well as HTML output for display
Slide 10
USER INTERFACE (HTMLpages)
bull Home page
rArr Less than 32 k size HTML filerArr Column structure than full screenrArr Use of frames feature supported by
HTML to divide screen in two partsrArr Left part Table of contents
rArr Right part Information page
IOC Training Course Report No 50Annex III - page 125
Slide 11
User interface (HTMLpages) Table of contents
bull Introduction to database (origin purposeownership copyrights updating frequencyetc)
bull Overview (contents building searchstrategy charges for search and retrieval ifany contact for further support etc)
bull Data entry formbull Data display Presentation formatsbull Access to databasebull List of previous search sets in current
session
Slide 12
User interface (HTMLpages) Right part of screen
rArr Database title subtitle logorArr Other related products (product on
other media subsets etc)rArr Ownership (Developers funding
agency software)rArr Navigator choice and screen
resolution
bull Opening page
IOC Training Course Report No 50Annex III ndash page 126
Slide 13
User interface (HTMLpages) Right part of screen
bull Search tools
rArr Broad group of data-setsrArr Keywords Term indexrArr Geographical co-ordinates
bull Menu items
rArr Pointers to last screenrArr Next screenrArr Sources starting with letters rArr Buttons for submission cancellation
Slide 14
User interface (HTMLpages) Right part of screen
bull Display formats
rArr Indicative informativerArr Graphics film cliprArr Audio background
IOC Training Course Report No 50Annex III - page 127
16 Dynamic Database publishing using Filemaker Pro(PPissierssens IOC)
Slide 1
102498 PPissierssens IOC 1
Dynamic Database publishingusing Filemaker Pro
Slide 2
102498 PPissierssens IOC 2
Step 1 create your database
IOC Training Course Report No 50Annex III ndash page 128
Slide 3
102498 PPissierssens IOC 3
Step 11 populate your database
Slide 4
102498 PPissierssens IOC 4
Step 2 create the html pages
bull Strategyndash online create new record
ndash online edit record
ndash online search recordLetrsquos do this
IOC Training Course Report No 50Annex III - page 129
Slide 5
102498 PPissierssens IOC 5
Writing the html pages
bull Defaulthtm
bull Searchhtm
bull Search_resultshtm
search_resultshtm
searchhtm
defaulthtm
Slide 6
102498 PPissierssens IOC 6
Writing the html pages
HIDXOWKWPltA HREF=FMPro-db=testdbFP3amp-lay=webamp
-format=searchhtmamp-viewgtSearch the DatabaseltAgt
database Layout to use
Output format action
ACTION
IOC Training Course Report No 50Annex III ndash page 130
Slide 7
102498 PPissierssens IOC 7
Writing the html pages 6HDUFKKWP - step1 the actionsltFORM ACTION=FMPro METHOD=postgt ltINPUT TYPE=hidden NAME=-DB VALUE=testdbfp3gt ltINPUT TYPE=hidden NAME=-Lay VALUE=webgt ltINPUT TYPE=hidden NAME=-format VALUE=search_resultshtmgt ltINPUT TYPE=hidden NAME=-error VALUE=search_errorhtmgt ltINPUT TYPE=hidden NAME=-SortField VALUE=surnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=firstnamegt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-SortField VALUE=countrygt ltINPUT TYPE=hidden NAME=-SortORder VALUE=Ascendinggt ltINPUT TYPE=hidden NAME=-max VALUE=20gtltPgt
Slide 8
102498 PPissierssens IOC 8
Writing the html pages 6HDUFKKWP - step 2 the search formSurname ltINPUT TYPE=hidden NAME=-op VALUE=bwgt ltINPUT TYPE=text NAME=surname VALUE= SIZE=22gtltPgt Firstname ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=firstname VALUE= SIZE=17gtltPgtJob TitleltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_title VALUE= SIZE=22gtltPgtJob Type ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=job_type VALUE= SIZE=22gtltPgtOrganization ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=organization VALUE= SIZE=22gtltPgtTypeltBgtltIgt ltIgtltBgtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=organization_type VALUE= SIZE=22gtltPgtCity ltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT
TYPE=text NAME=city VALUE= SIZE=22gtltFONTgtltPgtCountryltFONT SIZE=-1gtltINPUT TYPE=hidden NAME=-op VALUE=eqgtltINPUT
TYPE=text NAME=country VALUE= SIZE=23gtltFONTgtltPgtActivities ltINPUT TYPE=hidden NAME=-op VALUE=bwgtltINPUT TYPE=text
NAME=activities VALUE= SIZE=58gtltPgt
IOC Training Course Report No 50Annex III - page 131
Slide 9
102498 PPissierssens IOC 9
Writing the html pages
6HDUFKKWP - step 3 the action buttons
ltINPUT TYPE=radio NAME=-lop VALUE=AND checked=gtMatch all words between fields (AND)ltBRgtltINPUT TYPE=radio NAME=-lop VALUE=ORgtMatch any words between fields (OR)
ltINPUT TYPE=submit NAME=-Find VALUE=Start SearchgtltINPUT TYPE=reset VALUE=Reset this formgt
Slide 10
102498 PPissierssens IOC 10
Writing the html pages 6HDUFKBUHVXOWVKWP[FMP-RECORD]Name[FMP-FIELD Title] [FMP-FIELD firstname]
[FMP-FIELD middle_name]ltBgt [FMP-FIELD surname]ltBgtltPgtGender[FMP-FIELD gender]ltBRgt Degrees[FMP-FIELD degree]ltBRgt Job Title[FMP-FIELD job_title]ltBRgt
Job Type [FMP-FIELD job_type]ltBRgt Organizationampnbsp [FMP-FIELD organization]ltBRgt Organization type [FMP-FIELD organization_type]ltBRgt Departmentampnbsp[FMP-FIELD department]ltBRgt
Address [FMP-FIELD street_address]ltBRgt City [FMP-FIELD city]ltBRgt Country [FMP-FIELD country]ltBRgt Activities [FMP-FIELD activities]ltPgt
[FMP-RECORD]
IOC Training Course Report No 50Annex III ndash page 132
Slide 11
102498 PPissierssens IOC 11
The queryHttpscppi591testdbFmPro-DB=testdbfp3amp-Lay=webamp-
format=search_resultshtmamp-error=search_errorhtmamp-SortField=surnameamp-SortORder=Ascendingamp-SortField=firstnameamp-SortORder=Ascendingamp-SortField=countryamp-SortORder=Ascendingamp-max=20amp-op=bwampsurname=amp-op=bwampfirstname=amp-op=bwampjob_title=amp-op=bwampjob_type=amp-op=bwamporganization=amp-op=bwamporganization_type=amp-op=bwampcity=amp-op=eqampcountry=indiaamp-op=bwampactivities=amp-lop=ANDamp-Find=Start+Search
ampOLHQW DWDEDVHform
Filled form
query
resulthtml
HEVHUYHU
Slide 12
102498 PPissierssens IOC 12
The resultndash Search Results
Displaying records 1 through 12 of 12 records found
Name Mr Narayan BHASKARGendermaleDegreesMaster of Fisheries Science (MFSc) Bachelor of Fisheries Science (BFSc)Job TitleScientistJob Type ResearchOrganization Central Food Technological Research InstituteOrganization typeDepartment Meat Fish and Poultry TechnologyAddressCity MysoreCountry IndiaActivities 1 Have worked on incidence of bacteria of public health significance in the cultured shrimpsPenaeus monodonduring both the farming and harvest phases 2 Have worked on the shelflife and quality characteristics of the shrimpPenaeus indicus during ice storage 3 Is associated with the study on the food and feeding habits of the shrimpParapeaeopsis stylifera 4 Has worked on the preservation of salted-dried mackerel(Rastrelliger kanagurta Cuvier) usingfilm forming gums 5 Is associated with the study on the extension of shelf life of seer and mackerel steaks using lacticfermentation 6 Has studied the biochemical aspects of the underutilised crustacean species squilla (Oratosquilla nepaLatreille) from the point of view of processing 7Recently I have proposed projects on the isolation and characterisation oftransglutaminase from the Indian fishcrustacean species for the production of surimi Utilisation of the underutilisedcrustacean species squilla (Oratosquilla nepa Latreille) for producing value added products evaluation of cultured and wildcaught Indian major carps for the incidence of bacteria of public health significance
[end of this record]
IOC Training Course Report No 50Annex III - page 133
Slide 13
102498 PPissierssens IOC 13
Creating a new record
Step 1 QHZKWP
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE= SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE= SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE= SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE= SIZE=30gt
continue here for other fieldsUserID ltINPUT TYPE=text NAME=userid VALUE= SIZE=30gtPassword ltINPUT TYPE=text NAME=password VALUE= SIZE=30gt
ltINPUT TYPE=submit NAME= -New VALUE=Save your Record and Proceed to next StepgtltINPUT TYPE=reset VALUE=Reset this formgtltform)
Slide 14
102498 PPissierssens IOC 14
Creating a new record
bull Step 2 QHZBUHSOKWP
A record has been added to the database
lta href=ldquodefaulthtmrdquogtGo back to menultagt
IOC Training Course Report No 50Annex III ndash page 134
Slide 15
102498 PPissierssens IOC 15
Editing a recordbull OPTION 1 without security
ndash include field for unique identifierndash edit recordndash confirm edit is received
bull OPTION 2 with securityndash Verify userid and passwordndash list entries for that userID and passwordndash allow selection of record to editndash edit recordndash confirm edit is received
bull TRY
Slide 16
102498 PPissierssens IOC 16
Editing a record
ltFORM ACTION=FMPro METHOD=post gtltINPUT TYPE=hidden NAME=-DB VALUE=rdquotestdbFP3gtltINPUT TYPE=hidden NAME=-Lay VALUE=webgtltINPUT TYPE=hidden NAME=-format VALUE=new_replyhtmgtltINPUT TYPE=hidden NAME=-error VALUE=new_errorhtmgt
Title ltINPUT TYPE=text NAME=title VALUE=[FMP-Field title] SIZE=12gtltFONTgtFirstname ltINPUT TYPE=text NAME=firstname VALUE=[FMP-Field firstname]
SIZE=19gtMiddle NameltINPUT TYPE=text NAME=middle_name VALUE=[FMP-Field
middle_name] SIZE=19gtSurname ltINPUT TYPE=text NAME=surname VALUE=[FMP-Field surname] SIZE=30gt
ltINPUT TYPE=submit NAME=-New VALUE=Save your Record and Proceed to nextStepgt
ltINPUT TYPE=reset VALUE=Reset this formgtltform)
Current value
IOC Training Course Report No 50Annex III - page 135
Slide 17
102498 PPissierssens IOC 17
Error[FMP-IF CurrentErroreq 509]
Required Value ErrorSorry required information is missing Please check your submission and try again
[FMP-ELSE]
New Record Error
There was an error adding a record to the database Please check your
submission and try again - amp91 ERR[FMP-CURRENTERROR]amp93
ampnbsp
Press the ltBgtBackltBgt button in your browser
Error codes
500 Date value does not meet validation entry options
501 Time value does not meet validation entry options
502 Number value does not meet validation entry options
503 Value in field does not meet range validation entry options
504 Value in field does not meet unique value validation entry options
505 Value in field failed existing value validation test
506 Value in field is not a member value of the validation entry option value list
507 Value in field failed calculation test of validation entry option
508 Value in field failed query value test of validation entry option
509 Field requires a valid value
[FMP-IF]
Press the ltBgtBackltBgt button in your browser
[end of report]
IOC Training Course Report No 50Annex IV - page 1
ANNEX IV
LIST OF ACRONYMS
ASFA Aquatic Science and Fisheries AbstractsCD-ROM Compact Disk ndash Read Only MemoryDNA Designated National AgencyGEBCO General Bathymetric Chart of the OceansGE-MIM Group of Experts on Marine Information ManagementGIS Geographic Information SystemGLODIR Global Directory of Marine (and Freshwater) ProfessionalsGLOSS Global Sea Level Observing SystemGOOS Global Ocean Observing SystemGODAR Global Oceanographic Data Archeology and RescueGTSPP Global Temperature and Salinity Profile ProgrammeIGOSS Integrated Global Ocean Services SystemIOC Intergovernmental Oceanographic Commission (of UNESCO)IOCINCWIO IOC Regional Committee for the Co-operative Investigation in the North and Central
Western Indian OceanIOCINDIO IOC Regional Committee for the Central Indian OceanIODE International Oceanographic Data and Information ExchangeMEDI Marine Metadata Management SystemNIO National Institute of Oceanography (India)NODC National Oceanographic Data CentreODINEA Oceanographic Data and Information NetworkODINAFRICA Oceanographic Data and Information Network for AfricaRNODC-MEDI Responsible National Oceanographic Data Centre ndash MEDIWDC-A World Data Centre-AWWW World-Wide Web