20
T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

  • View
    215

  • Download
    1

Embed Size (px)

Citation preview

Page 1: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank1

Internet Resources Discovery (IRD)

Classic IRD Tools

Page 2: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

2

Classic IRD Tools

• Telnet Interface

• Archie

• Gopher/Veronica

• WAIS

• X.500/LDAP

• Netfind

Page 3: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

3

Telnet Interface

Page 4: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

4

Archie (1)

• Service for indexing ftp file names.

• Usually replicated to allow more users to use the database.

• FAQ: http://www.ou.edu/research/electron/internet/archifaq.htm

Page 5: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

5

Archie (2)

Page 6: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

6

Archie (3)

Page 7: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

7

Gopher/Veronica (1)

• Gopher is a directory of files, file directories and services.

• Veronica is the uniform user interface.

• Veronica’s user interface is based on menus, which offer searches on certain subjects.

• Once a resource is found - the user can access it directly, without invoking intermediate programs (e.g. ftp, telnet).

• Still around - gopher://gopher.floodgap.com/

Page 8: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

8

Gopher (2)

Page 9: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

9

WAIS (1)

• WAIS - Wide Area Information Servers

• Provides a full text index and keywords search services on documents.

• WAIS is based on Z39.50 ANSI standard for bibliographic information.

Page 10: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

10

WAIS (2)

Page 11: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

11

X.500/LDAP (1)• X.500 standards define a specification for a rich,

global, distributed directory.• Directory is based on hierarchically named

information objects.• Users can browse and search directory using

arbitrary fields.• LDAP - Lightweight Directory Access Protocol• Information: http://

www.kingsmountain.com/ldapRoadmap.shtml• Example: http://ldap.utexas.edu:8888/M

Page 12: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

12

X.500 (2)

Page 13: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

13

Netfind (1)

• Provides a White Pages service.

• Used for locating information on users.

• Uses a lot of network tools/databases.– finger– whois– mail protocol (SMTP)

Page 14: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

14

Netfind (2)

• http://ds.carnet.hr/netfind/indexe.html

Page 15: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

15

Netfind (3)

Page 16: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

16

Netfind: Information Gathering Framework

1. Information Source Selection

2. Information Collection

3. Information Filtering

4. Combining Heterogeneous Information

Page 17: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

17

Netfind Search (1)Domain cc.biu.ac.il returns:

( 0) Doing fallback lookup for ldap.tcp.cc.biu.ac.il.( 0) Doing fallback lookup for ph.tcp.cc.biu.ac.il.( 0) Doing fallback lookup for whois.tcp.cc.biu.ac.il.( 0) Doing fallback lookup for ldap.cc.biu.ac.il.( 0) Doing fallback lookup for whois.cc.biu.ac.il.( 0) Doing fallback lookup for ph.cc.biu.ac.il.( 0) SMTP_Finger_Search: checking domain cc.biu.ac.ilThe domain 'cc.biu.ac.il' does not run its own name servers,

and there is no aliased domain IP address/CNAME/MX record forthis domain -> Skipping domain search phase for this domain.

PHASE [host search]:0. ashur.cc.biu.ac.il1. alon.cc.biu.ac.il2. shikma.cc.biu.ac.il3. brosh.cc.biu.ac.il( 0) SMTP_Finger_Search: checking host ashur.cc.biu.ac.il( 1) SMTP_Finger_Search: checking host alon.cc.biu.ac.il( 2) SMTP_Finger_Search: checking host shikma.cc.biu.ac.il( 3) SMTP_Finger_Search: checking host brosh.cc.biu.ac.il( 0) read timed out( 3) read timed out( 1) read timed out

Page 18: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

18

Domain cs.biu.ac.il returns:

( 0) LookupAndFillInDomInfo: got address of domain: cs.biu.ac.il (132.70.1.24)( 0) Doing fallback lookup for ldap.tcp.cs.biu.ac.il.( 0) Doing fallback lookup for ph.tcp.cs.biu.ac.il.( 0) Doing fallback lookup for whois.tcp.cs.biu.ac.il.( 0) Doing fallback lookup for ldap.cs.biu.ac.il.( 0) Doing fallback lookup for whois.cs.biu.ac.il.( 0) Doing fallback lookup for ph.cs.biu.ac.il.( 0) SMTP_Finger_Search: checking domain cs.biu.ac.ilMail for Prof. J. B. Muskat is forwarded to [email protected]: this is a domain mail forwarding arrangement - so mail intended

for "muskat" should be addressed to"[email protected]"rather than "[email protected]".

( 0) SMTP_Finger_Search: checking host sunbeam.cs.biu.ac.il

SYSTEM: sunbeam.cs.biu.ac.ilLogin name: muskat In real life: Prof. J. B. MuskatDirectory: /u/segel/muskat Shell: /bin/TcshLast login Wed Jan 7 10:29 on ttyp1 from sunlightNew mail received Thu Mar 19 19:03:54 1998; unread since Thu Mar 19 17:38:40 1998No Plan.

FINGER SUMMARY:- The most promising email address for "muskat" based on the above finger search is [email protected].

Netfind Search (2)

Page 19: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

19

IRD Data Design Choices

System Granularity Distribution

Archie FilesDistributed

Among Servers

Gopher Services, FilesDistributed

Among Servers

WAIS DocumentsLocal to eachWAIS Server

X.500 VariesDistributed

Among Servers

Netfind UsersDistributed

Among Hosts

Page 20: T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Classic IRD Tools

T.Sharon-A.Frank

20

IRD Metadata Design Choices

System Granularity Distribution

Archie File-namesCentralized and

Replicated

Gopher VariesDistributed

Among Servers

WAISIndex onFull Text

Centralized

X.500Name

ComponentsDistributed

Among Servers

Netfind UsersDistributed

Among Hosts