Internet Evolution, GovernanceInternet Evolution, Governanceand the Digital Object and the Digital Object
ArchitectureArchitecture
Workshop on SCORMWorkshop on SCORMSequencing and NavigationSequencing and Navigation
Gaithersburg, MarylandGaithersburg, MarylandFebruary 23, 2005February 23, 2005
Robert E. KahnCorporation for National Research InitiativesReston, Virginia
Three Initial NetworksThree Initial Networks
About 30 – 35 years ago, DARPA funded the About 30 – 35 years ago, DARPA funded the creation of three seminal packet networks – creation of three seminal packet networks – ARPANET, Packet Radio, Packet SatelliteARPANET, Packet Radio, Packet Satellite
The Internet came about from a desire to The Internet came about from a desire to link link the three of themthe three of them
Ethernet occurred in parallel, led by Xerox Parc Ethernet occurred in parallel, led by Xerox Parc researchers, and other network types followedresearchers, and other network types followed
The resulting architecture was independent of The resulting architecture was independent of the number and type of networks or who ran the number and type of networks or who ran them.them.
Key DecisionsKey Decisions
The Internet would be a global information systemThe Internet would be a global information system An open-architectureAn open-architecture would be used to combine would be used to combine
different networks based on open and well-known different networks based on open and well-known interfaces, protocols & objectsinterfaces, protocols & objects..
A new communications-oriented host protocol A new communications-oriented host protocol ((TCP/IPTCP/IP) would be created to replace the original ) would be created to replace the original ARPANET host protocol (NCP)ARPANET host protocol (NCP)
The concept of global addressing and The concept of global addressing and IP addressesIP addresses would be introduced to identify individual machines would be introduced to identify individual machines anywhere on the global Internetanywhere on the global Internet
Comments on the Key DecisionsComments on the Key Decisions
The architecture is robust in the presence of many The architecture is robust in the presence of many different network types and many outagesdifferent network types and many outages
Gateways provided IP routing and Network Gateways provided IP routing and Network “Impedance Matching” “Impedance Matching”
TCP accommodated end-end protocolsTCP accommodated end-end protocols different packet sizes, duplicates, error detection, different packet sizes, duplicates, error detection,
losses due to tunnels, mountains, jamming, etc.losses due to tunnels, mountains, jamming, etc. Separate network administrations were permitted, Separate network administrations were permitted,
which allowed the Net to growwhich allowed the Net to grow DNS not technically critical, but helped usersDNS not technically critical, but helped users
Understanding the Big PictureUnderstanding the Big Picture
Many things were done well from the outset; with Many things were done well from the outset; with 20/20 hindsight, some could have been done better20/20 hindsight, some could have been done better
The context was criticalThe context was criticalMostly mainframes, few time-sharing systemsMostly mainframes, few time-sharing systemsNo PCs, workstations, LANsNo PCs, workstations, LANsOne dominant carrier in the USOne dominant carrier in the USGovernment facility initiallyGovernment facility initially
What is important at the time may be only apparent What is important at the time may be only apparent with hindsight; but also what seems important at the with hindsight; but also what seems important at the time may not turn out to be so important later ontime may not turn out to be so important later on
Key Management StructuresKey Management Structures
Internet Configuration Control Board (ICCB)Internet Configuration Control Board (ICCB) Internet Activities Board (IAB)Internet Activities Board (IAB) Internet Engineering Task Force (IETF)Internet Engineering Task Force (IETF) Internet Architecture Board (IAB)Internet Architecture Board (IAB) Internet Society (ISOC)Internet Society (ISOC)Domain Name System (DNS)Domain Name System (DNS) Internet Corporation for Assigned Names Internet Corporation for Assigned Names
and Numbers (ICANN)and Numbers (ICANN)
Defining the InternetDefining the Internet
Logical architecture for internetworkingLogical architecture for internetworking Independent of the underlying networksIndependent of the underlying networks
Open architectureOpen architecture at the network level at the network levelNot the routers, switches, lines, computersNot the routers, switches, lines, computersNot any one service provider on the netNot any one service provider on the netReference to the FNC definition from 1995Reference to the FNC definition from 1995
www.hpcc.gov/fnc/Internet_res.html www.hpcc.gov/fnc/Internet_res.html
Updating the “1995 Definition”Updating the “1995 Definition”
"Internet" refers to the global information system that -- "Internet" refers to the global information system that --
(i) is logically linked together by a globally unique address (i) is logically linked together by a globally unique address space based on the Internet Protocol (IP) or its subsequent space based on the Internet Protocol (IP) or its subsequent extensions/follow-ons;extensions/follow-ons;
(ii) is able to support communications using the (ii) is able to support communications using the Transmission Control Protocol/Internet Protocol (TCP/IP) Transmission Control Protocol/Internet Protocol (TCP/IP) suite or its subsequent extensions/follow-ons, and/or other suite or its subsequent extensions/follow-ons, and/or other IP-compatible protocols; and IP-compatible protocols; and
(iii) provides, uses or makes accessible, either publicly or (iii) provides, uses or makes accessible, either publicly or privately, high level services layered on privately, high level services layered on or integrated withor integrated with the communications and related infrastructure described the communications and related infrastructure described herein.herein.
Social and Political DimensionsSocial and Political Dimensions
Most Nation’s had committed to ISO protocolsMost Nation’s had committed to ISO protocols Yet TCP/IP won out in the final analysisYet TCP/IP won out in the final analysis Many reasons why; critical mass, many organizations Many reasons why; critical mass, many organizations
helped, no significant benefit to changing, etc.helped, no significant benefit to changing, etc.
Formation of ICCB, IAB, IETF, etc enabled the Formation of ICCB, IAB, IETF, etc enabled the net to evolvenet to evolve
NSF strategy of fostering independent networks NSF strategy of fostering independent networks - expanded participation without central control- expanded participation without central control
Boucher Bill allowed commercializationBoucher Bill allowed commercialization
The World Embraces the InternetThe World Embraces the Internet
Who is in Charge of the Internet?Who is in Charge of the Internet?Who is in Charge of the World Economy?Who is in Charge of the World Economy?World Summit in Geneva – December, 2003World Summit in Geneva – December, 2003And a host of follow-activities:And a host of follow-activities:
ITU Workshop – February, 2004ITU Workshop – February, 2004UN ICT Task Force Global Forum – March, 2004UN ICT Task Force Global Forum – March, 2004Working Group on Internet Governance (WGIG)Working Group on Internet Governance (WGIG)Phase II of the World Summit in Tunis – Nov. ’05Phase II of the World Summit in Tunis – Nov. ’05
Infrastructure DevelopmentInfrastructure Development
What is so hard about it?What is so hard about it? Making it scalable over platforms, size and timeMaking it scalable over platforms, size and time Achieving Critical MassAchieving Critical Mass
Getting Buy inGetting Buy in Pleasing many essential participantsPleasing many essential participants Displacing prior capabilitiesDisplacing prior capabilities Structuring matters to deal with concerns about empire Structuring matters to deal with concerns about empire
buildingbuilding
It’s a lot easier to create brand new capabilities It’s a lot easier to create brand new capabilities than to affect existing means of operationthan to affect existing means of operation
Infrastructure Creation is a Infrastructure Creation is a Subtractive ProcessSubtractive Process
Infrastructure reduces a common, shared Infrastructure reduces a common, shared capability to its basic and essential attributescapability to its basic and essential attributes
These attributes are not always recognized or These attributes are not always recognized or understood up frontunderstood up front
Upon further scrutiny, capabilities are usually Upon further scrutiny, capabilities are usually deleted from a well-conceived architecture deleted from a well-conceived architecture over timeover time
Consensus develops when no more can be Consensus develops when no more can be removed without disabling the infrastructureremoved without disabling the infrastructure
What is the Problem?What is the Problem?
Managing information in the Net over very long Managing information in the Net over very long periods of time – e.g. centuries or moreperiods of time – e.g. centuries or more
Dealing with very large amounts of information in Dealing with very large amounts of information in the Net over timethe Net over time
When information, its location(s) and even the When information, its location(s) and even the underlying systems may change dramatically underlying systems may change dramatically over timeover time
Respecting and protecting rights, interests and Respecting and protecting rights, interests and valuevalue
A Meta-level ArchitectureA Meta-level Architecture
Allows for arbitrary types of information Allows for arbitrary types of information systemssystems
Allows for dynamic formatting and data Allows for dynamic formatting and data typingtyping
Can accommodate interoperability Can accommodate interoperability between multiple different information between multiple different information systemssystems
Allows metadata schema to be identified Allows metadata schema to be identified and typedand typed
Digital Object Architecture:Digital Object Architecture:MotivationMotivation
To To reformulate the Internet architecturereformulate the Internet architecture around the around the notion of uniquely identifiable data structuresnotion of uniquely identifiable data structures
Enabling existing and new types of information to be Enabling existing and new types of information to be reliably managed and accessed in the Internet reliably managed and accessed in the Internet environment environment over long periods of timeover long periods of time
Providing mechanisms to stimulate innovation, the Providing mechanisms to stimulate innovation, the creation of dynamic new forms of expression and to creation of dynamic new forms of expression and to manifest older formsmanifest older forms
While supporting intellectual property protection, fine-While supporting intellectual property protection, fine-grained access control, and enable well-formed grained access control, and enable well-formed business practices to emergebusiness practices to emerge
Digital Object ArchitectureDigital Object Architecture Technical ComponentsTechnical Components
Digital Objects (DOs)Digital Objects (DOs) Structured data, independent of the platform on which it was Structured data, independent of the platform on which it was
createdcreated Consisting of “elements” of the form <type,value>Consisting of “elements” of the form <type,value> One of which is its unique, persistent identifierOne of which is its unique, persistent identifier
Resolution of Unique IdentifiersResolution of Unique Identifiers Maps an identifier into “state information” about the DOMaps an identifier into “state information” about the DO Handle System is a general purpose resolution systemHandle System is a general purpose resolution system
RepositoriesRepositories from which DOs may be accessed from which DOs may be accessed And into which they may be depositedAnd into which they may be deposited
Metadata RegistriesMetadata Registries Repositories that contain general information about DOsRepositories that contain general information about DOs Supports multiple metadata schemesSupports multiple metadata schemes Can map queries into unique DO specifications (via handles)Can map queries into unique DO specifications (via handles)
What is a Digital ObjectWhat is a Digital Object Defined data structureDefined data structure, machine independent, machine independent Consisting of a set of elementsConsisting of a set of elements
Each of the form Each of the form <type,value><type,value> One of which is the One of which is the unique identifierunique identifier
Identifiers are known as “Handles”Identifiers are known as “Handles” Format is Format is “prefix/suffix”“prefix/suffix” Prefix is unique to a naming authorityPrefix is unique to a naming authority Suffix can be any string of bits assigned by that authoritySuffix can be any string of bits assigned by that authority
Data structure can be parsed; types can be resolved within the Data structure can be parsed; types can be resolved within the architecturearchitecture
Associated Associated properties recordproperties record and and transaction record transaction record containing containing metadata and usage informationmetadata and usage information
Interoperability & Federated Interoperability & Federated RepositoriesRepositories
Create a cohesive interoperable collection Create a cohesive interoperable collection of repository-based systemsof repository-based systems Initially, perhaps, around a core set of Initially, perhaps, around a core set of
projects, content, applications and/or projects, content, applications and/or organizations as in ADL organizations as in ADL
Demonstrate interoperability between Demonstrate interoperability between different repository collectionsdifferent repository collections
Develop procedures to insure continued Develop procedures to insure continued accessibility to key archival information accessibility to key archival information
Repository NotionRepository Notion
Any Hardware & SoftwareConfiguration
Logical External Interface
RAP
RepositoryAccess Protocol
Repositories & Digital ObjectsRepositories & Digital Objects
REPOSITORY
IPv6
Each DigitalObject has itsown unique & persistent ID
Content Providerswant to assign Ids
Could be upwardsof trillions of DOsper Repository
Objects may beReplicated inMultiple Repositories
Handle SystemHandle System Distributed Identifier Service on the InternetDistributed Identifier Service on the Internet
First General Purpose Resolution systemFirst General Purpose Resolution system
Can be used to Can be used to locate repositorieslocate repositories that contain digital objects given that contain digital objects given their handlestheir handles - - and more!and more!
Other indirect referencesOther indirect references Public Keys, Authentication information for DosPublic Keys, Authentication information for Dos
Accommodates interoperability between many different information Accommodates interoperability between many different information systems; for examplesystems; for example DNS was demonstrated on the Handle System in preparation for Y2KDNS was demonstrated on the Handle System in preparation for Y2K Can support ENUM, RFID, and moreCan support ENUM, RFID, and more
Attributes of the Handle SystemAttributes of the Handle System
The basic Architecture of the Handle System The basic Architecture of the Handle System is is flat, scaleable, and extensibleflat, scaleable, and extensible
Logically central, but physically decentralizedLogically central, but physically decentralized Supports Supports Local Handle ServicesLocal Handle Services, if desired, if desired Handle resolutions return entire “Handle Handle resolutions return entire “Handle
Records” Records” or portions thereofor portions thereof Handle Records are alsoHandle Records are also
digital objectsdigital objectssigned by the serverssigned by the serversdoubly certificated by the systemdoubly certificated by the system
Resolution MechanismResolution Mechanism
Multiple SitesMultiple Servers
Handle System<www.handle.net>
Handle
HandleRecord
• System is non –nodal• Scaleable & Distributed• Supports global (and local) resolution• With backup for reliability, mirroring for efficiency
Managing Rights & InterestsManaging Rights & Interests Not just about copyrightNot just about copyright Terms and Conditions (T&Cs) for use may be Terms and Conditions (T&Cs) for use may be
contained within each DO; also information contained within each DO; also information about intrinsic value, such as monetary valueabout intrinsic value, such as monetary value
T&Cs are intended to indicate clearly what one T&Cs are intended to indicate clearly what one can and/or cannot docan and/or cannot do with a given DO, where with a given DO, where such clarity is intended by the owner of the DOsuch clarity is intended by the owner of the DO
Not an enforcement means, although it may be Not an enforcement means, although it may be used by an enforcement systemused by an enforcement system
Mobile programs that are Digital Objects may Mobile programs that are Digital Objects may apply such terms to themselves and to any apply such terms to themselves and to any digital objects they containdigital objects they contain
Handle FormatHandle Format
Prefix Authority
Item ID(any format)
Prefix Suffix
In use, a Handle is an opaque string.
2304.40/1234 Other examples ofHandles
2304/general info2304/12304. HQ/staff2304.1/memo1232304.22.Pub/2004
Direct Access and ProxiesDirect Access and Proxies
DirectAccess
One or moreProxy Servers
IndirectAccess
Redirection of Handle RequestsRedirection of Handle Requests
DirectAccess
DirectAccess
One or moreLocal Handle Services
General Registry of allNaming Authorities
RedirectionInformation
RedirectionInformation
ConclusionsConclusions
Managing Digital Objects for long-term access is a Managing Digital Objects for long-term access is a key challengekey challenge
Initial Technology Components are available; Initial Technology Components are available; Industry is expected to generate more over timeIndustry is expected to generate more over time
Third-party value-added providers in the private Third-party value-added providers in the private sector will ultimately shape the long-term evolutionsector will ultimately shape the long-term evolution
Interoperability and reliable information access is a Interoperability and reliable information access is a critical objectivecritical objective
A diversity of applications (with user-friendly A diversity of applications (with user-friendly interfaces) need to be developed & deployedinterfaces) need to be developed & deployed
The ADL Project can have a central role to play in The ADL Project can have a central role to play in demonstrating the technology and using it effectivelydemonstrating the technology and using it effectively