Upload
quintana-topaz
View
23
Download
2
Tags:
Embed Size (px)
DESCRIPTION
AIA 106 th Annual Meeting, Boston, Jan. 2005. ETANA-DL ( Electronic Tools and Near Eastern Archives Digital Library). Edward A. Fox, Virginia Tech James W. Flanagan, Case Western Reserve U. [email protected] http://fox.cs.vt.edu http://fox.cs.vt.edu/talks/. Outline. Acknowledgements - PowerPoint PPT Presentation
Citation preview
ETANA-DL(Electronic Tools and Near Eastern
Archives Digital Library)
Edward A. Fox, Virginia TechJames W. Flanagan, Case Western Reserve U.
AIA 106th Annual Meeting, Boston, Jan. 2005
[email protected] http://fox.cs.vt.edu
http://fox.cs.vt.edu/talks/
Outline Acknowledgements ETANA-DL High Level Overview Harvesting, Open Archives Initiative OCKHAM, Reference Models OAIS (ISO Standard for Archiving) 5S (Digital Library Framework) ETANA-DL Approach, Services, Integration Conclusions
NSF ITR Funding IT Research Digital library: Integration of DB,
HCI, HT, IR, LIS, MM, …
Complexity! Variety! Distributed! => 5S Framework + OAI / ODL
Archaeology Research Multiple sites Multiple kinds of artifacts Multiple terminologies
General/special services Multiple views Hypothesis testing Rapid publication
Map courtesy: www.enchantedlearning.com
Initial ETANA-DL Member Locations
Virginia Tech
Mississippi State University
Vanderbilt University
Canadian University College
Walla Walla College
Andrews University
CWRU
Willamette University
Acknowledgements
Contributors:• Karen Borstad, MPP• Douglas Clark, Walla Walla College• Larry Herr, Canadian University College• Christopher Holland, LRP• Paul Jacobs, Mississippi State U.• Stan LaBianca, Andrews U.• David McCreery, Willamette U.• David Schloen, U. of Chicago• Randall Younker, Andrews U.• . . .
Team:• Joanne Eustis, CWRU
• Weiguo Fan, Virginia Tech
• Nick Fischio, CWRU
• Paul Gherman, Vanderbilt U.
• Marcos Goncalves, Virginia Tech
• Doug Gorton, Virginia Tech (CS4624)
• Douglas Knight, Vanderbilt U.• Likhita Krishnamurthy, VT (CS5604)• Ming Luo, Virginia Tech• Ananth Raghavan, VT (CS5604)• Divya Rangarajan, VT (Ind. Study)• Unni Ravindranathan, Virginia Tech• Jack Sasson, Vanderbilt U.• Rao Shen, Virginia Tech• Ricardo Torres, U. Campinas, Brazil• Srinivas Vemuri, Virginia Tech
Lahav Website
Megiddo Opening Screen
Locus Screen: Pictures
View all
Area Screen
ETANA-DL Website
ETANA-DL Architecture
Users Services Data ETANA-DLUnion Services Users
DigBase
DigKit
ETANA-DL ArchitectureDigBase and DigKit
LahavNimrin
UmayriHisban
Megiddo
Jalul
New Sites
DATABASE
WRAPPERS
ETANA-DLUNION
CATALOG
SearchUSER
INTERFACE
BrowseRecommend
NotePersonalize
ReviewVisualizationsArchaeology
Specific
1st Prototype
…
Open Archives InitiativeOAI
www.openarchives.org
Open Archives Initiative (OAI)Protocol for Metadata Harvesting
Black Box Perspective
OA 1
OA 2
OA 4
OA 3
OA 5OA 6
OA 7
OAI = Technical Umbrella forPractical Interoperability…
ReferenceLibraries
Publishers E-PrintArchives
…that can be exploited by different communities
Museums
OAIRepositoryPerspective
Required: Protocol
DODO DO DO
MDO
MDO MDOMDOMDO
MDOMDOMDO
Discovery CurrentAwareness Preservation
Service Providers
Data Providers
Metada ta
ha rve sti ng
OAI: Data & Service Providers
Data and Service Providers
Data Providers possess metadata and share it (internally / externally) via well-defined OAI protocols (e.g., database servers)
Service Providers harvest and preserve data from Data Providers provide higher-level services to users (e.g., search engines)
Who will fit where in ETANA-DL? Data Provider – YOUR PROJECT Service Provider – ETANA-DL
NSDLOCKHAM
Services
NSDLServices
Teachers LearnersLibrarians
OCKHAMLibrary
Network
LibraryServices
OCKHAM Simplicity (a la OCCAM’s razor) Support by Mellon and DLF Four main ideas:
1. Components2. Lightweight protocols3. Open reference models (e.g., 5S, OAIS)4. Community perspective and involvement
Funded by NSF in NSDL, with P2P
Reference Models Reference Model: a common vocabulary
and description of components, services, and inter-relationships that comprise a system under consideration
Useful as a tool to foster consensus and common understanding in a time of rapid change and/or disagreement
OAIS RLG Pages - www.rlg.org
OAIS RLG Examples – 1 of 2
OAIS RLG Examples – 2 of 2
http://ssdoo.gsfc.nasa.gov/nost/isoas/
Informal 5S Definitions
DLs are complex systems that
help satisfy info needs of users (societies) provide info services (scenarios) organize info in usable ways (structures) present info in usable ways (spaces) communicate info with users (streams)
5SSs Examples Objectives
Streams Text; video; audio; image Describes properties of the DL content such as encoding and language for textual material or particular forms of multimedia data
Structures Collection; catalog; hypertext; document; metadata
Specifies organizational aspects of the DL content
Spaces Measure; measurable, topological, vector, probabilistic
Defines logical and presentational views of several DL components
Scenarios Searching, browsing, recommending
Details the behavior of DL services
Societies Service managers, learners, teachers, etc.
Defines managers, responsible for running DL services; actors, that use those services; and relationships among them
Site Partition Sub-partition Locus Container
Lahav FieldI
AreaA8
LocusA8074
Basket224
Nimrin QuadrantNW
Quadrant ValueN25/W50
Locus96
Bag240
Umayri FieldA
Square7J59
Locus001
Pail12
5S Structural Model Organization
5S MetaModel
5SGraphDL
Expert
DL Designer
5SL DL
Model
5SLGen
Practitioner
Researcher
TailoredDL
Services
Teacher
componentpool
ODLSearch,ODLBrowse,ODLRate,ODLReview,
…….
Requirements (1) Analysis (2)
Implementation (4)
Design (3)
5SGraph 5SGen
Mapping Tool
5S Suite
ETANA-DL Architecture
UnionCatalog
Inverted Files
Services DB
Index
Index
BrowseComponent
SearchComponent
Browse DB
OtherETANA-DL
Services
Web Interface
XOAI
XOAI
DigBase
DBData
MappingComponent
OA
I Data Provider
OAI
Archaeological Site ETANA-DL
DigKit
Configure
Digital Object
RepositoryCollection Minimal DL
Metadata Catalog
Descriptive Metadata
Specification
A Minimal DL in the 5S Framework
Structural Metadata
Specification
Streams Structures Spaces Scenarios Societies
indexingbrowsing searching
services
hypertext
Structured Stream
5S Archaeological DL Modeling
Modeling archaeological information systems
using the 5S theory to better understand the domain and design the system and the supporting
services
Streams Structures Spaces Scenarios Societies
indexingbrowsing searching
services
hypertext
Structured Stream
Descriptive Metadata
specification
SpaTemOrg
StraDia
Arch Descriptive Metadata specification
ArchDO
ArchObj
ArchColl
Arch Metadata catalog
ArchDColl ArchDR Minimal ArchDL
A Minimal ArchDL in the 5S Framework
Modeling ETANA-DL – An Archaeological DL Meta-model
Text Video Audio
*Site *Sub-partition *Container *Artifact*LocusRegion
Taxonomies
Temporal Artifact-specific
Space model
Structuremodel
Metadata
Drawing Photo 3DStreammodel
*Partition
Society model
ArchaeologistGeneral public
Geographic space
Service Manager
Information Satisfaction
Value added
Repository buildingScenario
model Services
Domain specific
User interface Metric space
Spatial
Modeling ETANA-DL – ETANA Model
*Field *Pail *Bone*LocusJordan
Taxonomies
Space model
Structuremodel Field record,
locus sheet
Figurine image (photo)
Streammodel
Umayri
Society model
Archaeologist
Generic public
Site-specific coordinate system Web interface Vector space
ETANA-DLService Manager
Searching, Browsing
Annotation, binding
Harvesting, Converting Scenario
model Services
Object comparison, marking item for analysis
Archaeologicalperiods
Bone type
Seed species
*Square
*Figurine*Quadrant *Bag*LocusJordan Valley Nimrin *Square*Field *Basket*LocusSouthern Israel Halif *Area
*Seed
Site/field plan(drawing)
Preliminary/FinalReport (application/pdf)
Spatial
Overall objective of 5SGraph:Help users model their own instances of a digital library (DL) in the 5S language (5SL).
A simple modeling process which enables rapid generation of digital libraries is needed.
Support non-expert users. Speed-up development process. Increase the quality of final product.
5SGraph: A DL Modeling Tool
Overview of 5SGraph
Workspace
(instance model)
Structured
toolbox
(metamodel)
Space Model
Society Model
ETANA-DL Approach Applying and extending Digital Library (DL)
techniques to solve key problems: making primary data available, data preservation, and interoperability
Modeling archaeological information systems using 5S to better understand the domain and design the system and the supporting services
Rapidly prototyping DLs that handle heterogeneous archaeological data using componentized frameworks: eliciting requirements refining metamodel and union schema modeling sites mapping harvesting providing useful services
Marking – writingnotes for
a specific user
Marking Items
Marked Items Display
Sender, Date,Object OAI ID
SenderComments
Options:View Record,
Add record to Items Of Interest,Re-mark item (Redirect),
Unmark item (Remove item from list)
Discussions Page
Discussions about an
object
View/Post messages, create new
threads
Recommendations
Items recommendedon the basis of
similar interests
ETANA-DL Searching ServiceSearch
ETANA-DL Multi-dimensional Browsing3 new sites
2 new types of artifacts
ETANA-DL Visual Browsing Service
Visual BrowseBy site
Visual Browsing Nimrin: Topographical Drawings
Full site North west quadrant
Square:N40/W20
Visual Browsing Nimrin : Square information
Square:N40/W20
Locus: 86Loci layout
Visual Browsing Nimrin : locus sheet
Visual Browsing Bab edh-Dhra' Cemetery
Pottery # 25
Visual Browsing Bab edh-Dhra' Cemetery
Pottery # 25
Repository1
DL1
Repository2
Union Catalog
Union Repository
Catalog1 Catalog2
Searching
Union DL DL2
archaeologists
Society
General Public
Society
ArchaeologistsGeneral Public
Union Society
ServiceBrowsingService
Union Service
Harvesting, Mapping,Searching, Browsing,
Clustering, Visualization
Architecture of a Union DL
Union Catalog
VNCatalog
Union Catalog Integration
Virtual Nimrin(VN)
Halif DigMaster(HD)
HDCatalog
VN MetadataFormat
MappingTool
MappingTool
Global MetadataFormat
Wrapper
Wrapper
HD MetadataFormat
Site Artifact Type Original data source Number of records harvested
Bab edh-Dhra’ Pottery cp6 database file 786
Lahav Figurine Tab-delimited text file 563
Madaba Locus field record Tables in Access DB 786
Mozan Publication PDF files 19
NimrinBone field record Table in Oracle DB 7419
Seed field record Table in Oracle DB 429
Locus field record Table in Oracle DB 2101
Umayri Bone field record 2 tables in Access DB 2122
Total 18404
Heterogeneous data handling
ETANA-DL Schema Design
Bone Seed Figurine
ETANA-DLObject
Count
Animal
……Species
Name
……Description
Dimensions
……
Owner
Subpartition
PartitionLocus
ID Container
Collection
……
Visualizing Components
Mapper1
Composite Mapper
Mapper2 Mapper3 Mapper4
Visual Mapping Tool Architecture
Data Mapping (state-of-the-art)
local schema global schema
Mapping recommendation
Mapping confirmation
Mapping history
No recommendation for “Tomb_Area”
User-decided mapping
5SGraph5S Archaeology
MetaModelArchDL Expert ArchDL Designer
VN Metadata Format
ETANA-DL Metadata Format
Mapping Tool
Wrapper4VN Wrapper4HD
HD Metadata Format
Inverted Files
Services DB
Index
Index
BrowseService
SearchService
Browse DB
OtherETANA-DL
Services
Web Interface
XOAI
XOAI
VNCatalog
VNCatalog
UnionCatalog
Structure Sub-modelScenario
Sub-model
Harvesting description
Mappingdescription
Browsing description
…
5SGen
ComponentPool
Browsing…
Conclusions
Working on 5S book … See http://feathers.dlib.vt.edu/ Thanks to NSF ITR IIS-0325579! Please fill in and return/send survey!