18
FitHAS, an easy to use a FitHAS, an easy to use a ssistant tool for FITS d ssistant tool for FITS d ata archiving ata archiving Wen Li, Chenzhou Cui, Ce Yu Wen Li, Chenzhou Cui, Ce Yu China-VO team China-VO team NAOC & Tianjin University NAOC & Tianjin University

FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

Embed Size (px)

Citation preview

Page 1: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

FitHAS, an easy to use assistant FitHAS, an easy to use assistant

tool for FITS data archivingtool for FITS data archiving

Wen Li, Chenzhou Cui, Ce YuWen Li, Chenzhou Cui, Ce Yu

China-VO teamChina-VO teamNAOC & Tianjin UniversityNAOC & Tianjin University

Page 2: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

ContentContent

FITSFITS Introduction to FitHASIntroduction to FitHAS Features of FitHASFeatures of FitHAS DemoDemo

Page 3: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

FITSFITS Introduction to FitHASIntroduction to FitHAS Features of FitHASFeatures of FitHAS DemoDemo

Page 4: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

FITS FITS

Flexible Image Transport SystemFlexible Image Transport System The standard data format used in The standard data format used in

astronomyastronomy Endorsed by NASA and the Endorsed by NASA and the

International Astronomical Union International Astronomical Union

Page 5: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University
Page 6: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

FITS data storageFITS data storage

Current storage: filesCurrent storage: files

Store in database?Store in database?

How to archive metadata of FITS files How to archive metadata of FITS files into database easily?into database easily?

Page 7: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

FITSFITS Introduction to FitHASIntroduction to FitHAS Features of FitHASFeatures of FitHAS DemoDemo

Page 8: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

FitHASFitHAS

FITS Header Archiving SystemFITS Header Archiving System• an easy to use assistant tool for FITS an easy to use assistant tool for FITS

data archivingdata archiving• provides graphic interface and wizard provides graphic interface and wizard • extracts header information from FITS extracts header information from FITS

files and import it to database.files and import it to database.

Page 9: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

Architecture of FitHASArchitecture of FitHAS

FITS filesFITS files

Wizard

DatabaseFITS files

Header analysisMetadata Mapping

and Archiving Database controller

Header viewer

Database browser

Config-uration

Configuration filesArchive

moniter

Page 10: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

What can FitHAS do?What can FitHAS do?

View FITS headerView FITS header Create tables in database according to the heaCreate tables in database according to the hea

der structure of the file(s)der structure of the file(s) Archive file(s) header(s) into databaseArchive file(s) header(s) into database Review records archived into a tableReview records archived into a table

Page 11: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

FITSFITS Introduction to FitHASIntroduction to FitHAS Features of FitHASFeatures of FitHAS DemoDemo

Page 12: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

FeaturesFeatures Supports single file archiving, as well as Supports single file archiving, as well as

batch archivingbatch archiving• Single fileSingle file• Multiple filesMultiple files• directorydirectory

Page 13: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

Supports file name filterSupports file name filter• Useful to specify which file(s) or directory to be impUseful to specify which file(s) or directory to be imp

orted.orted.• Use regular expressionUse regular expression

Page 14: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

\d <-> A digit: [0-9] \D <-> A non-digit: [^0-9] \w <-> A word character: [a-zA-Z_0-9] \W <-> A non-word character: [^\w] \s <-> A whitespace character (spaces, tabs, line breaks, etc.) \S <-> A non-whitespace character: [^\s] . <-> any character [abc] <-> a, b, or c [a-zA-Z] <-> A letter (in range of a - z, or A - Z)

X? <-> X, 0~1 times X* <-> X, zero or more times X+ <-> X, one or more times X{n} <-> X, exactly n times X{n,} <-> X, at least n times X{n,m} <-> X, at least n but not more than m times ……

Page 15: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

Friendly interface, convenient wizard, detailed Friendly interface, convenient wizard, detailed operation hint and result report.operation hint and result report.

Page 16: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

Various strategy to archive duplicate recordsVarious strategy to archive duplicate records• Empty table and archiveEmpty table and archive• Skip duplicate filesSkip duplicate files• Update duplicate recordsUpdate duplicate records

Auto generate table schema according to the sAuto generate table schema according to the selected file(s)elected file(s)

Keep the directory structure of the files in dataKeep the directory structure of the files in database.base.

Page 17: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

FITSFITS Introduction to FitHASIntroduction to FitHAS Features of FitHASFeatures of FitHAS DemoDemo

Page 18: FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University

Thank you!Thank you!