35
Status of Database and Calibrat Status of Database and Calibrat ion Project In BES-3 Offline So ion Project In BES-3 Offline So ftware System ftware System Bin Huang, Chunxiu Liu, Dayong Wang, Jianming Bian, Jinf a Qiu, Linli Jiang, Linghui Wu, Qiumei Ma, Yuguang Xie Jan. 12, 2006 Abstract The work of this group is one of the important parts in our BES-3 offline so ftware project. And it includes the fol lowing jobs: Framework(Calib), DB, Sub-Detector calibrat ion algorithms, Auto-Job-Sub-Script and Monitor p rograms. In this report, I would like to talk about the Status of Database and Calibr

Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Embed Size (px)

Citation preview

Page 1: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Status of Database and Calibration Project Status of Database and Calibration Project In BES-3 Offline Software SystemIn BES-3 Offline Software System

Bin Huang, Chunxiu Liu, Dayong Wang, Jianming Bian, Jinfa Qiu, Linli Jiang, Linghui Wu, Qiumei Ma, Yuguang Xie

Jan. 12, 2006

Abstract

The work of this group is one of the important parts in our BES-3 offline software project. And it includes the following jobs:

Framework(Calib), DB, Sub-Detector calibration algorithms, Auto-Job-Sub-Script and Monitor programs.

In this report, I would like to talk about the Status of Database and Calibration for BES-3 in the following way:

Page 2: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

• Introduction

• The offline calibration framework

• Database (MYSQL)

• Auto-Job-Sub-Script

• Sub-detector calibration algorithms

• Summary

Status of Database and Calibration Project In BES-3 Offline Software System

Page 3: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

一 Introduction

• The experimental data analysis flow

• The significance of offline calibration

• The basic process of offline calibration

Status of Database and Calibration Project In BES-3 Offline Software System

Page 4: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

e+ e-

Detector

physics

Data(Raw, MC)

Reconstruction

Physics Results

MC

Calibration

Status of Database and Calibration Project In BES-3 Offline Software System

Page 5: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Status of Database and Calibration Project In BES-3 Offline Software System

The significance of offline calibration

• To guarantee the physics data correction

Raw data Correcting and Scaling

Groups of Coefficient

Rec. and Physics Result

• To track the qualification of the data acquisition

Detector performance Monitor program

Hardware persons

Page 6: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

The flow of BES2 offline calibration

Status of Database and Calibration Project In BES-3 Offline Software System

Page 7: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

The relative parameters after offline calibration

Status of Database and Calibration Project In BES-3 Offline Software System

Page 8: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Status of Database and Calibration Project In BES-3 Offline Software System

二 The offline calibration framework

• The philosophy of designing the program ( Gaudi, C++, ROOT… )GLAST

• The structure of the framework and the packages

• The calibration data : the metadata, stored in the database(MySQL), and the bulk data (ROOT file)

• Calibration data will be made available for read access according to usual Gaudi practice for TDS data.

Page 9: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Status of Database and Calibration Project In BES-3 Offline Software System

The offline calibration framework

Data (persistent) Metadata (persistent)

Calibrator

bad strips(XML)

CAL, ACD calibs(XML,ROOT) MySQL rdbms

reference

uses

program, scriptrdbGuiRegister, search

reads

ROOT macros, etc.

writes to

Page 10: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

The Packages of the Calibration FrameworkCalibSvc: CalibDataSvc the DataSvc responsible for providing

access to data in a TDS. CalibMySqlCnvSvc the conversionSvc for metadata “conversion” CalibRootCnvSvc CalibXmlCnvSvc

calibUtil: provide the interface between the client of calibration fremwork and the MySQL DataBase

facilities : supply tools that are commonly used in the framework

rdbGui : a GUI that can register and write the metadata dbms

rdbModel: contain the classes and interfaces that describe and access a rdb

xmlBase: used for interpret and produce xml files 。CalibData: define the Data Model and corresponding ClassID of each subdetector in the TCDS, including the runfrom and runto numbers in each dataset

the ConversionSvc for bulk data conversion

Status of Database and Calibration Project In BES-3 Offline Software System

Page 11: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

TCDS StructureTransient (Calibration) Data Store

Calib

MdcCal TofCal DedxCal

vanilla vanilla vanilla

/Calib/MdcCal/vanilla /Calib/TofCal/vanilla /Calib/DedxCal/vanilla

(More)

digi

/Calib/MdcCal/digi

Status of Database and Calibration Project In BES-3 Offline Software System

Page 12: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Status of Database and Calibration Project In BES-3 Offline Software System

• The Data Model design: MDC, TOF and dE/dx

• The test of the framework: MDC, TOF and dE/dx

• The file written from TCDS

• Works to be continued on EMC and MUC

Page 13: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

• The selection(Oracle 、 MySQL 、 Postegre) / installation

• The construction of Metadata list

• Test of the system (Mdc Tof dE/dx)

• Browsing the Database from Website

Status of Database and Calibration Project In BES-3 Offline Software System

三 Database (MYSQL)

Page 14: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Field name Who fills Explanation, typical contents

Ser_no Mysql (rdbms) Unique serial # for this record

Calib_type Calibrator Mdc Emc Tof Muc Dedx …

Data_fmt Calibrator XML or ROOT

Run_from Calibrator Start run to which calibration applies

Run_to Calibrator End run to which calibration applies

Sft_ver Calibrator

Cal_ver Calibrator

Cal_par Calibrator

Rec_alg Calibrator

Rec_par Calibrator

Status Calibrator ‘OK’, ‘TEST’, ‘ABORT’

Creator prog (e.g.rdbGui) Name of program or script creating entry

Uid prog (e.g.rdbGui) login id

Enter_time Mysql (rdbms) Time entry was made in database

Data_ident Calibrator Typically file spec.

Input_desc Calibrator Description of input data.

Notes Calibrator Anything else about calibration or conditions under which it was performed that might be of interest.

Status of Database and Calibration Project In BES-3 Offline Software System

Page 15: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Data (persistent)Metadata (persistent)

Calibs(XML)

Calibs(ROOT)MySQL rdbms

calibUtilSearch db

reference

uses

executable

library

ConversionServices

(CalibSvc) reads

Status of Database and Calibration Project In BES-3 Offline Software System

Page 16: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Status of Database and Calibration Project In BES-3 Offline Software System

Page 17: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

A very simple script finished#!/bin/bashTIMES=5iter=0while [ "$iter" -lt "$TIMES" ]doecho -n "$iter"boss.exe jobMdcCalib.txtiter=`expr $iter + 1`cp MdcCalConst.root "MdcCalConst$iter.root"echo "MdcCalConst$iter.root created"mv histogram.root "T0histogram_$iter.root"Doneexit

Status of Database and Calibration Project In BES-3 Offline Software System

四 Auto-Job-Sub-Script

Manpower saved

Page 18: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

• The calibration algorithm for MDC

• The calibration algorithm for dE/dx

• The calibration algorithm for TOF

• The calibration algorithm for EMC

• The calibration algorithm for MuC

Status of Database and Calibration Project In BES-3 Offline Software System

五 Sub-detector calibration algorithms

                    

Page 19: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

2. The basic calibration method we used

Survival analysis mathod ( 残差分析 )

Δd = ddrift – doca

where ddrift: drift distance

doca: the distance between the track and the hit wire

1. What have we considered ?X-T calibration, T0 calibration, Wire survey calibration, Q-T calibration, and Space resolution calibration.

ΔT0 分布

Status of Database and Calibration Project In BES-3 Offline Software System

Page 20: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Start

Initailize ( histo , calib const… )

Execute (Rec, Fill the histo…)

Survaval analyse

Correction and Renew the const(XT/T0/…)

Finish

Main classes designed :

MdcCalibAlg

MdcCalib

MdcCalHistMgr

MdcCalConstMgr

MdcCalEvent

MdcCalGeo finailize( )

Status of Database and Calibration Project In BES-3 Offline Software System

3. The flow of the program (MdcCalibAlg)

N

Page 21: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

+bookHist()+fillHist()+statHist()

MdcCalHistMgr

+getRecInfo()+getResidue()

MdcCalEvent

+rdCalConst()+wtCalConst()+updateCalConst()

MdcCalConstMgr

+initDcCal()+getEvent()+exeDcCal()+endDcCal()

MdcCalib

+bookHist()+fillHist()+statHist()

XtMdcCalHistMgr

+bookHist()+fillHist()+statHist()

T0MdcCalHistMgr

+bookHist()+fillHist()+statHist()

WrMdcCalHistMgr

+bookHist()+fillHist()+statHist()

QtMdcCalHistMgr

+updateCalConst()

XtMdcCalConstMgr

+updateCalConst()

T0MdcCalConstMgr

+updateCalConst()

WrMdcCalConstMgr

+updateCalConst()

QtMdcCalConstMgr

+getMdcGeo()

MdcCalibGeo

Status of Database and Calibration Project In BES-3 Offline Software System

3. The flow of the program (MdcCalibAlg)

Page 22: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

残差分布ΔT0 分布

Status of Database and Calibration Project In BES-3 Offline Software System

4. Some results tested by MC data

Results after T0 calibration

Page 23: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

丝位偏移量分布

丝位

修正

量(m

m)

Results after survey calibration

每根丝的位置修正结果

Root 格式的直方图文件 (Wire.root)

4. Some results tested by MC data Status of Database and Calibration Project In BES-3 Offline Software System

Page 24: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

twcobs

rawMdcCalibFunSvc

TimeToDistFunDistToTimeFun

Mdc Calibration Constants

TCDS

Reconstruction

Simulation

Others

MdcCalibFunSvc :完成漂移室刻度常数到相关物理量的转换过程,既方便各模块调用,也有利于刻度人员的更新和维护。

Calibration

5.Mdc Calibration Function Service

Status of Database and Calibration Project In BES-3 Offline Software System

Page 25: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

+i ni t i al i se()+execute()+fi nal i se()+BookHi sts()+Fi l l Hi sts()+Anal yseHi sts()+Wri teHi sts()+getChargeOff Corr()+ReadParameters()+Wri teParameters()

DedxCal i b

Algori thm

DedxCal i bLayerGain DedxCal i bDri ftDi st DedxCal i bSaturati on DedxCal i bZposDedxCal i bWi reGain DedxCal i bRunByRun

DedxCal i bParameters<<uses>>

dE/dx Calibration Software Flow

Status of Database and Calibration Project In BES-3 Offline Software System

Page 26: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Status of Database and Calibration Project In BES-3 Offline Software System

(For the detail, please see the report given by Dayong Wang in this meeting )

The resolution after calibration

Page 27: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

TOF Calibration Software Flow

Tof Calibration Algorithm

calibration constants

Tof ReconstructionAlgorithm

Calibration frameworkconverter

Initialize()

execute()

finalize()

TimeCalib()

SpeedCalib()

AttenCalib()

Calibration data( Bhabha events )

Calibration constant

Data base

Calibration data( Bhabha events )

Status of Database and Calibration Project In BES-3 Offline Software System

Page 28: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Time after calibration

dt vs zHit Time resolution

Status of Database and Calibration Project In BES-3 Offline Software System

(For the detail, please see the report given by Linli Jiang in this meeting )

Page 29: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Energy Calibration of BESIII EMCEnergy Calibration of BESIII EMC

‘Digi’-calibrationBhabha calibration

0 calibration

Radiative Bhabha calibration

‘Cluster’-calibration

Status of Database and Calibration Project In BES-3 Offline Software System

•The R&D of calibration method / finished

•The Algorithms design / working on

Page 30: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Gamma-GammaCalibration

gi

Intermediate Data (matrix, vector)

Bhabha calibration const.

Bhabha calibration flow chart

Status of Database and Calibration Project In BES-3 Offline Software System

Page 31: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Status of Database and Calibration Project In BES-3 Offline Software System

Muc Calibration Software

•The alignment of Muc / finished

•The R&D of calibration method / working on

•The Algorithms design / working on

Page 32: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Status of Database and Calibration Project In BES-3 Offline Software System

TOF Calibration Software Flow

Page 33: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

• The database and calibration software was made a big progress in the last year.

• Calibration framework were released at the end of 2005

• Sub-detector algorithm softwares are carrying out smoothly:

MDC, dE/dx and TOF released soon

EMC and MUC worked on • Auto-job-submit-script: a very simple one--fini

shed

Status of Database and Calibration Project In BES-3 Offline Software System

Summary

Page 34: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

• In this year, we will have much works on the aboves (Algorithms modification, check with MC data … ) and the other Algorithms ( monitor programs, MDC D/H check …) should be considered soon.

• So we hope that more persons would join us!

---- Welcome!

Status of Database and Calibration Project In BES-3 Offline Software System

Summary

Page 35: Status of Database and Calibration Project In BES-3 Offline Software System Status of Database and Calibration Project In BES-3 Offline Software System

Thank you all !