JetMET DQM Status Kenichi Hatakeyama, Anwar Bhatti, Frank Chlebana, Jared Sturdy DQM Meeting November 4th, 2008

JetMET DQM Status

Kenichi Hatakeyama, Anwar Bhatti,

Frank Chlebana, Jared Sturdy

DQM Meeting

November 4th, 2008

November 4, 2008 DQM Meeting 2

JetMET POG Monitoring PlotsJetMET POG Monitoring Plotshttps://cmsweb.cern.ch/dqm/tier-0/

From CRAFT dataFrom CRAFT data

JetMET POG DQM isalready run routinely


JetMET DQM Shift InstructionJetMET DQM Shift Instructionhttps://twiki.cern.ch/twiki/bin/view/CMS/DQMShiftOfflineJetMET


Data Certification for “Jets”Data Certification for “Jets”

For jets we are looking at Several different algorithms (IterativeCone, SISCone,

PFlow, JPT) Regions in the detector (Barrel, EndCap, Forward) High and low jet pt triggers

Quality test compares current histogram with a reference histogram Chi2 or KS test

Several distributions are tested (Pt, eta, phi, constituents, HOverE)


Determining the Quality Flags for “Jets”Determining the Quality Flags for “Jets”

Quality flags for the different jet algorithms determined by comparing histogram to reference

JetMET_Jet_AAA (AAA = IterativeCone, SISCone, PFlow, JPT)

if ( (JetMET_Jet_AAA_Pt_Low_Val > 950 ) && (JetMET_Jet_AAA_Pt_High_Val > 950 ) && (JetMET_Jet_AAA_Eta_Low_Val > 950 ) && (JetMET_Jet_AAA_Eta_High_Val > 950 ) && (JetMET_Jet_AAA_Phi_Low_Val > 950 ) && (JetMET_Jet_AAA_Phi_High_Val > 950 ) && (JetMET_Jet_AAA_Constituents_Low_Val > 950 ) && (JetMET_Jet_AAA_Constituents_High_Val > 950 ) && (JetMET_Jet_AAA_HOverE_Low_Val > 950 ) && (JetMET_Jet_AAA_HOverE_High_Val > 950 ) )

JetMET_Jet_AAA = 1


Data Certificaiton for “MET”Data Certificaiton for “MET”

For MET, we are looking at met (MET from Barrel+Endcap+HF), and metNoHF (MET from Barrel+Endcap only).

Data Certification for MET: Currently fit MEx & MEy distributions to double Gaussians and

check Chi2 and the peak. Chi2 of double Gaussian fits: reduced chi2 <20 for lum section or 200 for

entire run (Need to adjust the criteria based on the statistics) Mean of the fitted Gaussian form: within +/-10 GeV

Looking into METPhi, MET, METsignificance also For these, need to compare with reference histograms (Chi2 or KS test)

Performed for the entire run and also per lumi section. Currently we use “monitoring variable versus lumi section” 2D

histograms, but a long run can exceed the axis range… (see later slides)


DBS information is organized in three layersAble to select subcomponent (HB,HO, HE, HF)

Layer 1 Layer 2 Layer 3 JetMET_Global JetMET_Jet_ICone JetMET_Jet_ICone_Barrel JetMET_Jet_SISCone JetMET_Jet_ICone_EndCap JetMET_Jet_PFlow JetMET_Jet_ICone_Forward JetMET_Jet_JPT JetMET_Jet_SISCone_Barrel ... JetMET_MET JetMET_MET_All JetMET_MET_NoHF

Currently have histograms for ICone, SISCone, and PFlow…

Data Certification OutputsData Certification Outputs


Data Certification Algorithm ImplementationData Certification Algorithm Implementation

Data Certification runs as a standalone cmsRun job Next step: move this into the harvesting job

Using a root Chi2 or KS test to compare current histogram against a reference Reference histograms need to be accessible Looking into the qtest code…

Results are saved in a “Data Certification” folder in the DQM root file


DCS queries which return HV/LV settings for the HCAL • takes several minutes (~3 min) to complete

Example from run 67124

Many channels are stableHBM_HV1_2_08/M1 CH1 HB -1 2 10 1 10/22/08 14:36:12 7516 HBM_HV1_2_08/M1 CH1 HB -1 2 1 1 10/22/08 14:36:12 7516 HBM_HV1_2_08/M1 CH1 HB -1 2 11 1 10/22/08 14:36:12 7516

Some channels are changingHBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 14:37:28 1332 HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 14:37:34 680 HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 14:37:40 380 …HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 14:38:19 32 HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 14:38:25 20 HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 14:38:31 12 HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 14:38:50 4 HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 15:41:39 452 HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 15:41:45 952 HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 15:41:51 1468 …HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 15:42:55 6588 HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 15:43:02 7108 HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 15:43:08 7132 HBP_HV2_1_10/M2 CH1 HB 1 15 5 1 10/22/08 15:43:27 7120

HV starts out low, is lowered, then raised

DCS QueriesDCS Queries


Data CertificationData Certification The JetMET Data Certification is determined entirely

from the results saved in the DQM root file…

Jet Data Certification is reported for the entire run

MET Data Certification is reported for the entire run and also per lumi section

Will use DCS information to identify Luminosity Sections with bad data…

Should be folded into the DPG (HCAL, ECAL) Data Certification results…


MET DQM in CRAFT dataMET DQM in CRAFT data(in following slides…)(in following slides…)


Run 66594Run 66594

MEx (GeV)MEx (GeV) MEy (GeV)MEy (GeV) METPhi (rad)METPhi (rad)

Lum

i Sect

ion

Lum

i Sect

ion

Lum

i Sect

ion

Lum

i Sect

ion

With HFWith HF

Barrel+Endcap OnlyBarrel+Endcap Only

First few lumi sections appear to be problematic.First few lumi sections appear to be problematic.N

um

ber

of

events

Num

ber

of

events

Num

ber

of

events

Num

ber

of

events


Run 66594 cont’dRun 66594 cont’d

Zoom-in view

Problem only in a first few lumi sections

On a lumi section based method, can keep the majority of events


Run 66594 cont’dRun 66594 cont’d Data certification

Looking at Chi2 of double Gaussian fits: reduced chi2 <20 (lum section) or

200 (entire run)

(Need to adjust the criteria based on the statistics) Mean of the fitted Gaussian form: within +-10 GeV


Run 66714Run 66714


Lum

i Sect

ion

Lum

i Sect

ion

Lum

i Sect

ion

Lum

i Sect

ion

With HFWith HF


No major problem.No major problem.N

um

ber

of

events

Num

ber

of

events

Num

ber

of

events

Num

ber

of

events



Data certification output

Good run


Run 66746Run 66746


Lum

i Sect

ion

Lum

i Sect

ion

Lum

i Sect

ion

Lum

i Sect

ion

With HFWith HF


Noise in HFNoise in HFat phi~0.8at phi~0.8

Check of the mean MEx or MEy will detecot this problem.Check of the mean MEx or MEy will detecot this problem.N

um

ber

of

events

Num

ber

of

events

Num

ber

of

events

Num

ber

of

events



Data certification output

MET without HF mostly OK


Run 67124Run 67124


Lum

i Sect

ion

Lum

i Sect

ion

Lum

i Sect

ion

Lum

i Sect

ion

With HFWith HF


Num

ber

of

events

Num

ber

of

events

Num

ber

of

events

Num

ber

of

events

met with/withtou HF seem to suffer from hot tower(s)met with/withtou HF seem to suffer from hot tower(s)



Data certification outputs

Bad Run


Run 68021Run 68021


Lum

i Sect

ion

Lum

i Sect

ion

Lum

i Sect

ion

Lum

i Sect

ion

With HFWith HF


Num

ber

of

events

Num

ber

of

events

Num

ber

of

events

Num

ber

of

events

No major problem.No major problem.



Data certification outputs


Summary from MET DQM Plot ScanningSummary from MET DQM Plot Scanning


SummarySummary

Data certification results from the current rather crude algorithm are already interesting!

Need to run updated version of JetMET DQM code This has additional histograms needed for DC Need to wait until CMSSW_2_2_X

Move Data Certification into the “harvesting step” Results will be written to DQM root file…

Need to designate area for reference histograms Used to determine Data Quality flags

Continue algorithm development on DQM output Need easy access to DQM root files…


BackupsBackups


Physics AnalysisPhysics Analysis

People doing an analysis using jets will initially restrict themselves to the central (barrel) well understood region and require a minimum set of working detector components….

Example query to construct dataset:

RunStart, RunStopHB, EBJetMET_Jet_ICone_BarrelTrigger, Tracker, Luminosity

Quality flags should have the required granularity

Documents

JetMET DQM Status Kenichi Hatakeyama, Anwar Bhatti, Frank Chlebana, Jared Sturdy DQM Meeting November 4th, 2008