. • ...... · .. :,:-:. ,:,.·.--::. '·\::-; •".;c_.;.i / .. •>:.-.

. . ... -_ .. _ .. :,-'-:''.\::::::~-:.--~----tl .. ·.,,<,,;,,y::/\:•\·.-........... .

Quality Assurance Workgroup:

Introduction and Updates

Dolor Sit Amet

Presentation Agenda

Introductions Ryan Marshall, Tribal Lead Audrey L Johnson, EPA Co-Lead Lisa Gover, R9 RTOC Policy Advisor & E-Enterprise

QA Workgroup Participant

Developing a Mission Statement

Updates on US EPA’s Quality Assurance Activities

QA Workgroup Mission Statement

How do we want to describe our workgroup’s purpose, goals and why Quality Assurance is important to Region 9 RTOC?

Example Mission Statement: To ensure Quality Assurance principles for producing data of

known quality are easily accessed and applied through available training, timely reviews and the clear communication of EPA’s requirements.

Does the statement above include the goals we wish to achieve? QA Applied Daily Available Training and Tools Timeliness in QA Document Reviews Clear Communication about EPA’s QA Grant Terms and

Conditions Ensuring Data Produced and Utilized is of Known Quality

What did we miss? Are there additional goals we want to include?

QA Directives E-Enterprise Project Region 9 Tracking Measures

US EPA QA Updates

·' ~ IT/IM l) IRJECTliVE ~, POLICY

1 1_ 2 3 4 5 6 7 8 9

10 11 12 13 14 15 16 17 18 19 :11]

21 22 23 24 25 26 27 28 29 &I 31

32 2-33 34 35 36 ell ~ 39

B11,1rommant31 Wonmiroo Qua1lly Polley

~bJI t/1!'•,EPA Clii'e<l.rtctlliliil\lrl Ol!l';eT, A:Kli!J\li'r11:ll:1">~t.lli'l MQ, flal'ed' itl1'"/.!00S

IBrnvironmental nformatio,rn Q uality Pol icy

PIEPOSE

Polc:y: • ~ pulley iBI i:riig--.m requ - 1'iX !tie j!fE!Bii[Cffl .ml

lfll={a'Tle!1atloo Ol"~ li:ffifl1lml:!1SI ~~[cl' R'Cgilmi • 16 ,cooas .. _ · . . 1tie ji([nd~~ I !tie An:H1 SOd:el)'

(ASQ~'A'11E£1::a:1 tuJooal Stammll!i lr:Eltl..te [A:.'l51) E42!1 • Q<.i, ' l'Jlal'BJ,!me.n! l,~l\'15 iWl!i'lmlli\'J1!!!1fil' ffi:l'ma!ooaoo' ~ ~ ~r:s v,;t'J gu/(JafJCetirltlie;

, ~eJ1511ngq'!Jalt)' ei; , ~ .s rns.antlgifdanceasllle -~ ct e EPAOIJalli)' RD;Jl<Oli aoo

, i;wi1~ a s':lUllU.--e toeni;u;e a11t1 enllianre Ire :ed!\!:!~ ct ~ CU311ty Prag:am aru:1 ~ca:-oo to~ oo aml te!2loology ~ -

SCOPE

Pal:y •IM'.t"ES Ille l'lfr1mlm reqitrernents 1rr !tie Otelly Pro\Jam SIUIOO'.m;i EPA roorrsnal llffl!P= 1h31 encxrnpass 1te,0011ee':'oo, ~00.. •E'r.llE"oo,. •Dr u:;e oJ"

iroon:ana1 tlllm!al!ro IJ!J Ol"ftll" El¥. anti 1t1e •Ci2El!J1,. cma:ruaroo,. .;r,:1 •crp?lo or "1roorrsnal 1Edlro'OJY. ~111eee ~t.m~are Rl'erred to as •Ell!,wool!Bilal

trtmlalllll ~llOS..

ft EPA-' IT/IM I) I RIECTliVE 0 . - PROCEDURE ~rommemtal lfll'ool13illoo Quality Rrocedura

llrc!:!We Nm CI0211!J.5-!P-OL 1

1 1_ 2 3 4 5 6 7 8 9

1□ 11 12 13 14 15 16 11 18

19 2-:111 21 22 23 24 25 26

27 3_ 28 29 &I 31 32 33 34 35 36 37 ~ 39

40 4!.. 41

~by ~~EPA 'ef~ om:ar, AKli!ra>T . l)cJeg,,..llrJ M!i, flal'ed' itlr/.!OOS

EnvironmeJiltal llnforrnalion Quality Pr,ooe,du:re

P~SE

111S Prnce<::l'.IB ~ 1tie t111ilem;mt,llllll or EPA'S ~ ~ Q! ~ ca:o 2 116_ 1 ~ mE l'rnl::EWre e!iliilll~ 1~ nci,p12a .an::1 IBi!IIOO,Sll(Jlei; ftll" •enw.1llg 11.lt EPAm'i1roomamal - ,.ml:~ pro:11.1:t; ,illldqpet"""..nllfl&flEf!NjerC/ -1"£l'a'._ ~ .=01 d''31l ,q,ua11y·ra~

.En:lell use. . .mi~ EPA: ms6loo ID .-:et hi.man healtll anti ltear'1roome:tt.

1J1ii, FnliCel:lll°e da;cillles t111ilEffBltif.Cffl ,iK1£1 iUm? ~ oJ" EP-A'6 Qua! i Progran.. Li I S 111 j:Wi1~ a •~o'e. ooord al:ed ·i1!!~1l0€1:l lllrOOIISls'._ t111ilerT"l3ll:allro or 1t1e auanty PDIIC'f toEll,We- 1t1e ,oont1rua1 llqlro,'e!Tl=l1l 1111 1ne qua111y« EP-Ji'6 en'lmll'ltaral " llll and - cftID' proc;µrrlo.

tools anll ~ IE •~re.are llasi:d oo iillll"Bl a.nil Wi18i:R6US ~ llfl &IJIP(mt (OMS),

DE1Jti:Y AsS1starrt Alt1W1 atar ( • 1J ancJ cteer I OfflCB" (CIO) ~~ !tie ~i; Ot.lilllly Procp1L

SCOPE

111S FnliCel:lll°e dell es Ille nmum reqJrffiBrti 1rr111e Cluallly ,ID]lr.rn 5IJl)p!lli:ng EP arr roomental ~.ms , -- em:orr~ Ill: cdlE!:lkn ~ e-, Cl" LR enwoorn;njjJ tfrlmlalloo by'Ol"ll!r EPA anll ltle d:l5lgn. OOll&n.c'CC\. .and

oo ,CJI' am IOOli1el1lal te:flflllllllqf_ CCll:cll;'E!y se ~es .Ye IIB!l lO,.as •E!t'i1JOOm;mal ~00•~ -

AlJl[l(EINCIE

.aooE!lCI!· m Prnce4Jre al l Jlgene)' ~ll'fee6 reep:mtlfe Inf en• ~ qp,;rallllfl& Illa: 5lQJllfi11lle IBPA JruolOnL TI1lli 111X1efi ~:IS anll Prog 1:e!, , ~oo;_ anifltlelr sutH:.~006. V"1Sl ,a:_ I e:ltl3RUall -~ Pm!:81Ure aJro .appie,s ID nllf1-B'II. <lga'llZ:l:ima (e.g.. sta!e,s, lrtla; , I E£; regU\3'.- IBl[eE-. mut.eer,orgam;U1005. WTtracJor6. ~ -a_;JeE!IIEfll tmllfell;,, ~6- ,llltef felleral !J='o'alm1 a;!EOOE£; I ~.-enm ~IZalkNl6. ,~anal ~ anti ctrer emr1ioo:JIEnlal fl':l!llrnl.iloo ~ ) liEf1\lmllng •MIit n ai~oJ"EP'A"6 1mro« alllll"Bl grampomt1~asll€!.ilE!loyan11 1 ~ce­v.tltl ~ . i'.5. ~ . extraruall ~ ,or~- a 'i'CiU!llaly li0:sl6 llfl(B" "lJIE!elT"am li:l'A.

MCKGRCM!llll

Pa,ie 1 orz;

US EPA’s DRAFT Quality Directives

Agency Comment Period Closed October 2020 & Tribal Consultation Completed November 2020

GOALS Improve communications between grantees and EPA

Quality Assurance (QA) personnel.

Pursue consistency in grant terms and conditions (T&Cs) across all EPA regional offices.

Improve QAPP training to better meet the needs of state and tribal grantees.

Explore how to track, report, and improve the timeliness of QAPP processes.

Analyze the extent to which information technology solutions could facilitate QAPP processes.

Analyze how to develop consistency in review of documents across EPA regions.

E-Enterprise QAPP Process Improvement

Project In 2018, under the direction of

the E-Enterprise Leadership Council, a group of state, tribal,

and EPA professionals conducted an improvement

event to analyzeQAPP business processes across the

EPA regions.

f 0 0 0

0

r

0

0 00

0

0 <>o 0

0 08>

0 0 0 8

0

<2> <2> <2> fJ..o">-~ rio">-~ ~1,0">-~ ~1,0">-~

0 0 0 ~1,01,">-~1,0"); ~1,0"); \1,0"); ~1,0'); ~1,01). ~1,0');

lli\">-o 1\">-~ 0\1,1 1,\\Ji 9">-'> <2,\1,:> ">-1,\"); ~">-0 'o\">-<2> ~\1,'o ~\Ji ~

R9 Decrease in State & Tribal QAPP Approval Times Due to Process Changes

As of December, 2020700

600

500

400

300

200

100

0

EPA Time + Grantee Time = Total Review Time

EPA Review Time Only

Num

ber o

f Rev

iew

Day

s

Date Review Began

0 0

Region 9 QA Review Process Improvements Since April 2018, we have seen a 26% decrease in the time it takes to get a QAPP Approved.

EPA Review Total Review Linear (EPA Review) Linear (Total Review)

Program 2020 2019 2018 3-Yr Avg (%) *

Superfund 57 40 97 22.7%

Water 76 50 91 25.4%

Air 52 45 38 15.8%

Land 80 77 98 29.8%

Enforcement 5 3 2 1.2%

TIP 13 8 21 4.9%

Total 283 223 347 853

R9 QA Branch Document Review Workload

Melinda.Ronca-Battista@nau.edu

Josephine.Kamkoff@nau.edu

ITEP QA Tools

QA Fun and Writing a QAPP

LINK to Melinda’s Annual Conference Presentation: https://youtu.be/qnt22Gk0SfE

Contact Information

Ryan Marshall Fort Independence Indian Tribe QA Workgroup Lead paya@fortindependence.com

Lisa Gover R9 RTOC Policy Advisor E-Enterprise QA Workgroup Member

Audrey L. Johnson QA Workgroup Co-Lead Manager, Quality Assurance Branch Johnson.audreyl@epa.gov