Upload
ngoduong
View
215
Download
2
Embed Size (px)
Citation preview
Laboratory Audit Preparation, Including Review of FDA Warning Letters
Paul Smith [email protected]
April 2014
CAG EMEAI FY14 | Agilent Restricted | Page 2
Contents
• Audit Preparation - Thinking
• FDA Warning Letters – Data Gathering
• Audit Letter……….
• Types of Audit
• Laboratory Focus Areas
• Prepare Your People
• Instrument Qualification
• Instrumentation
• Data Integrity
• Laboratory Tour
CAG EMEAI FY14 | Agilent Restricted | Page 3
What Do You See?
Human Condition • People “see” what they “expect”
• Some auditors look in detail, others don’t look or see what they expect.
• Specialists will Always look in detail
• Camels • Walking • Same Direction
• 48 Camels • Families
• The More You Look, the More You See
• The Greater the Expertise the Greater their “Resolution” for Looking & Understanding Finer Detail…..
• What is the expertise of your next auditor……. ?
Camel
Shadow
CAG EMEAI FY14 | Agilent Restricted | Page 4
… But, the same principles apply to ALL AUDITS.
Laboratory
(Sometimes the Hardest !)
Health & Safety
Pharmaceutical Regulatory [FDA, MHRA] ISO 17025 / 9001
Accreditation Body
Customs & Excise
Financial
Internal (Self-Audits)
Customers
Environmental
Rules Applied & Possible Actions…..
Vary Between Audits....
CORPORATE
Prepare Well Once – Then Update / Apply
EU GMP Chapters
Some Possible Laboratory Audits Audits Preparation is a Strategic Priority !
CAG EMEAI FY14 | Agilent Restricted | Page 5
Managing The Audit – What to Expect
• Inspector • Host • Fronter • Scribe • Runner
• Broad Knowledge - stay with inspector
• Technical Experts - Subject
• Records - Time asked supplied • Gets what's asked (Info. / People)
Official Audit Role
Strategic Audit Role
• “Reads” The Inspector
• Believable
• Records - Actions issues….. • Spy (In – Out)
CAG EMEAI FY14 | Agilent Restricted | Page 6
• Live – Software Vs. Presentations / Simulated FDA / EU Regulators – Now LIVE / INTERACTIVE Review • Document Request System (Electronic or Paper) ?
Managing The Audit – What to Expect
• Inspector • Host • Fronter • Scribe • Runner
Audit Decisions:
Runner
The Control Room is Staffed by experienced personnel who: • Keep calm under pressure • Know site & company systems well
CAG EMEAI FY14 | Agilent Restricted | Page 7
Audit Preparation – Thinking Perspective
• Scientist
• Manager
• QC
• R&D
“I Believe…….” Passion, but risk
Minimise risk
Calculated answer
Love a good argument
“Yes…….”
Strategic…….
“Why…..”
Stereotype Answer Potential Implications
( “avoid” justification ) (“economical” with answers)
( “love” justification ) ( “scientific” with answers)
CAG EMEAI FY14 | Agilent Restricted | Page 9
Approaches to Warning Letter Analysis….. The FDA Warning Letters page is one of the best free compliance resources because:
• USA – Largest Pharmaceutical market globally • Many years worth of data….. • The FDA Have historically been very influential • Search facility….. • Free to access / download • More detailed than any other Regulatory Body • The FDA will answer questions….. • An insight into interpretation of cGMP
Download Read Categorise Learn / Apply
Review – Significant Cause / Observations
Search – Key word contents
Possible Usage
Search
CAG EMEAI FY14 | Agilent Restricted | Page 10
Google “FDA Warning Letters”
http://www.fda.gov/ICECI/EnforcementActions/WarningLetters/default.htm
Basic Search Engine
CAG EMEAI FY14 | Agilent Restricted | Page 11
FDA Warning Letter Page – Recent Warning Letters
A B
C
D E
F G
H
I J
http://www.fda.gov/ICECI/EnforcementActions/WarningLetters/default.htm
Recent FDA Warning Letters
CAG EMEAI FY14 | Agilent Restricted | Page 12
How Many ? How Many Times are Techniques Cited ?
• HPLC – 68 • GC – 17
• KF – 2 • NMR - 2 • FTIR – 6 • FT-IR – 11 • Chromatography - 32 • Dissolution – 40 • UV – 44 • Infrared – 52
• Qualification 348 • Stability - 371 • Calibration 438 • Training > 1,000
Updated: 31/Mar./2014
Manufacturing Process Qualification
Supplier Qualification
CAG EMEAI FY14 | Agilent Restricted | Page 13
FDA Warning Letters – A Valuable Resource / Tool…
Country Number Austria 6 Belgium 15 China 143 Denmark 16 France 31 Germany 75 Hungary 2 India 48 Ireland 12 Israel 14 Italy 42 Netherlands 13 Spain 23 Switzerland 27 United Kingdom 58
By Country
Warning Letters by Country
Updated: 31/Mar./2014
0
20
40
60
80
100
120
140
160
6 15
143
16
31
75
2
48
12 14
42
13 23 28
58
CAG EMEAI FY14 | Agilent Restricted | Page 14
FDA Warning Letters – 5 Year Trend…
By Country
0
5
10
15
20
25
30
35
40
3
6 2
3
20132012201120102009
Warning Letters by Country – Last 5 Years
CAG EMEAI FY14 | Agilent Restricted | Page 16
FDA Letter Time Line….
Audit Preparation Time Line – From FDA Pharmaceutical Audit
For an Inspection - Reactive
Audit Notification
Mgt. Meeting
Major Action
Progress
Lab. Tour
Team Brief
Tidy Up
Last Tour
Team Brief
• Briefing Process
(Procedure)
• Action Plan • Ongoing
• News • Tour Findings
Location Overview
• Overview • Changes and Updates (last visit)
• Presentations….. • Validation • DEMONSTRATION (“Live System”) • Annex 11 / Chapter 4 • Data Integrity (“Audits”).........
Company Systems
Change Management
OOS Complaints
Trends
• Quality • Lists • CAPA
• Site • Global
Self Audits Ongoing
- Proactive
• Amnesty ! (e.g. Printed Documentation)
• Audit Actions • OOS • CAPA • Qualification • Validation • Training • Documentation • Change…. Etc.
Auditor
• Google • FDA • Other…
(Specialist ?) Daily “Wash
Up”
• News • Timings • Bins .. Etc.
• Site or ?
Computer Systems
CAG EMEAI FY14 | Agilent Restricted | Page 18
How The Audit is Performed.…
Hierarchical
• Records Trace (e.g. “Batch”) – Pedigree • Examine the Manufacturing Records • Examine the Lab. Results • Examine the Analyst Training Records • Examine the Instrument Details... etc
Hierarchical
Emphasis – Identify areas of non-compliance in the INFORMATION
System Based Inspection
Generic System Questions:
Emphasis – Identify areas of non-compliance in your QUALITY SYSTEM
• Examine Your Quality System • Examine Your - Analyst Training Process • Instrument Selection and Qualification • Batch Failures / Out of Specification Results • Your Trending and Quality CAPA System
Scope – Limited by where the inspection “starts” (e.g. which batch)
Scope – Your whole quality system – everything – WIDER RANGING
CAG EMEAI FY14 | Agilent Restricted | Page 19
Kinds of Audit
ISO 9001
• Quality Management System • Some Component • Early Observation…. • CAPA follow up
Is it Effective ? - Quality Mgt.
Emphasis – Evaluate if Quality System is Effective for - SCOPE of ACCREDITATION
Is it Valid…… - Technical Evaluation
ISO 17025 Accredited Calibration Accredited Services
Emphasis – Problems & Technical Evaluation of What You Do Scope of A..
• Technical Review of What You Do • Examine Your Systems • Uncertainty of Measurement (not just pass / fail)
FDA / MHRA
• Now Assume - You Are Fraudulent • Until You Can “Prove” otherwise • Data Integrity (electronic data) • Independent Data Integrity Auditing
Date Integrity
Emphasis – We don’t Trust / Believe You – EVIDENCE to “Prove” Otherwise
ISO 13485 – Medical Devices • CAPA • Adverse Effects • Change Control
CAG EMEAI FY14 | Agilent Restricted | Page 20
Audit
How The Audit is Performed
Hierarchical
System Based Inspection
Kinds of Audit
Pharmaceutical ISO Accreditation Data Integrity Supplier
Supply Chain
[e.g. Approval of Lab. Suppliers]
Data Integrity
[e.g. MHRA]
CAG EMEAI FY14 | Agilent Restricted | Page 21
Audit Preparation Focus Areas People
Analytical Methods
Analytical Equipment
Procedures
Infrastructure
Supplier Approval
• Job Description / Training Records • Demographics / Age / Qualifications • Expertise / Skills Map • Audit Risk ? (+ Debarment) • Validation “Status”
• Technology Transfer • Registration • Review (e.g. OOS) • Suitability for Use
• Maintenance • Qualification / Calibration • Training (Technique / Instrument / SOP)
• Approved • In Date • Is the Ink Wet ! • Justification • Housekeeping
• Electricity • Location of Instruments
• Audit • Questionnaires • Lab. Supplier Approval • Quality Agreement
Software / Computer Systems • Validation / Qualification • Configuration Mgt.
• Reviews • Change Control
+ Data Integrity
CAG EMEAI FY14 | Agilent Restricted | Page 23
Prepare Your People
Some inspectors are HOSTILE, “The Future of this site depends.. ”
ALL inspectors can be Intimidating…….
CAG EMEAI FY14 | Agilent Restricted | Page 24
Prepare Your People
• NEED training to answer AUDIT Questions: BE CONFIDENT in their answers STRUCTURE their answers
• MUST ONLY answer questions on…… WHICH THEY ARE KNOWLEDGEABLE
• ONLY answer.…. THE QUESTION ASKED
People who talk to the auditor:
An inspector will: • ASK you to describe…..
• CHECK Understanding Vs. SOP
• OBSERVE, then CHECK……
• CROSS-CHECK…. & ASK QUESTIONS…..
When asking questions, an inspector will ASK,
Then wait for your answer
After Your ANSWER, they
then wait ………
When people are nervous, they will talk…............ to fill the LONG SILENCE …….
RAPPORT……. !
CAG EMEAI FY14 | Agilent Restricted | Page 25
Prepare Your People Everyday phrase …. Impression….
“I think this is what happens …”
“Normally, we would…..”
“That’s too expensive……”
“That’s not my problem…”
“I would expect you to know what happens …”
Care – this implies you don’t care
“So what happens when it’s not normal …”
“If you can’t afford to have proper controls, you shouldn’t be doing this…”
“To be honest…..” Suggests you are not always honest !
Provide a rational reason !
CAG EMEAI FY14 | Agilent Restricted | Page 27
HPLC Qualification – History of Divergence
May 1987
FDA Process
Validation Guide Lines
• Approach Not Harmonised [ different approaches ] • Conflicting Content [ for laboratories to defend ]
• Paper Based [ storage, access, risk ]
• Compliance Risks [ manual calculations ] [ paper protocols ] [ data integrity ]
People Applied FDA PROCESS VALIDATION GUIDE to….
To LABORATORY INSTRUMENTS
1990’s
Company A
Company A
Company B
Company C
Company A
CAG EMEAI FY14 | Agilent Restricted | Page 28
USP <1058>
Risk Based Categorisation: A, B, C:
A – Verify by Observation (e.g. Stirrer) - No calibration or Measurement
B – Verify by Calibration - Calibrate by SOP / Document (e.g. pH Meter)
C – Qualify (e.g. HPLC) - Complex Systems - Verify by Full Qualification
Strength of <1058>
Addressed in <1058> Update
CAG EMEAI FY14 | Agilent Restricted | Page 29
What an FDA Warning Letter Might Contain
Unique Reference – e.g. “ucm1048179”
Audit Dates
Location
References to 21 CFR and / or USP requirements
Common Words:
Adulterated Misbranded Acknowledgement of Response:
We acknowledge receipt of your reply, but….. Lacks sufficient detail / corrective actions Was not considered as > 15 days from WL
Details of non-conformance
Expression of audit / response concerns
Expression of WL response requirements:
Risk-Assessment for US distributed products Copies of anything promised (procedures, validation) Counter arguments (if difference of opinion)
A “ucm” number is assigned to each FDA web page…. Google will “find” it, if “links broken”.
How many audit days (but not how many people), days to WL
Auditors Carry GPS
Look Up [+ EIR Data]
FD&C Adulterated Drug Definition (Chapter 9, section 351)
FD&C Misbranded Drug Definition (Chapter 9, section 352)
Often Basic Errors…….
Analysis of………
“Tone” of response……
Consequences of what they found, how you responded, what you promised…..
CAG EMEAI FY14 | Agilent Restricted | Page 30
Example Warning Letter – “ucm1048179”
“…a live rodent that you brushed off your Shoulder onto the floor, and then kicked under a pallet….”
Audit Days
[ 15 “Working” Days ] Days to Issue
[ 74 Days, 53 “Working Days” ]
CFR Look Up
[ “Google CFR” ]
“Tone”
Non-Conformance
CAG EMEAI FY14 | Agilent Restricted | Page 31
FDA Warning Letter Trends
725
535 538
471
445 474
673
1720
0
200
400
600
800
1000
1200
1400
1600
1800
2000
2004 2005 2006 2007 2008 2009 2010 2011 2012 2013
?
Trend Downwards – In Terms of Number of Warning Letters
Trend Upwards !
Margaret Hamburg Joined FDA
( 21st Commissioner, May 18th 2009 )
http://www.fda.gov/ICECI/EnforcementActions/ucm247813.htm
?
725 535 538 471 445 474 673
1720
4882
6760
0
1000
2000
3000
4000
5000
6000
7000
8000
2004 2005 2006 2007 2008 2009 2010 2011 2012 2013
FDA Audits: 97 % of US Facilities [pharmaceutical, every 2 years]
FDA Audits: 7 % of Non US Facilities [pharmaceutical every year]
[Source: Journal of Validation Technology; D. W. Vincent, Winter 2012 edition]
US Audits: Down 40 %
Overseas Audits: Up 30 %
Mutual Recognition Audits [Tougher “National” Audits]
Move From “Fixed” Time Triggers To RISK Based Triggers…… Whistle Blowers…. [other regulators – UK MHRA…… ]
976 [2013] down to 591 [2014]
604 [2013] up to 843 [2014]
Source: Pharmaceutical Manufacturing.com
> 10 Times Increase
CAG EMEAI FY14 | Agilent Restricted | Page 33
Suitability for Use – Fundamental 4Q Life Cycle
PQ DQ OQ IQ
Does it Meet your USER
REQUIREMENTS
Design Qualification
Installation Qualification
Has it been INSTALLED CORRECTLY
Operational Qualification
Performance Qualification
Does it WORK as
EXPECTED [in the lab]
Will it Work with Customer
METHODS
PQ DQ
What do you want to use it for ?
User User
Pharmaceutical Companies & Service providers don’t agree…
• WHAT - An OO or PQ Contains • WHO - Should perform it • HOW - Often an OQ should be Done
CAG EMEAI FY14 | Agilent Restricted | Page 34
What will an Auditor Look at ?
DQ
Use OQ
IQ Maintenance
Re-Qualification (Justification)
Breakdown
Repair Re-Qualification (Justification)
Is the Instrument Suitable for use Accuracy / Uncertainty Sensitivity / Science
Is it installed Correctly
Is there an SOP Are people Trained Is it Calibrated Method Validation
Maintenance Routine ?
Failure Mgt. Impact of Failure CAPA ?
Re-Qualification / Calibration
What do you want it to do:
- Write it down - Why is it suitable
Does it Work:
- Installed correctly - In your laboratory
What about:
- The future
Audit Focus
CAG EMEAI FY14 | Agilent Restricted | Page 35
Range of Use…………(Best Practice to Qualify Range of Use)
Wavelength (nm)
Oven Temperature (oC)
Flow Rate (mL/Min.)
245 nm
45 oC 1 mL/min.
Min. Flow
Max. Flow
Low
est
Wav
elen
gth
Hig
hest
W
avel
engt
h
Highest Temp.
Lowest Temp.
Range of Use
Qualification should “bracket” THE RANGE OF USE (good science & easier to “defend” users may have to do extra qualification……)
Why Range of Use is Important ?
1 ml/min. (Pump)
45 oC (Oven)
245 nm (Detector)
Customer HPLC Method
Qualification Space
CAG EMEAI FY14 | Agilent Restricted | Page 36
Example – Range of Use Warning Letter The qualification – MUST BE – representative, of how the instrument is used…..
Failure of your quality control unit/laboratory to ensure that analytical instrumentation and test equipment used to assure the quality of your APIs has been appropriately qualified and calibrated for their intended use.
Specifically, your firm has failed to conduct adequate qualifications of your analytical instruments and test equipment. For example, the residual solvent method used to test (b)(4) API has an initial starting gas chromatograph (GC) oven temperature of (b)(4). Your firm’s current qualification of the GC oven temperature does not include temperatures below 100˚C. http://www.fda.gov/ICECI/EnforcementActions/WarningLetters/2010/ucm236841.htm
Qualify the Range of Use
CAG EMEAI FY14 | Agilent Restricted | Page 38
Laboratory Instrumentation …..
System URS DQ IQ OQ Calib.
PQ SSC
Rationale Problems Actions
FT-IR B test site…. Too Good !! Avoid in Audit ?
GC X X X USP, SSC URS, DQ, IQ Do OEM
HPLC X X Caffeine GAPS Do IQ Review
Dissolution OEM, USP Sets Std… USE in Audit
LC-MS X X X X X Non Routine From R & D Move
NIR X Calibration No URS Retrospective
KF X X X Daily Test IQ, PQ only System Suit.
pH Meters X X X X In House PQ only Hide !
Balances OEM Calib. Fail Review Results
……. etc ! ! X X Fragmented Mixture Panic !
= Present X = Absent
Status Decisions – What do you do about……
Rationale - Monitoring
Any Problems ?
What is Your Strategy ? [about problems]
Does Your Laboratory Have These [or their equivalent steps ?]
CAG EMEAI FY14 | Agilent Restricted | Page 39
Laboratory Instrumentation …..
System “Owner” “User” “Expert” 2nd Expert Supplier (s)
FT-IR (1) Paul John Paul Derek A
GC (4) Clare Peter Ted Mark B
HPLC (11) James Mark Carole Mike A
Dissolution (1) Dave R John Derek Rob C
LC-MS (1) James R & D Mike Rob D
NIR (1) Paul Paul Paul Derek A
KF (3) James Andy Derek Mark E
pH Meters (2) Dave R Mark Mark Andrew E
Balances (6) Clare Richard Derek Andrew F
……. Etc…… Manager 7 5 4 7
Holiday Company Closed ! Too Busy
People / Contacts
Relationship with supplier – in an Audit…. (what would yours do ?)
With “Live” System
CAG EMEAI FY14 | Agilent Restricted | Page 41
So, What is Data Integrity ? Data Integrity
Data
Prove Your Data is Not Fraudulent !
• ALCOA +…. (understand) • Build lab. workflow • Check results to electronic • Data integrity audits
• You have it electronically • It is not tampered with • Implement reviews
Data Traceability is Essential In Data Integrity….
CAG EMEAI FY14 | Agilent Restricted | Page 42
Example Sample Workflow…. Electronic Vs. Paper
1. Sample Receipt
2. Booked into LIMS
3. Schedule Tests
4. Sample Preparation
5. Chromatograph Sample
6. Calculate Results
8. Compare Against Specification
7. Check / Report Results
A ttributable [Who did it]
L egible [Can you read it]
C ontemporaneous [Recorded in “Real Time”]
O riginal [Is it original]
A accurate [Is it Accurate]
Electronic Log Vs. Ink Signature
Print , Secure Electronic File or Handwriting
Electronic Log Vs. Date Written
Secure Electronic File Vs. Paper “Photocopy”
Validated Electronic Output Vs. Paper….
Electronic Vs. Paper
Greater Risk ? (easier to manipulate) (very difficult to detect)
More Secure ? (harder to manipulate) (simpler to detect)
A
L
C
O
A
CAG EMEAI FY14 | Agilent Restricted | Page 44
Examples – Search on “HPLC” - 68
A B C D
1. Enter Search Criteria (e.g. HPLC)
2. Select Sort By (Default is Alphabetical)
3. Select Sort Criteria (e.g. Descending)
4. Select Go
5. Select ALL
6. Select Warning Letter (to open)
Use “Ctrl F” to FIND KEY WORDS
(Copy & Paste into Excel)
CAG EMEAI FY14 | Agilent Restricted | Page 45
FDA “HPLC” Warning Letters…
0
1
2
3
4
5
6
7
8
9
10
2013
2012
2011
2010
2009
2008
2007
2006
2005
2004
2003
2002
2001
6
10
6
9
5 5
4
3
2
3
4
5 5
13 years on FDA Warning Letter Page: 46 % - last 4 Years
Key Points: • HPLC has the Highest FDA Focus of ANY Analytical Technique • High focus area in recent years
CAG EMEAI FY14 | Agilent Restricted | Page 46
FDA – Takes 10 x Longer
To Issue Warning Letters
Than Companies Have to Respond
FDA Warning Letters That Mention HPLC or GC Days to Issue Warning Letter [ 84 ]
Days to Issue Warning Letter [HPLC Only]
Audit Duration [ (HPLC & GC) = 84 ]
CAG EMEAI FY14 | Agilent Restricted | Page 47
0 1 2 3 4 5 6 7
Data Integrity
Calibration
Method
N/A
No GC
7
4
2
3
1
Review of FDA Warning Letters About GC Most of these categories cause concern over the validity of the analytical results….
Read Evaluate Categorise Knowledge
GC Methods
Calibration
Data Integrity: Now Biggest Category
Capability of the Method
Would trust this data ?
GC in Name, GC in SOP…..
GC Warning Letters – Most are relatively Recent !
CAG EMEAI FY14 | Agilent Restricted | Page 48
Primary Cause – HPLC Warning Letters
Calibration: Biggest Single Category
Decisions & Justification
Using the Method
Data Integrity
Capability of the Method Poor HPLC Use / Training
HPLC Methods
Would trust this data ?
0 2 4 6 8 10 12
Calibration Defeciency
No Calibration
N/A
OOS Problems
Problems With System Suitability
Chromatography - Unknown Peak
HPLC Method Validation
Defecient HPLC Method
Data Integrity - Data Deletion
Data Integrity - Incomplete Data
Data Integrity - Security
Data Integrity - Fraud
Stability Testing
Sterlity
Impact of Instrument Repair / Failure
9
8
8
7
2
2
11
5
1
3
4
3
1
1
1
HPLC Methods
Would trust this data ?
Poor HPLC Use / Training
CAG EMEAI FY14 | Agilent Restricted | Page 50
Plan The Lab. Tour
Sample Receipt
Fume Hoods
LIMS HPLC
KF
Sam
ple
Stor
age
/ Wei
ghin
g
Writ
e U
p
Writ
e U
p
Writ
e U
p
Office Area
Clipboard – with Flow Charts Sample Receipt – Paperwork Etc…
How Do You Plan Yours ?
CAG EMEAI FY14 | Agilent Restricted | Page 51
Strategy For The Laboratory Tour Plan the Lab. Tour
Walk the route…..
Where would you “like” to stop ?
Where will you explain your Instrument Control(Calibration). ?
What did your audit reveal ?
Look in cupboards…… !
What is Visible – Housekeeping ….Etc.
Before the Audit – EMPTY Tree CYCLERS / Bins … Etc.
Empty PC Recycle Bin !
“…found unofficial batch records for approximately 75 batches of injectable finished drug products torn in half in the waste are”
“ The investigator found a certificate of analysis (COA) for (b)(4) oz, lot number (b)(4), dated January 19, 2011, in a trash container in the office used by QC personnel ”
Empty the Bins !
Wockhardt – ucm361928
Compania – ucm311326
CAG EMEAI FY14 | Agilent Restricted | Page 54
Common Questions – Customers Ask Agilent (During an Audit !)
Audit Question How do we defend……
Audit Question
1. The auditor has asked why we don’t perform optional test X (e.g. injection linearity).
2. We have methods with settings (e.g. temperatures) different to the qualification.
3. The auditor has asked for our PQ, but we don’t perform one
4. The auditor is asking questions we can’t explain……..
How do we defend……
How do we defend……
How do we defend……
How do we defend……
• Read the documentation • Always understand – what you sign • Ask for training / explanation…..
Implications of Choice - Why
Range of Use
Life Cycle Usage
Fundamental Understanding
Customers are the service providers Greatest risk !
CAG EMEAI FY14 | Agilent Restricted | Page 55
Debarment………. (Updated March 2013)
To date, the FDA has applied the GDEA to debar over 132 people and lists these: http://www.fda.gov/ICECI/EnforcementActions/FDADebarmentList/ucm2005408.htm
Legal details for each debarment are published in the federal register:
“….Employed as a chemist in the Quality Control Depart….”
• Significant fines if debarred person employed • FDA will not accept / review ANDA…..
0
2
4
6
8
10
12
14
16
18
13
18
7 8
3 1 1
2 1
Number of people FDA Debarred each year
Possible Fines:
Individual $250, 000 Company $1, 000, 000
April 5th 2012
CAG EMEAI FY14 | Agilent Restricted | Page 56
Data
Data
Data
Data
Data
Data
Structure
Experience
• Store • Search
• Organise • Meaning
• Apply • Decisions
Knowledge Management
of the Audit Preparation Process
CAG EMEAI FY14 | Agilent Restricted | Page 58
HPLC Analysis – % Included in Warning Letter
71 % of HPLC letters Include Reference to Stability Testing
0 10 20 30 40 50 60 70 80
Calibration
Training
OOS
SSC
Method Validation
Defecient Methods
Data Integrity - Security
Data Integrity - Data Deletion
Data Integrity - Incomplete Records
Reaccurance
External Consultant Required
Data Review
Complete Data
Poor Response / CAPA
Stability
41
27
51
27
43
17
27
13
43
30
16
27
43
43
71
CAG EMEAI FY14 | Agilent Restricted | Page 59
GC Analysis – % Included in Warning Letter
79 % of GC letters Include Reference to aspect of Data Integrity
0 10 20 30 40 50 60 70 80
Calibration
Training
OOS
SSC
Methods
Data Integrity
Reaccurance
External Consultant Required
Complete Data
Poor Response / CAPA
Stability
50
21
36
29
43
79
30
7
36
79
36
0 20 40 60 80
Data Integrity
Security
Manufacturing
Data Change
Data Deletion
Incomplete Records
Audit Trail
79
21
21
7
7
50
14
GC Data Integrity Review (%)
CAG EMEAI FY14 | Agilent Restricted | Page 60
Data Integrity Questions – About Software ?
1. Do you have your source electronic data – or are your deleting them ?
2. Do you review your electronic source files ?
3. Does review include a review of meaningful metadata ?
4. Does your system configuration include clear segregation of duties ?
5. If “COTS” software – Is it validated for your intended use ?
- Independence of Administrator and User Roles, Shared Passwords… Etc.
- Authenticity of data
- Data integrity check – visibility of repeat work, integration and sequence files – data not reported
- Electronic files should be retained – they are the source data, paper is not
- Vendor documentation (including qualification) must be reviewed and may need augmenting
CAG EMEAI FY14 | Agilent Restricted | Page 61
Data Quality Triangle – Principles of Good Data
Must be done before
Must be done before
Is part of
Good Business Sense
Principles Apply To ALL Analytical Laboratories
Know Instrument is Working
Suitability of Method
System Working
Instrument
Method
Method
Method
5 Pages Current USP
Know Instrument is Suitable for Use [ Update Proposed to USP <1058> ]
Implemented August 2008