IODE/MARBEF Biodiversity Data Management Training Course, Oostende 2007

IODE/MARBEF Biodiversity Data Management Training Course,Oostende 2007

Quality Assurance Work Package

Keith Cooper (CEFAS, UK)

1. What is Quality Assurance (QA)?

1.1 Quality Assurance can be defined as:

‘All those planned or systematic actions necessary to provide adequate confidence that a product or service is of the type and quality needed and expected by the customer.’

1.2 Quality Assurance must apply to all stages of a process.

1.3 Required standards are determined for each stage of a process and Quality Control (QC) measures are put in place to check attainment.

1.4 Analytical Quality Control (AQC) relates to the QC of sample analyses.

The need for Quality Assurance The need for Quality Assurance

2. Why is Quality Assurance important to MarBEF?

2.1 MARBEF outputs may be used to influence policy makers. It is therefore vital that there is confidence in such outputs.

2.2 MARBEF involves integration of historic data from different sources. It is therefore essential that we understand the ‘quality’ of such information. This involves assessments of its inherent quality (i.e. whether data was obtained in a scientifically valid manner) and also its ‘fitness for purpose’.

2.3 MARBEF will also involve collaboration between partners in the collection and interpretation of new data. In these circumstances it is important that work is undertaken to a consistently high standard.

The need for Quality Assurance The need for Quality Assurance

1. QA Work Package Aim1.1 The aim of the Quality Assurance work package is to help ensure the quality of MARBEF products.

2. Approach2.1 We will achieve this aim by:

- raising awareness of the importance of quality assurance in all aspects of scientific work

- developing a MarBEF QA framework

- providing information and advice to:

allow individual laboratories to improve their own in-house AQC procedures.

individual projects in MARBEF

- encouraging participation in existing national or international QA schemes (e.g. BEQUALM)

- developing a MarBEF Procedures database.

2.2 The work package will operate in a spirit of encouragement. It is not our intention to ‘police’ the network, merely to provide advice and information in support of MARBEF activities.

Work Package Aims Work Package Aims

MARBEF QA MARBEF QA Work Package Work Package

TeamTeam

QA Schemes e.g. NMBAQC/ BEQUALM

I CES/ OSPAR/ HELCOMSTGQAB

MARBEF QA Steering GroupMARBEF

Community

•Executive committee•Steering committee•Theme 1•Theme 2•Theme 3•I ndividual participants•Data management•Training•Outreach•Taxonomic clearing system

3. Organisation

4. Communication4.1 Communication will be primarily through the

MarBEF QA webpages.

www.marbef.org/qa/

Work Package Aims Work Package Aims

1. The need for a MarBEF QA Framework

1.1 It is recognised that the adoption of Quality Systems and/or internal in-house QA measures across the MarBEF network is likely to be patchy. Thus, there is a need for a common QA Framework. The framework is intended not to replace but complement existing Quality Systems.

1.2 The MarBEF QA Framework is designed to encourage the adoption of similar standards across the network.

1.3 The Joint Code of Practice is an example of a QA framework and forms the basis of the proposed MarBEF QA Framework.

1.4 We hope MarBEF participants will adopt the contents of the framework and agree to work according to its principles.

The MarBEF QA Framework The MarBEF QA Framework

2. The MARBEF QA Framework

1.5 MARBEF participants are encouraged to abide by the QA framework for all MARBEF projects.

1.6 The QA framework comprises 12 sections outlined below. Adhering to the principles contained within the framework should assure the quality of the research:

- Responsibilities

- Competence

- Project Planning

- Quality Control

- Health & Safety

- Handling of samples and materials

- Facilities and equipment

- Documentation of procedures and methods

- Research/work records

- Data integration

1.7 MARBEF QA Framework Register

The MarBEF QA Framework The MarBEF QA Framework

1. The Role of QA Schemes

1.1 The purpose of a QA schemes is to provide a source of external quality assurance.

1.2 QA schemes generally focus on laboratory analytical quality control, AQC (i.e. the quality of sample processing).

1.3 QA schemes principally exist to ensure the quality of sample processing between laboratories engaged in common scientific programmes.

1.4 This is often achieved through intercalibration exercises, commonly known as ring tests, and also through training exercises.

1.5 QA schemes, in their simplest form may consist of an exchange of material between two or more laboratories. Larger schemes often use one administrative laboratory that is responsible for circulation of test material and the analysis and reporting of results.

1.6 Ring test results may be kept in confidence between the participant and the assessor, allowing the participant to undertake remedial action. Thus the aim of these schemes is not to ‘name and shame’ but to provide encouragement to raise overall standards. Whilst participation in various scientific programmes is dependent on participation in a QA scheme many schemes have an open door policy and encourage wider participation.

Quality Assurance Schemes Quality Assurance Schemes

2. Participation within the MarBEF Network

2.1 Our aim is to provide a description of the QA schemes that exist in Europe with relevance to work carried out under MarBEF. It is hoped that access to this information will encourage participation from within the MARBEF community.

2.2 The table below provides a summary of QA schemes, together with the matrices they consider.

3. MarBEF QA Scheme Register3.1 MarBEF participants are invited to register their participation in a QA Schemes below.

SCHEME

i) NMBAQC/ BEQUALM v v v v v

ii) QAP GMMP v v v



1. What are Quality Assurance groups?

1.1 Quality Assurance groups exist to provide ‘quality’ advice to laboratories engaged in common programmes. As such the output of these groups may be of direct relevance to MarBEF. In this section we will attempt to draw attention to the outputs of these groups.

1.2 Do you know of a QA group, national or international, not mentioned here? If so, please contact the QA work package leader (see Contacts).

2. Details of existing QA Groups

i) ICES/OSPAR/HELCOM Steering Group on Quality Assurance of Biological measurements (STGQAB)

ii) ICES Working Group on Marine Data Management

Quality Assurance Groups Quality Assurance Groups

1. MarBEF Procedures Database

1.1 One of MarBEF’s major aims involves the integration of existing and new data to address and answer ‘larger questions’ which could not be achieved by partners operating in isolation.

1.2 Disparate datasets are the building blocks of this work and their integration presents significant challenges.

1.3 For example, methodologies can differ, both between laboratories and over time and this may have implications for the comparability of data.

1.4 To aid this integration the QA and Data Management work packages are developing the MarBEF Procedures database. Its primary aim is to store information about the methods used in the collection of individual datasets by linking it to the MarBEF data system. This will allow researchers to compare the methods used in the acquisition of datasets of interest.

1.5 In addition to this primary aim the database will also:

- allow researchers to identify available methods and to identify gaps

- aid in the development of international standards/MARBEF procedures

- encourage greater harmonisation of methodology

- allow individuals to see how their procedures compare with others (including international guidelines e.g. ISO CEN, ICES, OSPAR etc)

- sread knowledge and best practice (Network of Excellence)

MarBEF Procedures Database MarBEF Procedures Database

1.6 Factors affecting data comparability

- Gear type & dimensionse.g. Trawl mesh, core diameter

- Removal of sub-samples?– What– How much?

- Position fixing– The difference between the co-ordinates on different datums varies from place to place– E.g. OSGB 36 vs WGS 84 130m off east coast of UK

- Quality control measures– Sample rejection criteria– Washing gear between stations


1.6 Factors affecting data comparability con’t

- Taxonomic resolution

- Treatment of certain groupse.g. hydroids only counted when attached vs fragments counted

- Sub-sampling?


www.marbef.org/qa/db.php



DATASETS EDCBA

PROCEDURES

1.7 Integrating datasets


DATA

PROCEDURES

1.8 Linking data to procedures

Data ManagementData Management 1. Quality Control of data

Please direct all enquiries to:

Work package Keith Cooper

leader:

Address CEFAS

Remembrance Avenue

Burnham-on-Crouch

Essex

CM0 8HA

Tel + 44 (0)1621 787200

Fax + 44 (0)1621 784989

E-mail [email protected]

Contact UsContact Us

Documents

IODE/MARBEF Biodiversity Data Management Training Course, Oostende 2007