Southern California Bight
1998 Regional Marine Monitoring Survey
(Bight'98)


Quality Assurance
Manual

click for downloadable PDF version


TABLE OF CONTENTS

I. INTRODUCTION

II. QUALITY ASSURANCE OBJECTIVES
A. Overview
B. General Approach to Quality Assurance
C. Measurement Quality Objectives
D. Quality Assurance and Quality Control

III. REQUIREMENTS FOR FIELD AND LABORATORY OPERATIONS
A. Field Operations
B. Laboratory Operations

IV. MEASUREMENTS OF FISH AND INVERTEBRATE ASSEMBLAGES AND FISH PATHOLOGY
A. Overview
B. Field Operations
C. Gross External Pathology

V. ANALYSIS OF CHEMICAL CONTAMINANTS IN SEDIMENTS AND TISSUES
A. Overview
B. Sample Collection, Preservation, and Holding Time C. Laboratory Operations
D. Data Evaluation Procedures

VI. MACROBENTHIC COMMUNITY ASSESSMENT
A. Overview
B. Sample Collection, Preservation, and Holding
C. Laboratory Operations
D. Information Management

VII. SEDIMENT TOXICITY TESTING
A. Overview
B. Laboratory Capability
C. Interlaboratory Comparability
D. Sample Collection
E. Amphipod Survival Test
F. Qwiklite (Qwiksed) Test
G. Microtoxtm Test
H. P450 Reporter Gene System (RGS)

VIII. FISH BIOMARKERS
A. Overview
B. Sample Collection
C. Bile Facs Measurement
D. Comet Assay (DNA Damage)

IX. LITERATURE CITED

X. APPENDIX A. BENTHIC LABORATORY PROCEDURES


1. INTRODUCTION

The Southern California Bight (SCB; Figure I-1), an open embayment in the coast between Point Conception and Cape Colnett (south of Ensenada), Baja California, is an important and unique ecological resource. The SCB is a transitional area that is influenced by currents from cold, temperate ocean waters from the north and warm, tropical waters from the south. In addition, the SCB has a complex topography, with offshore islands, submarine canyons, ridges and basins, that provides a variety of habitats. The mixing of currents and the diverse habitats in the SCB allow for the coexistence of a broad spectrum of species, including more than 500 species of fish and 1,500 species of invertebrates. The SCB is a major migration route, with marine bird and mammal populations ranking among the most diverse in north temperate waters.

The coastal zone of the SCB is a substantial economic resource. Los Angeles/Long Beach Harbor is the largest commercial port in the United States, and San Diego Harbor is home to one of the largest US Naval facilities in the country. More than 100 million people visit southern California beaches and coastal areas annually, bringing an estimated $9B into the economy. Recreational activities include diving, swimming, surfing, and boating, with about 40,000 pleasure boats docked in 13 coastal marinas within the region (NRC 1990). Recreational fishing brings in more than $500M per year.

The SCB is one of the most densely populated coastal regions in the country, which creates stress upon its marine environment. Nearly 20 million people inhabit coastal Southern California, a number which is expected to increase another 20% by 2010 (NRC 1990). Population growth generally results in conversion of open land into non-permeable surfaces. More than 75% of southern Californian bays and estuaries have already been dredged and filled for conversion into harbors and marinas (Horn and Allen 1985). This "hardening of the coast" increases the rate of runoff and can impact water quality through addition of sediment, toxic chemicals, pathogens and nutrients to the ocean. Besides the impacts of land conversion, the SCB is already home to fifteen municipal wastewater treatment facilities, eight power generating stations, 10 industrial treatment facilities, and 18 oil platforms that discharge to the open coast.

Each year, local, state, and federal organizations spend in excess of $10M to monitor the environmental quality of natural resources in the SCB. Most of this monitoring is associated with National Pollutant Discharge Elimination System (NPDES) permits and is intended to assess compliance of waste discharge with the California Ocean Plan and the Federal Clean Water Act, which set water quality standards for effluent and receiving waters. Some of this information has played a significant role in management decisions in the SCB.

While these monitoring programs have provided important information, they were designed to evaluate impacts near individual discharges. Today, resource managers are being encouraged to develop management strategies for the entire SCB. To accomplish this task, they need regionally-based information to assess cumulative impacts of contaminant inputs and to evaluate relative risk among different types of stresses. It is difficult to use existing data to evaluate regional issues because the monitoring was designed to be site-specific and is limited to specific geographic areas. The monitoring provides substantial data for some areas, but there is little or no data for the areas in between. Beyond the spatial limitations, data from these programs are not easily merged to examine relative risk. The parameters measured often differ among programs. Even when the same parameters are measured, the methodologies used to collect the data often differ and interlaboratory quality assurance (QA) exercises to assess data comparability are rare.


1994 Pilot Project

To begin addressing these concerns, twelve organizations joined in a cooperative sampling effort in 1994, called the Southern California Bight Pilot Project (SCBPP). The SCBPP involved sampling 261 sites, using common methods, along the continental shelf between Point Conception and the United States/Mexico border. Assessments were made of water quality, sediment contamination, the status of biological resources and species diversity, and the presence of marine debris. The SCBPP provided a much-needed first "snapshot" of the state of the SCB.

Benefits derived from the SCBPP also included the development of new useful technical tools that could only be developed with regional data sets and participation by multiple organizations. For example, the project produced iron-normalization curves for the SCB, allowing distinction between natural and anthropogenic contributions of metals in sediments (Schiff and Weisberg 1998). A Benthic Response Index was developed that integrates complex benthic infaunal data into an easily interpreted form that describes the degree of perturbation at a site (Bergen et al. 1998). The project also produced a series of manuals containing standardized field, laboratory and data management approaches that increased comparability of data among participants, even after the SCBPP was completed.


1998 Survey

The proposed 1998 Southern California Bight Regional Monitoring Project (Bight'98) is a continuation of the successful cooperative regional-scale monitoring begun in southern California in 1994 during the SCBPP. Bight'98 builds upon the previous successes and expands on the 1994 survey by including more participants, sampling more habitats, and measuring more parameters. Sixty two organizations, including international and volunteer organizations, have agreed to participate (Table I-1).

The inclusion of new participants provides several benefits. Cooperative interactions among many organizations with different perspectives and interests, including a combination of regulators and dischargers, ensures that the most appropriate regional questions are being addressed in the study. The additional resources brought by new participants also expands the number of habitats and indicators that will be sampled. Sampling for Bight'98 will include all of the areas sampled in 1994, plus a new focus on nearshore habitats (bays, harbors and beaches) and offshore islands. Bight'98 will also coordinate with a Mexican program to characterize the condition of SCB coastal waters south of the US border. The new indicators that will be measured include shoreline microbiology, biomarkers and new chemical measures.

The Bight'98 Survey is organized into three technical components: 1) Coastal ecology, 2) Shoreline microbiology, and 3) Water quality. This document is the Quality Assurance (QA) Plan for the coastal ecology component of the program. It provides a summary of the methodologies that will be used to collect and process the samples, and the steps that will be taken to ensure data quality. It also outlines the procedures that will be used to quantify whether the project has been successful in meeting its data quality goals. The QA Plan is supported by a work plan, that provides a description of overall project design for the coastal ecology component; a field methods and logistics document that describes the procedures that will be followed by the field crews responsible for sample collection; and an information management manual that details the ways that data will be recorded, transferred among participants and stored.


II. QUALITY ASSURANCE OBJECTIVES


A. Overview

The primary goal of the QA/QC plan is to ensure that the data generated in Bight'98 are comparable among particpants. Many different organizations will be participating in the collection and analysis of samples in Bight'98; encouraging and maintaining consistency in field and laboratory operations and ensuring data comparability will be critical to success of the project.

Data comparability will be achieved through a combination of standardized methods (where appropriate) and performance based standards. Where standardized methods have been agreed upon for this project, QA/QC measures will be used to assure that methods are applied consistently. Where performance based standards are appropriate, QA/QC measurements will be used as a measure of performance. The appropriate QA/QC procedures for each of the monitoring program components (e.g., field operations, water quality, sediment and tissue chemical analyses, benthic analyses, demersal fish analyses) have been established by the Bight'98 Steering Committee.

B. General Approach To Quality Assurance

The QA program for Bight'98 consists of two distinct but related activities: quality assurance and quality control. Quality assurance includes design, planning, and management activities conducted prior to implementation of the project to ensure that the appropriate kinds and quantities of data will be collected. The goals of quality assurance are to ensure that: 1) standard collection, processing, and analysis techniques will be applied consistently and correctly; 2) the number of lost, damaged, and uncollected samples will be minimized; 3) the integrity of the data will be maintained and documented from sample collection to entry into the data record; 4) all data will be comparable; and 5) results can be reproduced.

Quality control (QC) activities are implemented during the data collection phase of the project to evaluate the effectiveness of the QA activities. QC activities ensure that measurement error and bias are identified, quantified, and accounted for, or eliminated, if practical. QC activities include both internal and external checks. Typical internal QC checks include repeated measurements, internal test samples, use of independent methods to verify findings, and use of standard reference materials. Typical external QC checks include exchanging samples among laboratories for reprocessing to test comparability of results, independent performance audits, and periodic proficiency examinations.

Many of the organizations participating in Bight'98 have well established monitoring programs. QA activities for Bight'98 have focused on developing a common field manual and documenting the comparability of laboratory methods. Training of field and laboratory personnel is focused on communicating goals and objectives of the pilot project as well any modifications in methods or procedures that have been made to ensure data comparability. The purpose of this training is to verify that all participants will be able to implement the agreed upon procedures in a consistent manner with comparable proficiency. Quantitative measures of the overall effectiveness of training have been identified to translate QA activities such as communication and training into QC activities such as performance audits and proficiency examinations. These quantitative measures are known as measurement quality objectives (MQOs).

C. Measurement Quality Objectives

MQOs establish acceptable levels of uncertainty for each measurement process. MQOs typically address the major components of data quality: representativeness, completeness, precision, accuracy and comparability. Data comparability, or "the confidence with which one data set can be compared to another" (Stanley and Verner 1985), is a primary concern in this project. Comparability of reporting units and calculations, data base management processes, and interpretative procedures must be ensured if the overall goals of the project are to be realized.

Specific MQOs for precision and accuracy, the most readily quantifiable components of data quality, have been identified for Bight'98 to ensure that the data produced by the many field crews and laboratories involved in the project will be comparable. Accuracy is defined as the difference between the measured value of an indicator and its true or expected value, which represents an estimate of systematic error or net bias (Kirchner 1983, Hunt and Wilson 1986, Taylor 1987). Precision is the degree of mutual agreement among individual measurements and represents an estimate of random error (Kirchner 1983, Hunt and Wilson 1986, Taylor 1987). Together, accuracy and precision provide an estimate of the total error or uncertainty associated with a measured value. Requiring participating field crews and laboratories to achieve standard, quantitative MQOs for accuracy and precision will help to ensure that individual data sets are free of any crew- or laboratory-specific bias and that the degree of random error is consistent across data sets. Accuracy and precision goals for indicators to be measured during the Bight'98 are provided in Table 2-1. Accuracy and precision cannot be defined for all parameters because of the nature of the measurements. For example, accuracy measurements are not possible for toxicity testing, sample collection activities, and fish pathology measurements. Measurement of accuracy and precision in sediment toxicity testing would require the use of reference materials with a known level of toxicity that is stable during storage. Suitable reference materials for sediment toxicity are not available.

An MQO for completeness was also defined for Bight'98. Completeness is a measure of the proportion of the expected, valid data (i.e., data not associated with some criterion of potential unacceptability) that is actually collected during a measurement process. The MQO for completeness is 90% for each measurement process. The sampling design for the project is sufficiently redundant to absorb the loss of up to 10% of the samples without compromising the goals of the program, provided that the lost samples are not concentrated in a single subpopulation of interest. Redundancy was incorporated at this level because monitoring programs of this size typically lose as many as 10% of samples as a result of logistical difficulties or failure to achieve quality control criteria.

D. Quality Assurance And Quality Control Activities

Establishing MQOs is of little value if the proper quality assurance activities are not undertaken to ensure that such objectives will be met. Quality assurance in the Bight'98 will be achieved by:

The effectiveness of quality assurance efforts will be measured by quality control activities that fall into two categories:

The goal of these activities is to quantify accuracy and precision, but, most importantly, they will be used to identify problems that need to be corrected as data sets are generated and assembled.

A Field Operations Manual (1998) has been prepared to standardize data collection efforts in the field. Each participating organization collecting samples in the field has identified a single point of contact for field operations (referred to as the Chief Scientist in the field operations manual).

A single laboratory manual was not developed for the project since each of the participating laboratories have their own internal operating procedures. Comparability of laboratory efforts will be ensured through compliance with the requirements listed in the Quality Assurance Project Plan (QAPP) which identifies performance based standards and the appropriate level of QA/QC. Procedures for benthic analyses appropriate to the Bight'98 Project are detailed in the Infaunal Sample Analyses Laboratory Procedures Manual (Appendix A).

The manuals and the QA/QC requirements were prepared in coordination with the appropriate personnel from each of the participating organizations. Potential problem areas identified in the preparation and review of these manuals were resolved using a consensus-based approach. Copies of these manuals have been distributed to all participants in the program. These manuals will form the basis for training workshops and provide a reference for field and laboratory personnel during sample collection and processing activities.



III. REQUIREMENTS FOR FIELD AND LABORATORY OPERATIONS


A. Field Operations

The Bight'98 survey will be conducted cooperatively by a number of organizations (including one or more contractors) which routinely monitor the marine environment according to their own protocol. It is important to the success of the Bight98 study that comparable data are collected by each organization.

Quality Assurance activities for field collection include:

Quality Control measures for the field collection effort include:

Field operations manual

Standard field procedures are documented in the Bight'98 Field Operations Manual (1998). The field manual includes detailed descriptions of collection procedures, criteria for acceptable samples, and conditions under which samples need to be recollected. The field operations manual will provide the basis for protocol calibration exercises and a reference for field personnel during sampling activities.

The field manual provides an overview of field teams and activities and procedures related safety, protocol calibration, navigation requirements, sampling schedule and station types, procedures for benthic sampling, procedures for trawl sampling, procedures for packaging and shipping of samples, contingency plans, and procedures for managing information collected in the field.

Chief Scientists and Boat Captains will be instructed on the field procedures to be followed during the survey and they, in turn, will instruct their field personnel on the proper procedures for the survey. The chief scientist of each organization is responsible for distributing the Bight'98 Field Operations Manual to all field personnel and ensuring that their staff understands and uses the protocols detailed in the manual.

Training and protocol calibration

Proper training of field personnel is a critical aspect of quality assurance. Organizations participating in Bight'98 will provide personnel who have extensive field experience, but not necessarily with the standard methods selected for this project. Instruction for this project, therefore, will focus on ensuring consistency in data collection among all field personnel.

Chief scientists and boat captains of all organizations participating in the survey will be required to attend a protocol calibration meeting, which will be conducted several weeks before the survey. The goals and objectives of the Bight'98 will be discussed at this meeting as well as the responsibilities of the chief scientist and boat captains during the Bight'98 survey. Each participating organization will be provided with a Workplan, Field Operations Manual and QA/QC Document for Bight'98 and will be instructed on field procedures to be used during the survey, including proper entry of data on field data forms. The meeting will emphasize decision-making procedures for determining whether a station should be abandoned and whether a sample is acceptable. Lines of communication within the project and QA/QC activities occurring on the boat during the survey will also be discussed.

The Chief Scientist of each organization will train their field personnel, as needed, on the field operations to be conducted during the survey. It will be the responsibility of the Chief Scientist of each organization to review the Workplan and Field Operations Manual with their field crews and to ensure that they understand the field procedures and specific field QA/QC requirements that must be followed during the survey. It is also the Chief Scientist's responsibility to train their field crews, as needed, on operations to be performed. Personnel that cannot not perform an operation as required by the project will not participate in that operation.

Field audits

Field sampling capability will be established by means of field audits conducted by the Field QA Specialist prior to sampling for the Bight'98 study. These presurvey field audits will be conducted to assess equipment, vessels, and protocols used by participating organizations, and to instruct the crew as needed on the procedures described in the field operation manual and the QA/QC document. The priority for conducting field audits prior to the sampling period will begin with organizations that did not participate in the 1994 Regional Survey or who have a significant number of staff members that did not participate in the 1994 Regional Survey. If resources and time are still available after all of these organizations have been audited, the organizations that participated in the Bight'98 will be subject to a field audit to confirm the capabilities that existed and were documented for the Bight'98.

A field QA/QC checklist, developed to provide comparability and consistency in this process, will be used to record the pre-cruise audit data. The Field QA Specialist will provide additional instruction when discrepancies are noted during the presurvey field QA audit. The Chief Scientist will also be notified of the audit results so that any problems can be corrected prior to sampling.

Ongoing quality control during the sample period will be established through field audits. Each vessel will be visited at least once during the survey. In addition to the information contained on the QA/QC checklist. Each vessel will also be audited by a preassigned taxonomist, who will observe species identification in the field. This data will be recorded on a Taxonomy QA/QC data sheet. If there are errors in species identification, the taxonomist will inform the Chief Scientist of the cruise to take action to correct the problem. Field personnel will be instructed regarding the appropriate identifications.

Navigation

The ability to accurately locate sampling sites is critical to the success of the survey. A minimum of a Loran-C, a radar, and a fathometer will be required for this project.

The boat captain will be responsible for calibrating the navigation equipment and maintaining a navigation log for all sampling stations. The log includes latitude and longitude coordinates, GPS coordinates (if GPS is available), depth measurements for each station, and daily calibration information. The Chief Scientist will responsible for reviewing the log as part of the daily QC check of all completed data forms. The Field QA Specialist will check basic navigation and the completeness and accuracy of the navigation logs. As position data are received at the Field Operations Center at SCCWRP, automatic-range checks will be performed on station latitude and longitude coordinates. The reported station location will be compared to the expected coordinates and flagged for further investigation if the positions differ by more than 300 m. If discrepancies are found, original data sheets will be reviewed and the Chief Scientist will be contacted to provide an explanation.

B. Laboratory Operations

Several laboratories are participating in Bight'98. Quality assurance and quality control measures are necessary to ensure that the data generated by the participating laboratories is comparable. This section addresses only general laboratory operations. The sections on each indicator (i.e., chemistry, benthic analyses, toxicity, and biomarkers) present specific QA/QC requirements and procedures associated with the processing of specific samples.

The quality assurance measures for Bight'98 include the following:

Quality control measures for laboratories participating in Bight'98 include the following:

MQOs for chemical analysis are provided in Chapter 6 of this document. MQOs for benthic analysis are provide in Chapter 7 of this document. MQOs for toxicity are provided in Chapter 8 of this document. MQOs for biomarker analyses are provided in Chapter 9.

Documentation of general laboratory practices

All laboratories providing analytical support for chemical or biological analyses must have the appropriate facilities to store and prepare samples, and appropriate instrumentation and staff to provide data of the required quality within the time period dictated by the project. Laboratories are expected to conduct operations using good laboratory practices, including:

Laboratories should be able to provide information documenting their ability to conduct the analyses with the required level of data quality. Such information might include results from interlaboratory comparison studies, control charts and summary data of internal QA/QC checks, and results from certified reference material analyses. Laboratories must also be able to provide analytical data and associated QA/QC information in a format and time frame specified by the Laboratory Coordinator or the Information Management Officer.

In addition to the Bight'98 QAPP, the following documents and information must be current, and they must be available to all laboratory personnel participating in the project:

Personnel in the laboratories should be well versed in good laboratory practices, including standard safety procedures. It is the responsibility of the laboratory manager and/or supervisor to ensure that safety training is mandatory for all laboratory personnel. The laboratory is responsible for maintaining a current safety manual in compliance with the Occupational Safety and Health Administration (OSHA), or equivalent state or local regulations. The safety manual should be readily available to laboratory personnel. Proper procedures for safe storage, handling and disposal of chemicals should be followed at all times; each chemical should be treated as a potential health hazard and good laboratory practices should be implemented accordingly.

Protocol calibration and training

Each participating laboratory has a representative to the Bight'98 Steering Committee. This individual serves as the point of contact for the QA Officer or his designee in identifying and resolving issues related to data quality.

To ensure that the samples are analyzed in a consistent manner throughout the duration of the project, key laboratory personnel should participate in an orientation session conducted during an initial site visit or via communication with the QA Officer or his designee. The purpose of the orientation session is to familiarize key laboratory personnel with the QA program requirements and procedures.

Complete and detailed procedures for processing and analysis of samples in the field are provided in the Bight'98 Field Operations Manual (1998). Procedures for benthic analyses are provided in the Infaunal Sample Analysis Laboratory Procedure (SCCWRP, 1998) which is attached as an appendix to this document. Procedures for chemistry, toxicity and biomarker analyses are referenced in the appropriate chapters.

Demonstration and documentation of performance

Laboratories are required to demonstrate acceptable performance before analysis of samples can proceed, as described for each indicator in subsequent sections. Initially, a QA assistance and performance audit will be performed by QA Officer or his designee to determine if each laboratory effort is in compliance with the procedures outlined in this document and to assist the laboratory where needed.

Specific QA/QC procedures have been developed for Bight'98 to evaluate the quality of data being generated by the participating laboratories relative to the MQOs developed for this project. It is the responsibility of each participating laboratory to ensure that all the Bight'98 QA/QC procedures outlined in the subsequent chapters are followed.

Quality control of laboratory operations will be evaluated on a continuous basis through the use of internal and external performance evaluations. Technical systems audits by the QA Officer or his designee may be conducted may be conducted at any time during the project. In addition, participating laboratories are required to participate in interlaboratory comparison studies detailed in the indicator section of this document (Chemistry, Benthic Analyses, Toxicity, Biomarkers).



IV. MEASUREMENTS OF FISH AND INVERTEBRATE ASSEMBLAGES AND FISH PATHOLOGY


A. Overview

This section presents Bight'98 QA/QC protocols and requirements for demersal fish and invertebrate assemblage analyses, from sample collection to final validation of the resultant data. Sample collection methods are documented in the Bight'98 Field Operations Manual (1998). The field crews will generate data on species identification, enumeration, biomass, length measurements (fish only), and gross external pathology.

Field crews will conduct a standard 10-min trawl at selected stations. The Bight'98 Field Operations Manual contains a list of trawl stations and their locations. The contents of the net will be examined and fish and invertebrates will be identified to species, measured for length (fish only), counted, weighed, and examined for evidence of gross external pathologies. Organisms suspected of having pathologies will be fixed in 10% buffered formalin and shipped to SCCWRP. Diseased specimens will be examined by a pathologist.

B. Field Operations

Trawling

Field crews must adhere to prescribed sampling protocols because fish and invertebrate assemblage data (species identification, enumeration, biomass, and length) are significantly influenced by the collection methods. Factors influencing the catch are gear type, net deployment, trawl duration, and tow speed. All crews must have standard nets to ensure comparability of gear. The importance of maintaining the trawl duration and speed should be stressed during the presurvey protocol calibration meeting. During sampling, crews must record towing speed and trawl duration on the Trawl Cover Sheet. The Chief Scientist will be responsible for reviewing all trawl data sheets and the boat captain's log daily for investigating and correcting any discrepancies.

The field QA/QC auditor will monitor adherence to collection methodology during a presurvey audit of each field crew. During the audit, the field QA/QC auditor will ensure that the following trawling procedures are executed correctly: 1) the net is rigged properly; 2) the trawl is deployed and retrieved properly; and 3) the trawl data sheets are accurate and complete. The field QA/QC auditor will use a standardized field QA/QC checklist to ensure consistency and comparability of observations between crews. Any discrepancies will be noted and corrected during the audit.

Acceptability criteria have been established for trawl sample collection. Because some stations have rocky bottoms, the completeness objective for successful trawls will be 90% (Table 4-1). All of the samples collected (except for repeat trawls for bioaccumulation samples) will be processed, identified, counted, measured (fish only), and weighed.

Species enumeration, length, and biomass measurements

Demersal fish and invertebrate species identification, enumeration, individual lengths (fish only), and biomass will be determined in the field following protocols presented in the Bight'98 Field Operations Manual (1998). The quality of fish and invertebrate identification, enumeration, biomass, and length measurements will be ensured through presurvey training, audits, and intercalibration, and in-survey and postsurvey audits.

The chief scientist of each organization will be responsible for reviewing standard sampling procedures with his/her field crew and conducting training as needed. The field QA/QC auditor will assess understanding of trawl processing protocol by each new organization during a presurvey evaluation.

During the survey, each chief scientist will check to make sure that the scales are calibrated at the start of each day, that the appropriate identification aids and processing equipment are on board, and that processing follows the protocol described in the Bight'98 Field Operations Manual. In addition, each chief scientist will recount, reweigh, and remeasure 2 fish species (with at least 10 individuals) each day during the survey to provide data for precision estimates relative to the target measurement quality objectives (MQOs).

The field QA/QC auditor will conduct at least one in-survey visit during trawl sampling per vessel during the field survey. The auditor will check to make sure that the scales are calibrated at the start of each day, that the appropriate identification aids and processing equipment are on board, and that processing follows the protocol described in the Bight'98 Field Operations Manual. He or she will also check to see that 2 fish species are recounted, reweighed, and remeasured during the visit.

Completeness objectives for fish and invertebrate counts and weights, and fish lengths will be 90% (Table 4-1). Precision objectives for counts, weights, and lengths will be 10% (Table 4-1).

Species identification

The taxonomic identification of demersal fish and invertebrate species will be ensured by a presurvey training and intercalibration, in-survey audits, and postsurvey voucher checks.

Presurvey QA activities include a taxonomic information transfer meeting, an in-field training/intercalibration exercise, and an intercalibration exercise assessing organizational fish and invertebrate identification abilities. The taxonomic information transfer meeting will provide literature lists, taxonomic keys, and discussions on how to identify species expected on the survey. The in-field training/intercalibration exercise will provide training for individuals less familiar with the fauna and intercalibration for those with more experience. It will be conducted on an organization vessel with lead taxonomists from all participating organizations. Trawls will be conducted at different depths and ways to identify the species will be discussed. The taxonomic assessment exercise will assess the probability that identification errors will be made in the field. Each organization will identify specimens of representative fish and invertebrate species in buckets that will be passed to each organization. The assessment will focus on estimating irretrievable error rates (i.e., incorrect identifications in the field with specimens not returned to the laboratory). Thus correct identifications and "return for further identification" are acceptable but identification errors are not. An organization with greater than 5% errors (fish and invertebrates combined) will be asked to redo the assessment.

During the survey a project-assigned taxonomist will audit taxonomic identifications in the field in at least one visit per vessel. These taxonomists will audit at least 25% of fish and invertebrate species collected per day during a visit.

Each organization will also be asked to provide at least voucher specimen of each species identified in the field. Prior to the survey, each field crew will be given a list of fish and invertebrate species likely to be encountered in the survey to facilitate tracking of specimens collected. A voucher collection of organisms collected in the Bight'98 trawls will be developed during the survey. The collection will be housed at SCCWRP along with the Bight'98 voucher collection; both will eventually be archived in a museum. In addition, each organization will be encouraged to develop its own voucher collection. Extra voucher specimens will be saved to provide a reference collection to assist training in subsequent years.

Following the survey, the original identification of voucher specimens will be checked by lead project fish and invertebrate taxonomists. All erroneous identifications for an organization will be corrected in the database.

To maintain a consistent level of field crew performance, overall completeness and accuracy objectives will be 95% (i.e., <5% unidentified species or errors) (Table 4-1).

C. Gross External Pathology

The field crew must examine all demersal fish and invertebrates collected for evidence of external gross pathologies. Fish will be examined for the following anomalies: fin erosion, tumors, external parasites, color anomalies, skeletal deformities, and lesions. Invertebrates will be examined for burn spots and other anomalies. The quality of gross pathology determinations will be ensured principally through information provided prior to the survey, checks conducted in the field during the survey by the project-assigned taxonomists, and postsurvey voucher checks. Field crews will examine all fish and invertebrates and preserve any suspected of having a pathology. Organisms collected for pathological examination must be preserved according to the protocol described in the Bight'98 Field Operations Manual. Specimens will be returned to the laboratory with a sample identification label that notes the suspected pathology.

Because of the potential difficulty in proper field identification of pathologies, all definitive examinations will be conducted by a qualified pathologist. This pathologist will examine the organisms and provide the project-assigned taxonomist with the results.

A voucher collection of preserved specimens or photographs representing every type of pathological condition identified in the Bight'98 fish and invertebrates. Each of these examples should be verified by an external pathologist experienced with the species in question. Similarly, each organization should maintain its own reference collection of pathological fish and invertebrates. These reference collections will be used to very the diagnoses made in future years to ensure intra- and interlaboratory consistency. A reference collection will also be developed for future training purposes.

To maintain a consistent level of field crew performance, the Bight'98 program has established an overall completeness and accuracy objectives of 95% (i.e., <5% unidentified pathologies or errors) (Table 4-1).



V. ANALYSIS OF CHEMICAL CONTAMINANTS IN SEDIMENTS AND TISSUES

A. Overview

Quality assurance of chemical measurements has many diverse aspects. This section presents Bight'98 QA/QC protocols and requirements covering a wide range of activities, from sample collection and laboratory analysis to final validation of the resultant data. Much of the guidance for this section is based on USEPA SW846 and protocols developed for the EMAP-E Virginian Province, as well as those developed over many years on the National Oceanic and Atmospheric Administration's (NOAA) National Status and Trends (NS&T) Program. This guidance is applicable to low parts per billion analyses of both marine sediment and fish samples unless, otherwise noted.

The Bight'98 project will measure a variety of organic and inorganic contaminants in marine sediment and whole fish samples . (Table 5-1) Bight'98 requires that laboratories demonstrate comparability continuously through strict adherence to common QA/QC procedures, routine analysis of Certified Reference Materials, and regular participation in interlaboratory comparison exercises (round-robins). The QA/QC program adopts a "performance-based" approach to achieving quality assurance of low-level contaminants. Laboratories are not required to use a single, standard analytical method for each type of analysis. They are free to choose the best, or most feasible method within the constraints of cost and equipment, provided that the resulting data is of known and documented quality.

Each laboratory must demonstrate its capability to meet the reporting objectives for each of the target analytes. Initially, each laboratory should establish a method detection limit (MDL) for each target analyte following the MDL protocol cited in 40 CFR Part 136. Laboratories must participate in an available on-going intercalibration exercise, and meet the performance criteria prior to analysis of the survey samples.

The participating laboratories must continue to review their laboratory performance and make corrections if QA/QC criteria are not met. The comparability in performance among laboratories is continuously evaluated based on analysis of certified reference materials (CRMs), intercalibration samples, spiked samples, sample duplicates, and laboratory reagent blanks.

B. Sample Collection, Preservation, and Holding Time

Field personnel must strictly adhere to Bight'98 protocols to ensure the collection of representative, uncontaminated sediment and fish tissue chemistry samples. These sample collection protocols are described in detail in the Field Operations Manual. Briefly, the key aspects of quality control associated with chemistry sample collection are as follows:

C. Laboratory Operations Overview

Bight'98 will involve the distribution of chemistry samples to several different laboratories. Each participating laboratory will analyze samples using existing methodology and report results only for the constituents that match those listed in Table 5-1.

The QA/QC requirements presented in the following sections are intended to provide a common foundation for each laboratory's protocols. The resultant QA/QC data will enable an assessment of the comparability of results generated by different laboratories and different analytical procedures. It should be noted that the QA/QC requirements specified in this plan represent the minimum requirements for any given analytical method. Additional requirements that are method-specific should always be followed, as long as the minimum requirements presented in this document have been met.

The performance-based Bight'98 QA program for analytical chemistry laboratories is based on an initial demonstration of laboratory capability (e.g., performance evaluation) and an ongoing demonstration of capability.

Control limit criteria and recommended frequency of analysis for each QA/QC element or sample type required in the Bight'98 program are summarized in Tables 5-3 through 5-6. The following sections discuss general aspects of the QA/QC elements.

Prior to the analysis of samples, each laboratory should calculate method detection limits for each analyte; establish an initial calibration curve for all analytes; and demonstrate acceptable performance on a known or blind accuracy-based material.

Following a successful first phase, the laboratory must demonstrate its continued capabilities by: participating in an on-going series of interlaboratory comparison exercises; repeated analysis of certified reference materials (CRMs); laboratory control standards; and analysis of laboratory method blanks and spiked samples. These steps are detailed in the following sections.

The results for the various QA/QC samples should be reviewed by laboratory personnel immediately following the analysis of each sample batch. These results should then be used to determine when control limit criteria have not been met and corrective actions must be taken, before processing a subsequent sample batch.

To accomplish the objectives of the Bight'98 study, three criteria must be met for any analytical methods used:

The on-going intercalibration exercises are used to provide an initial check on the performance of the participating laboratories against these criteria. Any laboratory that fails to meet these criteria should repeat analyses of the intercalibration samples before analyzing the survey samples.

Continuous performance evaluation against these criteria can be achieved by analyses of sample duplicates, spiked blanks, matrix spikes, reporting level spikes, laboratory control standards, and certified reference materials. The data quality requirements for the Bight'98 study are summarized in Tables 5-3 to 5-6. Discussion of each component is detailed below.

Initial calibration

Equipment should be calibrated prior to the analysis of each sample batch, after each major equipment disruption, and whenever on-going continuing calibration checks do not meet recommended control limit criteria (Tables 5-3 to 5-6).

Organics. Calibration range must be established for each constituent from a minimum of five analytical standards of increasing concentration. The calibration range should be well characterized and must be established prior to the analysis of samples. Only data which results from quantification within the demonstrated working calibration range may be reported by the laboratory without annotation (i.e., quantification based on extrapolation outside the calibration range is not acceptable). Samples with measured concentrations outside the calibration range should be diluted as appropriate, and reanalyzed. For results below the lowest calibration point (RL), samples may be further concentrated, or results "flagged" (annotated) as MDL. The latter is acceptable only if: (1) sample extraction/concentration steps were sufficient to meet the target analyte RL goals of the study, or (2) matrix problems have required sample dilution.

Trace metals. ICP-AES and ICP-MS instruments are calibrated with a calibration blank and a minimum of one calibration standard. The atomic absorption spectrometers including flame atomic absorption (FAA), graphite furnace (GFAA), hydride generation, and cold vapor are calibrated using a minimum of 1 blank and three calibration standards. The linear coefficient of the calibration curve must be at least 0.995 to be acceptable.

Initial documentation of method detection limits

In Bight'98, the MDL will be used to demonstrate the capability of a laboratory to reach the sensitivity required to measure a specific constituent and demonstrate acceptable precision. The MDL represents a quantitative estimate of low-level response detected at the maximum sensitivity of a method. The Code of Federal Regulations (40 CFR Part 136) gives the following definition: "the MDL is the minimum concentration of a substance that can be measured and reported with 99% confidence that the analyte concentration is greater than zero and is determined from analysis of a sample in a given matrix containing the analyte." The calculated MDL is a function of method precision at low analyte concentrations. Laboratories must submit documented MDLs for each analytical method (summarized in a spreadsheet) to the Chairperson of the Chemistry Technical Committee prior to analysis of field samples. MDLs should be determined in both fish tissue and sediment, using "clean" sample matrices in order to minimize the interference of sample analytes on estimation of detection limits of target analytes.

Each laboratory is to follow the procedure specified in 40 CFR Part 136 (Federal Register, Oct. 28, 1984) to calculate nominal MDLs for each analytical method employed. Briefly, at least seven replicates of each representative matrix should be spiked at a concentration between one and five times the estimated detection limit (except for certain trace metals; see below for details), or at the reporting level (RL, see below) as a default. The amount of sample (i.e., weight of sediment or tissue) used in calculating the MDL should match, as closely as possible, the amount of sample typically used. The mean and standard deviation of the replicates are used to compute the MDL by multiplying the standard deviation by the Student t value for the 99% confidence interval (for n=7, t=3.143).

Trace metals. The MDLs for aluminum, antimony, arsenic, barium, beryllium, cadmium, chromium, copper, iron, lead, mercury, nickel, selenium, silver, and zinc could be determined on a certified reference material or be calculated from a spiked clean matrix.

Reporting levels

In the Bight'98 program, RLs are used to report concentrations of target analytes (Table 5-7). As defined by the Bight'98 Chemistry Technical Committee, RLs are identical to the lowest concentration of any specific calibration range. The RL is therefore the lowest quantitative value which can be justified and reported in terms of calibration reliability. Values below the RL, but above the nominal MDL are reported when detected, but must be flagged or annotated using the footnote supplied for data reporting. Laboratories must demonstrate their capability to achieve the required RLs by matching the lowest level of calibration standards to the reporting level and meeting the control limit criteria for the initial calibration. Table 5-7 shows the Bight 98 Reporting Levels.

Trace Metals. The maximum acceptable MDLs are set at one-fifth of the ERL. For the purpose of this study, reporting levels (RLs) are used interchangeably with maximum acceptable MDLs.

Trace Organics. The RLs for the PAH in sediment are set based on the combination of the ERL and historical data. The RLs for the chlorinated pesticide in sediments are also based on the ERL values. Sediment RLs for PCB congeners are based on total PCB ERLs. Fish tissue RLs for chlorinated hydrocarbon analytes are based on tissue residue guidelines for protection of wildlife, as recommended by Environment Canada. RLs for biomarker compounds (LABs) are based on the sensitivity of the method and what can be expected of the LAB concentrations in the SCB.

Performance criteria at the RL

The initial performance demonstration of precision near the RL can be derived from the MDL determination or separate analysis. The standard deviation of at least 7 replicates of clean matrix spiked at or near the RL should be < 0.35 times the RL. In order for test performance to be estimated for ongoing organics analyses, each sample batch should include at least one spike at or near the RL (see Reporting level spikes (organics).

Calibration verification

An initial calibration verification standard is analyzed at the beginning of each analysis following the calibration procedure to check the accuracy of the calibration. For all three analytical techniques, one initial calibration verification standard is made from a source different from the source that is used for the calibration standards. The initial calibration is near the mid-range of the calibration and must be within ±10% of the true value when analyzed. ICP-AES and ICP-MS also require a second initial calibration standard of a substantially different concentration than the first initial calibration standard; the second initial calibration standard must also be within ±10% of the true value when analyzed.

For continuing trace metal measurements, the continuing calibration verification (CCV) verifies that the instrument stays in calibration throughout the analysis. The CCV is prepared in the same acid matrix as the calibration standard. It is analyzed after every ten samples and at the end of the run. The CCV can come from any source that is near the mid-range of the calibration and must be within the ranges specified in Table 5-3.

For trace organics measurements using full scan GC/MS, instrument tuning needs to be performed by analyzing 50 ng of decafluorotriphenylphosphine (DFTPP) prior to use of the instrument. The fragmentation profiles from this analysis have to be within the EPA-recommended criteria (see USEPA SW-846). The initial instrument calibration performed to establish calibration ranges for specific analytes is checked through the analysis of calibration verification standards (i.e., calibration standard solutions) prior to analysis of each batch of samples. Calibration verification standard solutions used for the calibration checks should contain all the analytes of interest at concentrations at or near the mid-level of a multi-point calibration range.

If the control limit for analysis of the calibration verification standard is not met (Tables 5-3 to 5-6), the analyst(s) should identify and eliminate the source(s) causing the failure and perform another calibration verification. If problems persist, preventive maintenance or corrective actions must be performed. A calibration verification standard is injected. The results should be assessed using the calibration verification criteria (Tables 5-3 to 5-6). If the calibration verification criteria are not met, a new initial calibration must be performed. No sample analysis should begin until a satisfactory calibration verification is achieved.

Calibration blanks (trace metals)

Laboratories need to analyze calibration blanks (pure matrix used to prepare calibration standard solutions) prior to analysis of samples to ensure that the instrument is free of contamination. Concentrations of all target analytes obtained from analysis of the calibration blanks should be below MDLs.

Method blanks

Method blanks (also called procedural blanks) are used to assess laboratory contamination during all stages of sample preparation and analysis. For both organic and inorganic analyses, one laboratory reagent blank should be run in every sample batch. The method blank should be processed through the entire analytical procedure in a manner identical to the samples. Control limits for blanks (Tables 5-3 to 5-6) are based on the laboratory's maximum acceptable method detection limits (trace metals) or reporting levels (trace organics and TOC) as documented prior to the analysis of samples. For trace metals, the level of any analyte in the method blank must be below MDL or less than 5% of the level of the analyte in the samples. A reagent blank concentration equal to or greater than three times the MDL for one or more of the analytes of interest requires definitive corrective action to identify and eliminate the source(s) of contamination before proceeding with sample analysis. For trace organics, if the method blank contains any analyte with a measured concentration greater than RL, all samples should be re-analyzed within the batch if that analyte is detected in samples. Concentrations lower than RL should be reported, but not used to correct concentrations in the field samples.

Sample duplicates

Analysis of sample duplicates is used to assess the precision of an analytical method in quantifying target analytes and not required for all methods. The relative percent difference (RPD) between the sample and sample duplicate results is calculated as follows:

RPD = (C1 - C2) x 100
(C1 + C2)/2

where: C1 = the larger of the duplicate results for a given analyte, and
C2 = the smaller of the duplicate results for a given analyte.

The data from this process are typically used to establish a statistical range with which the precision of subsequent analyses can be assessed.

Matrix spikes and matrix spike duplicates

A laboratory spiked sample matrix (commonly called a matrix spike or MS) and a laboratory spiked sample matrix duplicate (commonly called a matrix spike duplicate or MSD) will be used both to evaluate the effect of the sample matrix on the recovery of the compound(s) of interest and to provide an estimate of analytical precision. A minimum of one MS should be analyzed for 10% of samples. The matrix spike solution should contain all the analytes of interest. The final spiked concentration of each analyte in the sample should be between 10 and 100 times the MDL for that analyte, as previously calculated by the laboratory (unless the unspiked sample contains more than this amount in which case 1 to 5 times the pre-existing concentration in the sample).

Recovery data for the fortified compounds ultimately are intended to provide a basis for determining the prevalence of matrix effects in the samples analyzed during the project. However, these data may not truly reflect the magnitude of matrix interference with the analyses since spiking materials may not enter the complex matrix. This is particularly true for measurements of trace organics in complex matrices. Therefore, it is recommended that recovery data from analyses of MS and MSD samples are only used as an evaluation tool for methods measuring trace organics.

For trace metals, the spike control limits are presented in Table 5-3. for all elements other than iron and aluminum due to their high concentrations. If the percent recovery for any analyte in the MS or MSD is lower than the control limits, the raw data quantitation reports should be reviewed. If the reason for a low percent recovery value is not discovered, the instrument response may be checked using a calibration standard. Low matrix spike recoveries may be a result of matrix interference and further instrument response checks may not be warranted, especially if the low recovery occurs in both the MS and MSD, and the other QC samples in the batch indicate that the analysis was "in control". An explanation for low percent recovery values for MS/MSD results should be given in the cover letter accompanying the data package. Corrective actions taken and verification of acceptable instrument response must be included.

Analysis of the MS/MSD also is useful for assessing laboratory precision. The RPD between the MS and MSD results should be within the control limits (Tables 5-3 to 5-6 and 5-9) for at least one result per batch.. If results for any analytes do not meet the control limit criteria, calculations and instruments should be checked. A repeat analysis may be required to confirm the results.

Reporting level spikes (organics)

Since a large number of samples are expected to contain organic analytes with concentrations near RLs, it is important to estimate the confidence of the measurements near these levels. For each batch of samples analyzed, a relatively clean matrix (clean sand or Orange Roughy) is spiked with a standard solution containing all analytes of interest at levels approximately 20% above RLs. This sample is processed and analyzed along with other field samples. Recovery data from all participating laboratories will be gathered and analyzed to yield a confidence range for each method measuring low-level target analytes.

Certified reference materials

Certified reference materials (CRMs) generally are the most useful QC samples for assessing the accuracy of a given analysis (i.e., closeness of a measurement to the "true" value). CRMs can be used to assess accuracy because they have "certified" concentrations of the analytes of interest, as determined through replicate analyses by a reputable certifying organization using two independent measurement techniques for verification. In addition, the certifying organization may provide "non-certified" or "informational" values for other analytes of interest. Such values are determined using a single measurement technique, which may introduce unrecognized bias. Therefore, non-certified values must be used with caution in evaluating the performance of a laboratory using a method which differs from the one used by the certifying organization. A list of reference materials used for the Bight'98 study is presented in Table 5-8.

As an alternative, laboratory control material (LCM) may be used in replacing a CRM. A LCM is similar to a CRM in that it is a homogeneous matrix that closely matches the samples being analyzed. For the Bight'98 study, two sediment materials were collected from Santa Monica Bay and the Palos Verdes Shelf and repeatedly analyzed by a number of laboratories. Although concentrations of the analytes of interest in these materials are not certified, they can be used to assess the precision (i.e., consistency) of a single laboratory, as well as to determine the degree of comparability among different laboratories. In practice, LCMs may be preferred for routine (i.e., day to day) analysis because CRMs are relatively expensive. However, CRMs still must be analyzed at regular intervals (e.g., monthly or quarterly) to provide a check on accuracy.

Routine analysis of CRMs or, when available, LCMs, is a vital aspect of the "performance-based" Bight'98 QA philosophy. At least one CRM or LCM must be analyzed along with each batch of samples (Tables 5-3 to 5-6 and 5-9). For CRMs, both the certified and non-certified concentrations of the target analytes should be known to the analyst(s) and should be used to provide an immediate check on performance before proceeding with a subsequent sample batch. Performance criteria for both precision and accuracy have been established for analysis of CRMs or LCMs (Tables 5-3 to 5-6 and 5-9). If the laboratory fails to meet either the precision or accuracy control limit criteria for a given analysis of the CRM or LCM, the data for the entire batch of samples is suspect.

Calculations and instruments should be checked; the CRM or LCM may have to be reanalyzed (i.e., reinjected) to confirm the results. If the values are still outside the control limits in the repeat analysis, the laboratory is required to find and eliminate the source(s) of the problem and repeat the analysis of that batch of samples until control limits are met, before continuing with further sample processing. The results of the CRM or LCM analysis should never be used by the laboratory to "correct" the data for a given sample batch.

Surrogate standards

Recovery surrogates are compounds chosen to simulate the analytes of interest in organic analyses. The recovery surrogate represents a reference analyte against which the signal from the analytes of interest is compared directly for the purpose of quantification. Recovery surrogates must be added to each sample, including QA/QC samples, prior to extraction. The reported concentration of each analyte should NOT be adjusted to correct for the recovery of the surrogate standards. The surrogate recovery data therefore should be carefully monitored; each laboratory must report the percent recovery of the surrogate(s) along with the target analyte data for each sample. If possible, isotopically-labeled analogs of the analytes should be used as recovery surrogates for GC/MS analyses.

Control limit criteria for surrogate recoveries are provided in Tables 5-4 to 5-5. Each laboratory should set its own control limit criteria based on the experience and best professional judgment of the analyst(s). It is the responsibility of the analyst(s) to demonstrate that the analytical process is always "in control" (i.e., highly variable surrogate recoveries are not acceptable for repeat analyses of the same certified reference material and for the matrix spike/matrix spike duplicate).

Internal standards (organics)

Internal standards are added to each sample extract just prior to instrumental analysis to enable optimal quantification, particularly of complex extracts subject to matrix effects or retention time shifts relative to the analysis of standards. Internal standards are essential if the actual recovery of the surrogates added prior to extraction is to be calculated. The internal standards also can be used to detect and correct for problems in the instrument. The elements or compounds used as internal standards must be different from those already used as recovery surrogates. The analyst(s) should monitor internal standard retention times and recoveries to determine if instrument maintenance or repair, or changes in analytical procedures, are indicated. Corrective action should be initiated based on the experience of the analyst(s) and not because warning or control limits are exceeded. Instrument problems that may have affected the data or resulted in the reanalysis of the sample should be documented properly in logbooks and internal data reports and used by the laboratory personnel to take appropriate corrective action.

D. Data Evaluation Procedures

It is the responsibility of the Project Manager or his designee to acknowledge initial receipt of the data package(s), verify that the four data evaluation steps (see below) are completed, notify the analytical laboratory of any additional information or corrective actions deemed necessary after the data evaluation, and, following satisfactory resolution of all "corrective action" issues, take final action by notifying the laboratory in writing that the submitted results have been officially accepted as complete. It may be necessary or desirable for a team of individuals (e.g., the QA Coordinator, Lab Coordinator and/or staff analytical chemists) to assist the Project Manager in technical evaluation of the submitted data packages. While the Project Manager has ultimate responsibility for maintaining official contact with the analytical laboratory and verifying that the data evaluation process is completed, it is the responsibility of the QA Coordinator to closely monitor and formally document each step in the process as it is completed. This documentation should be in the form of a data evaluation tracking form or checklist that is filled in as each step is completed. This checklist should be supplemented with detailed memos to the project file outlining any concerns with data omissions, analysis problems, or descriptions of questionable data identified by the laboratory.

Evaluation of the data package should begin as soon as possible following its receipt, since delays increase the chance that information may be misplaced or forgotten and (if holding times have been exceeded) can sometimes limit options for reanalysis. The following steps are to be followed and documented in evaluating Bight'98 chemistry data:

Checking Data Completeness

The first part of data evaluation is to verify that all required information has been provided in the data package. In Bight'98, this should include the following steps:

The Project Manager should contact the laboratory and request any missing information as soon as possible after receipt of the data package. If information was omitted because required analyses were not completed, the laboratory should provide and implement a plan to correct the deficiency. This plan may include submittal of a revised data package and possible reanalysis of samples.

Assessing data quality

Data validation, or the process of assessing data quality, can begin after Bight'98 personnel have determined that the data package is complete. Normally, the first major part of validation involves checking 100% of the data for any possible errors resulting from transcription of tabulated results, misidentification or miscalculations. However, Bight'98 laboratories are expected to submit data that has been tabulated and checked 100% for accuracy; the raw data reports needed to perform these checks (e.g., chromatograms, original quantitation reports) are not submitted as part of the data package. The laboratory is required to maintain this raw data in an orderly manner and to have these records available for review by Bight'98 personnel upon request. The first-step validation checks performed by Bight'98 personnel will be limited to the following:

The second major aspect of data validation is to compare the QA/QC data against established criteria for acceptable performance (specified earlier in this plan). This will involve the following steps:

There are several possible courses of action to be taken if the reported data are deficient (i.e., warning and/or control limits exceeded) during the assessment of data quality: