National Cancer Institute   Cancer Therapy Evaluation Program   Developing Cancer Therapies
CTEP HomeContactHelpSearch:

Investigator's Handbook
A Manual for Participants in Clinical Trials of Investigational Agents Sponsored by DCTD, NCI
Table of
Contents
Part A
1 2 3
Part B
4 5 6
Part C
7 8 9 10 11
Part D
12 13 14 15 16
Part E
17 18 19
Appendices

Part D: The Organization of a Clinical Trial

16. Monitoring and Quality Assurance


16. Monitoring and Quality Assurance

16.1 Introduction

Sponsors and research bases must monitor their clinical trials. In assuring the quality of data, monitoring is a key component of any clinical trials program. Quality assurance and monitoring are concerned with the execution of a trial, rather than its conception, and with the quality of the data that support the scientific conclusions.

Many individual activities are part of quality assurance, and investigators have recognized some of them as vital to the integrity of clinical trials for years. In particular, the quality control of pathology and radiotherapy has been part of the Cooperative Group program for a long time. More recently, investigators have increasingly recognized the importance of verifying the accuracy of other classes of data.

We shall now discuss in more detail the items that form the major focus of the DCTD-sponsored quality assurance effort. Note that the first two classes of concern (protocol compliance and data accuracy) are really central problems in clinical trials methodology. The fact that they are assessed intensively by the on-site audit program should in no way divert attention from their essential importance to the scientific content of clinical trials.


16.2 Protocol Compliance

16.2.1 Cooperative Groups

The groups have recognized the importance of assessing the extent of protocol compliance for many years. One of the first areas to receive attention was the confirmation of diagnosis. Today, virtually all groups have Pathology Committees or Reference Panels for selected studies; central pathology review reduces one important source of variability in trial results. Furthermore, most Cooperative Groups have quality control in radiotherapy, which consists at least of reviews of port films by group radiotherapists. These reviews are best done prospectively, so that errors can be detected in time to alter subsequent treatment. In the Cooperative Groups, the medical oncology committee or the protocol chair reviews case report forms to establish whether dose adjustments have followed protocol guidelines, and whether appropriate study tests have been obtained.

In most Cooperative Groups, the protocol chair also reviews each case to determine eligibility, evaluability, and validity of response and adverse event assessment. In some cases, the statistical office accomplishes one or more of these tasks. All of these assessments are performed through review of submitted case report forms.


16.2.2 Cancer Centers

The majority of Cancer Centers have organized procedures to assess protocol compliance centrally and systemically (Section 3, Research Bases). The CTEP on-site audit program evaluates protocol compliance as part of its monitoring visits. Indeed, this is a major focus of a monitoring visit to a Cancer Center, along with the administrative review for central data management, protocol development, and data collection.


16.2.3 CTEP Clinical Drug Development Contractors

Protocol compliance is assessed by the Clinical Trials Monitoring Service (CTMS). Phase 1 and Phase 2/3 contractors submit raw data to CTMS, which reviews it carefully for extent of compliance with the protocol. Reports of these evaluations are provided to the investigator and to CTEP.


16.3 Data Accuracy

The importance of verifying the accuracy of the basic data elements used in the analysis of study endpoints is obvious. Data accuracy is assessed during on-site audits by comparison of the research record (e.g., flow sheets) with the primary patient record. Response assessment may be evaluated by examination of radiographs or scintiscans, where relevant.

In many of the early on-site audits performed, CTEP was concerned about the absence of formalized procedures at many centers for assessing these important issues internally. Many institutions lacked central registration mechanisms to enroll patients on trials. Centralized systems of data management were often not available. Some institutions lacked clear procedures for certifying the accuracy of research data. Formal procedures for evaluating the accuracy of response assessment, for example by second-party review, were commonly lacking. As institutions have recognized the importance of these tools for the conduct of clinical trials and have brought them "on-line," the quality of data has improved commensurately.


16.4 Procedural Requirements

As an IND sponsor, the DCTD must verify that its investigators adhere to the various procedural requirements of investigational agent trials. The specific procedural activities checked at the time of the on-site audit are:

  • Informed Consent - Investigators must be certain that the patient signs the IRB-approved version of the informed consent prior to initiation of protocol-directed therapy. The consent form must be a document specifically written for the protocol, and must address all elements required by Federal regulations.
  • IRB Approval - Each protocol must have full approval by the IRB named in the assurance for the institution prior to patient entry. There should be written verification of this action and of at least annual review. Substantive protocol amendments must also be approved by the IRB.
  • Agent Accountability - Each investigator must assure that:
  • All IND agents supplied by DCTD are used only for patients on the specific protocol for which the agents were requested and approved by CTEP
  • Logs are maintained that record the disposition of each unit of agent received from CTEP for the protocol.

On-site auditors will also review the completeness of reporting adverse events and the quality of record keeping with particular reference to the completeness of the source documentation.

Each of these areas is reviewed at the time of on-site audit. In addition, many Cooperative Groups and Cancer Centers maintain internal procedures to assure the quality of data on their trials and assure that regulatory requirements have been met.


16.5 Components of the Quality Assurance Program Implemented by CTEP

16.5.1 Monitoring

Monitoring includes following the overall progress of the study to ensure that projected accrual goals are met in a timely fashion and excessive accrual is avoided; that eligibility and evaluability rates do not fall below acceptable standards; and that risks of the study do not outweigh benefits. Poor performance in any of these areas is cause for concern. Because these activities are performed during study execution, they may lead directly to improved conduct of the trial. The Cooperative Groups are performing these tasks according to systematic, formalized procedures. For Phase 1 studies, the CTMS performs these duties.

Cancer Center studies are monitored by the CTMS with direct oversight from CTMB.


16.5.2 The On-Site Auditing Program

16.5.2.1 Purpose of Site Visit Audits

  • Verification of data accuracy by comparison of the primary medical record with the case report form maintained by the research base for analysis
  • Verification of the presence of an IRB-approved consent form signed by the patient prior to the initiation of protocol therapy
  • Verification of IRB approval (and at least annual review and reapproval) of each sponsored study
  • Verification that procedures for agent accountability meet the requirements of federal regulations and CTEP procedures, including maintenance of NCI Agent Accountability Records.


16.5.2.2 Outline of Audit Procedures

  • Trials to be audited are those involving DCTD investigational agents and selected prevention trials
  • All audits will be conducted by persons knowledgeable about clinical trials methodology and the Federal regulations and NCI policies pertinent to clinical trials
  • Audits will be randomly timed
  • Audits will be conducted at an average rate of once every three years (except CTMS monitored Phase 1 trials).


16.5.2.3 Adaptions of Basic Procedures to Specific Needs

These basic procedures have been adapted to the several types of clinical trials organizations supported by NCI in the following way:

  • Cooperative Groups - Each Group will perform its own program of on-site audits, to be conducted by its staff and/or members with direct oversight by CTMB. CTEP or CTMS staff will attend a percentage as observers.
  • Clinical Agent Development Contractors - On-site audit visits are made to the Phase 1 contractors three times each year and to the Phase 2/3 contractors once annually. All are site visited by the CTMS. Noncontract studies may be assigned to CTMS monitoring at CTEP discretion.
  • Others - This category comprises all others performing DCTD IND agent studies, including RO1/PO1 holders (conducting clinical IND agent trials as part of grant-related activity), and new agent studies groups. Audits will be conducted by teams composed of CTMS staff, CTEP staff, and outside physicians, as deemed necessary by CTEP.
  • Cancer Centers - Audits will be conducted by teams composed of CTMS staff, CTEP staff and outside physicians. Audits will occur once every three years.

Relationship Between the Content of the Site Visit Audits and the Type of Clinical Trials Organization.

Components of the Quality Assurance Program
  Protocol Compliance Data Accuracy Procedures
Contract & Other Phase 1 Studies CTMS CTMS CTMS
Cancer Centers CTMS CTMS CTMS
Cooperative Groups Group
    Note 1
Group
    Note 2
Group
    Note 1

CTMS = Clinical Trials Monitoring Service (CTEP monitoring organization, which monitors Phase 1 and some Phase 2 trials, and coordinates On-Site Auditing Program)

Note 1:
Protocol compliance is verified by each Cooperative Group through its quality control program. Much of this is accomplished through a central review of case report forms. However, protocol compliance should also be checked at the time of on-site audits to review patient charts, since information pertinent to the eligibility and evaluability of a patient may be discovered that was not included on the case report form.

Note 2:
Conducted as part of the on-site auditing program of the Cooperative Groups, and co-site visited by NCI.


16.6 Informed Consent and the Monitoring Program

Many have asked about the legality of review of a patient's primary medical record by outside individuals. The answer is straightforward. No Federal law prohibits external review of a patient's medical record. The regulations of informed consent do require, however, that the patient be informed of "the extent to which confidentiality of records will be maintained." This means that there is no rule against chart review by outsiders, but that the patient must be told what will be done. For this reason, CTEP requires that each informed consent document for investigational agent trials it sponsors include a statement with the following language, "A qualified representative of FDA and NCI may review my medical records." CTEP may also suggest that the name of the manufacturer of the agent be included as having access to the records. This access may be necessary for the pharmaceutical company to prepare a New Drug Application (NDA) or Biologic License Application (BLA) for an agent.

Also, please note that medical records are protected from inquiries under the Freedom of Information Act (FOIA). Even if the study is performed under Government sponsorship, any records on the premises of the investigator are not subject to FOIA requests. Furthermore, any patient-related records in Government files are protected from FOIA requests by the Privacy Act. As an additional measure of safeguarding, CTEP removes patient names from any documents in its possession.


16.7 Dealing with Problems Identified During On-Site Audits

CTEP and the Cooperative Groups have a full range of options in dealing with problems identified at the on-site audit. In a great majority of cases, the measures are intended to be constructive, educational, and corrective rather than punitive. The actions that are taken vary with the individual case.

All reports of on-site audits are sent to CTEP electronically. The reports are assessed by CTEP staff on a regular basis. When major problems are identified by a Cooperative Group audit, this information is immediately conveyed to the group chair and CTEP for further action and investigation. After requesting a written clarification, and following review of the case by the Cooperative Group and/or CTEP, appropriate measures will be applied if the original assessment is confirmed. The options for action include:

  • Letter of Warning
  • Probationary status
  • Suspension of patient entry privileges
  • Immediate repeat audit
  • Removal of access to investigational agents
  • Notification of FDA if investigational agents are involved (FDA may conduct its own investigation)
  • Notification of the Office of Research Integrity if scientific misconduct is a possibility (ORI may conduct its own inquiry/investigation)
  • Notification of the Office of Human Research Protection (OHRP), http://ohrp.osophs.dhhs.gov/index.html, if issues of patient rights, informed consent, or IRB review are involved (OHRP may conduct its own investigation)

The following actions may be taken in instances of suspected data fabrication or falsification or other possible scientific misconduct:

  • Replacement of principal investigator
  • Termination of grant or contract
  • Reanalysis or retraction of published results
  • Formal ORI investigation
  • Debarment of investigator or other staff from future participation in PHS research.


Table of
Contents
Part A
1 2 3
Part B
4 5 7
Part C
7 8 9 10 11
Part D
12 13 14 15 16
Part E
17 18 19
Appendices


  Home   |   Contact   |   Privacy Notice   |   Accessibility National Cancer Institute   National Institutes of Health   Department of Health and Human Services   USA.gov