IOM Says CDC Great Lakes Reports Have Shortcomings

Sep 5: According to a release and a review by the National Academy of Sciences' Institute of Medicine (IOM), two drafts of a yet-to-be-finalized report [See WIMS 3/14/08] looking at health and pollution data from the Great Lakes region have problems that diminish the documents' scientific quality. These shortcomings limit the usefulness of the drafts -- prepared by the U.S. Centers for Disease Control and Prevention -- in determining whether health risks might be associated with living near the lakes.

Questions about the scientific quality of the drafts and concern following the unauthorized publication of one of the interim drafts on a public website [See WIMS 2/8/08] led CDC to ask the IOM for an independent review of the documents. The drafts originated with an international commission's request for CDC's Agency for Toxic Substances and Disease Registry (ATSDR) to evaluate the public health implications of hazardous materials present in certain areas within U.S. states in the Great Lakes basin. The IOM committee focused on a 2007 draft and a 2008 version that was prepared after directors within ATSDR expressed apprehension about the 2007 draft's methodology and conclusions and postponed its public release. No final report has been released.

"We found problems in how each draft was developed, which data were used, and what conclusions the authors drew," said Robert Wallace, Irene Ensminger Stecher Professor of Epidemiology and Internal Medicine, College of Public Health, University of Iowa, Iowa City, and chair of the committee that wrote the report. "Our task was to focus solely on the scientific quality of the drafts and not to assess whether pollution around the Great Lakes poses health concerns," he added. "The problems we found in the drafts would limit the ability of officials and others to draw conclusions from them about whether any health risks are associated with living in or near certain places around the Great Lakes."

Most of the concerns about the 2007 draft raised by CDC's peer reviewers and ATSDR directors -- particularly how data were selected and used -- are valid, the committee concluded. Pollution and health data were lumped together despite differences in where and when the information was collected and despite lack of supporting evidence or explanation of how particular contaminants could lead to any of the identified health problems. The release indicates that, "This juxtaposition of data without explanation or support could lead readers to assume links between contamination and health problems regardless of whether they actually exist. Furthermore, some data that might have provided useful evidence apparently were not considered, and the drafts contained little explanation for why the data used were chosen."

The Committee concluded, "The 2008 draft provides only a summary of selected data on chemical releases and contamination and does not add substantially to the understanding of pollution around the Great Lakes. Though the authors' decision to leave out the health data in the 2008 draft is understandable given its incompatibilities with the available contamination data, it significantly changed the nature of the resulting draft and scope of response to the original request to CDC." The committee also noted problems with using the selected contaminant data as indicators of actual exposures. Moreover, the draft lacks information on other potential sources of contaminants or ways that people could be exposed.

Access a release from the IOM and link to the complete 50-page report (click here). Access the ATSDR website for the Great Lakes report which contains extensive links to background information, the Statement of Concern, the 2004 & 2007 & 2008 drafts, and more (click here).