My initial reaction to reading this article was that it illustrated well the nearly insuperable difficulty most lay readers would have in understanding original research reports as published in professional journals.
My next reaction was that I had great difficulty understanding this particular report, not because of unfamiliarity with the terms of the design of the study, but because of the remarkably abstruse way it was presented. I doubt that most clinical physicians without a research background would find their way through the article either--at least not to the point of viewing it from a critical perspective.
When, after considerable rereading, I felt that I had a reasonable grasp of the material, I came to feel that the one reason for its being presented in such a confusing way was to avoid bringing out the many serious flaws in the study design and data.
I do not want to exhaust my audience with the kind of critique I would have given had I been one of the journal's reviewers asked to evaluate the manuscript submitted. I will merely point out some of the greater flaws, which I have already suggested in the Summary above:
- The authors appear to base almost all of their conclusions on the finding of "comparable" lengthening of reaction time in alcohol-intoxicated healthy subjects versus people with sleep-disordered breathing; in statistical language, such an attempt to prove an absence of differences is problematic if not impossible
- Those significant differences which they did find have little to do with their main point
- The issue of age effects on reaction time is a real one, which is nowhere in the data offered addressed adequately
- The patient and healthy groups were not comparable as to age and may well have proven dissimilar if compared on other relevant characteristics, such as education or socioeconomic status
- The two healthy control groups, though dissimilar in age, are also dissimilar in numbers (11 versus 80) and therefore unlikely to show significant differences in reaction times as a result of limitation of statistics in comparing different groups of very different sizes
- In all likelihood, though never specified, the two control groups were drawn from different population, the large group of younger healthy controls probably representing students, the smaller group possibly representing people who worked around the laboratory, making their comparability all the less probable
- To the extent that one can puzzle out the absolute magnitude of differences in reaction times between healthy, unintoxicated subjects and sleep-disordered subjects, they appear remarkably modest in size, even though quite statistically significant
- Nowhere do the authors reference other research on the relationship of differences of this magnitude to other measures, whether on neuropsychological testing or in actual risk of accidents, which might validate the importance of their finding
- To my reading, the authors have deliberately set the article up with the objective of offering all but the small group of people able to read their article critically, a conclusion not supported by their data but certain to draw public and government (i.e. funding source) attention
Lest you think these issues are irrelevant complaints of an overly critical researcher, I quote from the authors' concluding sentences:
". . .this investigation has presented a comparative model to support the realization that the consequences of driving or engaging in safety-sensitive activities when sleepy as a result of SDB [sleep-disordered breathing] may be the same as driving under the influence of alcohol or, in some cases, driving drunk. In addition, it is hoped that this may further stimulate an awareness of the potential for altered performances at home and at work as a result of SDB."
Does this frighten you? It should. The authors are among the most esteemed researchers in the field of sleep, so their findings and opinions carry weight. Not only do their concluding comments suggest that people with sleep-disordered breathing shouldn't drive, they hint at justifications for finding them unsatisfactory as employees, employers, professionals, or even spouses and fathers!
|