A TALE OF TWO LARGE TRIALS
One trial done quite well and the other suboptimally interpreted.
The following compares two very large randomized trials, one done very well, the Heart Protection Study1, and one interpreted quite suboptimally, the ALLHAT trial2.
Very large randomized clinical trials effectively deal with the issue of having adequate numbers for statistical significance.
A large trial, however, does not guarantee that the treatment protocols being studied are good ones or broadly applicable, nor does it guarantee that valid conclusions regarding the trial's outcome are made by the authors.
Heart Protection Study (An Excellent Study)
The Heart Protection Study1 was a trial of 20,536 patients.†The patient population consisted of individuals at substantial risk for developing a future coronary artery disease event because of preexisting coronary disease or very high risk factors. The trial treated all patients with the same dose of cholesterol lowering medicine (simvastatin - Zocor 40 mg ) regardless of whether the patientís pretreatment cholesterol was high, moderate, or low. This landmark trial reliably showed through the strength of its large numbers and clinically relevant treatment protocol that the benefit of a statin medication for this group of patients was the same regardless of the initial level serum cholesterol. The results of this trial will favorably change the treatment of patients at high risk for heart disease. The fundamental understanding of physicians of whether a baseline cholesterol level is pertinent in regards to initiation of therapy for this population has been effectively and appropriately changed.
However, even in this stellar trial, it would have been possible for the authors to extend their conclusions beyond what the trial results warranted.
The authors could have inappropriately concluded that their trial results applied only to the particular cholesterol drug tested, simvastin. Their unfounded conclusion would then have been that only simvastin should be used to treat patients with coronary heart disease who have a normal or low pretreatment cholesterol levels. In addition, the authors could have inappropriately concluded in their reportís formal conclusions that their trial data proves that measuring cholesterol levels in this type of patients is not useful since all these patients should be treated with the cholesterol lowering medicine regardless. Though individual authors of this study may have thought the trial raises the question of whether follow-up blood tests are really needed, they did not inappropriately extend their conclusions beyond what the trial directly tested.
Hence, even an excellent trial such as the
Heart Protection Study could be substantially diminished if the authors of that
trial had chosen to make inappropriate conclusions and if the editors of the
journal that published the paper did not require those conclusions to be revised
prior to publication.
Hence, even an excellent trial such as the Heart Protection Study could be substantially diminished if the authors of that trial had chosen to make inappropriate conclusions and if the editors of the journal that published the paper did not require those conclusions to be revised prior to publication.
Fortunately, the Heart Protection Study had excellent investigators, both in the formulation of their trial protocol and in the conclusions which they directly derived from the data.
The ALLHAT hypertension trial--A large trial suboptimally interpreted
The ALLHAT trial on the other hand, is a poster child for conclusions extending beyond the data in a large randomized trial.
The ALLHAT trial failings result primarily from the overextended and inappropriate conclusions. The trial treatment protocol specified specific blood pressure treatment regimens which had serious limitations in regards to substantially differing from the way hypertensive patients are currently treated by physicians.
Instead, the authors in their 2001 report made a sweeping statement that their trial results indicated that a diuretic should be the first drug used for the treatment of hypertension.
The advantage of this being a very large trial is that if this trial protocol was repeated for these particular suboptimal combinations of medication for this particular patient population, the same results would occur.
ALLHAT trial with a similar 100,000 patients rather than 30,000 patients would not make
the specific blood pressure
combinations studied more broadly applicable, though it would be expected to have
the same patient outcome. A
very large randomized trial only ensures reproducibility in that the same trial would
have similar results if repeated in the same fashion.
Hence, very large randomized clinical trials effectively deal with the issue of having adequate numbers for statistical significance. A large trial, however, does not guarantee that the treatment protocols being studied are good ones, nor does it guarantee that appropriate conclusions regarding the trial's outcome are made by the authors.
2. ALLHAT Officers and Coordinators for the ALLHAT Collaborative Research Group. Major outcomes in high-risk hypertensive patients randomized to angiotensin-converting enzyme inhibitor or calcium channel blocker vs. diuretic: the antihypertensive and lipid-lowering treatment to prevent heart attack trial (ALLHAT). JAMA 2002; 288: 2981-2997.
copyright 2005-2013 ImprovingMedicalStatistics.com