Jefferson T (2006). Why the MRC randomized trials of whooping cough (pertussis) vaccines remain important more than half a century after they were done.
Email to someoneTweet about this on TwitterShare on FacebookPin on PinterestShare on LinkedIn

© Tom Jefferson, Via Adige 28a, 00161 Anguillara Sabazia (Roma), Italy. Email: toj1@aol.com


Cite as: Jefferson T (2006). Why the MRC randomized trials of whooping cough (pertussis) vaccines remain important more than half a century after they were done. JLL Bulletin: Commentaries on the history of treatment evaluation (http://www.jameslindlibrary.org/articles/why-the-mrc-randomized-trials-of-whooping-cough-pertussis-vaccines-remain-important-more-than-half-a-century-after-they-were-done/)


Background: earlier studies of pertussis vaccination

During the late 1920s and early 1930s statistics published by the League of Nations (1934) made clear that whooping cough (pertussis) was an increasingly important cause of childhood mortality. Scientific interest in preventing the disease had begun in France in 1913 when Charles Nicolle began developing a series of whooping cough vaccines (Nicolle and Conor 1913). These vaccines produced inconsistent results, however, and it was not until the late 1920s that Danish researchers (Madsen 1933) developed a new generation of vaccines based on whole, killed pertussis bacteria, spun by centrifuge and partly purified. Between the mid-1930s and mid-1940s several field studies of this second generation of vaccines were conducted (Doull et al 1936; Harrison et al. 1938; Kendrick and Elderling 1939; Bell 1941; Kendrick 1942; McFarlan et al. 1945). These studies also yielded widely differing estimates of vaccine efficacy, however. In an early cohort study done in the Faroe Islands, Madsen reported that the proportion of vaccinated individuals protected ranged from 94 to 24 per cent (Madsen 1933). Other estimates of the proportion protected ranged from 80 per cent (Kendrick and Elderling 1939) to only 11 per cent (McFarlan et al. 1945).

These varying estimates in vaccine performance had at least two possible explanations. They might have reflected either differing manufacturing processes, or variations in the methodological rigour of the studies: for example, while Doull et al (1936) had used alternation to generate comparison groups and McFarlan et al (1945) had expressed concern about possible observer biases, Bell (1941) had conducted an exemplary randomized trial with several measures taken to prevent biased assessments of outcome (Chalmers 2010).

The Medical Research Council Trials

Despite more than a decade of intensive assessment of different formulations of whooping cough vaccines, the question of the field effectiveness of the vaccines remained inadequately answered. It was against this background that the Whooping Cough Immunisation Committee of the Medical Research Council decided to do ten randomized field trials of different formulations of whole-cell, killed, pertussis vaccines (MRC 1951). The studies were done between November 1946 and April 1948 and involved four vaccines in six batches (produced by Parke Davis Ltd, Glaxo Laboratories and the Michigan Department of Health) and a placebo (a “catarrhal vaccine” produced by Burroughs Wellcome Ltd).

The MRC studies were carried out in London, Manchester and Leeds after a publicity campaign inviting participation. After signed consent had been received from their parents, eight thousand nine hundred and twenty seven children aged 6 to 18 months with no previous history of whooping cough or pertussis vaccination were initially included. Table II in the paper records the numbers of children in the vaccine and control groups who (i) were excluded before completion of inoculations; (ii) received the full course of inoculations; (iii) were excluded during follow up; and (iv) remained for analysis at the end of the follow–up period.

After classification by sex and age, the children were allocated to one of four groups. For each age and sex group, sheets had previously been drawn up on which the letters A, B, C and D in random order (using a system of cards) were repeated a sufficient number of times to deal with all the expected numbers of volunteers. On arrival at the clinics, the children were inoculated (mainly by intramuscular injections) with material from a bottle with the appropriate letter.

These precautions taken to prevent foreknowledge of allocations was reflected in comparison groups with very similar characteristics (as shown in Table III in the paper). Care was also taken to reduce observer bias among those assessing outcomes:

Although four vaccine letters were used, two of them in fact indicated the pertussis vaccine being tested in the trial and the other two the ‘anti-catarrhal’ vaccine. It was thought that by employing this method field-workers would be less likely to distinguish the pertussis vaccine from the ‘anti-catarrhal’ vaccine. As the early trials progressed it became evident that more cases of pertussis were occurring in children inoculated with vaccines A and C – the ‘anti-catarrhal’ vaccines – than in children with vaccines B and D – the pertussis vaccines. There was also some difference in the incidence of slight inoculation reactions between the pertusssis and ‘anti-catarrhal’ vaccines. To ensure, therefore, that follow-up observations remained unbiased, the vaccine letter on each record card was covered by a thick label until the end of the investigation or until the duration or severity of an attack of pertussis had been recorded on the card.

Follow-up was for between 2 and 3 years (27 months on average). Surveillance was carried out by teams each consisting of a doctor, a nurse and a clerk, as well as by parents, using a system of pre-paid envelopes. Exposure to the disease was reported as at “home” or “other”, and the data were reported in these categories. Cases of pertussis were defined as a cough with positive culture, and 806 out of 836 suspected cases were confirmed in this way. Data on disease severity were also reported, using duration of cough (in weeks), number of paroxysms in 24 hours, and the presence of respiratory complications. One child in five was visited within 72 hours post-immunisation to assess adverse effects.

The authors of the report concluded that, despite notable variability in effectiveness, all of the vaccines tested afforded considerable protection. The vaccine that performed best was the Michigan Health Department’s product. The only adverse effects reported were six sterile abscesses in recipients of alum-precipitated vaccines.

The enduring importance of the MRC whooping cough vaccine trials

The MRC pertussis vaccine trials are important not only in the history of randomized, placebo controlled trials, but also in the history of vaccine assessment. The results showed that all the available whole-cell vaccines were significantly more effective than placebo against pertussis. However, there are two nearly forgotten related spin-offs from these trials.

First, the trials and subsequent follow-up work (Standfast 1958) confirmed that the mouse protection test, introduced in the USA in the 1940s, was adequate to assess the minimum required potency of whole-cell pertussis vaccines. The mouse protection test is a potency assessment based on the capacity of the vaccine to protect a mouse from direct intra-cerebral challenge with virulent pertussis micro-organisms (Kendrick et al. 1949). Confirmation of the reliability of the mouse protection test enabled the MRC to set a minimum quality standard for assessing such important vaccines.

Second, however, although the mouse protection test was a good predictor of vaccine performance against placebo, it could not adequately distinguish the differential effectiveness of different vaccines used in the field, in children. The MRC trials showed that the effectiveness of vaccines as measured in children varied from manufacturer to manufacturer, from 61 to 89 per cent (Figure; and Jefferson et al. 2003). The practical consequences of these findings are that (i) it is difficult to forecast the field performance of any whole-cell pertussis vaccine without randomized placebo controlled trials using clinical outcome measures; and (ii) it is impossible to extrapolate from the result of an assessment of one type of whole-cell vaccine to reliable assessments of the effects of another vaccine.

The practical implications of these conclusions were largely forgotten until the 1980s (Fine and Clarkson 1987), when ‘breakthrough epidemics’ of whooping cough in vaccinated populations and questions about the safety of whole-cell vaccines led to the development of modern acellular vaccines. Most developed countries are now using acellular vaccines, but countries that persisted until recently in using whole-cell vaccines that had never been tested against placebo face the possibility of further pertussis-related disease. For example, 37 per cent of immunised school age children in Britain presenting with a cough lasting two weeks or more have serological evidence of recent B. pertussis infection (Harnden et al. 2006). Had the lessons of the MRC pertussis vaccine trials been fully understood and implemented, no whole-cell pertussis vaccine would have been introduced without evidence from placebo-controlled field evaluations.

The failure to grasp this lesson has probably resulted in substantial potentially avoidable morbidity and mortality in so-called ‘breakthrough epidemics’ occurring in populations vaccinated with whole-cell vaccines of low field effectiveness. As exemplified by the MRC pertussis vaccine trials, what matters most in assessing the effects of vaccines is reliable evidence on their effects on outcome measures that are of importance to the people vaccinated, not just their effects on antibody responses in vitro, or in animals.

table

Figure. Meta-analytical representation of the effectiveness of whole-cell vaccines against pertussis (wP) reported in the 1951 MRC trial. The detected heterogeneity is due to different vaccine effectiveness, as population, background risk and study design are the same for all vaccine arms. Based on: Jefferson et al. 2003.

This James Lind Library commentary has been republished in the Journal of the Royal Society of Medicine 2007;100:343-345. Print PDF

Acknowledgements

I am grateful to Harry Marks for references to the early development of pertussis vaccines.

References

Bell JA (1941). Pertussis prophylaxis with two doses of alum-precipitated vaccine. Public Health Reports 56:1535-1546.

Chalmers I (2010). Joseph Asbury Bell and the birth of randomized trials. In: The James Lind Library (www.jameslindlibrary.org).

Doull JA, Shibley GS, McClelland JE (1936). Active immunization against whooping cough: interim report of the Cleveland experience. American Journal of Public Health 26:1097-1105.

Fine PEM, Clarkson JA (1987). Reflections on the efficacy of pertussis vaccines. Reviews of Infectious Diseases 9:866-83.

Harnden A, Grant A, Harrison T, Perera R, Brueggeman A, Mayon-White R, Mant D (2006). Whooping cough in school age children with persistent cough: prospective cohort study in primary care. BMJ 333:174-7.

Harrison WT, Franklin JP, Bell JA (1938). Prophylactic value of a single dose of precipitated pertussis vaccine. Public Health Reports 53:793-796.

Jefferson T, Rudin M, Dipietrantonj C. (2003). Systematic review of the effects of DTP vaccines in children. Vaccine 21:2012-2023.

Kendrick PL (1942). Use of alum-treated pertussis vaccine, and alum-precipitated combined pertussis vaccine and diphtheria toxoid, for active immunization. American Journal of Public Health 32:615-626.

Kendrick P, Eldering G, Borowski A (1939). A study in active immunization against pertussis. American Journal of Hygiene 29 Sec. B:133-153.

Kendrick P, Updyke. EL, Eldering G (1949). Comparison of pertussis cultures by mouse protection and virulence tests.  American Journal of Public Health 39:179-184.

League of Nations (1934). Relative importance of the principal infectious diseases of childhood (diphtheria, scarlet fever, whooping-cough and measles). Epidemiological Report No. 173, Table III.

Madsen T (1933). Vaccination against whooping cough. JAMA 101:187-8.

McFarlan AM, Topley E, Fisher M (1945). Trial of whooping-cough vaccine in city and residential nursery groups. BMJ 2:205-208.

Medical Research Council (1951). The prevention of whooping-cough by vaccination. BMJ 1:1463-71.

Nicolle C, Conor A (1913). Vaccinothérapie dans le coqueluche. Comptes rendus de l’Academie des Sciences de Paris 16:1849-1851.

Standfast AF (1958). The comparison between field trials and mouse protection tests against intranasal and intracerebral challenges with Bordetella pertussis. Immunology, Oxford 1:135-43.