3.1 Recording and interpreting numbers in testing treatments
Email to someoneTweet about this on TwitterShare on FacebookPin on PinterestShare on LinkedIn

Cite as: The James Lind Library 3.1 Recording and interpreting numbers in testing treatments (http://www.jameslindlibrary.org/essays/3-1-recording-and-interpreting-numbers-in-testing-treatments/)


Numbers are needed to record the results of fair tests of treatments, and tables and graphs are used to describe the characteristics and experience of groups of patients, the treatment they have received, and quantitative estimates of treatment effects.

Using quantification in testing treatments

It was not until the early 18th century that numbers began to be used to assess the effects of medical interventions (Nettleton 1722a; 1722b; 1722c; Jurin 1724; and Huth 2005; Boylston 2010; Boylston 2012). This development occurred chiefly, but not exclusively, in Britain, Where it has been systematically studied (Tröhler 2010)  . In 1732, for example, Francis Clifton published a book entitled The state of physick, ancient and modern, briefly considered: with a plan for the improvement of it (Clifton 1732). Clifton pointed out that, instead of assessing the worth of therapies by whether they accorded with theories, physicians needed to base their judgements about the effects of treatments on a sufficient number of their own (or otherwise testified) observations, organised in tables. A series of authors emphasised similar principles throughout the 18th century. Quantification began in the 1720s with comparisons of death rates following variolation (inoculation) with those associated with the disease itself, establishing the relative safety of the former. In this field, numbers were used throughout the century in various European countries, and they played a role in the introduction of vaccination around 1800. By then numerical data had become an important criterion for assessing new therapies in surgery and medicine (Tröhler 2010).

Using tables and graphs to present treatment comparisons

In the British Army, John Rollo (1781) may have been the first to use tables to give a detailed account of all the cases he had treated in a military hospital in Barbados. When he became chief of the Hospital of the Ordnance (artillery) at Woolwich, he published a hospital report based on the same principles (Rollo 1801). Richard McCausland (1783) published his comparative studies of various treatments for intermittent fevers in statistical tables (Maehle 2011). Thomas Dickson Reide’s (1793) View of the diseases of the Army was full of tabular compilations and arithmetical calculations, as were James McGrigor’s reports (1801; 1815). Numerical data were quite often used to calculate simple ratios. For example, William Falconer (1807) calculated success:failure ratios to compare the results of his practice in Bath with those published earlier by Rice Charleton (1770).

Replacing certainties with probabilities

What were the motives for quantifying and tabulating oberservations? What were the numbers intended to convey? The title and the place of publication of a work by George Fordyce provide an initial answer: An attempt to improve the evidence of medicine (Fordyce 1793), published in the Transactions of a Society for the Improvement of Medical and Chirurgical Knowledge. Quantification of experience aimed at “increasing the certainty of medicine.” John Millar (1798) observed that “Where mathematical reasoning can be had, it is a great folly to make use of any other, as to grope for a thing in the dark, when you have a candle standing by you”; and his dispensary-physician colleague William Black (1789) noted that: “However it may be slighted as an heretical innovation, I would strenuously recommend Medical Arithmetick as a guide and compass through the labyrinth of therapeutick.” Reide (1793) justified this approach using a simple analogy:” How ridiculous would it appear [for a merchant] to judge of the advantages or disadvantages of particular branches of commerce from reasoning and conjecture whilst the result can be reduced to certainty be keeping regular accounts, and balancing them at stated periods.”

Methodological questions were indeed eagerly debated in 18th century British medicine. Among the issues there was that of certainty versus the slowly growing notion of statistical probability. In 1772, for example, James Lind, then chief of the 1000-bed Haslar Navel Hospital, summarized the transition from belief in an absolute authority to reliance on relative statistics: “A work indeed more perfect, and remedies more absolutely certain might perhaps have been expected from an inspection of several thousand…patients.“ But even such facts always remained partial in his view, and he concluded with the remarkable insight that “for though they may for a little, flatter with hopes of greater success, yet more enlarged experience must ever evince the fallacy of all positive assertions in the healing art” (Lind 1772, p v-vi).

More outspokenly, John Haygarth, with the help “of an ingenious friend, Mr Dawson, a truly mathematical genius”, calculated probabilities of escaping infection by ‘continuous fever’ or smallpox. On the basis of results “computed arithmetically by the doctrine of chances, according to the data”, he advocated the immediate isolation of smallpox and fever patients in specific wards in Chester (Haygarth 1784, p 26-28).

Interpreting numbers

With the availability of more and more numerical data, numbers began to be pitted against numbers at the beginning of the 19th century. How did people judge whether treatment comparisons were trustworthy and meaningful? For example, during the debates about bloodletting for the treatment of fevers around 1800, statistics were widely used on both sides. It became clear that these data needed interpretation. In 1813, Thomas Mills had re-introduced copious bloodletting and purging at the Dublin Fever Hospital. The statistics comparing his mortality rates with those of other physicians who had hardly used bloodletting were reprinted in the review of his Essay on the utility of blood-letting in fever (Mills 1813). This elicited the following comment:

presuming….these are candid and correct statements, we may deem them potent arguments in favour of the advantages of the anti-phlogistic [bloodletting and purging] treatment of fever (Edinburgh Medical and Surgical Journal 1813).

Besides the issue of honesty the question of bias was raised, of the need to compare the comparable. For instance, the Monthly Review wrote that Mills’ work left “a rather painful impression on our minds,” for these impressive results might be explained by the type of patients treated by Mills rather than by the therapy he had applied (Monthly Review 1814, p314). This issue was also raised in relation to interpreting statistics about the timing of amputation (immediate vs. delayed), and comparisons of treatments for fever in the Army and Navy (Edinburgh Medical and Surgical Journal 1813, p 458-459).

A writer in the Edinburgh Medical and Surgical Journal in 1813 stressed that, if one could assume the data to have been honestly assembled and presented by both sides, the only way out of the maze would be through “extensive comparative experiments” (Edinburgh Medical and Surgical Journal 1813).

During the 19th century there was gradual recognition that it is important to record the extent of uncertainty associated with estimates of treatment differences. In particular, Jules Gavarret, a mathematically inclined Parisian physician, pointed out the need to analyse treatment comparisons of sufficient size and to calculate the ‘limits of oscillation’ associated with statistical estimates of treatment differences (Gavarret 1840). However, this practice did not really become widely adopted until the second half of the 20th Century (see Explanatory Essay 3.2).

< Previous Essay | Next Essay >

The text in these essays may be copied and used for non-commercial purposes on condition that explicit acknowledgement is made to The James Lind Library (www.jameslindlibrary.org).

References

Black W (1789). An arithmetical and medical analysis of the diseases and mortality of the human species. London: J Johnson.

Boylston AW (2010). Thomas Nettleton and the dawn of quantitative assessments of the effects of medical interventions. JLL Bulletin: Commentaries on the history of treatment evaluation (www.jameslindlibrary.org).

Boylston AW (2012). Defying providence: smallpox and the forgotten 18th century revolution.

Charleton R (1770). An inquiry into the efficacy of warm bathing in palsies. Oxford: Clarendon.

Clifton F (1732). The state of physick, ancient and modern, briefly considered: with a plan for the improvement of it. London printed by W Bowyer, for John Nourse without Temple-Bar, 1732.

Edinburgh Medical and Surgical Journal (1813);9:458-459.

Falconer W (1807). A practical dissertation on the medicinal effects of the Bath waters. London and Bath: Robinson & Crutwell.

Fordyce G (1793). An attempt to improve the evidence of medicine. Transactions of a society for the Improvement of medical and chirurgical knowledge. London: J Johnson.

Gavarret LDJ (1840). Principes généraux de statistique médicale: ou dèveloppement des règles qui doivent provider à son emploi. Paris: Bechet Jeune & Labé.

Haygarth J (1784). An inquiry on how to prevent the small-pox. Chester and London: Monk and Johnson.

Huth EJ (2005). Quantitative evidence for judgments on the efficacy of inoculation for the prevention of smallpox: England and New England in the 1700s. JLL Bulletin: Commentaries on the history of treatment evaluation (www.jameslindlibrary.org).

Jurin J (1724). A letter to the learned Dr. Caleb Cotesworth, F. R. S. of the College of Physicians, London, and physician to St. Thomas’s Hospital; containing a comparison between the danger of the natural small pox, and that given by inoculation. Philosophical Transactions of the Royal Society of London (1722 – 1723), 32:213-227.

Lind (1772). A treatise of the scurvy. In three parts. Containing an inquiry into the nature, causes and cure, of that disease. Together with a critical and chronological view of what has been published on the subject. (Third Edition) London: Printed for S Crowder, D Wilson and G Nicholls, T Cadell, T Beket and Co.

Maehle A-H(2011). Four early clinical studies to assess the effects of Peruvian bark. JLL Bulletin: Commentaries on the history of treatment evaluation (www.jameslindlibrary.org).

McCausland R (1783) . Facts and observations on different medical subjects. Medical Commentaries viii (1781/82), 247-96.

McGrigor J (1801). Account of diseases of the 88th Regiment, during their passage to India, and at Bombay, from December 1798 till June 1800. Annals of Medicine, vol I Lustrum II, 1:353-369.

McGrigor J (1815). Sketch of the medical histories of the British Armies in the Peninsula of Spain and Portugal, during the late campaigns. Med.-chir. Trans. 6:381-489.

Millar J (1798). Observations on the conduct of the war. An appeal to the people of Great Britain. London: for the author.

Mills T (1813). An essay on the utility of bloodletting in fever. Dublin : J. Barlow for Gilbert and Hodges, London: Longman, Hurst, Rees, Orme and Brown.

Nettleton T (1722a). A letter from Dr. Nettleton, physician at Halifax in Yorkshire, to Dr. Whitaker concerning the inoculation of the small pox.. Phil. Trans. 32, 1722 No. 370. p 35-48. Also published as an Account of the success of inoculating the small-pox in a letter to Dr. William Whitaker. Printed by S. Palmer for J. Batley London.

Nettleton T (1722b). A letter to James Jurin dated June 16, 1722. Published as part of a letter from Dr. Nettleton Physician, a letter from the same learned and ingenious gentleman concerning his further progress in inoculating the small pox. Philosophical Transactions, vol. 32, 1722 no. 370. p 49-52. Original in Royal Society Archives, Early Letters vol 1.

Nettleton T (1722c). Part of a letter from Dr. Nettleton, physician at Halifax, to Dr. Jurin, R.S. Secr. Concerning the inoculation of the smallpox, and the mortality of that distemper in the natural way. Philosophical Transactions of the Royal Society of London. 32:209-212.

Reide TD (1793). A view of the diseases of the Army in Great Britiain, America, the West Indies and on board of King’s ships. London: Johnson.

Rollo J (1781). Observations on the diseases which appeared in the Army on St Lucia…, Barbados. Orderson for the author.

Rollo J (1801). A short account of the Royal Artillery Hospital at Woolwich. London: Mawman.

Tröhler U (2010). The introduction of numerical methods to assess the effects of medical interventions during the 18th century: a brief history. JLL Bulletin: Commentaries on the history of treatment evaluation (www.jameslind.library)