Does hospital mortality rise on weekdays? Possibly

Carl Heneghan

Carl Heneghan, Director CEBM

In this weeks BMJ, Fiona Godlee, asks important questions about who had access, and when they had access to a BMJ analysis published in 2015, which controversially stated increased hospital mortality is associated with weekend admissions. This issue is leading to considerable strain amongst juniors doctors, and questionable analyses are seemingly guiding flawed UK health policy.

What is concerning me, though, is the poor quality of the epidemiology, the lack of independent analysis and the thorough lack of engagement with the data. Therefore, I thought I would  show you how easy it is to torture the data and arrive at the opposite answer to the 2015 BMJ analysis.

Using the hospital admitted population as the denominator for mortality estimates leads to bias: confounding occurs due to the increased severity of those admitted on weekends. A bias known as selection bias. Changes in the number of people in the denominator admitted on any given day acts to inflate or deflate the mortality rate.  In the Freemantle analysis,  more patients with a higher predicted mortality risk are admitted at the weekend than those admitted during the week. However, from the paper: ‘the number of patients admitted to hospital during the working week (Monday to Friday) averaged 2.7 million a day, with an average of 1.2 million admitted on a Saturday and 1 million on a Sunday.

As a consequence,  the weekday mortality effect is deflated compared to the weekend effect, if hospital admissions are used as the denominator – take a look at the numerator/denominator bias if you want to learn more.

One way to remove selection bias is to use the population at large as the source denominator – they are not biased by selection.  Taking the data from Dr Sam Lewis’s rapid response to the original Freemantle BMJ analysis  – I don’t have access the raw data although this has been asked for   – we could equally infer there are too many healthy people being admitted in the week. The point Dr Lewis is trying to make.

By recalculating the % death rates using the source denomination population of England ( at the time 53,865,800), we observe the substantial increased number of deaths on weekdays as opposed to weekends (see the table.) and the relative impact, which shows how careful you have to be when interpreting associations. Indeed, if you look at the quoted figures in the Freemantle paper, you could argue the problem is too many healthy people are being admitted during the week.  Now where do you want to put your policy?

Died in hospital Didn’t die in hospital Source popn. % Died RR
Sat 10992 53854808 53,865,800 0.02041% 0.986
Sun 10696 53855104 53,865,800 0.01986% 0.960
Mon 11519 53854281 53,865,800 0.02138% 1.034
Tues 11429 53854371 53,865,800 0.02122% 1.026
Weds 11143 53854657 53,865,800 0.02069% 1.000 reference group
Thurs 11429 53854371 53,865,800 0.02122% 1.026
Frid 12272 53853528 53,865,800 0.02278% 1.101
Total 79480 376981120 377060600 0.02108%

 

Give us a few weeks with the real data and we could really do something at the Centre. What matters is not who saw what, when; but that we get the opportunity to see the data and get to work analysing it: epidemiology underpinning policy is far too important to be hidden behind closed doors.

As I have shown if you ‘torture the data’ sufficiently you can make the answer anything you want it to be.

 

 

Carl Heneghan

About Carl Heneghan

Carl is Professor of EBM & Director of CEBM at the University of Oxford. He is also a GP and tweets @carlheneghan. He has an active interest in discovering the truth behind health research findings and also blogs on Trust The Evidence at www.carlheneghan.com

View more posts by Carl Heneghan

One comment on “Does hospital mortality rise on weekdays? Possibly

  1. Thanks for this thought provoking analysis. It is interesting that from your analysis Friday comes up as highest mortality- this may be because GPs have been trying to sort people out during the week and for those deteriorating, they get admitted before the weekend? I wonder if the “hospital admitted population” data account for the fact elective admissions (weekdays mostly) are likely to have very low mortality? e.g. you might be coded as a “stroke” when you are admitted for a post stroke elective endarterectomy but are very unlikely to die during that admission-therefore using a population denominator does make much more sense. Large administrative datasets are fraught with problems such as these. I wonder if smaller high quality and more detailed studies would offer better insight into the truth and help us to design appropriate 24/7 care where it would truly be of benefit, or justify the need for a “7 day NHS”. In my experience as a junior doctor some inpatients get better care at the weekend as a consultant sees them all at least once and there is less distraction for doctors in outpatients/arranging procedures/investigations/discharge planning…

Leave a Reply

Your email address will not be published. Required fields are marked *