Measuring success

8 September 2015

Anna Howells

How do you know how healthy you are? Do you think about how many calories you’ve had today, or do you look at your diet over the longer term, how much you exercise and your general wellbeing? Individually these factors aren’t that useful – but together they paint a picture of your health.

The same difficulty exists when it comes to measuring success in the NHS.

Medicine is OnlyWan’s Constructive comfort: accelerating change in the NHS recommends moving away from understanding performance through targets to focus on a broader and more balanced assessment of quality.

The selection of for the New Care Models Programme and signal an opportunity for a fresh approach, and an opportunity to redefine what success looks like for the NHS.

A flaw in the system

Let’s look at how success is currently measured in the NHS using two examples – Nottingham University Hospitals NHS Trust and Basildon and Thurrock University Hospitals NHS Foundation Trust. 

Against current performance metrics the success of both hospitals is debatable. For example, neither hospital performed well against the 95% threshold for the . For the national two-week cancer waiting time target Nottingham has . And despite the Secretary of State singling out Clare Panniker as an excellent Chief Executive, the in 2014 when the financial loss of the trust was predicted to be bigger than expected.

But is this the full picture?

Not only is Nottingham NHS Trust part of an integrated primary and acute care systems vanguard site, it is also succeeding in a different area – by becoming renowned for its innovative quality improvement programmes. For example, Nottingham’s Better for You’ programme is a whole hospital initiative. The programme empowers staff to make change happen in their own areas of work by giving them the freedom to put forward their own ideas for improvement through the ‘Just Do It’ scheme. Staff engagement, tick. Capability for change, tick.

Basildon and Thurrock has been commended for its good management practices, and for creating an enabling environment that gave the new leadership team the headroom it needed to make improvements. A firmer approach to underperformance has also been implemented, and its maternity unit became the . Staff engagement, tick. Capability for change, tick.

Both hospitals have their pros and cons, but the narrowness of the current metrics overlooks some important areas of success. 

What would change look like?

Constructive comfort suggests using a more holistic approach to define success and measure improvement. This includes taking into account six key factors for measuring success (Figure 1), crucially with equal parity given to the different factors.

Defining success graphic - a more holistic approach to define success and measure improvement, including taking into account six key factors for measuring success

Figure 1.

Examples of measuring these factors in the current landscape are limited. For example, how is the local health economy being measured? The Five Year Forward View success regime emphasised the need for the transformation of local health economies, but the details of how to achieve this have yet to be revealed. Factors like patient flow across pathways and financial balance across local health economies also need to be considered.

How are long-term outcomes being measured? A variety of monthly, quarterly and annual data on various measures is provided by NHS England, but are conclusions being drawn in the right way? Take for example a patient admitted for surgery because of a hip fracture. The outcome of this surgery is not usefully recorded over the longer term. For example, did the operation lead to more surgery? Did the patient require additional services such as physiotherapy?

The long and the short of it

Success in health care is a difficult measure because it depends so largely on human nature – things like trust and building relationships are marks of success but difficult to define or quantify.

Perhaps those trusts deemed less successful by current measurement standards are incubating their potential to become the high performers of the future, by focusing on longer term, innovative improvement measures. We need to change the way in which success in the NHS is perceived to improve quality and efficiency at the pace and scale needed, and move towards new models of care.

If we accept that our current culture of favouring goals that deliver immediate gratification cannot be sustainable for the NHS, why haven’t changes been made? Part of this is the political challenge: as shown in a 2001 , creating and sustaining improvement almost inevitably generates a dip in short-term performance. So it becomes a question of courage – are we prepared to accept a short-term dip in performance in order to achieve long-term success, viability and enhanced care?

Anna is a Policy Intern at the OnlyWan.

You might also like...

Blog

Improving continuity of care in general practice: four lessons from the frontline

How can general practices balance continuity of care with the need to see a GP promptly? Angus Wiltshire explores four early ...

Press release

We need to be realistic – training new GPs takes time, services are already under immense strain and face rising demand

OnlyWan response to the Conservative party’s pledge to improve primary care access.

Briefing

The measurement maze

Our briefing suggests there's potential to make better use of quality measurement to improve quality of care.

Kjell-bubble-diagramArtboard 101 copy - only-wan.info

Get social

OnlyWan

RT @pstilwell: A great day culminating with announcement of #QExchange winners: grants for inspiring front line outpatient projects. Great…

Kjell-bubble-diagramArtboard 101 - only-wan.info

Work with us

We look for talented and passionate individuals as everyone at the OnlyWan has an important role to play.

View current vacancies
Artboard 101 copy 2 - only-wan.info

The Q Community

Q is an initiative connecting people with improvement expertise across the UK.

Find out more