Brian Baker
Published originally 10.18.18 on The Doctor Weighs In
Most of us don’t think twice about getting on a commercial airline. The odds of dying on even the worst 39 airlines is 1 in 1.5 million or a .0000006% chance of death. This is more than five times better than Six Sigma quality (defect levels below 3.4 per million).
In a 2012 study published by The Lancet, mortality rates for surgery, up to two months post care, are 3.6%. Obviously, this is far from Six Sigma quality. Meanwhile, surgery volumes and outcome data are not publicly available to study.
Global tracking procedures
Remember the Malaysian Air Flight 370 that disappeared March 2014 killing 239 people? The global airline industry responded by augmenting global tracking procedures improved to mitigate similar future tragedies.
This is an example of an industry learning from failure and applying new standards to improve outcomes. We can learn something here.
Tracking time to fail
A friend mine called to offer a sunset test ride in a Learjet 45. He’s the Captain for Caterpillar Aviation with over 14,000 hours flying all types of aircraft – even acrobatics. This is a hot rod of an airplane. It can do zero to rotate in only a few seconds and is capable of 535 MPH or 81% the speed of sound.
Earlier that week, a pre-flight check identified a warning indicator. The landing gear and back-up aileron hydraulics showed a pending failure in 20 operational hours.
The Learjet has an information system so thorough, connected, and well programmed that it tracks the time to failure for all critical flight systems based on historical failure. The flight crew is alerted when components are due for replacement before they actually fail – which could be in flight.
Bombardier, the manufacturer of the Learjet, collected data and programmed what it learned about critical failures into their systems. They have also created a live indicator. Their goal was to have a great outcome: flight safety.
A critical failure live indicator
In this case, the parts were inexpensive brushes in a motor that drives a hydraulic pump. Sometimes the smallest things, combined with experience, have the potential for a large impact on quality.
Standard FAA quality procedures mandate that following maintenance on critical systems, a non-commercial test flight must be made. The fuel for the test flight cost more than the brushes. But the ride at sunset was a beautiful thing – lucky me!
Just like the flight system algorithms and indicators removed the impractical work of checking brushes before each flight, well-programmed healthcare algorithms, starting with structured historical data can do the same. An oncology project proved it. I’ll get to that in a bit, but first, more about data.
Time to fail: What healthcare can learn from airplanes
Have you ever heard of dirty data? In a paper published by Datamark, analysts from Merrill Lynch, Gartner and IBM agreed that between 60% and 80% of health data is unstructured.
It is referred to as “dirty data” meaning it’s not in a defined field like name, address, city, state or zip. Unlike defined fields, unstructured data cannot be easily sorted and mined. It includes physician notes and impressions, a paragraph in the EMR from the nurse, or even an image.
In addition, data in healthcare are not interoperable or translatable between systems. Unfortunately, not much interfaces with much else. Instead, there are disparate, unconnected systems and uncommon languages.
Natural language processing
Natural language processing (or NLP) technology interprets spoken or written language. The limitation lies in its inability to semantically distinguish true meaning or lexicon.
For example, words might say “this is the third time I ordered this meal.” Does that mean you were so pleased in the past you came back and ordered the same thing two more times? Or, does it mean you’ve placed your order three times and still don’t have it?
Advancing to natural language understanding or NLU is the next step to contextual, semantic understanding of unstructured data. Development is underway in companies like Digital Reasoning and Cicayda who analyze e-documentation in legal reviews and discovery.
Progress Using Defined Data
Working with a very large oncology group, we studied drug utilization appropriateness against patient outcomes. We looked at about 300,000 encounters over 2 years.
The lead oncologist, who is both brilliant and humble, wanted to know what was going to happen to patients before they treated them. Looking at the impact of oncology drugs was a great place to start.
Using defined non-Personal Health (Patient) Information (PHI), prescription orders from four different EMR systems and lab results, we programmed the EMR detail data against drug manufacturer’s guidelines.
Failure to follow guidelines
Forty-one percent of the time, drug utilization fell outside guidelines, including
- too much drug used,
- not enough drug used
- drugs prescribed with the wrong timing.
The impact on patients, measured through outcomes (e.g. blood work) revealed the results. The financial impact of inappropriate use was easier to score at $16 million.
Failure analytics and the future of healthcare
The algorithm for the oncology equation worked. It consolidated the collective training and experience of physicians and scientists encapsulated in one place making for easy reference and guidance against real data from disparate systems.
This is the first step toward an automated indicator of future quality, using historical outcomes to guide treatment decisions.
In a directionally similar step, Medicare has mandated medical imaging begin using Clinical Decision Support tools January 1, 2021.
This mechanism uses past treatment efficacy to advise clinicians to the most appropriate procedure. While it uses static unconnected data, it’s a good start. It provides guidance to help those busy ER docs order the right exam.
Let the evidence guide us
We must transform practice (try this) into science (know).
Health data challenges are complex but can be overcome with planning, communication, and strategy.
“Processes and standards should be driven by evidence and outcomes”
This is the direction in which we need to be pointed.
Let’s start by using consolidated historical data from clinical information (not just claims data) combined with the collective experience of clinicians to inform better clinical decisions and not just create post-encounter reports.
Augmented intelligence is needed
Capable technology that can accept disparate defined data is proven. More complex, but also proven is capturing the subject matter expertise of clinicians in algorithms.
Combining data and automating functions can produce active, stratified, evidence-driven guidance. No artificial intelligence here.
Augmented Intelligence, rather than artificial intelligence, is a more accurate representation. It distills the details of every encounter, treatment, and outcome to guide future treatment. It does this by consolidating the experiences of many and sharing it as universal guidance easily stratified by user preference. This approach will drive quality outcomes and value.
Honeybees
A bee swarm is a force to be reckoned with. Working in the yard the day after my ride in the hot rod Learjet ride, I enjoyed the full wrath of one.
After the fired-up little bees got under my clothes, they succeeded in stinging me in all sorts of unimaginable locations. It was a display of amazing coordination.
I’m lucky I don’t have an allergy to bee stings and am thankful for 100mg of Benadryl. The point is that the smallest things, when coordinated with great communication, can have a fierce impact on change.
These small creatures are a great illustration of the power of aligned goals with common communications and a strategy, produced an effective force that drove away perceived danger.
The bottom line
The current trajectory of healthcare indicates that we will miss our flight safety targets if we don’t get to work…starting with the small things. While public transparency and automated clinical risk indicators from common data remain elusive, the good news is, progress is taking place, albeit often in silos