Systematic Review: When Studies Disagree, Which Treatment Should We Trust?

Systematic Review

Example Case

A 46-year-old office worker visits the clinic with recurring shoulder discomfort.

The client has tried several treatments, each providing temporary relief. However, the pain continues to return.

“I’ve been reading about shoulder pain online. One study says massage helps, another recommends exercise, and someone else says stretching is the answer. They all claim to be based on research. So, which one should I actually believe?”

Instead of immediately recommending another technique, the therapist considers a different question.

What does the overall scientific evidence actually tell us?

This is where a systematic review becomes useful.

Subjective Symptoms

The client reports:

  • Recurring shoulder pain
  • Temporary relief following treatment
  • Discomfort during certain activities
  • Uncertainty about treatment choices
  • Frustration with conflicting health information

Interestingly, the problem is no longer just about pain. The client also wants to understand which treatment has reliable evidence behind it.

What It May Feel Like

When searching for health advice, people often encounter:

  • Different treatments claiming similar benefits
  • Conflicting research findings
  • Promising results from small studies
  • Recommendations based on personal experiences
  • Uncertainty about long-term effectiveness

As a result, choosing an appropriate treatment can become confusing. However, one positive study does not necessarily establish that a treatment works.

Objective Findings

During clinical assessment, the therapist may identify:

  • Pain during particular shoulder movements
  • Reduced movement tolerance
  • Local muscle tenderness
  • Changes in strength or function
  • Activities that repeatedly aggravate symptoms

These observations help clarify the client’s condition. Nevertheless, assessment alone cannot establish which treatment is generally most effective. That requires examining the available research.

*********

What Could It Be Related To?

A systematic review collects and evaluates relevant studies to answer a clearly defined research question.

Rather than selecting a few favourable results, researchers follow a structured process:

  1. Define a specific research question.
  2. Search for relevant studies systematically.
  3. Apply predetermined selection criteria.
  4. Evaluate study quality and risk of bias.
  5. Compare and synthesise findings.
  6. Assess how confident we can be in the conclusions.

Sometimes, researchers also perform a meta-analysis, combining numerical results from compatible studies. However, not every systematic review includes a meta-analysis.

More importantly, a systematic review is only as trustworthy as its methods and the evidence it includes.

Why might research findings disagree? Possible explanations include:

  • Different participant characteristics
  • Different treatment techniques or dosages
  • Small sample sizes
  • Differences in outcome measurements
  • Short follow-up periods
  • Risk of bias
  • Differences in the conditions being studied

For example, a treatment may improve pain temporarily without producing meaningful long-term functional improvement. Meanwhile, another intervention may require more time before benefits become noticeable.

Therefore, asking whether a treatment works is not enough. We must also ask for whom, how much, compared with what, and for how long.

When interpreting a systematic review, the therapist should consider:

  • Does the research match the client’s condition?
  • Were appropriate studies included?
  • How reliable were the research methods?
  • Were the treatment benefits clinically meaningful?
  • Were possible harms considered?
  • How certain are the overall findings?

These questions connect scientific evidence with clinical reasoning. After all, evidence is valuable only when it can inform an appropriate decision.

Returning to the client’s shoulder pain, the therapist can use the available evidence to guide management. This may involve:

  • Identifying the most likely clinical problem
  • Discussing supported treatment options
  • Explaining expected benefits and limitations
  • Considering the client’s goals and preferences
  • Selecting suitable exercises or other interventions
  • Monitoring pain, movement and daily function
  • Adjusting treatment based on reassessment

Importantly, a systematic review does not replace clinical judgement. Instead, it helps clinicians combine research evidence, professional expertise and the individual’s circumstances.

How Does It Usually Recover?

A systematic review does not directly heal an injury. However, it can help identify interventions that are more likely to improve meaningful outcomes and those with limited or uncertain benefits. For our client, recovery will depend on the actual shoulder condition, contributing factors and response to appropriate care. Over time, progress may involve:

  • Less pain during normal activities
  • Improved shoulder movement
  • Greater strength and load tolerance
  • Reduced dependence on temporary symptom relief
  • Confidence in returning to normal routines

Nevertheless, improvement should be measured through real changes in symptoms and function, rather than assumptions based on research findings alone. Good evidence guides the decision. The client’s response helps determine what happens next.

Your Body Talks. Learn to Listen.

One study may offer a possibility. Several studies may reveal a pattern. But stronger evidence comes from examining the whole picture, including its limitations.

Don’t just follow the research that sounds promising. Learn to question the evidence behind it.

Ask it. Even if you think it’s a ridiculous question.
Someone else has probably wondered exactly the same thing.

Leave a Reply

Your email address will not be published. Required fields are marked *