GxP Insights

Deviation & CAPA Trend Analysis: KPIs and QRM (ICH Q9/Q10)

How to set up trend analysis and KPIs for deviations and CAPA: dashboards, thresholds, escalation, Management Review and PQS integration according to ICH Q9/Q10.

A Aldo Xhango 7 min read
✓ Official sources and references ✓ Practical approach ✓ For pharmaceutical professionals
GUIDEGXP · PRACTICAL GMP INSIGHTS
Trend Analysis Deviazioni & CAPA: KPI e QRM (ICH Q9/Q10)

Deviation & CAPA Trend Analysis: KPIs and QRM (ICH Q9/Q10)

Trend Analysis for Deviations and CAPA: KPIs, Dashboards and Quality Risk Management

If you manage deviations one by one, you are putting out fires.

If you analyse them as a system, you are doing prevention.

And today, inspectors — both EU and FDA — are increasingly moving in this direction: they do not only want to see “closed records”; they want to see that you can connect events, decisions and outcomes.

In practice, they want to see that your Pharmaceutical Quality System (PQS) is learning.

Table of Contents

  • Why trending is truly a maturity requirement
  • What to trend: minimum set and advanced set
  • Data taxonomy: without consistent classifications, trending does not exist
  • Practical methods: Pareto, thresholds and control mentality
  • When a trend becomes a CAPA
  • Integration with the PQS: Management Review, PQR and Change Control
  • How to present trends during an audit without hurting yourself
  • Ready-to-use KPI pack: list and definitions
  • FAQ on trending and QRM
  • Do you want to connect trends, decisions, CAPA and effectiveness?

1. Why trending is truly a maturity requirement

A single deviation tells a story.

Fifty deviations tell the reality of the process.

Trending helps to:

  • identify weak signals before they become major or critical issues;
  • demonstrate CAPA effectiveness over time;
  • decide priorities and resources in a risk-based way;
  • prevent recurrence and repeat findings.

In other words:

Trending = prevention + governance.

The real value of trend analysis is not producing a report. It is transforming recurring data into documented decisions.

2. What to trend: minimum set and advanced set

2.1 Minimum set

If you are building or improving your trending system, start here:

  • deviations per month or quarter;
  • breakdown by severity: minor, major, critical;
  • average closure time and percentage on-time;
  • top categories by cause, type or department;
  • open/closed CAPA and percentage overdue;
  • recurrences, meaning the same failure mode within a defined time window.

This set already allows you to understand whether the system is under control, whether investigations are being closed on time and whether certain problems are recurring.

2.2 Advanced set

When you want to raise the level of maturity, you can introduce more advanced KPIs and views, such as:

  • deviations by opportunity area, for example training, procedure, equipment, supplier;
  • “human error” trend, to be monitored as a possible symptom of a system problem;
  • CAPA effectiveness pass/fail rate;
  • CAPA aging by risk class;
  • correlations between sources, for example deviations, complaints, OOS and audit findings;
  • quality process capability indicators, such as deviations per batch or deviations per 1,000 machine hours.

The advanced set is useful when you want to move from reactive control to predictive and preventive management.

GMP Deviations & CAPA: Effective Implementation and Audit Defensibility (EU GMP, FDA, AIFA, ICH Q10)

3. Data taxonomy: without consistent classifications, trending does not exist

This is the point that destroys most dashboards.

If each investigator uses different categories, such as “human error”, “distraction”, “lack of attention” or “operator”, you do not have data: you have free text.

3.1 Practical solution

To make trending truly usable:

  • define controlled lists, preferably dropdowns, for event type, primary cause, area, equipment class, product and process step;
  • keep a free-text notes field, but do not use it as the only classification;
  • align definitions through SOP and training;
  • perform internal audits on classification quality, for example on a monthly sample.

Good taxonomy makes data comparable over time. Without consistency, even the most beautiful dashboard becomes difficult to defend.

4. Practical methods: Pareto, thresholds and control mentality

It does not need to be complicated. It needs to be consistent.

4.1 Pareto

Every month or quarter, ask yourself:

Which 3 categories generate 60–80% of the events?

Pareto helps focus resources on the problems that truly weigh on the system.

4.2 Thresholds and signals

Define simple, clear and defensible thresholds.

Examples:

  • if a department exceeds +30% deviations compared with the average of the last 6 months, a dedicated review is opened;
  • if 3 similar events occur within 60 days, a systemic CAPA is assessed;
  • if overdue CAPA exceed a defined threshold, escalation to the Quality Council is triggered.

The important point is that thresholds are defined in advance, not invented after seeing the data.

4.3 Control mentality

Even without formal control charts, you can think with a control mentality.

Always ask yourself:

  • what is the baseline?
  • what represents normal variability?
  • what instead indicates a level change or a shift?

This approach helps distinguish physiological noise from a real signal of loss of control.

5. When a trend becomes a CAPA

A trend should not remain just a chart. When it shows a real or recurring risk, it must generate action.

5.1 Clear and defensible triggers

Simple rules:

  • Recurrence: same failure mode 2–3 times within a defined window;
  • Severity escalation: repeated minor events indicating loss of control;
  • Cross-area: same pattern in different departments;
  • High-impact near miss: event detected before impact, but with high potential severity;
  • Backlog or aging: deviations open for too long, indicating a system problem in the investigation process.

When one of these triggers is activated, the question should not only be: “Do we close the record?”, but: “Do we need a system CAPA?”

6. Integration with the PQS: Management Review, PQR and Change Control

Trending without decisions is a data cemetery.

The data must land in the right processes of the Pharmaceutical Quality System.

6.1 Management Review / Quality Council

Here, trends must generate decisions on:

  • resources;
  • priorities;
  • escalation;
  • ownership;
  • action timelines.

6.2 PQR / APR

In the Product Quality Review or Annual Product Review, trends must feed the annual evaluation of product and process quality, with documented follow-up where required.

6.3 Change Control

Many CAPA lead to changes. This is why it is important to maintain traceability between:

  • CAPA;
  • Change Control;
  • assessment;
  • qualification or validation;
  • approvals;
  • release of the change.

6.4 Risk Register / QRM

Real data must update the risk register.

If events show that probability is higher than expected or that a control is less effective, the Quality Risk Management process must be updated.

6.5 CCS / Annex 1 for sterile processes

In sterile manufacturing, EM trends and deviations must feed the Contamination Control Strategy.

They must not remain isolated reports: they must contribute to the overall contamination control strategy.

7. How to present trends during an audit without hurting yourself

Presenting trends during an audit is useful, but it must be done well.

7.1 Three fundamental rules

  1. Show trend, interpretation and action. Not just charts.
  2. Do not leave a negative trend without comment. It is better to say: “Yes, we know this — and here is the plan.”
  3. Bring before/after examples on 1–2 successful CAPA. These are very strong during audits.

The objective is not to show that you have no problems. The objective is to show that you know how to identify, interpret and manage them.

7.2 Audit-ready package

A useful package may include:

  • dashboard for the last 12 months;
  • list of deviations by severity;
  • CAPA list with overdue items highlighted and rationale for any extensions;
  • 2 complete cases with effectiveness check.

This allows you to tell the story of the system in an orderly, non-defensive way.

8. Ready-to-use KPI pack: list and definitions

8.1 Deviation Rate

Number of deviations divided by number of batches or production hours.

This normalises the data and allows comparison between periods, lines or departments.

8.2 On-Time Closure of deviations

Percentage of deviations closed within the target defined in the SOP.

This indicates the system’s ability to investigate and close within the expected timelines.

8.3 CAPA On-Time

Percentage of CAPA completed by the due date.

This helps monitor discipline, ownership and execution capability.

8.4 CAPA Aging

Average number of days CAPA remain open, preferably broken down by risk class.

High aging may indicate resource issues, governance issues or unmanaged complexity.

8.5 Recurrence Rate

Percentage of repeated events in the same category or with the same failure mode.

This is one of the most important KPIs to understand whether CAPA are truly preventing recurrence.

8.6 Effectiveness Pass Rate

Percentage of CAPA that pass the effectiveness check.

If the value is low, it may indicate poorly designed CAPA or unrealistic success criteria.

8.7 Human Error Share

Percentage of deviations attributed to human factors.

This should be monitored as a possible system symptom. Too many “human error” cases may indicate problems with procedures, training, ergonomics, supervision or process design.

9. FAQ on trending and QRM

9.1 How often should trending be performed?

It depends on the volume of events, but monthly or quarterly frequency is typical.

The important point is that the frequency is consistent with risk and leads to real decisions.

9.2 If trending shows an increase in deviations, is it always a problem?

Not automatically.

It may indicate an improvement in reporting culture. However, you must demonstrate this with consistent indicators, for example an increase in minor events, a decrease in major events or earlier detection of events.

9.3 What is the most common mistake in trend analysis?

Producing charts without interpretation and without decisions.

An uncommented trend does not demonstrate control. A trend that is interpreted, linked to actions and followed over time demonstrates PQS maturity.

10. Do you want to connect trends, decisions, CAPA and effectiveness?

Do you want ready-to-use dashboards, checklists, examples of inspection evidence packs and a complete method to connect trends, decisions, CAPA and effectiveness?

You will find everything in the GuideGxP premium guide:

QA Manager Operational Guide – Deviation, CAPA, and Audit Readiness

THE PRAGMATIC GMP · EVERY MONDAY

The GMP topics that matter, in 7 minutes.

One GMP topic, one real-world example and one practical action, based on official sources and inspection trends.
Discover The Pragmatic GMP