, ,

Designing a KRI Program: From a Metric Wishlist to an Early Warning System

A key risk indicator (KRI) is a measurable quantity that changes before or as a risk materializes, monitored against thresholds that trigger a defined response when crossed. The definition has four parts, and most “KRI programs” fail at least two of them: the quantity must be measurable from data the organization actually has; it must relate to a specific risk in the register rather than to general performance; it must have thresholds that mean something; and crossing a threshold must cause something to happen. A spreadsheet of 140 monthly metrics with no thresholds, reviewed by a committee that notes them, is a dashboard, which has its uses, but it is not an early warning system, and when the risk materializes nobody will have been warned.

This guide explains how to build the system rather than the dashboard. It covers what a KRI is and how it differs from a key performance indicator and a key control indicator, the selection criteria that turn a metric wishlist into a short list of indicators, leading versus lagging indicators and why a program needs both, how to calibrate thresholds from historical data and from the organization’s risk appetite, the escalation wiring that makes a breach an event with an owner and a deadline, the lifecycle that reviews and retires indicators, a build sequence with the first twenty KRIs most organizations should start with, how internal audit tests the program, the failures that make dashboards decorative, and a worked example of a regional bank’s operational risk function rebuilding its program. It extends the site’s KRI reference table and non-financial indicators guide, which list indicators by risk type, into the design of the program that uses them.

In this guide

KRI, KPI and KCI: the distinctions that matter

IndicatorMeasuresQuestion it answersExampleOwner
Key performance indicator (KPI)Achievement of an objectiveAre we succeeding?On-time delivery 96 percentBusiness management
Key risk indicator (KRI)Exposure to, or early signs of, a specific riskIs a risk building, before it hits?Orders shipped from a single depot above 40 percent of volume (concentration risk)Risk owner; risk function maintains
Key control indicator (KCI)Whether a control is operatingIs the control working?Percentage of vendor bank changes with completed call-back verificationControl owner; second line monitors
Loss or incident metricRisk that has already materializedWhat did it cost us?Operational losses this quarterRisk function

The lines blur in practice, and the same number can serve two roles: a reconciliation backlog is a KCI for the reconciliation control and a KRI for the financial reporting risk. What matters is that each indicator in the program is tagged to the risk (or control) it monitors, because an indicator with no risk attached cannot have a meaningful threshold, and the risk taxonomy gives the categories the tagging uses. KPIs belong in management reporting; a KRI program that fills up with them has become a scorecard.

Selection criteria: from wishlist to indicators

CriterionTestWhat fails it
RelevanceThe indicator moves when the specific risk’s likelihood or exposure moves; the causal link can be stated in one sentenceHeadcount as a KRI for “people risk”
PredictivenessHistorical data, or a credible argument, shows the indicator changes before losses or incidentsLoss totals (lagging only) with no leading companion
MeasurabilityData exists, is produced routinely, has a defined source and calculation, and can be reproduced by someone else“Staff morale”; indicators requiring a manual survey nobody runs
Controllability or actionabilitySomeone can do something when the indicator moves, even if only escalateMacroeconomic indices with no response attached
TimelinessAvailable at a frequency that leaves time to act (daily or weekly for fast risks; monthly for slow ones)Quarterly indicators for a risk that materializes in days
Sensitivity and stabilityMoves enough to signal, not so much that it signals constantly; thresholds can be set that separate normal from abnormalIndicators that are red every month or never move
CostProducing it costs less than the warning is worthIndicators needing a week of manual work each month
OwnershipOne person is accountable for the data and one for the responseIndicators “owned by the risk committee”

Applying the criteria to a wishlist is a scoring exercise: each candidate scored one to three on each criterion, with any zero on measurability or relevance disqualifying. A wishlist of 100 candidates typically yields 25 to 45 indicators, which is the right size for a mid-size organization’s enterprise-level program; business units carry their own operational indicators below it. Fewer, well-calibrated indicators that someone acts on beat a comprehensive set nobody reads, and the KPI guide makes the same argument for the audit function’s own metrics.

Leading and lagging indicators

A lagging indicator measures the risk after it has materialized (losses, incidents, complaints, breaches found); a leading indicator measures a condition that precedes materialization (staff turnover in a control function, system changes without testing, vendor financial stress, overdue reconciliations, limit utilization approaching the limit). Programs need both: lagging indicators are reliable and confirm whether leading ones were right; leading indicators are the point of the exercise and are harder to find, because they require a causal theory of how the risk materializes. The practical method is to take each high-rated risk in the register, write its causal chain (the root cause guide’s “why” ladder in forward gear: what happens first, then next, then the loss), and look for a measurable quantity at each early link. For payment fraud through vendor bank account changes, the chain runs from an unverified change, to a payment against the new account, to the loss; the leading indicator is the proportion of bank changes without verification, measured weekly, and the lagging indicator is diverted payments. A program with no indicator earlier than the loss for any of its top ten risks has not yet built an early warning system.

Calibrating thresholds

MethodHow it worksBest forWeakness
Appetite-derivedRed at the level the appetite statement or a limit defines as unacceptable; amber at a stated fraction (often 80 percent) of redIndicators tied to limits: concentrations, capital, liquidity, open high findingsNeeds an appetite statement precise enough to yield numbers
StatisticalAmber and red at percentiles of the indicator’s own history (for example the 80th and 95th) or at two and three standard deviations from a stable meanIndicators with two or more years of data and stable processesNormalizes a bad baseline; blind to regime change
BenchmarkThresholds from peers, regulators or standards (regulatory ratios, industry loss rates)Externally comparable indicatorsPeer data may not fit the organization
Expert and scenarioRisk owners set the level at which they would act, tested against scenarios (“at what reconciliation backlog would month-end close be at risk?”)New indicators with no history; operational indicatorsOwners set thresholds they can meet
TrendThresholds on the rate of change rather than the levelSlow-moving indicators where direction matters (turnover, aging)Noisy for small populations

Three calibration rules apply whatever the method. Thresholds are set once, by the risk function with the owner, documented with their method and reviewed at the annual lifecycle step, not adjusted when breached. A threshold that is breached every month is wrong or the risk is out of appetite, and the program must say which. And the red threshold’s meaning is fixed across the program: red means a defined response is now required, not “worse than amber.” The risk matrix guide’s calibration discipline, including the inter-rater test, applies to thresholds set by expert judgment.

Escalation wiring: making a breach an event

StatusMeaningRequired responseOwnerDeadline
GreenWithin normal rangeNone; reported in the monthly packData ownerMonthly
AmberApproaching the unacceptable level, or adverse trend for two periodsRisk owner explains the cause and states whether action is needed; recorded against the indicatorRisk ownerWithin 10 business days of the reading
RedAt or beyond the unacceptable levelRisk owner proposes an action plan or a risk acceptance; risk committee decides; the indicator stays red until the reading returns or the acceptance is approvedRisk owner; risk committeeAction plan within 10 business days; committee decision at next meeting or sooner
Red for two consecutive periods or breach of a board limitSustained exposureEscalation to the board risk committee; the risk acceptance discipline applies if management proposes to acceptChief risk officerNext board committee meeting
Data unavailableThe indicator could not be producedTreated as amber; data owner explainsData ownerWithin 5 business days

The wiring is what separates a program from a dashboard, and it is tested by looking at the last twelve months of breaches and asking what happened after each. The breach log (indicator, date, status, cause, action, closure) is the program’s primary evidence; internal audit reads it before anything else, and a committee that wants to know whether its program works can read the same log in ten minutes.

The KRI lifecycle

Indicators are born, reviewed and retired. The annual review, aligned with the risk assessment cycle, asks of each indicator: did it move in the year, and did its movements correspond to anything (an indicator that was green all year while the risk produced three incidents has failed); is the risk it monitors still rated high enough to deserve enterprise-level monitoring; are the thresholds still right, given the year’s data and any appetite changes; is the data still produced at acceptable cost; and does anyone act on it. Indicators that fail are retired, with the date and reason recorded so that history can be read, and replaced where the risk still needs a signal. New indicators enter through the same selection scoring, usually when a risk is re-rated, an incident reveals a missing signal or a new business line arrives. A program whose indicator set has not changed in three years has stopped learning; one that changes half its indicators every year has not calibrated anything.

The first twenty KRIs

The indicators below suit most mid-size organizations as a starting set: each is measurable from systems most organizations have, tied to a common high-rated risk, and mostly leading. Thresholds are illustrative; each organization calibrates its own. Banks add the prudential indicators (limit utilizations, liquidity ratios, model performance) their frameworks require.

#IndicatorRisk monitoredTypeSource and frequencyIllustrative thresholds (amber / red)
1Vendor bank account changes without completed verification, as a percentage of changesPayment fraudLeadingAP system; weekly5% / 10%
2Open High and Critical audit findings past their due dateControl environmentLeadingIssue log; monthly2 / 5
3Account reconciliations not completed within the close deadline, and reconciling items older than 60 days above thresholdFinancial reportingLeadingReconciliation tool; monthly5% / 10% of accounts
4Manual journal entries above the materiality threshold posted without secondary approvalFinancial reporting; fraudLeadingGL; monthly1 / 3
5Users with privileged access outside the approved administrator listCyber; unauthorized accessLeadingIdentity system; weekly1 / 3
6Leavers with active system access more than 24 hours after terminationUnauthorized accessLeadingHR and identity systems; weekly1 / 3
7Critical vulnerabilities open beyond the remediation standardCyberLeadingVulnerability scanner; weekly10 / 25
8Changes to production without an approved change recordTechnology; availabilityLeadingChange and deployment logs; weekly2% / 5% of changes
9Backup jobs failed or not verified in the period for critical systemsResilience; data lossLeadingBackup system; daily1 / 3 systems
10Days since last successful restore test of each critical systemResilienceLeadingDR records; monthly270 / 365 days
11Critical third parties without a current risk assessment or with an expired assurance reportThird-partyLeadingVendor system; monthly5% / 10%
12Spend with the largest supplier as a percentage of category spend (concentration)Third-party concentrationLeadingAP; quarterly50% / 70%
13Voluntary turnover in control functions (finance, risk, compliance, IT security) over the trailing twelve monthsPeople; control capacityLeadingHR; monthly15% / 25%
14Key roles with no trained deputyKey personLeadingHR and succession records; quarterly2 / 5
15Customer complaints per 10,000 transactions, and complaints open beyond the response standardConduct; serviceMixedComplaints system; monthlyTrend-based; 10% / 20% late
16Regulatory deadlines due in 90 days without an assigned owner and planComplianceLeadingRegulatory calendar; monthly1 / 2
17Hotline reports alleging management involvement, and investigations open beyond 60 daysFraud; cultureMixedCase system; monthlyAny / 2 open late
18Revenue from the largest customer as a percentage of totalStrategic concentrationLeadingBilling; quarterly20% / 30%
19Operational losses and near misses in the period against the annual budget for lossesOperational risk, all typesLaggingLoss database; monthly75% / 100% of budget year to date
20Incidents rated major or above in the period, and repeat incidents with the same root causeOperational; resilienceLaggingIncident system; monthly1 / 2 major; any repeat

The build sequence

StepWorkOutputTypical effort
1. Start from the registerTake the top 15 to 20 risks by residual rating; write each causal chainCausal chains with candidate signalsTwo workshops
2. Build the wishlistCandidates from the chains, from existing management reports and from the reference table60 to 120 candidatesOne week
3. Score and selectApply the eight criteria; disqualify unmeasurable and irrelevant candidates25 to 45 indicators, at least one leading per top riskOne workshop
4. DefineA definition card per indicator (template below): calculation, source, owner, frequencyDefinition cardsTwo to three weeks with data owners
5. BaselinePull 12 to 24 months of history where it exists; examine distributionsHistorical seriesTwo weeks
6. CalibrateSet amber and red by the methods above; document the method per indicatorThresholdsOne workshop plus follow-up
7. Wire escalationAgree the response table with the risk committee; set up the breach logEscalation procedureOne committee meeting
8. PilotRun three cycles; fix data problems; test whether breaches produce responsesWorking programOne quarter
9. ReportMonthly pack to the risk committee; quarterly summary to the boardReportingOngoing
10. ReviewAnnual lifecycle review with the risk assessmentRetirements and additionsAnnual

Two further design points shorten the path. Aggregation: indicators are not added or averaged into a composite score, because a composite hides the one red that matters; the pack shows each indicator and a count of statuses. And ownership of the program as a whole: the risk function maintains the definitions, produces or collects the readings, computes the statuses and runs the breach log, while the risk owners own the responses; a program in which the business units produce their own readings and set their own statuses is a self-assessment, not an early warning system, and the RCSA already serves that purpose.

Reporting: what the committee and the board see

The risk committee sees the full set monthly: each indicator’s current reading, status, trend over twelve periods, the threshold and, for amber and red, the owner’s explanation and action. The board or its risk committee sees a quarterly summary: the indicators in red or sustained amber, what changed, the breach log’s open items, and the indicators retired or added, with the full set available as an appendix. Two presentation rules keep the pack honest: status is computed from the thresholds, never set by hand, and a data-unavailable indicator shows as amber with the reason rather than disappearing. The audit committee calendar places the risk profile and indicators in the third-quarter meeting for committees that also oversee risk, and the presentation template shows how internal audit’s own dashboard sits beside them.

How internal audit tests a KRI program

TestProcedureFinding it produces
CoverageMap indicators to the top 20 register risks; identify risks with no indicator or only lagging onesEarly warning absent for named high risks
Definition and reproducibilityRe-perform five indicators from source data using the definition cardIndicators that cannot be reproduced; calculations that drifted
Threshold basisReview the documented method for each threshold; test statistical ones against the data; check for thresholds moved after breachesThresholds without basis; thresholds adjusted to avoid red
EscalationTake every red and sustained amber in twelve months from the breach log; trace to the owner’s response and the committee’s decisionBreaches with no response; responses without closure
Back-testTake the year’s incidents and losses; check whether the relevant indicators moved beforehandIndicators that did not warn; missing indicators
Data integrityCheck source extracts, manual adjustments and the completeness of the populations (the IPE tests)Manually edited readings; incomplete populations
LifecycleReview the annual review’s evidence; count indicators unchanged for three years and those green all year while the risk produced incidentsDead indicators; a program that stopped learning
Reporting honestyCompare the board summary with the full set and the breach logReds omitted; status set by hand

The tests sit inside the operational risk framework audit as its KRI component, or run as a standalone engagement of 150 to 250 hours where the program is large. Internal audit also uses the program: red and sustained amber indicators are an input to the annual risk assessment and a trigger for in-year plan changes.

Failures that make dashboards decorative

FailureHow it showsFix
Too many indicators140 metrics; the committee notes them in four minutesScore against the criteria; 25 to 45 at enterprise level
KPIs in disguiseRevenue, margin and headcount on the risk dashboardTag every indicator to a register risk or remove it
All laggingLosses, incidents and complaints; nothing that precedes themCausal chains for the top risks; one leading indicator each
Thresholds by feelNo documented method; thresholds moved when breachedAppetite-derived or statistical calibration; change control on thresholds
No wiringReds reported, nothing happens, no breach logThe response table; the log; committee decisions recorded
Hand-set statusOwners mark their indicators greenStatus computed from readings; no manual override
Data debtHalf the indicators produced by manual spreadsheet work; late or missing readingsAutomate the top indicators; treat unavailable as amber
No lifecycleSame indicators for years regardless of the risk profileAnnual review with retirements

Template: the KRI definition card

KRI: [Vendor bank account changes without completed verification]. ID: [KRI-07]. Risk monitored: [3.5.2 External fraud: payment diversion], register entry [R-14], residual rating [High]. Type: [Leading]. Definition and calculation: Number of vendor master bank account changes in the period for which the independent call-back verification field is blank or dated after the first payment, divided by all bank account changes in the period, expressed as a percentage. Data source: [AP vendor change log, table and fields; payment table]. Frequency: [Weekly, Monday for the prior week]. Data owner: [AP manager]. Risk owner: [Controller]. Thresholds and method: Amber 5 percent, red 10 percent; appetite-derived from the payment fraud appetite statement (no unverified change should precede a payment) with amber at an operational tolerance agreed by the controller; reviewed [date]. Response: Amber: AP manager explains and confirms retrospective verification within 10 business days. Red: controller presents the cause and action to the risk committee; payments to affected vendors held pending verification. History: [Introduced after the FY27 AP audit finding; 24 months of back-filled data; two amber readings, no red]. Last review: [date]. Status: [Active].

Worked example: Lakeshore Bancorp rebuilds 140 metrics into 38 indicators

Lakeshore Bancorp, the $9 billion regional bank used in examples across this site, has an operational risk function of six reporting to the chief risk officer. Its KRI program, inherited from a 2019 consulting engagement, carried 140 indicators reported monthly in a 60-page pack: 91 of them were performance metrics or volumes with no risk attached, 112 had no thresholds, the 28 with thresholds had been set by the business units at levels they always met, and the pack had never produced an escalation. The operational risk framework audit rated the KRI component a High finding on exactly those facts, and the function rebuilt the program over two quarters using the sequence above, with internal audit as challenger.

ElementBeforeAfter
Indicators140; 91 performance metrics38 at enterprise level, each tagged to one of the top 22 register risks; 22 leading, 10 lagging, 6 control indicators
Coverage of top risks9 of 22 top risks had any indicator; 3 had a leading one22 of 22 with at least one leading indicator
Thresholds28 indicators with thresholds, set by business units38 with documented thresholds: 14 appetite-derived (limits and the appetite statement), 17 statistical from 24 months of data, 7 expert-set and flagged for recalibration after a year
EscalationNone in five yearsResponse table approved by the risk committee; breach log live; 11 amber and 3 red readings in the first two quarters, each with a recorded response
Notable early warningsDeposit assumption sensitivity indicator (a new leading indicator from the deposit beta work) went amber two months before the model risk audit’s High finding; the third-party assurance-expiry indicator went red and surfaced the inventory gap later cited in the examination
DataAbout 60 percent of readings produced by manual spreadsheet work; typical delivery 15 business days after period end29 of 38 automated from source systems; delivery 5 business days; 9 manual indicators flagged for automation
Pack60 pages6 pages monthly for the risk committee; one page quarterly for the board risk committee with the breach log
LifecycleNo review since 2019First annual review retired 4 indicators that never moved and added 3 after the resilience program’s mapping

Internal audit’s follow-up review a year later re-performed six indicators (all reproduced), traced all fourteen breaches to responses (two had closed late and were raised as a Medium finding on the escalation deadline), and back-tested the year’s seven major incidents, finding that four had been preceded by an amber or red reading on a related indicator and three had not, which produced the next year’s additions. The function’s own observation was that the program became useful at the moment it became small: thirty-eight indicators the committee argued about replaced 140 it had never read.

Questions about KRI programs

What is the difference between a KRI and a KPI?

A KPI measures achievement of an objective; a KRI measures exposure to, or early signs of, a specific risk, against thresholds that trigger a response. The same number can serve both roles, but a KRI must be tagged to a register risk and have thresholds with a defined response.

How many KRIs should an organization have?

Twenty-five to forty-five at enterprise level for a mid-size organization, with at least one leading indicator for each top risk; business units carry their own operational indicators below. More than that and the committee stops reading.

How do I set KRI thresholds?

From the risk appetite or a limit where one exists, from the indicator’s own history (percentiles or standard deviations) where there is enough data, from benchmarks where comparable, and by expert judgment tested against scenarios where nothing else is available; document the method and do not move thresholds when breached.

What makes a KRI leading rather than lagging?

A leading indicator measures a condition that precedes the risk materializing, found by writing the risk’s causal chain and measuring an early link; a lagging indicator measures the risk after it has materialized. Programs need both, and the leading ones are the point.

What should happen when a KRI turns red?

A defined response within a deadline: the risk owner proposes an action plan or a risk acceptance, the risk committee decides, the breach is logged, and the indicator stays red until the reading returns or the acceptance is approved. Sustained red goes to the board committee.

How often should KRIs be reviewed?

Annually, with the risk assessment: each indicator is tested for whether it moved, whether its movements meant anything, whether its risk still warrants monitoring and whether its thresholds still fit. Indicators that fail are retired and replaced.

How does internal audit test a KRI program?

Coverage of the top risks, reproducibility of a sample of indicators from source data, the basis for thresholds, the escalation of every breach in the year, a back-test against the year’s incidents, data integrity, the lifecycle review and the honesty of board reporting.

New guides & tools by email

Useful so far?

There are 400+ more guides where this came from. Get new guides, templates and free audit tools by email when they ship. No schedule, no filler.

Free. One confirmation email from WordPress.com, then you’re in. Unsubscribe anytime.

New guides & tools by email

Don’t lose this library.

400+ practitioner-written guides and free tools. Hear when new ones land.

One confirmation email from WordPress.com, then you’re in. Unsubscribe anytime.

Comments

Leave a Reply

Discover more from internalauditguide.com

Subscribe now to keep reading and get access to the full archive.

Continue reading