Skip to content
FRSign inBook a walkthrough
How-toWith a checklist

SMS Audit Evidence: What Auditors Actually Ask For

An SMS audit does not ask to read your manual. It asks for the records your system produces, then samples one and follows it end to end. This is the element to evidence map, the four questions most audits open with, and why the difference between a hard audit and a calm one is decided months before the auditor arrives.
Mounir OuafiFounder and CEO of eAvioraPublished 12 min read

Your audit-readiness checklist

Tick each step as you finish it. Your ticks stay on this device and are never sent to us.

Steps done0 of 9

Next: List the record each of the twelve elements produces

Map | Evidence per element0 of 3

In eAviora. Records are linked on one operational graph, and the Safety Risk Profile is computed from them.

Rehearse | The four questions0 of 4

In eAviora. The name of a confidential reporter shows only to people cleared for confidential reports, on the record and in its audit, timeline and export views.

Hold | The trail0 of 2

In eAviora. Every change made in the app or through the API writes its audit entry in the same transaction as the change.

01Element to evidence map

ICAO Annex 19 organizes an SMS into four components holding twelve elements. An audit does not grade the elements in the abstract; it asks what each one produced. The table maps them to the artefact an auditor expects and to the shape that survives a sample trace.

SMS elements, the evidence they produce, and the shape that survives sampling
ElementEvidence an auditor expectsThe shape that survives a sample trace
Management commitmentSigned safety policy, resourcing decisionsA controlled document with revision history and named acknowledgment
Accountability and responsibilitiesAccountability map, per-record ownersThe owner and verifier recorded on each occurrence, finding and action
Key safety personnelAppointment records, competency validityTraining records with validity windows tied to the appointment
Emergency response planningThe plan, the roles, the drill recordDrill outcomes recorded against the plan they exercised
Hazard identificationHazard register, occurrence and audit intakeReactive and proactive sources landing as records on one spine
Risk assessment and mitigationRisk assessments, matrix scores, barriersBow-tie models with named barriers and their assessed condition
Performance monitoringIndicator definitions, charts, underlying dataControl charts with the rule that tripped and the data behind it
Management of changeChange assessments and their approvalsChange routed by assessed risk band with the approval on the record
Continuous improvementAudit findings, corrective actions, effectivenessClosure gated on a recorded verification
Training and communicationCompetency records, bulletins, acknowledgmentsAcknowledgment per person, not a distribution list

The third column is where audits are won or lost. Most operations can produce the artefact in column two. Fewer can produce it with the link that shows which hazard the occurrence belonged to, or which person verified that the action worked. See the closure gate for why the verification link is the one most often missing.

02The four questions

Audits vary, auditors do not vary much. Four questions do most of the work, and each one tests a different joint in the system.

Show me the hazard this occurrence belongs to. This tests whether hazard identification is a live register or a document written once. If the link has to be reconstructed by a person who remembers, the register is not doing its job. The answer should be a navigation, not a search.

Prove this corrective action worked. This tests safety assurance, and it is the most common source of findings. Implementation is not effectiveness. Both EASA Part-ORO and FAA 14 CFR Part 5 expect verification that the risk actually fell, by someone other than the person who owned the action.

Your system classified this. Justify it. Increasingly asked now that classification is often AI-assisted. The defensible answer has three parts: the proposal and its confidence, the person who accepted or changed it, and a version pin on the taxonomy so the same record reads the same way in three years. See AI in aviation safety management.

Who saw the confidential report? This tests whether Annex 19 confidentiality protection is enforced by the system or promised by a policy. A convincing answer shows access control at the data layer and a record of every read, which is also what makes a just culture survivable when a report is uncomfortable.

03What a good audit trail looks like

A defensible trail on one occurrence reads as a sequence of stamped events with an actor on each: the report as filed, the reference minted, the classification proposed with its confidence, the person who accepted it and what they changed, the barrier assessment that followed, and the indicator that moved. Each line carries a time in UTC, an actor, and a change.

What makes it defensible is not that it is long. It is that it is continuous: no step in the story is missing, and no step was written after the fact. An audit trail assembled during audit preparation is a document. One written as the work happened is evidence. For the full path a record takes, see what happens after an occurrence report.

04Being ready instead of preparing

The cost of an audit is set long before it is scheduled. Where occurrence, hazard, indicator, action and audit records live in separate systems, the links between them exist only in the heads of the people who made them, so audit preparation is a reconstruction project. Where those links are structural, preparation is a query and the time goes into the findings instead.

This is also why IOSA preparation tends to expose the same weakness twice: the evidence exists, but proving which requirement it satisfies is manual. The fix is not a better folder structure. It is attaching evidence to the requirement when the evidence is produced.

Questions

An SMS audit asks for the records each part of the system produces, not for the system description. Expect to show the signed safety policy and accountability map, appointment records for key safety personnel, the emergency response plan, the SMS documentation set, the hazard register with risk assessments, occurrence reports and their investigations, safety performance indicators with their underlying data, internal audit findings with corrective actions and evidence of effectiveness, management-of-change assessments, and training and competency records. Auditors sample: they pick one record and follow it end to end, so the connections between those artefacts matter as much as the artefacts.

Mounir OuafiFounder and CEO of eAviora, the aviation safety intelligence platform.

Related reading

Ask us the four audit questions, on your own records.

Book a walkthrough on your own operation, or keep reading in all the insights.