Across shipping organisations, documented controls are rarely absent. Safety Management Systems (SMS) are certified, procedures are approved, and internal audits frequently close without major non-conformities. Yet external audits SIRE 2.0 inspections, ISM audits, Right Ship reviews, and charterer vetting continue to raise repeat observations against controls that appear robust on paper.
This contradiction reflects a core audit intelligence principle: auditors no longer assess compliance alone; they assess whether controls effectively manage risk during real operations. For Marine and Fleet Managers, understanding why documented controls fail requires examining control execution, sustainability, and behavioural alignment not documentation quality.
1. Control Design vs Control Effectiveness
Most documented controls are technically sound. However, modern audit regimes differentiate clearly between control design and control effectiveness.
OCIMF’s SIRE 2.0 Implementation and Transition Guidance (2023) explicitly states that inspections are intended to assess management system effectiveness and operational risk control, rather than procedural compliance alone. Early SIRE 2.0 inspection feedback confirms that well-documented controls are still assessed as ineffective when execution is inconsistent.
For example:
- Permit to Work (PTW) systems may exist fleetwide
- Risk assessment templates may be standardised
- Toolbox talk procedures may be clearly defined
Auditors test whether these controls:
- Are applied at the point of risk
- Reflect actual conditions at the time of work
- Influence operational decisions rather than follow them
From an audit intelligence perspective, a control that exists but does not actively manage risk is considered ineffective, regardless of documentation completeness.
2. Static Procedures in Dynamic Operations
Vessel operations evolve continuously trade routes, cargo profiles, equipment condition, manning experience, and environmental exposure all change over time. However, many SMS procedures remain static.
The ICS Guidelines on the Application of the ISM Code highlight that a significant proportion of ISM non-conformities relate to procedures that no longer reflect current operational realities, particularly during high-risk activities.
Auditors increasingly examine whether procedures:
- Have been reviewed following operational or trading changes
- Reflect actual vessel configuration and equipment condition
- Align with updated regulatory and vetting expectations
When procedures lag behind operational reality, auditors identify deficiencies in risk identification and control relevance, even when procedures are formally approved.
3. Control Degradation Between Audit Cycles
Industry audit data consistently shows that control failures typically develop between audits, not during them.
Analysis published in UK P&I Club Loss Prevention Bulletins indicates that recurring deficiencies in PTW systems, risk assessment quality, and supervision are frequently linked to erosion of control discipline over time, rather than the absence of procedures.
Common indicators include:
- Generic risk assessments are reused without review
- Toolbox talks are conducted as routine briefings
- Supervisory checks are becoming informal or assumed
This explains why vessels often receive similar observations across multiple inspection cycles despite documented corrective actions. The issue is not the closure of findings, but the lack of continuous monitoring of control performance.
4. Evidence-Based Auditing and Triangulation
Modern audits are evidence-based rather than document-driven. Auditors do not rely solely on procedures; they triangulate evidence through observation, interviews, and record analysis.
The Paris MoU Annual Report on Port State Control repeatedly notes that deficiencies are frequently raised where documented procedures exist but are not supported by operational evidence or crew understanding.
Auditors assess:
- Whether permits, risk assessments, and logs align chronologically
- Whether crew explanations are consistent with documented controls
- Whether risk controls are visibly applied during task execution
Where documentation appears retrospective or disconnected from operational decision-making, controls are assessed as ineffective even if all required forms are present.
5. Training Focused on Compliance Rather Than Risk Judgment
Several industry studies indicate that procedural training alone is insufficient.
The IMO Human Element, Training and Watchkeeping (HTW) Committee has repeatedly emphasised that accidents and audit failures often stem from weak situational awareness and poor risk judgment, rather than from a lack of procedural knowledge.
Auditors test this through scenario-based questioning, such as:
- Why were specific controls selected
- How risk change if conditions deteriorated
- When should work be stopped or re-assessed
When responses are procedural rather than risk-based, auditors identify weaknesses in competence and control ownership, particularly under SIRE 2.0’s human-factors-focused assessment model.
6. Fragmented Ownership of Controls
Another recurring audit intelligence theme is fragmented ownership between shore management and vessel operations.
OCIMF guidance stresses that management systems must demonstrate active operational ownership, not passive compliance. Auditors identify weak ownership when:
- Officers refer to controls as “company requirements” rather than operational tools
- Responsibility for control effectiveness is unclear
- Feedback from vessels does not result in procedural improvement
Controls that are designed ashore but not actively maintained onboard tend to remain theoretical and are vulnerable to failure under audit scrutiny.
7. Implications Under SIRE 2.0 and Modern Vetting
SIRE 2.0 explicitly evaluates:
- Management system effectiveness
- Human performance and behaviour
- Control sustainability under operational pressure
Early industry feedback shared through OCIMF forums indicates that execution gaps rather than missing procedures are the primary drivers of negative inspection observations.
For Marine and Fleet Managers, audit intelligence efforts should therefore focus on:
- Identifying controls most prone to degradation (PTW, risk assessments, mooring operations, engine-room activities)
- Monitoring control performance trends, not just audit outcomes
- Using inspection findings and near-miss data to strengthen weak controls proactively
Conclusion
Documented controls fail under real audits, not because they are absent, but because they do not consistently manage operational risk. Modern auditors assess how systems perform under variability, pressure, and human factors, not how well they are written.
For Marine and Fleet Managers, success lies in shifting from document assurance to control intelligence, ensuring that controls remain operationally relevant, actively monitored, and clearly owned.
In today’s audit environment, particularly under SIRE 2.0, control effectiveness, not documentation volume, is the true measure of compliance.