The USOAP CMA Audit of the Lebanese Civil Avition System.Presentation · 2018-02-07 · Organization, Staffing and Training ‐ PEL Legislation and Regulations ‐ PEL Undetermined

The USOAP CMA Audit of The Civil Aviation System of The Lebanese Republic

Overview

Background

Objective and Activities

Executive Summary

Analysis of Audit results

2/7/2018 The Directorate General of Civil Aviation

Background

The scope of the audit is to assess Lebanon’s oversight capabilities and their safety performance based on:

Evaluating the effective implementation of the eight criticalelements of the state’s safety oversight system;

Review of the civil aviation legislation frame work;


Audit under the Continuous Monitoring Approach (CMA)Date: 16 to 27 of October 2017

Objective and Activities

The USOAP CMA audit covered to the following areas:

LEG, ORG, PEL, OPS, AIR.

The scope of the USOAP CMA audit did not include the areas ofAIG, ANS and AGA.

The USOAP CMA audit assessed the effective implementation ofthe eight Critical Elements (CEs) of a safety oversight system.

The Audit USOAP CMA activities covered visits to theIndustry/Service Providers for general overview .


Executive Summary

The audit resulted in an overall Effective Implementation of57.44% for the eight CEs of the State’s Safety OversightSystem.

Critical Elements CEswith low EI are; • CE4, State Systems & Functions, at 31.17%

• CE5, Qualified Technical Personnel, at 15.49%and

• CE8, Resolution of safety issues, at 43.75 %2/7/2018 The Directorate General of Civil Aviation

54.84%

72.16%

34.21%

11.59%

70.87%

81.00%

57.14%54.55%

80.65%

66.35%

31.17%

15.49%

71.64%69.20%

48.72%43.75%

0.00%

10.00%

20.00%

30.00%

40.00%

50.00%

60.00%

70.00%

80.00%

90.00%

CE‐1 PrimaryAviation legislation

CE‐2 SpecificOperatingRegulations

CE‐3 State Systemand Functions

CE‐4 QualifiedTechnicalPersonnel

CE‐5 TechnicalGuidance, Toolsand provision ofSafety‐CriticalInformation

CE‐6 Licensing,Certification

Authorization andApprovalObligations

CE‐7 Surveillanceobligations

CE‐8 Resolution ofSafety Issues

EI before the Audit EI After the Audit

Effective Implementation by Critical Elements of the Safety Oversight System EI before Audit: 61.73%EI after Audit: 57.44%


Analysis of Audit results (Critical Elements)

Analysis of Results by Sub‐Areas of Critical Elements 1 to 4:


61.54%

33.33%

50.00%

100.00%

33.33%

84.62%

33.33%

100.00% 100.00%

77.78%

0.00%

20.00%

40.00%

60.00%

80.00%

100.00%

120.00%

Conformance to TheChicago Convention

Establishment of aCAA/Investigation Authority

Delegation of Authority Enforcement Provisions Empowerment of CAAInspectors/Investigators


CE‐1 Primary Aviation Legislation EI before Audit: 54.84%Effective Implementation (%) in CE‐1 Sub‐Areas EI after Audit: 80.65%


EI Below34%


Analysis of Results by Sub‐Areas of Critical Elements 1 to 4:Lack of EI in the following areasCE1, CAA and independent Investigation Authority are not fully established.


52.38%

0.00%

100.00% 100.00%

85.71% 88.89%

62.50%

94.74%

23.81%

0.00%

77.78%

66.67%

90.32% 88.89%

62.50%

94.74%

0.00%

20.00%

40.00%

60.00%

80.00%

100.00%

120.00%

RegulationAmendmentProcedures

Identification andNotificationofdifferences

Pel Regulations OPS Regulations AIR Regulations AIG Regulations ANS Regulations AGA Regulations


Not Aud

ited

Not Aud

ited

Not Aud

ited

CE‐2 Specific Operating Regulations EI before Audit: 72.16%Effective Implementation (%) in CE‐2 Sub‐Areas EI after Audit: 66.35%


EI Below 24%


Analysis of Results by Sub‐Areas of Critical Elements 1 to 4:Lack of EI in the following areasCE2, Regulatory Amendment Procedure & procedure to identify and notify regulatory

differences to ICAO require implementation.


32.00%36.36%

50.00%

12.50%

33.33%

77.78%

40.00%

31.82%

20.00%

12.50%

0.00%

44.44%

0.00%

10.00%

20.00%

30.00%

40.00%

50.00%

60.00%

70.00%

80.00%

90.00%

OrganizationalStructure

Functions andResponsibilities

Credentials recruitement andStaffing

FinancialResources

Delegation ofTasks Outside

CAA


CE‐3 State System and Functions EI before Audit: 34.21%Effective Implementation (%) in CE‐3 Sub‐Areas EI after Audit: 31.17%


EI Below 32%


Analysis of Results by Sub‐Areas of Critical Elements 1 to 4:Lack of EI in the following areasCE3, The Organizational structure, Functions & Responsibilities, Staffing, Credential

powers and Financial resources need a comprehensive review (Below 32%)


50.00%

6.25%4.17%

44.44%

12.50%

8.33%

0.00%

10.00%

20.00%

30.00%

40.00%

50.00%

60.00%

Technical PersonnelQualifications and

Experience

Training Policy andProgramme

Training Plan andRecords


CE‐4 Qualified Technical Personnel EI before Audit: 11.59%Effective Implementation (%) in CE‐4 Sub‐Areas EI after Audit: 15.49%


Overall Training Areas

42.86% 42.86%

16.67%

0.00% 0.00% 0.00%

37.50%

71.43%

28.57%

0.00% 0.00% 0.00%0.00%

10.00%

20.00%

30.00%

40.00%

50.00%

60.00%

70.00%

80.00%

PELCompetency

OPSCompetency

AIRCompetency

AIGCompetency

ANSCompetency

AGACompetency


Not Audited

Specific Training Areas

EI Below 13%


Analysis of Results by Sub‐Areas of Critical Elements 1 to 4:Lack of EI in the following areasCE4 Training & competency are not efficiently implemented (Below 13%)


Analysis of Audit results (Audited Areas)

Analysis of Results by Audit Areas:Effective Implementation reported in the following areas:LEG, 66.67%

ORG, 30%

OPS, 59.56%

PEL, 54.35%

AIR, 76.67%


38.10%

50.00%

82.93% 80.99%

66.36%

56.04%

39.31%

64.96%66.67%

30.00%

54.35%59.56%

76.67%

56.04%

39.31%

64.96%

0.00%

10.00%

20.00%

30.00%

40.00%

50.00%

60.00%

70.00%

80.00%

90.00%

LEG‐PrimaryAviation legislation

and SpecificOperatingRegulations

ORG‐Civil AviationOrganization

PEL‐PersonnelLicensing and

Training

OPS‐AircraftOperations

AIR‐Airworthinessof aircraft

AIG‐AircraftAccident and

IncidentInvestigation

ANS‐AirNaviagationServices

AGA‐Aerodromesand Ground Aids


Effective Implementation by Audited Area


Analysis of Audit results(High Priority remedial actions)

LEG: EI 66.67% Establish and implement a rulemaking process to enable the timely development, promulgation &

amendment of specific operating regulations.

Establish and implement procedures for identifying and notifying to ICAO differences between ICAOSARPs and the Lebanese legislation.

Establish and implement a process to ensure the identification and publication in the (AIP) ofsignificant differences between the SARPs/PANS/SUPPS and the Lebanese Regulations and practices.

Revise the Lebanese flight operations and dangerous goods regulations in order to ensure fullcompliance with the provisions of Annexes 6 and 18 to the Chicago convention.

Promulgate the regulations for operators of aeroplanes over 5700 Kg maximum certified take‐offmass to monitor and assess maintenance and operational experience.



ORG: EI 30% Separate the Safety oversight and service provision functions in the areas of ANS and AGA.

Establish and implement mechanism to ensure that DGCA has sufficient funds to carry out all Safetyoversight‐related activities.

Establish and implement mechanism to enable the DGCA to identify staffing needs, attract and recruitqualified/experienced technical personnel.

Provide the required training to all DGCA staff to allow them to adequately carry out Safety oversight‐related tasks.

Carry out a quality review of all documentation (instructions, procedures and guides for inspectorsand technical staff).



PEL: EI 54.34% Ensure the implementation of a medical system by the establishment of the required structure and by

the designation and supervision of qualified doctors in charge of the assessment of medical fitness oflicense holders and applicants concerned.

Administer adequately the examinations of license holders and applicants.

Implement an effective surveillance programme of the approved training organizations (TOs).

Implement a system for the approval of foreign TOs and establish agreements with foreign civilaviation authorities (CAAs).

Implement procedures to ensure enforcement of regulations, including the application of graduatedsanctions, as appropriate.



OPS: EI 59.56%Ensure, prior to the issuance of operations specifications (OpsSpecs) that all

regulatory requirements and procedures have been established and implemented.

Implement a formal operator surveillance programme in order to verify all (AOC)holders comply with the national and international requirements.

Develop and Implement procedures and plans for carrying out both routine andrandom inspections of all entities.

Develop and Implement procedures to ensure that entities, other than air operators,establish and implement initial and recurrent dangerous goods training programmes.



AIR: EI 76.67%Develop and implement a ramp inspection programme for A/C operated by AOC

holders and foreign air operators.

Establish and effectively implement the procedure for the issuance of special flightpermits.

Re‐issue the noise certificates issued to Lebanese aircraft following the newlydeveloped template.


Analysis of Audit results(Distribution of PQs)

PQ Findings distributed by Critical Elements in areas of:

I. PEL

II. OPS and

III. AIR


10

1

5

4

2

6

5

11

3

6

8

3

1

8

7

2

8

2

5

6

0 2 4 6 8 10 12 14 16 18 20

Approval and Surveillance of Training Organizations

Record Keeping

Language Proficiency

Medical Assessment

Examinations

Conversion and Validation of Foreign Licences

Issuance of Licences and Ratings

Facilities, Equipment and Documentation

Organization, Staffing and Training ‐ PEL

Legislation and Regulations ‐ PEL

Undetermined PQs Satisfactory PQs after the Audit Unsatisfactory PQs SSCs

Personnel Licensing and Training (PEL)Protocol Questions by Sub‐Areas Groupings


Number of Protocol Questions

1

7

1

1

3

8

14

4

1

3

2

4

5

15

7

3

5

8

7

3

6

2

2

2

7

7

4

2

1

4

7

0 5 10 15 20 25

Resolution of Safety Concerns ‐ OPS

Aircraft Operations Surveillance

Dangerous Goods

Air Operator SMS

Ground Handling

Security Measures

FRMS

Crew Scheduling and Operational Control

Air Operator Training

Air Operator Document Review

AOC Application

Delegation and Transfer of Responsibilities

Facilities, Equipment and Documentation

Organization, Staffing and Training ‐ OPS

Legislation and Regulation ‐ OPS


Aircraft Operations (OPS)Protocol Questions by Sub‐Areas Groupings


2

6

1

1

3

7

10

17

2

10

1

2

7

6

29

1

1

1

4

3

2

7

7

0 5 10 15 20 25 30 35 40

Resolution of Safety Concern ‐ AIR (AID)

Airworthiness Surveillance

AMOs

Airworthiness Certification of Air Operators

State of Registry/Operator Continuing Airworthiness Responsibilities

Certificate of Airworthiness and other Authorizations

Aircraft Registration

Delegation and Transfer of Responsibilities (AID)

Facilities, Equipment and Documentation of the Airworthiness Inspection Division (AID)

Organization, Staffing and Training of the Airworthiness Inspection Division (AID)

Legislation and Regulations ‐ AID


Airworthiness of Aircraft (AIR) – Airworthiness InspectionProtocol Questions by Sub‐Areas Groupings


Thank You

Documents

The USOAP CMA Audit of the Lebanese Civil Avition System.Presentation · 2018-02-07 · Organization, Staffing and Training ‐ PEL Legislation and Regulations ‐ PEL Undetermined