54
u way V su,al Range ( V ) Operat-'o,n,al* est an ·0 , ..,., Eva ;Mati,O Tes Plan .i< .> Joseph Goslin Frances A. Mackuse August 1991 DOr/FAA/CT- TN91/4 . (0 &,,)1 ,ntegra lioln DdCUie.nt is on file at the Technical Center City International AirpQI'tt ·f'$.* 'II<' * 4 if' « .. '¥! @@W#$i0. . u.s. Deportment of Transportation Federal AvtatiaJ'I Administration .t 1-".-"' ::'J. 08405 I }} Technical Center /FM Atlantic City Internallanal ".Irport N.J. 08405 T-TN 1/41 c. 3

V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

u way V sual Range ( V ) Operat-onal est an

middot0

Eva MatiO Tes Plan

ilt

gt

Joseph Goslin Frances A Mackuse

August 1991

DOrFAACT-TN914

(0 amp)1 ntegra lioln

DdCUient is on file at the Technical Center LibrarY~Atlaotic City International AirpQItt

middotf$ IIlt 4 if laquo

yen W$i0 ~

us Deportment of Transportation

Federal AvtatiaJI Administration

t

1--

~

J 08405

I

Technical CenterFM Atlantic City Internallanal Irport NJ 08405

T-TN 141

c 3

o FAA Goln Jose~h et a1 C1-TN Runway visual r nge (RVR) oper

FAA Technical Center

IIJllllllillIm IIIIWIIIIII~ Illil ~~ m1111

914 c 2

ati na~ test and valuatio

00016490

NOTICE

This document Is disseminated under the sponsorship of the US Department of Transportation in the interest of Information exchange The United States Government assumes no liability for the contents or use thereof

The United States Govemment does not endorse products or manufacturers Trade or manufacturers names appear herein solely because they are considered essential to the objective of this report

Technical Report Documentotion Page

1 Report Illgt 2 GOllernmenr Accl5sion No J R~cpj~n Catalog No

DOTFAACT-TN9l4

4 Title and Subrille 5 Report Oote

RUNWAY VISUAL RANGE (RVR) OPERATIONAL TEST August 1991 AND EVALUATION (OTampE)INTEGRATION TEST PLAN 6 prforming Organi taflon Code

1----------------------------------------- a P 8forml9 OrCj1oni zari on Report No

7 Author) Joseph Goslin Frances A Mackuse ACN-250 Bruce E Ware Alanna Randazzo UAL DOTFAAGT-TN9l4

9 Performing Organization Name and Address

US Department of Transportation Federal Aviation Administration Technical Center Atlantic City International Airport New Jersey 08405

10 Wok Unt No (TRAIS)

11 Conroct or Gant No

13 Type of Repo and Peod Covered

12 Sponsoing Agency Name and Addr

US Department of Transportation Federal Aviation Administration Technical Center Atlantic City International Airport New Jersey 08405

Technical Note 14 Sponsoring Agncy Code

15 Supplementary Not bullbull

16 Abstract

The Runway Visual Range (RVR) system consists of a group of sensors with associated softwarefirmware displays and data distribution links The data provided by this array of sensors will provide runway visual range at various points of a precision approach runway These RVR products will be automatically processed and distributed to air traffic controllers The data is then presented to the pilot by the controller in a numerical format equating to the number of feet forward along the runway that a pilot may be expected to see

17 KeyWod

Runway Visual Range (RVR) Remote Maintenance Monitoring System Atmospheric Scattering Coefficient Operational Test and Evaluation (OTampE)

18 Oi i bution Stotement

Document is on file at the Technical Center Library Atlantic City International Airport New Jersey 08405

22 Price20 Secui Iy Classi F (of tni pog)19 Secu Iy Clall f (ol Ini eport)

44UnclassifiedUnclassified

Form DOT F 17007 (8-72) Reproduction of completed page authorized

TABLE OF CONTENTS

Page

1 INTRODUCTION 1

11 Scope 1 12 Authority to Change 1

2 APPLICABLE DOCUMENTS 2

21 FAA Documents 2 22 Other Documents 3

3 OTampEINTEGRATION PHILOSOPHY 3

4 TampE APPROACH AND CONCEPT 4

41 Test Configuration 4

42 Test Categories 4

43 Critical Requirements 9 44 Verification Methods 9

5 TEST PROGRAM FLOW DIAGRAM 10

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES 10

61 Responsibilities 10 62 Roles 10 63 Support Contractors 12

7 DOCUMENT REQUIREMENTS AND CONTROL 12

71 Documentation Tree 12 72 Operating and Control Documents 12

8 TRAINING 14

9 TEST SUPPORT 14

91 Instrumentation 14 92 Data Analysis 17 93 Test Site Configuration 17

10 REVIEWS AND REPORTS 17

101 Test Readiness Review (TRR) 17 102 Test Schedule Status Review (TSSR) Meetings 17 103 Post-Test Review 18 104 DRR 18 105 Quick Look Reports 18 106 Final Test Report 18

iii

TABLE OF CONTENTS (Continued)

Page

n SCHEDULES 18

12 TVRTM 18

121 Column Definitions and Utilization 19

13 ABBREVIATIONS AND ACRONYMS 20

APPENDIXES

A - Runway Visual Range (RVR) Test Verification Requirements Traceability Matrix (TVRTM)

B - Test Discrepancy Reports

C - Test Schedule

LIST OF ILLUSTRATIONS

Figure Page

4-1 RVR FunctionalPhysical Interfaces 5 41-1 RVR OTampEIntegration Test Configuration 6 51-1 RVR OTampEIntegration Test Program Flow Diagram 11 71-1 RVR Verification Documentation Tree 13 723-1 Test Conduct Log 15 724-1 Test bbserverMonitor Record 16

iv

1 INTRODUCTION

The Runway Visual Range system (RVR) is a flexible modular system that will provide runway visual range data at various points along a precision approach runway These data products will be automatically processed and distributed to air traffic controllers The data is then presented to the pilot by the controller in a numerical format equating to the number of feet forward along a departure or landing runway that the pilot may be expected to see

The RVR system consists of visibility sensors an ambient light sensor runway light intensity monitors a processor with associated softwarefirmware displays digital data distribution links and a built-in remote maintenance monitoring capability

The functions of the RVR system include the data acquisition and processing of the measurement of the atmospheric scattering coefficient ambient luminance and runway light intensity for RVR product dissemination

The RVR will provide runway visual range data updated at least once per minute at various points of a precision approach runway in accordance with FAA specified siting criteria RVRs may also be installed on nonprecision runways for takeoff and capacity enhancement reasons RVRs operate in a variety of configurations employing varying numbers of visibility sensors and runway light intensity monitors without human attendance

11 SCOPE

This document provides the overall philosophy and approach to the Operational Test and Evaluation (OTampE)Integration test of the RVR system This test plan identifies interface and system-level requirements of the RVR necessary to satisfy the National Airspace System (NAS) OTampElntegration test requirements contained in the RVR Test Verification Requirements Traceability Matrix (TVRTM) presented in appendix A of this document

The plan will also identify the test verification methodsrequirements that will be required to meet OTampElntegration test criteria The information contained within this plan has been structured to provide guidance to support OTampElntegration testing at one of the designated locations scheduled to receive the RVR system

12 AUTHORITY TO CHANGE

Modificationsrevisions to this plan shall be proposed in writing to the Federal Aviation Administration (FAA) Technical Center Engineering Test and Evaluation Service The proposal shall (1) clearly document the section number of the plan (2) document the information currently contained in the plan and (3) document the proposed modification The reason for this proposed modification shall also be defined The CommunicationsNavigationSurveillance Division shall maintain a record of all dispositions and subsequent revisions to the plan

1

2 APPLICABLE DOCUMENTS

This section lists the applicable documentation and reference materials which relate to the contents of

21 FAA DOCUMENTS

211 FAA Specifications

FAA-E-2772

NAS-SS-IOOO

NAS-SR-IOOO

NAS-DD-IOOO

212 FAA Standards

FAA-STD-024a

213 FAA Orders

FAA Order No 18104A

this plan or upon which this plan is based

RVR System Specification (Revision 3) 62387

Functional and Performance Requirements for the NAS System Specification Volumes I III and V

NAS System Requirements

Level One Design Document

Preparation of Test and Evaluation Documentation B1787

FAA NAS Test and Evaluation Program

214 Other FAA

NAS-MD-110

NAS-MD-790

NAS-MD-79l

NAS-MD-792

Documents

Test and Evaluation (TampE) Terms and Definitions for the NAS 32787

Remote Maintenance Monitoring System (RMMS) Interface Control Document

Guidelines for the Development of Level II Interface Control Documents for RMMS

Operational Requirements for the RMMS

2

NAS-MD-793 RMS Functional Requirements for the Remote Monitoring Subsystem (RMS)

Master Test Plan Runway Visual Range (RVR) Master Test Plan

22 OTHER DOCUMENTS

DTFAOl-88-C-00024 RVR Contract (mods 1-8)

NAS-IR-33102201 RVRTCCC

NAS-IR-33109301 RVRASOS (IGD dated July 13 1990)

RVRMPS IRD RVRMPS IRD Teledyne Drawing 861240 Rev B

RVRMPS ICD RVRMPS ICD Teledyne Drawing 861233 Rev B

RVRMDT lRD RVRMDT lRD Teledyne Drawing 861241 Rev B

RVRMDT lCD RVRMDT lCD Teledyne Drawing 861234 Rev B

3 OTampEINTEGRATION PHILOSOPHY

The RVR overall OTampElntegration philosophy is to verify that the interfaces between the existing NAS system and the RVR which provides new and improved functional and operational performance capabilities operates correctly as specified with no degradation to the NAS operation

FAA Order 18l04A delegates the responsibility for OTampElntegration testing to the Engineering Test and Evaluation Service CommunicationsNavigationSurveillance Division ACN-200 Weather and Remote Maintenance Monitoring Systems Branch ACN-250 at the FAA Technical Center

The RVR OTampElntegration test will verify requirements from the NAS-SS-lOOO Volumes I-V and the NAS Interface Requirements Documents (IRD) Verification Requirements Traceability Matrix (VRTM) as identified in the RVR Master Test Plan (MTP) VRTM The success criteria for these requirements will be detailed in the OTampElntegration test procedures The OTampElntegration testing will include an operational evaluation to assess the operational suitability and effectiveness of the Controller Display (CD) as part of the RVR system ACN-250 will support the Navigation and Landing Engineering Division (ANN-lOO) and the Visual Aids Branch (ANN-140) to accomplish the RVR OTampElntegration Test

3

The RVR OTampEIntegration test will be conducted by ACN-250 at the designated operational test site In accordance with the MTP and 18104A all subsystems identified in this test plan will be tested either by live or electronic means Upon completion of these testing activities test results will be analyzed to assure verification of the NAS requirements

ACN-250 will support ANN-140 in the monitoring of the Factory Acceptance Tests (FAT) and the Site Acceptance Tests (SAT) In agreement with ANN-140 NAS requirements that may be verified during the conduct of the FAT and SAT test activities ~ill not e d ated

4 TampE APPROACH AND CONCEPT

To determine the overall interoperability of the RVR with the NAS environment OTampEIntegration testing will require testing of the RVR subsystem in an environment as near operational as possible The term operational relates to the configuration into which the RVR must be integrated For this reason both live andor simulated interfacing subsystems and equipment will be used To the extent possible RVR OTampElntegration testing will be performed using all interconnectionsinterfaces available and appropriate to the RVR system (see figure 4-1)

41 TEST CONFIGURATION

RVR OTampEIntegration consists of one configuration as shown in figure 41-1 Each interconnectioninterface within this configuration is defined as a verification category For ease of identification a letter has been assigned to each verification category

42 TEST CATEGORIES

Categories to be tested and verified as satisfactorily interfaced with the RVR as part of the NAS system are

Category A - Maintenance Processor System (MPS) interface

Category B - Maintenance Data Terminal (MDT) interface

Category C - Ex~ernal Coded Time Source (ECTS) interface (Note We will not address testing of this category per Case File Number NNl40-RVR-OOl)

Category D - Tower Computer Control Complex (IeGG) interface

Category E - Automated Surface Observing System (ASOS) interface

Gategory F - Operational Evaluation of the CD

4

LEGEND ~-lI I bull ONE WAY DATA FLOW

4 bull

~ r-

TE _ bull J

TWO WAY DATA flOW

~ 4

SUBSYSTEM

TRANSMISSION EQUIPMENT

PROVIDING CONNECTIVITY

BETWUN INTERfACES

or -

TE i L_ bull 1

I

RVR

---- bull RMS I

I

I I I I I

____ Jbull I

T] ~

rE] ~

FIGURE 4-1 RVR FUNCTIONALPHYSICAL INTERFACES

TEST CONFIGURATION

RVR

VE RI FICATIO CATEGORIES

A

MPS

B

MOT

C

THIS CATEGORY HAS BEEN DELETED

D

Teee

E

ASOS

tI ~

INTERFACES wrrH RVR

FIGURE 41-1 RVR OTampEINTEGRATION TEST CONFIGURATION

6

I

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 2: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

o FAA Goln Jose~h et a1 C1-TN Runway visual r nge (RVR) oper

FAA Technical Center

IIJllllllillIm IIIIWIIIIII~ Illil ~~ m1111

914 c 2

ati na~ test and valuatio

00016490

NOTICE

This document Is disseminated under the sponsorship of the US Department of Transportation in the interest of Information exchange The United States Government assumes no liability for the contents or use thereof

The United States Govemment does not endorse products or manufacturers Trade or manufacturers names appear herein solely because they are considered essential to the objective of this report

Technical Report Documentotion Page

1 Report Illgt 2 GOllernmenr Accl5sion No J R~cpj~n Catalog No

DOTFAACT-TN9l4

4 Title and Subrille 5 Report Oote

RUNWAY VISUAL RANGE (RVR) OPERATIONAL TEST August 1991 AND EVALUATION (OTampE)INTEGRATION TEST PLAN 6 prforming Organi taflon Code

1----------------------------------------- a P 8forml9 OrCj1oni zari on Report No

7 Author) Joseph Goslin Frances A Mackuse ACN-250 Bruce E Ware Alanna Randazzo UAL DOTFAAGT-TN9l4

9 Performing Organization Name and Address

US Department of Transportation Federal Aviation Administration Technical Center Atlantic City International Airport New Jersey 08405

10 Wok Unt No (TRAIS)

11 Conroct or Gant No

13 Type of Repo and Peod Covered

12 Sponsoing Agency Name and Addr

US Department of Transportation Federal Aviation Administration Technical Center Atlantic City International Airport New Jersey 08405

Technical Note 14 Sponsoring Agncy Code

15 Supplementary Not bullbull

16 Abstract

The Runway Visual Range (RVR) system consists of a group of sensors with associated softwarefirmware displays and data distribution links The data provided by this array of sensors will provide runway visual range at various points of a precision approach runway These RVR products will be automatically processed and distributed to air traffic controllers The data is then presented to the pilot by the controller in a numerical format equating to the number of feet forward along the runway that a pilot may be expected to see

17 KeyWod

Runway Visual Range (RVR) Remote Maintenance Monitoring System Atmospheric Scattering Coefficient Operational Test and Evaluation (OTampE)

18 Oi i bution Stotement

Document is on file at the Technical Center Library Atlantic City International Airport New Jersey 08405

22 Price20 Secui Iy Classi F (of tni pog)19 Secu Iy Clall f (ol Ini eport)

44UnclassifiedUnclassified

Form DOT F 17007 (8-72) Reproduction of completed page authorized

TABLE OF CONTENTS

Page

1 INTRODUCTION 1

11 Scope 1 12 Authority to Change 1

2 APPLICABLE DOCUMENTS 2

21 FAA Documents 2 22 Other Documents 3

3 OTampEINTEGRATION PHILOSOPHY 3

4 TampE APPROACH AND CONCEPT 4

41 Test Configuration 4

42 Test Categories 4

43 Critical Requirements 9 44 Verification Methods 9

5 TEST PROGRAM FLOW DIAGRAM 10

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES 10

61 Responsibilities 10 62 Roles 10 63 Support Contractors 12

7 DOCUMENT REQUIREMENTS AND CONTROL 12

71 Documentation Tree 12 72 Operating and Control Documents 12

8 TRAINING 14

9 TEST SUPPORT 14

91 Instrumentation 14 92 Data Analysis 17 93 Test Site Configuration 17

10 REVIEWS AND REPORTS 17

101 Test Readiness Review (TRR) 17 102 Test Schedule Status Review (TSSR) Meetings 17 103 Post-Test Review 18 104 DRR 18 105 Quick Look Reports 18 106 Final Test Report 18

iii

TABLE OF CONTENTS (Continued)

Page

n SCHEDULES 18

12 TVRTM 18

121 Column Definitions and Utilization 19

13 ABBREVIATIONS AND ACRONYMS 20

APPENDIXES

A - Runway Visual Range (RVR) Test Verification Requirements Traceability Matrix (TVRTM)

B - Test Discrepancy Reports

C - Test Schedule

LIST OF ILLUSTRATIONS

Figure Page

4-1 RVR FunctionalPhysical Interfaces 5 41-1 RVR OTampEIntegration Test Configuration 6 51-1 RVR OTampEIntegration Test Program Flow Diagram 11 71-1 RVR Verification Documentation Tree 13 723-1 Test Conduct Log 15 724-1 Test bbserverMonitor Record 16

iv

1 INTRODUCTION

The Runway Visual Range system (RVR) is a flexible modular system that will provide runway visual range data at various points along a precision approach runway These data products will be automatically processed and distributed to air traffic controllers The data is then presented to the pilot by the controller in a numerical format equating to the number of feet forward along a departure or landing runway that the pilot may be expected to see

The RVR system consists of visibility sensors an ambient light sensor runway light intensity monitors a processor with associated softwarefirmware displays digital data distribution links and a built-in remote maintenance monitoring capability

The functions of the RVR system include the data acquisition and processing of the measurement of the atmospheric scattering coefficient ambient luminance and runway light intensity for RVR product dissemination

The RVR will provide runway visual range data updated at least once per minute at various points of a precision approach runway in accordance with FAA specified siting criteria RVRs may also be installed on nonprecision runways for takeoff and capacity enhancement reasons RVRs operate in a variety of configurations employing varying numbers of visibility sensors and runway light intensity monitors without human attendance

11 SCOPE

This document provides the overall philosophy and approach to the Operational Test and Evaluation (OTampE)Integration test of the RVR system This test plan identifies interface and system-level requirements of the RVR necessary to satisfy the National Airspace System (NAS) OTampElntegration test requirements contained in the RVR Test Verification Requirements Traceability Matrix (TVRTM) presented in appendix A of this document

The plan will also identify the test verification methodsrequirements that will be required to meet OTampElntegration test criteria The information contained within this plan has been structured to provide guidance to support OTampElntegration testing at one of the designated locations scheduled to receive the RVR system

12 AUTHORITY TO CHANGE

Modificationsrevisions to this plan shall be proposed in writing to the Federal Aviation Administration (FAA) Technical Center Engineering Test and Evaluation Service The proposal shall (1) clearly document the section number of the plan (2) document the information currently contained in the plan and (3) document the proposed modification The reason for this proposed modification shall also be defined The CommunicationsNavigationSurveillance Division shall maintain a record of all dispositions and subsequent revisions to the plan

1

2 APPLICABLE DOCUMENTS

This section lists the applicable documentation and reference materials which relate to the contents of

21 FAA DOCUMENTS

211 FAA Specifications

FAA-E-2772

NAS-SS-IOOO

NAS-SR-IOOO

NAS-DD-IOOO

212 FAA Standards

FAA-STD-024a

213 FAA Orders

FAA Order No 18104A

this plan or upon which this plan is based

RVR System Specification (Revision 3) 62387

Functional and Performance Requirements for the NAS System Specification Volumes I III and V

NAS System Requirements

Level One Design Document

Preparation of Test and Evaluation Documentation B1787

FAA NAS Test and Evaluation Program

214 Other FAA

NAS-MD-110

NAS-MD-790

NAS-MD-79l

NAS-MD-792

Documents

Test and Evaluation (TampE) Terms and Definitions for the NAS 32787

Remote Maintenance Monitoring System (RMMS) Interface Control Document

Guidelines for the Development of Level II Interface Control Documents for RMMS

Operational Requirements for the RMMS

2

NAS-MD-793 RMS Functional Requirements for the Remote Monitoring Subsystem (RMS)

Master Test Plan Runway Visual Range (RVR) Master Test Plan

22 OTHER DOCUMENTS

DTFAOl-88-C-00024 RVR Contract (mods 1-8)

NAS-IR-33102201 RVRTCCC

NAS-IR-33109301 RVRASOS (IGD dated July 13 1990)

RVRMPS IRD RVRMPS IRD Teledyne Drawing 861240 Rev B

RVRMPS ICD RVRMPS ICD Teledyne Drawing 861233 Rev B

RVRMDT lRD RVRMDT lRD Teledyne Drawing 861241 Rev B

RVRMDT lCD RVRMDT lCD Teledyne Drawing 861234 Rev B

3 OTampEINTEGRATION PHILOSOPHY

The RVR overall OTampElntegration philosophy is to verify that the interfaces between the existing NAS system and the RVR which provides new and improved functional and operational performance capabilities operates correctly as specified with no degradation to the NAS operation

FAA Order 18l04A delegates the responsibility for OTampElntegration testing to the Engineering Test and Evaluation Service CommunicationsNavigationSurveillance Division ACN-200 Weather and Remote Maintenance Monitoring Systems Branch ACN-250 at the FAA Technical Center

The RVR OTampElntegration test will verify requirements from the NAS-SS-lOOO Volumes I-V and the NAS Interface Requirements Documents (IRD) Verification Requirements Traceability Matrix (VRTM) as identified in the RVR Master Test Plan (MTP) VRTM The success criteria for these requirements will be detailed in the OTampElntegration test procedures The OTampElntegration testing will include an operational evaluation to assess the operational suitability and effectiveness of the Controller Display (CD) as part of the RVR system ACN-250 will support the Navigation and Landing Engineering Division (ANN-lOO) and the Visual Aids Branch (ANN-140) to accomplish the RVR OTampElntegration Test

3

The RVR OTampEIntegration test will be conducted by ACN-250 at the designated operational test site In accordance with the MTP and 18104A all subsystems identified in this test plan will be tested either by live or electronic means Upon completion of these testing activities test results will be analyzed to assure verification of the NAS requirements

ACN-250 will support ANN-140 in the monitoring of the Factory Acceptance Tests (FAT) and the Site Acceptance Tests (SAT) In agreement with ANN-140 NAS requirements that may be verified during the conduct of the FAT and SAT test activities ~ill not e d ated

4 TampE APPROACH AND CONCEPT

To determine the overall interoperability of the RVR with the NAS environment OTampEIntegration testing will require testing of the RVR subsystem in an environment as near operational as possible The term operational relates to the configuration into which the RVR must be integrated For this reason both live andor simulated interfacing subsystems and equipment will be used To the extent possible RVR OTampElntegration testing will be performed using all interconnectionsinterfaces available and appropriate to the RVR system (see figure 4-1)

41 TEST CONFIGURATION

RVR OTampEIntegration consists of one configuration as shown in figure 41-1 Each interconnectioninterface within this configuration is defined as a verification category For ease of identification a letter has been assigned to each verification category

42 TEST CATEGORIES

Categories to be tested and verified as satisfactorily interfaced with the RVR as part of the NAS system are

Category A - Maintenance Processor System (MPS) interface

Category B - Maintenance Data Terminal (MDT) interface

Category C - Ex~ernal Coded Time Source (ECTS) interface (Note We will not address testing of this category per Case File Number NNl40-RVR-OOl)

Category D - Tower Computer Control Complex (IeGG) interface

Category E - Automated Surface Observing System (ASOS) interface

Gategory F - Operational Evaluation of the CD

4

LEGEND ~-lI I bull ONE WAY DATA FLOW

4 bull

~ r-

TE _ bull J

TWO WAY DATA flOW

~ 4

SUBSYSTEM

TRANSMISSION EQUIPMENT

PROVIDING CONNECTIVITY

BETWUN INTERfACES

or -

TE i L_ bull 1

I

RVR

---- bull RMS I

I

I I I I I

____ Jbull I

T] ~

rE] ~

FIGURE 4-1 RVR FUNCTIONALPHYSICAL INTERFACES

TEST CONFIGURATION

RVR

VE RI FICATIO CATEGORIES

A

MPS

B

MOT

C

THIS CATEGORY HAS BEEN DELETED

D

Teee

E

ASOS

tI ~

INTERFACES wrrH RVR

FIGURE 41-1 RVR OTampEINTEGRATION TEST CONFIGURATION

6

I

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 3: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

Technical Report Documentotion Page

1 Report Illgt 2 GOllernmenr Accl5sion No J R~cpj~n Catalog No

DOTFAACT-TN9l4

4 Title and Subrille 5 Report Oote

RUNWAY VISUAL RANGE (RVR) OPERATIONAL TEST August 1991 AND EVALUATION (OTampE)INTEGRATION TEST PLAN 6 prforming Organi taflon Code

1----------------------------------------- a P 8forml9 OrCj1oni zari on Report No

7 Author) Joseph Goslin Frances A Mackuse ACN-250 Bruce E Ware Alanna Randazzo UAL DOTFAAGT-TN9l4

9 Performing Organization Name and Address

US Department of Transportation Federal Aviation Administration Technical Center Atlantic City International Airport New Jersey 08405

10 Wok Unt No (TRAIS)

11 Conroct or Gant No

13 Type of Repo and Peod Covered

12 Sponsoing Agency Name and Addr

US Department of Transportation Federal Aviation Administration Technical Center Atlantic City International Airport New Jersey 08405

Technical Note 14 Sponsoring Agncy Code

15 Supplementary Not bullbull

16 Abstract

The Runway Visual Range (RVR) system consists of a group of sensors with associated softwarefirmware displays and data distribution links The data provided by this array of sensors will provide runway visual range at various points of a precision approach runway These RVR products will be automatically processed and distributed to air traffic controllers The data is then presented to the pilot by the controller in a numerical format equating to the number of feet forward along the runway that a pilot may be expected to see

17 KeyWod

Runway Visual Range (RVR) Remote Maintenance Monitoring System Atmospheric Scattering Coefficient Operational Test and Evaluation (OTampE)

18 Oi i bution Stotement

Document is on file at the Technical Center Library Atlantic City International Airport New Jersey 08405

22 Price20 Secui Iy Classi F (of tni pog)19 Secu Iy Clall f (ol Ini eport)

44UnclassifiedUnclassified

Form DOT F 17007 (8-72) Reproduction of completed page authorized

TABLE OF CONTENTS

Page

1 INTRODUCTION 1

11 Scope 1 12 Authority to Change 1

2 APPLICABLE DOCUMENTS 2

21 FAA Documents 2 22 Other Documents 3

3 OTampEINTEGRATION PHILOSOPHY 3

4 TampE APPROACH AND CONCEPT 4

41 Test Configuration 4

42 Test Categories 4

43 Critical Requirements 9 44 Verification Methods 9

5 TEST PROGRAM FLOW DIAGRAM 10

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES 10

61 Responsibilities 10 62 Roles 10 63 Support Contractors 12

7 DOCUMENT REQUIREMENTS AND CONTROL 12

71 Documentation Tree 12 72 Operating and Control Documents 12

8 TRAINING 14

9 TEST SUPPORT 14

91 Instrumentation 14 92 Data Analysis 17 93 Test Site Configuration 17

10 REVIEWS AND REPORTS 17

101 Test Readiness Review (TRR) 17 102 Test Schedule Status Review (TSSR) Meetings 17 103 Post-Test Review 18 104 DRR 18 105 Quick Look Reports 18 106 Final Test Report 18

iii

TABLE OF CONTENTS (Continued)

Page

n SCHEDULES 18

12 TVRTM 18

121 Column Definitions and Utilization 19

13 ABBREVIATIONS AND ACRONYMS 20

APPENDIXES

A - Runway Visual Range (RVR) Test Verification Requirements Traceability Matrix (TVRTM)

B - Test Discrepancy Reports

C - Test Schedule

LIST OF ILLUSTRATIONS

Figure Page

4-1 RVR FunctionalPhysical Interfaces 5 41-1 RVR OTampEIntegration Test Configuration 6 51-1 RVR OTampEIntegration Test Program Flow Diagram 11 71-1 RVR Verification Documentation Tree 13 723-1 Test Conduct Log 15 724-1 Test bbserverMonitor Record 16

iv

1 INTRODUCTION

The Runway Visual Range system (RVR) is a flexible modular system that will provide runway visual range data at various points along a precision approach runway These data products will be automatically processed and distributed to air traffic controllers The data is then presented to the pilot by the controller in a numerical format equating to the number of feet forward along a departure or landing runway that the pilot may be expected to see

The RVR system consists of visibility sensors an ambient light sensor runway light intensity monitors a processor with associated softwarefirmware displays digital data distribution links and a built-in remote maintenance monitoring capability

The functions of the RVR system include the data acquisition and processing of the measurement of the atmospheric scattering coefficient ambient luminance and runway light intensity for RVR product dissemination

The RVR will provide runway visual range data updated at least once per minute at various points of a precision approach runway in accordance with FAA specified siting criteria RVRs may also be installed on nonprecision runways for takeoff and capacity enhancement reasons RVRs operate in a variety of configurations employing varying numbers of visibility sensors and runway light intensity monitors without human attendance

11 SCOPE

This document provides the overall philosophy and approach to the Operational Test and Evaluation (OTampE)Integration test of the RVR system This test plan identifies interface and system-level requirements of the RVR necessary to satisfy the National Airspace System (NAS) OTampElntegration test requirements contained in the RVR Test Verification Requirements Traceability Matrix (TVRTM) presented in appendix A of this document

The plan will also identify the test verification methodsrequirements that will be required to meet OTampElntegration test criteria The information contained within this plan has been structured to provide guidance to support OTampElntegration testing at one of the designated locations scheduled to receive the RVR system

12 AUTHORITY TO CHANGE

Modificationsrevisions to this plan shall be proposed in writing to the Federal Aviation Administration (FAA) Technical Center Engineering Test and Evaluation Service The proposal shall (1) clearly document the section number of the plan (2) document the information currently contained in the plan and (3) document the proposed modification The reason for this proposed modification shall also be defined The CommunicationsNavigationSurveillance Division shall maintain a record of all dispositions and subsequent revisions to the plan

1

2 APPLICABLE DOCUMENTS

This section lists the applicable documentation and reference materials which relate to the contents of

21 FAA DOCUMENTS

211 FAA Specifications

FAA-E-2772

NAS-SS-IOOO

NAS-SR-IOOO

NAS-DD-IOOO

212 FAA Standards

FAA-STD-024a

213 FAA Orders

FAA Order No 18104A

this plan or upon which this plan is based

RVR System Specification (Revision 3) 62387

Functional and Performance Requirements for the NAS System Specification Volumes I III and V

NAS System Requirements

Level One Design Document

Preparation of Test and Evaluation Documentation B1787

FAA NAS Test and Evaluation Program

214 Other FAA

NAS-MD-110

NAS-MD-790

NAS-MD-79l

NAS-MD-792

Documents

Test and Evaluation (TampE) Terms and Definitions for the NAS 32787

Remote Maintenance Monitoring System (RMMS) Interface Control Document

Guidelines for the Development of Level II Interface Control Documents for RMMS

Operational Requirements for the RMMS

2

NAS-MD-793 RMS Functional Requirements for the Remote Monitoring Subsystem (RMS)

Master Test Plan Runway Visual Range (RVR) Master Test Plan

22 OTHER DOCUMENTS

DTFAOl-88-C-00024 RVR Contract (mods 1-8)

NAS-IR-33102201 RVRTCCC

NAS-IR-33109301 RVRASOS (IGD dated July 13 1990)

RVRMPS IRD RVRMPS IRD Teledyne Drawing 861240 Rev B

RVRMPS ICD RVRMPS ICD Teledyne Drawing 861233 Rev B

RVRMDT lRD RVRMDT lRD Teledyne Drawing 861241 Rev B

RVRMDT lCD RVRMDT lCD Teledyne Drawing 861234 Rev B

3 OTampEINTEGRATION PHILOSOPHY

The RVR overall OTampElntegration philosophy is to verify that the interfaces between the existing NAS system and the RVR which provides new and improved functional and operational performance capabilities operates correctly as specified with no degradation to the NAS operation

FAA Order 18l04A delegates the responsibility for OTampElntegration testing to the Engineering Test and Evaluation Service CommunicationsNavigationSurveillance Division ACN-200 Weather and Remote Maintenance Monitoring Systems Branch ACN-250 at the FAA Technical Center

The RVR OTampElntegration test will verify requirements from the NAS-SS-lOOO Volumes I-V and the NAS Interface Requirements Documents (IRD) Verification Requirements Traceability Matrix (VRTM) as identified in the RVR Master Test Plan (MTP) VRTM The success criteria for these requirements will be detailed in the OTampElntegration test procedures The OTampElntegration testing will include an operational evaluation to assess the operational suitability and effectiveness of the Controller Display (CD) as part of the RVR system ACN-250 will support the Navigation and Landing Engineering Division (ANN-lOO) and the Visual Aids Branch (ANN-140) to accomplish the RVR OTampElntegration Test

3

The RVR OTampEIntegration test will be conducted by ACN-250 at the designated operational test site In accordance with the MTP and 18104A all subsystems identified in this test plan will be tested either by live or electronic means Upon completion of these testing activities test results will be analyzed to assure verification of the NAS requirements

ACN-250 will support ANN-140 in the monitoring of the Factory Acceptance Tests (FAT) and the Site Acceptance Tests (SAT) In agreement with ANN-140 NAS requirements that may be verified during the conduct of the FAT and SAT test activities ~ill not e d ated

4 TampE APPROACH AND CONCEPT

To determine the overall interoperability of the RVR with the NAS environment OTampEIntegration testing will require testing of the RVR subsystem in an environment as near operational as possible The term operational relates to the configuration into which the RVR must be integrated For this reason both live andor simulated interfacing subsystems and equipment will be used To the extent possible RVR OTampElntegration testing will be performed using all interconnectionsinterfaces available and appropriate to the RVR system (see figure 4-1)

41 TEST CONFIGURATION

RVR OTampEIntegration consists of one configuration as shown in figure 41-1 Each interconnectioninterface within this configuration is defined as a verification category For ease of identification a letter has been assigned to each verification category

42 TEST CATEGORIES

Categories to be tested and verified as satisfactorily interfaced with the RVR as part of the NAS system are

Category A - Maintenance Processor System (MPS) interface

Category B - Maintenance Data Terminal (MDT) interface

Category C - Ex~ernal Coded Time Source (ECTS) interface (Note We will not address testing of this category per Case File Number NNl40-RVR-OOl)

Category D - Tower Computer Control Complex (IeGG) interface

Category E - Automated Surface Observing System (ASOS) interface

Gategory F - Operational Evaluation of the CD

4

LEGEND ~-lI I bull ONE WAY DATA FLOW

4 bull

~ r-

TE _ bull J

TWO WAY DATA flOW

~ 4

SUBSYSTEM

TRANSMISSION EQUIPMENT

PROVIDING CONNECTIVITY

BETWUN INTERfACES

or -

TE i L_ bull 1

I

RVR

---- bull RMS I

I

I I I I I

____ Jbull I

T] ~

rE] ~

FIGURE 4-1 RVR FUNCTIONALPHYSICAL INTERFACES

TEST CONFIGURATION

RVR

VE RI FICATIO CATEGORIES

A

MPS

B

MOT

C

THIS CATEGORY HAS BEEN DELETED

D

Teee

E

ASOS

tI ~

INTERFACES wrrH RVR

FIGURE 41-1 RVR OTampEINTEGRATION TEST CONFIGURATION

6

I

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 4: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

TABLE OF CONTENTS

Page

1 INTRODUCTION 1

11 Scope 1 12 Authority to Change 1

2 APPLICABLE DOCUMENTS 2

21 FAA Documents 2 22 Other Documents 3

3 OTampEINTEGRATION PHILOSOPHY 3

4 TampE APPROACH AND CONCEPT 4

41 Test Configuration 4

42 Test Categories 4

43 Critical Requirements 9 44 Verification Methods 9

5 TEST PROGRAM FLOW DIAGRAM 10

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES 10

61 Responsibilities 10 62 Roles 10 63 Support Contractors 12

7 DOCUMENT REQUIREMENTS AND CONTROL 12

71 Documentation Tree 12 72 Operating and Control Documents 12

8 TRAINING 14

9 TEST SUPPORT 14

91 Instrumentation 14 92 Data Analysis 17 93 Test Site Configuration 17

10 REVIEWS AND REPORTS 17

101 Test Readiness Review (TRR) 17 102 Test Schedule Status Review (TSSR) Meetings 17 103 Post-Test Review 18 104 DRR 18 105 Quick Look Reports 18 106 Final Test Report 18

iii

TABLE OF CONTENTS (Continued)

Page

n SCHEDULES 18

12 TVRTM 18

121 Column Definitions and Utilization 19

13 ABBREVIATIONS AND ACRONYMS 20

APPENDIXES

A - Runway Visual Range (RVR) Test Verification Requirements Traceability Matrix (TVRTM)

B - Test Discrepancy Reports

C - Test Schedule

LIST OF ILLUSTRATIONS

Figure Page

4-1 RVR FunctionalPhysical Interfaces 5 41-1 RVR OTampEIntegration Test Configuration 6 51-1 RVR OTampEIntegration Test Program Flow Diagram 11 71-1 RVR Verification Documentation Tree 13 723-1 Test Conduct Log 15 724-1 Test bbserverMonitor Record 16

iv

1 INTRODUCTION

The Runway Visual Range system (RVR) is a flexible modular system that will provide runway visual range data at various points along a precision approach runway These data products will be automatically processed and distributed to air traffic controllers The data is then presented to the pilot by the controller in a numerical format equating to the number of feet forward along a departure or landing runway that the pilot may be expected to see

The RVR system consists of visibility sensors an ambient light sensor runway light intensity monitors a processor with associated softwarefirmware displays digital data distribution links and a built-in remote maintenance monitoring capability

The functions of the RVR system include the data acquisition and processing of the measurement of the atmospheric scattering coefficient ambient luminance and runway light intensity for RVR product dissemination

The RVR will provide runway visual range data updated at least once per minute at various points of a precision approach runway in accordance with FAA specified siting criteria RVRs may also be installed on nonprecision runways for takeoff and capacity enhancement reasons RVRs operate in a variety of configurations employing varying numbers of visibility sensors and runway light intensity monitors without human attendance

11 SCOPE

This document provides the overall philosophy and approach to the Operational Test and Evaluation (OTampE)Integration test of the RVR system This test plan identifies interface and system-level requirements of the RVR necessary to satisfy the National Airspace System (NAS) OTampElntegration test requirements contained in the RVR Test Verification Requirements Traceability Matrix (TVRTM) presented in appendix A of this document

The plan will also identify the test verification methodsrequirements that will be required to meet OTampElntegration test criteria The information contained within this plan has been structured to provide guidance to support OTampElntegration testing at one of the designated locations scheduled to receive the RVR system

12 AUTHORITY TO CHANGE

Modificationsrevisions to this plan shall be proposed in writing to the Federal Aviation Administration (FAA) Technical Center Engineering Test and Evaluation Service The proposal shall (1) clearly document the section number of the plan (2) document the information currently contained in the plan and (3) document the proposed modification The reason for this proposed modification shall also be defined The CommunicationsNavigationSurveillance Division shall maintain a record of all dispositions and subsequent revisions to the plan

1

2 APPLICABLE DOCUMENTS

This section lists the applicable documentation and reference materials which relate to the contents of

21 FAA DOCUMENTS

211 FAA Specifications

FAA-E-2772

NAS-SS-IOOO

NAS-SR-IOOO

NAS-DD-IOOO

212 FAA Standards

FAA-STD-024a

213 FAA Orders

FAA Order No 18104A

this plan or upon which this plan is based

RVR System Specification (Revision 3) 62387

Functional and Performance Requirements for the NAS System Specification Volumes I III and V

NAS System Requirements

Level One Design Document

Preparation of Test and Evaluation Documentation B1787

FAA NAS Test and Evaluation Program

214 Other FAA

NAS-MD-110

NAS-MD-790

NAS-MD-79l

NAS-MD-792

Documents

Test and Evaluation (TampE) Terms and Definitions for the NAS 32787

Remote Maintenance Monitoring System (RMMS) Interface Control Document

Guidelines for the Development of Level II Interface Control Documents for RMMS

Operational Requirements for the RMMS

2

NAS-MD-793 RMS Functional Requirements for the Remote Monitoring Subsystem (RMS)

Master Test Plan Runway Visual Range (RVR) Master Test Plan

22 OTHER DOCUMENTS

DTFAOl-88-C-00024 RVR Contract (mods 1-8)

NAS-IR-33102201 RVRTCCC

NAS-IR-33109301 RVRASOS (IGD dated July 13 1990)

RVRMPS IRD RVRMPS IRD Teledyne Drawing 861240 Rev B

RVRMPS ICD RVRMPS ICD Teledyne Drawing 861233 Rev B

RVRMDT lRD RVRMDT lRD Teledyne Drawing 861241 Rev B

RVRMDT lCD RVRMDT lCD Teledyne Drawing 861234 Rev B

3 OTampEINTEGRATION PHILOSOPHY

The RVR overall OTampElntegration philosophy is to verify that the interfaces between the existing NAS system and the RVR which provides new and improved functional and operational performance capabilities operates correctly as specified with no degradation to the NAS operation

FAA Order 18l04A delegates the responsibility for OTampElntegration testing to the Engineering Test and Evaluation Service CommunicationsNavigationSurveillance Division ACN-200 Weather and Remote Maintenance Monitoring Systems Branch ACN-250 at the FAA Technical Center

The RVR OTampElntegration test will verify requirements from the NAS-SS-lOOO Volumes I-V and the NAS Interface Requirements Documents (IRD) Verification Requirements Traceability Matrix (VRTM) as identified in the RVR Master Test Plan (MTP) VRTM The success criteria for these requirements will be detailed in the OTampElntegration test procedures The OTampElntegration testing will include an operational evaluation to assess the operational suitability and effectiveness of the Controller Display (CD) as part of the RVR system ACN-250 will support the Navigation and Landing Engineering Division (ANN-lOO) and the Visual Aids Branch (ANN-140) to accomplish the RVR OTampElntegration Test

3

The RVR OTampEIntegration test will be conducted by ACN-250 at the designated operational test site In accordance with the MTP and 18104A all subsystems identified in this test plan will be tested either by live or electronic means Upon completion of these testing activities test results will be analyzed to assure verification of the NAS requirements

ACN-250 will support ANN-140 in the monitoring of the Factory Acceptance Tests (FAT) and the Site Acceptance Tests (SAT) In agreement with ANN-140 NAS requirements that may be verified during the conduct of the FAT and SAT test activities ~ill not e d ated

4 TampE APPROACH AND CONCEPT

To determine the overall interoperability of the RVR with the NAS environment OTampEIntegration testing will require testing of the RVR subsystem in an environment as near operational as possible The term operational relates to the configuration into which the RVR must be integrated For this reason both live andor simulated interfacing subsystems and equipment will be used To the extent possible RVR OTampElntegration testing will be performed using all interconnectionsinterfaces available and appropriate to the RVR system (see figure 4-1)

41 TEST CONFIGURATION

RVR OTampEIntegration consists of one configuration as shown in figure 41-1 Each interconnectioninterface within this configuration is defined as a verification category For ease of identification a letter has been assigned to each verification category

42 TEST CATEGORIES

Categories to be tested and verified as satisfactorily interfaced with the RVR as part of the NAS system are

Category A - Maintenance Processor System (MPS) interface

Category B - Maintenance Data Terminal (MDT) interface

Category C - Ex~ernal Coded Time Source (ECTS) interface (Note We will not address testing of this category per Case File Number NNl40-RVR-OOl)

Category D - Tower Computer Control Complex (IeGG) interface

Category E - Automated Surface Observing System (ASOS) interface

Gategory F - Operational Evaluation of the CD

4

LEGEND ~-lI I bull ONE WAY DATA FLOW

4 bull

~ r-

TE _ bull J

TWO WAY DATA flOW

~ 4

SUBSYSTEM

TRANSMISSION EQUIPMENT

PROVIDING CONNECTIVITY

BETWUN INTERfACES

or -

TE i L_ bull 1

I

RVR

---- bull RMS I

I

I I I I I

____ Jbull I

T] ~

rE] ~

FIGURE 4-1 RVR FUNCTIONALPHYSICAL INTERFACES

TEST CONFIGURATION

RVR

VE RI FICATIO CATEGORIES

A

MPS

B

MOT

C

THIS CATEGORY HAS BEEN DELETED

D

Teee

E

ASOS

tI ~

INTERFACES wrrH RVR

FIGURE 41-1 RVR OTampEINTEGRATION TEST CONFIGURATION

6

I

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 5: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

TABLE OF CONTENTS (Continued)

Page

n SCHEDULES 18

12 TVRTM 18

121 Column Definitions and Utilization 19

13 ABBREVIATIONS AND ACRONYMS 20

APPENDIXES

A - Runway Visual Range (RVR) Test Verification Requirements Traceability Matrix (TVRTM)

B - Test Discrepancy Reports

C - Test Schedule

LIST OF ILLUSTRATIONS

Figure Page

4-1 RVR FunctionalPhysical Interfaces 5 41-1 RVR OTampEIntegration Test Configuration 6 51-1 RVR OTampEIntegration Test Program Flow Diagram 11 71-1 RVR Verification Documentation Tree 13 723-1 Test Conduct Log 15 724-1 Test bbserverMonitor Record 16

iv

1 INTRODUCTION

The Runway Visual Range system (RVR) is a flexible modular system that will provide runway visual range data at various points along a precision approach runway These data products will be automatically processed and distributed to air traffic controllers The data is then presented to the pilot by the controller in a numerical format equating to the number of feet forward along a departure or landing runway that the pilot may be expected to see

The RVR system consists of visibility sensors an ambient light sensor runway light intensity monitors a processor with associated softwarefirmware displays digital data distribution links and a built-in remote maintenance monitoring capability

The functions of the RVR system include the data acquisition and processing of the measurement of the atmospheric scattering coefficient ambient luminance and runway light intensity for RVR product dissemination

The RVR will provide runway visual range data updated at least once per minute at various points of a precision approach runway in accordance with FAA specified siting criteria RVRs may also be installed on nonprecision runways for takeoff and capacity enhancement reasons RVRs operate in a variety of configurations employing varying numbers of visibility sensors and runway light intensity monitors without human attendance

11 SCOPE

This document provides the overall philosophy and approach to the Operational Test and Evaluation (OTampE)Integration test of the RVR system This test plan identifies interface and system-level requirements of the RVR necessary to satisfy the National Airspace System (NAS) OTampElntegration test requirements contained in the RVR Test Verification Requirements Traceability Matrix (TVRTM) presented in appendix A of this document

The plan will also identify the test verification methodsrequirements that will be required to meet OTampElntegration test criteria The information contained within this plan has been structured to provide guidance to support OTampElntegration testing at one of the designated locations scheduled to receive the RVR system

12 AUTHORITY TO CHANGE

Modificationsrevisions to this plan shall be proposed in writing to the Federal Aviation Administration (FAA) Technical Center Engineering Test and Evaluation Service The proposal shall (1) clearly document the section number of the plan (2) document the information currently contained in the plan and (3) document the proposed modification The reason for this proposed modification shall also be defined The CommunicationsNavigationSurveillance Division shall maintain a record of all dispositions and subsequent revisions to the plan

1

2 APPLICABLE DOCUMENTS

This section lists the applicable documentation and reference materials which relate to the contents of

21 FAA DOCUMENTS

211 FAA Specifications

FAA-E-2772

NAS-SS-IOOO

NAS-SR-IOOO

NAS-DD-IOOO

212 FAA Standards

FAA-STD-024a

213 FAA Orders

FAA Order No 18104A

this plan or upon which this plan is based

RVR System Specification (Revision 3) 62387

Functional and Performance Requirements for the NAS System Specification Volumes I III and V

NAS System Requirements

Level One Design Document

Preparation of Test and Evaluation Documentation B1787

FAA NAS Test and Evaluation Program

214 Other FAA

NAS-MD-110

NAS-MD-790

NAS-MD-79l

NAS-MD-792

Documents

Test and Evaluation (TampE) Terms and Definitions for the NAS 32787

Remote Maintenance Monitoring System (RMMS) Interface Control Document

Guidelines for the Development of Level II Interface Control Documents for RMMS

Operational Requirements for the RMMS

2

NAS-MD-793 RMS Functional Requirements for the Remote Monitoring Subsystem (RMS)

Master Test Plan Runway Visual Range (RVR) Master Test Plan

22 OTHER DOCUMENTS

DTFAOl-88-C-00024 RVR Contract (mods 1-8)

NAS-IR-33102201 RVRTCCC

NAS-IR-33109301 RVRASOS (IGD dated July 13 1990)

RVRMPS IRD RVRMPS IRD Teledyne Drawing 861240 Rev B

RVRMPS ICD RVRMPS ICD Teledyne Drawing 861233 Rev B

RVRMDT lRD RVRMDT lRD Teledyne Drawing 861241 Rev B

RVRMDT lCD RVRMDT lCD Teledyne Drawing 861234 Rev B

3 OTampEINTEGRATION PHILOSOPHY

The RVR overall OTampElntegration philosophy is to verify that the interfaces between the existing NAS system and the RVR which provides new and improved functional and operational performance capabilities operates correctly as specified with no degradation to the NAS operation

FAA Order 18l04A delegates the responsibility for OTampElntegration testing to the Engineering Test and Evaluation Service CommunicationsNavigationSurveillance Division ACN-200 Weather and Remote Maintenance Monitoring Systems Branch ACN-250 at the FAA Technical Center

The RVR OTampElntegration test will verify requirements from the NAS-SS-lOOO Volumes I-V and the NAS Interface Requirements Documents (IRD) Verification Requirements Traceability Matrix (VRTM) as identified in the RVR Master Test Plan (MTP) VRTM The success criteria for these requirements will be detailed in the OTampElntegration test procedures The OTampElntegration testing will include an operational evaluation to assess the operational suitability and effectiveness of the Controller Display (CD) as part of the RVR system ACN-250 will support the Navigation and Landing Engineering Division (ANN-lOO) and the Visual Aids Branch (ANN-140) to accomplish the RVR OTampElntegration Test

3

The RVR OTampEIntegration test will be conducted by ACN-250 at the designated operational test site In accordance with the MTP and 18104A all subsystems identified in this test plan will be tested either by live or electronic means Upon completion of these testing activities test results will be analyzed to assure verification of the NAS requirements

ACN-250 will support ANN-140 in the monitoring of the Factory Acceptance Tests (FAT) and the Site Acceptance Tests (SAT) In agreement with ANN-140 NAS requirements that may be verified during the conduct of the FAT and SAT test activities ~ill not e d ated

4 TampE APPROACH AND CONCEPT

To determine the overall interoperability of the RVR with the NAS environment OTampEIntegration testing will require testing of the RVR subsystem in an environment as near operational as possible The term operational relates to the configuration into which the RVR must be integrated For this reason both live andor simulated interfacing subsystems and equipment will be used To the extent possible RVR OTampElntegration testing will be performed using all interconnectionsinterfaces available and appropriate to the RVR system (see figure 4-1)

41 TEST CONFIGURATION

RVR OTampEIntegration consists of one configuration as shown in figure 41-1 Each interconnectioninterface within this configuration is defined as a verification category For ease of identification a letter has been assigned to each verification category

42 TEST CATEGORIES

Categories to be tested and verified as satisfactorily interfaced with the RVR as part of the NAS system are

Category A - Maintenance Processor System (MPS) interface

Category B - Maintenance Data Terminal (MDT) interface

Category C - Ex~ernal Coded Time Source (ECTS) interface (Note We will not address testing of this category per Case File Number NNl40-RVR-OOl)

Category D - Tower Computer Control Complex (IeGG) interface

Category E - Automated Surface Observing System (ASOS) interface

Gategory F - Operational Evaluation of the CD

4

LEGEND ~-lI I bull ONE WAY DATA FLOW

4 bull

~ r-

TE _ bull J

TWO WAY DATA flOW

~ 4

SUBSYSTEM

TRANSMISSION EQUIPMENT

PROVIDING CONNECTIVITY

BETWUN INTERfACES

or -

TE i L_ bull 1

I

RVR

---- bull RMS I

I

I I I I I

____ Jbull I

T] ~

rE] ~

FIGURE 4-1 RVR FUNCTIONALPHYSICAL INTERFACES

TEST CONFIGURATION

RVR

VE RI FICATIO CATEGORIES

A

MPS

B

MOT

C

THIS CATEGORY HAS BEEN DELETED

D

Teee

E

ASOS

tI ~

INTERFACES wrrH RVR

FIGURE 41-1 RVR OTampEINTEGRATION TEST CONFIGURATION

6

I

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 6: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

1 INTRODUCTION

The Runway Visual Range system (RVR) is a flexible modular system that will provide runway visual range data at various points along a precision approach runway These data products will be automatically processed and distributed to air traffic controllers The data is then presented to the pilot by the controller in a numerical format equating to the number of feet forward along a departure or landing runway that the pilot may be expected to see

The RVR system consists of visibility sensors an ambient light sensor runway light intensity monitors a processor with associated softwarefirmware displays digital data distribution links and a built-in remote maintenance monitoring capability

The functions of the RVR system include the data acquisition and processing of the measurement of the atmospheric scattering coefficient ambient luminance and runway light intensity for RVR product dissemination

The RVR will provide runway visual range data updated at least once per minute at various points of a precision approach runway in accordance with FAA specified siting criteria RVRs may also be installed on nonprecision runways for takeoff and capacity enhancement reasons RVRs operate in a variety of configurations employing varying numbers of visibility sensors and runway light intensity monitors without human attendance

11 SCOPE

This document provides the overall philosophy and approach to the Operational Test and Evaluation (OTampE)Integration test of the RVR system This test plan identifies interface and system-level requirements of the RVR necessary to satisfy the National Airspace System (NAS) OTampElntegration test requirements contained in the RVR Test Verification Requirements Traceability Matrix (TVRTM) presented in appendix A of this document

The plan will also identify the test verification methodsrequirements that will be required to meet OTampElntegration test criteria The information contained within this plan has been structured to provide guidance to support OTampElntegration testing at one of the designated locations scheduled to receive the RVR system

12 AUTHORITY TO CHANGE

Modificationsrevisions to this plan shall be proposed in writing to the Federal Aviation Administration (FAA) Technical Center Engineering Test and Evaluation Service The proposal shall (1) clearly document the section number of the plan (2) document the information currently contained in the plan and (3) document the proposed modification The reason for this proposed modification shall also be defined The CommunicationsNavigationSurveillance Division shall maintain a record of all dispositions and subsequent revisions to the plan

1

2 APPLICABLE DOCUMENTS

This section lists the applicable documentation and reference materials which relate to the contents of

21 FAA DOCUMENTS

211 FAA Specifications

FAA-E-2772

NAS-SS-IOOO

NAS-SR-IOOO

NAS-DD-IOOO

212 FAA Standards

FAA-STD-024a

213 FAA Orders

FAA Order No 18104A

this plan or upon which this plan is based

RVR System Specification (Revision 3) 62387

Functional and Performance Requirements for the NAS System Specification Volumes I III and V

NAS System Requirements

Level One Design Document

Preparation of Test and Evaluation Documentation B1787

FAA NAS Test and Evaluation Program

214 Other FAA

NAS-MD-110

NAS-MD-790

NAS-MD-79l

NAS-MD-792

Documents

Test and Evaluation (TampE) Terms and Definitions for the NAS 32787

Remote Maintenance Monitoring System (RMMS) Interface Control Document

Guidelines for the Development of Level II Interface Control Documents for RMMS

Operational Requirements for the RMMS

2

NAS-MD-793 RMS Functional Requirements for the Remote Monitoring Subsystem (RMS)

Master Test Plan Runway Visual Range (RVR) Master Test Plan

22 OTHER DOCUMENTS

DTFAOl-88-C-00024 RVR Contract (mods 1-8)

NAS-IR-33102201 RVRTCCC

NAS-IR-33109301 RVRASOS (IGD dated July 13 1990)

RVRMPS IRD RVRMPS IRD Teledyne Drawing 861240 Rev B

RVRMPS ICD RVRMPS ICD Teledyne Drawing 861233 Rev B

RVRMDT lRD RVRMDT lRD Teledyne Drawing 861241 Rev B

RVRMDT lCD RVRMDT lCD Teledyne Drawing 861234 Rev B

3 OTampEINTEGRATION PHILOSOPHY

The RVR overall OTampElntegration philosophy is to verify that the interfaces between the existing NAS system and the RVR which provides new and improved functional and operational performance capabilities operates correctly as specified with no degradation to the NAS operation

FAA Order 18l04A delegates the responsibility for OTampElntegration testing to the Engineering Test and Evaluation Service CommunicationsNavigationSurveillance Division ACN-200 Weather and Remote Maintenance Monitoring Systems Branch ACN-250 at the FAA Technical Center

The RVR OTampElntegration test will verify requirements from the NAS-SS-lOOO Volumes I-V and the NAS Interface Requirements Documents (IRD) Verification Requirements Traceability Matrix (VRTM) as identified in the RVR Master Test Plan (MTP) VRTM The success criteria for these requirements will be detailed in the OTampElntegration test procedures The OTampElntegration testing will include an operational evaluation to assess the operational suitability and effectiveness of the Controller Display (CD) as part of the RVR system ACN-250 will support the Navigation and Landing Engineering Division (ANN-lOO) and the Visual Aids Branch (ANN-140) to accomplish the RVR OTampElntegration Test

3

The RVR OTampEIntegration test will be conducted by ACN-250 at the designated operational test site In accordance with the MTP and 18104A all subsystems identified in this test plan will be tested either by live or electronic means Upon completion of these testing activities test results will be analyzed to assure verification of the NAS requirements

ACN-250 will support ANN-140 in the monitoring of the Factory Acceptance Tests (FAT) and the Site Acceptance Tests (SAT) In agreement with ANN-140 NAS requirements that may be verified during the conduct of the FAT and SAT test activities ~ill not e d ated

4 TampE APPROACH AND CONCEPT

To determine the overall interoperability of the RVR with the NAS environment OTampEIntegration testing will require testing of the RVR subsystem in an environment as near operational as possible The term operational relates to the configuration into which the RVR must be integrated For this reason both live andor simulated interfacing subsystems and equipment will be used To the extent possible RVR OTampElntegration testing will be performed using all interconnectionsinterfaces available and appropriate to the RVR system (see figure 4-1)

41 TEST CONFIGURATION

RVR OTampEIntegration consists of one configuration as shown in figure 41-1 Each interconnectioninterface within this configuration is defined as a verification category For ease of identification a letter has been assigned to each verification category

42 TEST CATEGORIES

Categories to be tested and verified as satisfactorily interfaced with the RVR as part of the NAS system are

Category A - Maintenance Processor System (MPS) interface

Category B - Maintenance Data Terminal (MDT) interface

Category C - Ex~ernal Coded Time Source (ECTS) interface (Note We will not address testing of this category per Case File Number NNl40-RVR-OOl)

Category D - Tower Computer Control Complex (IeGG) interface

Category E - Automated Surface Observing System (ASOS) interface

Gategory F - Operational Evaluation of the CD

4

LEGEND ~-lI I bull ONE WAY DATA FLOW

4 bull

~ r-

TE _ bull J

TWO WAY DATA flOW

~ 4

SUBSYSTEM

TRANSMISSION EQUIPMENT

PROVIDING CONNECTIVITY

BETWUN INTERfACES

or -

TE i L_ bull 1

I

RVR

---- bull RMS I

I

I I I I I

____ Jbull I

T] ~

rE] ~

FIGURE 4-1 RVR FUNCTIONALPHYSICAL INTERFACES

TEST CONFIGURATION

RVR

VE RI FICATIO CATEGORIES

A

MPS

B

MOT

C

THIS CATEGORY HAS BEEN DELETED

D

Teee

E

ASOS

tI ~

INTERFACES wrrH RVR

FIGURE 41-1 RVR OTampEINTEGRATION TEST CONFIGURATION

6

I

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 7: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

2 APPLICABLE DOCUMENTS

This section lists the applicable documentation and reference materials which relate to the contents of

21 FAA DOCUMENTS

211 FAA Specifications

FAA-E-2772

NAS-SS-IOOO

NAS-SR-IOOO

NAS-DD-IOOO

212 FAA Standards

FAA-STD-024a

213 FAA Orders

FAA Order No 18104A

this plan or upon which this plan is based

RVR System Specification (Revision 3) 62387

Functional and Performance Requirements for the NAS System Specification Volumes I III and V

NAS System Requirements

Level One Design Document

Preparation of Test and Evaluation Documentation B1787

FAA NAS Test and Evaluation Program

214 Other FAA

NAS-MD-110

NAS-MD-790

NAS-MD-79l

NAS-MD-792

Documents

Test and Evaluation (TampE) Terms and Definitions for the NAS 32787

Remote Maintenance Monitoring System (RMMS) Interface Control Document

Guidelines for the Development of Level II Interface Control Documents for RMMS

Operational Requirements for the RMMS

2

NAS-MD-793 RMS Functional Requirements for the Remote Monitoring Subsystem (RMS)

Master Test Plan Runway Visual Range (RVR) Master Test Plan

22 OTHER DOCUMENTS

DTFAOl-88-C-00024 RVR Contract (mods 1-8)

NAS-IR-33102201 RVRTCCC

NAS-IR-33109301 RVRASOS (IGD dated July 13 1990)

RVRMPS IRD RVRMPS IRD Teledyne Drawing 861240 Rev B

RVRMPS ICD RVRMPS ICD Teledyne Drawing 861233 Rev B

RVRMDT lRD RVRMDT lRD Teledyne Drawing 861241 Rev B

RVRMDT lCD RVRMDT lCD Teledyne Drawing 861234 Rev B

3 OTampEINTEGRATION PHILOSOPHY

The RVR overall OTampElntegration philosophy is to verify that the interfaces between the existing NAS system and the RVR which provides new and improved functional and operational performance capabilities operates correctly as specified with no degradation to the NAS operation

FAA Order 18l04A delegates the responsibility for OTampElntegration testing to the Engineering Test and Evaluation Service CommunicationsNavigationSurveillance Division ACN-200 Weather and Remote Maintenance Monitoring Systems Branch ACN-250 at the FAA Technical Center

The RVR OTampElntegration test will verify requirements from the NAS-SS-lOOO Volumes I-V and the NAS Interface Requirements Documents (IRD) Verification Requirements Traceability Matrix (VRTM) as identified in the RVR Master Test Plan (MTP) VRTM The success criteria for these requirements will be detailed in the OTampElntegration test procedures The OTampElntegration testing will include an operational evaluation to assess the operational suitability and effectiveness of the Controller Display (CD) as part of the RVR system ACN-250 will support the Navigation and Landing Engineering Division (ANN-lOO) and the Visual Aids Branch (ANN-140) to accomplish the RVR OTampElntegration Test

3

The RVR OTampEIntegration test will be conducted by ACN-250 at the designated operational test site In accordance with the MTP and 18104A all subsystems identified in this test plan will be tested either by live or electronic means Upon completion of these testing activities test results will be analyzed to assure verification of the NAS requirements

ACN-250 will support ANN-140 in the monitoring of the Factory Acceptance Tests (FAT) and the Site Acceptance Tests (SAT) In agreement with ANN-140 NAS requirements that may be verified during the conduct of the FAT and SAT test activities ~ill not e d ated

4 TampE APPROACH AND CONCEPT

To determine the overall interoperability of the RVR with the NAS environment OTampEIntegration testing will require testing of the RVR subsystem in an environment as near operational as possible The term operational relates to the configuration into which the RVR must be integrated For this reason both live andor simulated interfacing subsystems and equipment will be used To the extent possible RVR OTampElntegration testing will be performed using all interconnectionsinterfaces available and appropriate to the RVR system (see figure 4-1)

41 TEST CONFIGURATION

RVR OTampEIntegration consists of one configuration as shown in figure 41-1 Each interconnectioninterface within this configuration is defined as a verification category For ease of identification a letter has been assigned to each verification category

42 TEST CATEGORIES

Categories to be tested and verified as satisfactorily interfaced with the RVR as part of the NAS system are

Category A - Maintenance Processor System (MPS) interface

Category B - Maintenance Data Terminal (MDT) interface

Category C - Ex~ernal Coded Time Source (ECTS) interface (Note We will not address testing of this category per Case File Number NNl40-RVR-OOl)

Category D - Tower Computer Control Complex (IeGG) interface

Category E - Automated Surface Observing System (ASOS) interface

Gategory F - Operational Evaluation of the CD

4

LEGEND ~-lI I bull ONE WAY DATA FLOW

4 bull

~ r-

TE _ bull J

TWO WAY DATA flOW

~ 4

SUBSYSTEM

TRANSMISSION EQUIPMENT

PROVIDING CONNECTIVITY

BETWUN INTERfACES

or -

TE i L_ bull 1

I

RVR

---- bull RMS I

I

I I I I I

____ Jbull I

T] ~

rE] ~

FIGURE 4-1 RVR FUNCTIONALPHYSICAL INTERFACES

TEST CONFIGURATION

RVR

VE RI FICATIO CATEGORIES

A

MPS

B

MOT

C

THIS CATEGORY HAS BEEN DELETED

D

Teee

E

ASOS

tI ~

INTERFACES wrrH RVR

FIGURE 41-1 RVR OTampEINTEGRATION TEST CONFIGURATION

6

I

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 8: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

NAS-MD-793 RMS Functional Requirements for the Remote Monitoring Subsystem (RMS)

Master Test Plan Runway Visual Range (RVR) Master Test Plan

22 OTHER DOCUMENTS

DTFAOl-88-C-00024 RVR Contract (mods 1-8)

NAS-IR-33102201 RVRTCCC

NAS-IR-33109301 RVRASOS (IGD dated July 13 1990)

RVRMPS IRD RVRMPS IRD Teledyne Drawing 861240 Rev B

RVRMPS ICD RVRMPS ICD Teledyne Drawing 861233 Rev B

RVRMDT lRD RVRMDT lRD Teledyne Drawing 861241 Rev B

RVRMDT lCD RVRMDT lCD Teledyne Drawing 861234 Rev B

3 OTampEINTEGRATION PHILOSOPHY

The RVR overall OTampElntegration philosophy is to verify that the interfaces between the existing NAS system and the RVR which provides new and improved functional and operational performance capabilities operates correctly as specified with no degradation to the NAS operation

FAA Order 18l04A delegates the responsibility for OTampElntegration testing to the Engineering Test and Evaluation Service CommunicationsNavigationSurveillance Division ACN-200 Weather and Remote Maintenance Monitoring Systems Branch ACN-250 at the FAA Technical Center

The RVR OTampElntegration test will verify requirements from the NAS-SS-lOOO Volumes I-V and the NAS Interface Requirements Documents (IRD) Verification Requirements Traceability Matrix (VRTM) as identified in the RVR Master Test Plan (MTP) VRTM The success criteria for these requirements will be detailed in the OTampElntegration test procedures The OTampElntegration testing will include an operational evaluation to assess the operational suitability and effectiveness of the Controller Display (CD) as part of the RVR system ACN-250 will support the Navigation and Landing Engineering Division (ANN-lOO) and the Visual Aids Branch (ANN-140) to accomplish the RVR OTampElntegration Test

3

The RVR OTampEIntegration test will be conducted by ACN-250 at the designated operational test site In accordance with the MTP and 18104A all subsystems identified in this test plan will be tested either by live or electronic means Upon completion of these testing activities test results will be analyzed to assure verification of the NAS requirements

ACN-250 will support ANN-140 in the monitoring of the Factory Acceptance Tests (FAT) and the Site Acceptance Tests (SAT) In agreement with ANN-140 NAS requirements that may be verified during the conduct of the FAT and SAT test activities ~ill not e d ated

4 TampE APPROACH AND CONCEPT

To determine the overall interoperability of the RVR with the NAS environment OTampEIntegration testing will require testing of the RVR subsystem in an environment as near operational as possible The term operational relates to the configuration into which the RVR must be integrated For this reason both live andor simulated interfacing subsystems and equipment will be used To the extent possible RVR OTampElntegration testing will be performed using all interconnectionsinterfaces available and appropriate to the RVR system (see figure 4-1)

41 TEST CONFIGURATION

RVR OTampEIntegration consists of one configuration as shown in figure 41-1 Each interconnectioninterface within this configuration is defined as a verification category For ease of identification a letter has been assigned to each verification category

42 TEST CATEGORIES

Categories to be tested and verified as satisfactorily interfaced with the RVR as part of the NAS system are

Category A - Maintenance Processor System (MPS) interface

Category B - Maintenance Data Terminal (MDT) interface

Category C - Ex~ernal Coded Time Source (ECTS) interface (Note We will not address testing of this category per Case File Number NNl40-RVR-OOl)

Category D - Tower Computer Control Complex (IeGG) interface

Category E - Automated Surface Observing System (ASOS) interface

Gategory F - Operational Evaluation of the CD

4

LEGEND ~-lI I bull ONE WAY DATA FLOW

4 bull

~ r-

TE _ bull J

TWO WAY DATA flOW

~ 4

SUBSYSTEM

TRANSMISSION EQUIPMENT

PROVIDING CONNECTIVITY

BETWUN INTERfACES

or -

TE i L_ bull 1

I

RVR

---- bull RMS I

I

I I I I I

____ Jbull I

T] ~

rE] ~

FIGURE 4-1 RVR FUNCTIONALPHYSICAL INTERFACES

TEST CONFIGURATION

RVR

VE RI FICATIO CATEGORIES

A

MPS

B

MOT

C

THIS CATEGORY HAS BEEN DELETED

D

Teee

E

ASOS

tI ~

INTERFACES wrrH RVR

FIGURE 41-1 RVR OTampEINTEGRATION TEST CONFIGURATION

6

I

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 9: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

The RVR OTampEIntegration test will be conducted by ACN-250 at the designated operational test site In accordance with the MTP and 18104A all subsystems identified in this test plan will be tested either by live or electronic means Upon completion of these testing activities test results will be analyzed to assure verification of the NAS requirements

ACN-250 will support ANN-140 in the monitoring of the Factory Acceptance Tests (FAT) and the Site Acceptance Tests (SAT) In agreement with ANN-140 NAS requirements that may be verified during the conduct of the FAT and SAT test activities ~ill not e d ated

4 TampE APPROACH AND CONCEPT

To determine the overall interoperability of the RVR with the NAS environment OTampEIntegration testing will require testing of the RVR subsystem in an environment as near operational as possible The term operational relates to the configuration into which the RVR must be integrated For this reason both live andor simulated interfacing subsystems and equipment will be used To the extent possible RVR OTampElntegration testing will be performed using all interconnectionsinterfaces available and appropriate to the RVR system (see figure 4-1)

41 TEST CONFIGURATION

RVR OTampEIntegration consists of one configuration as shown in figure 41-1 Each interconnectioninterface within this configuration is defined as a verification category For ease of identification a letter has been assigned to each verification category

42 TEST CATEGORIES

Categories to be tested and verified as satisfactorily interfaced with the RVR as part of the NAS system are

Category A - Maintenance Processor System (MPS) interface

Category B - Maintenance Data Terminal (MDT) interface

Category C - Ex~ernal Coded Time Source (ECTS) interface (Note We will not address testing of this category per Case File Number NNl40-RVR-OOl)

Category D - Tower Computer Control Complex (IeGG) interface

Category E - Automated Surface Observing System (ASOS) interface

Gategory F - Operational Evaluation of the CD

4

LEGEND ~-lI I bull ONE WAY DATA FLOW

4 bull

~ r-

TE _ bull J

TWO WAY DATA flOW

~ 4

SUBSYSTEM

TRANSMISSION EQUIPMENT

PROVIDING CONNECTIVITY

BETWUN INTERfACES

or -

TE i L_ bull 1

I

RVR

---- bull RMS I

I

I I I I I

____ Jbull I

T] ~

rE] ~

FIGURE 4-1 RVR FUNCTIONALPHYSICAL INTERFACES

TEST CONFIGURATION

RVR

VE RI FICATIO CATEGORIES

A

MPS

B

MOT

C

THIS CATEGORY HAS BEEN DELETED

D

Teee

E

ASOS

tI ~

INTERFACES wrrH RVR

FIGURE 41-1 RVR OTampEINTEGRATION TEST CONFIGURATION

6

I

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 10: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

LEGEND ~-lI I bull ONE WAY DATA FLOW

4 bull

~ r-

TE _ bull J

TWO WAY DATA flOW

~ 4

SUBSYSTEM

TRANSMISSION EQUIPMENT

PROVIDING CONNECTIVITY

BETWUN INTERfACES

or -

TE i L_ bull 1

I

RVR

---- bull RMS I

I

I I I I I

____ Jbull I

T] ~

rE] ~

FIGURE 4-1 RVR FUNCTIONALPHYSICAL INTERFACES

TEST CONFIGURATION

RVR

VE RI FICATIO CATEGORIES

A

MPS

B

MOT

C

THIS CATEGORY HAS BEEN DELETED

D

Teee

E

ASOS

tI ~

INTERFACES wrrH RVR

FIGURE 41-1 RVR OTampEINTEGRATION TEST CONFIGURATION

6

I

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 11: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

TEST CONFIGURATION

RVR

VE RI FICATIO CATEGORIES

A

MPS

B

MOT

C

THIS CATEGORY HAS BEEN DELETED

D

Teee

E

ASOS

tI ~

INTERFACES wrrH RVR

FIGURE 41-1 RVR OTampEINTEGRATION TEST CONFIGURATION

6

I

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 12: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

421 Category A - RVRMPS Interface

Category A will demonstrate RVRMPS operability by interfacing the two subsystems functionally and physically It will verify the data exchange between the RVR and the MPS in accordance with NAS-SS-lOOO The RMMS shall provide the capability to automate and remotely control (1) the periodic tasks of equipment performance monitoring (2) the recording of site data (3) the support of fault isolation through diagnostic testing and (4) the operational status of remote sites The RVR system shall employ an embedded RMS The MPS shall control communications to all remote facilities and shall collect record and analyze the facility data The MPS may direct RMSs to execute controls to bring equipment within operational performance limits

4211 Test Objectives

The specific objectives of this test category are as follows

a To verify that the RVR supplies correct data in the proper format to the MPS upon request

b To verify that the RVR responds correctly to control commands initiated by the MFS

c To verify that the RVR will supply correct data in the proper format to the MPS upon an unplanned event or alarm condition

4212 Tests to be Performed

The following subparagraphs describe the tests to be performed to verify the test requirements of the RVRMPS interface These tests will be further described in the RVRMPS test procedures

42111 Link Level Interface Testing

The purpose of the link level interface testing is to verify that the link level communications can be established from the MPS to the RVR RMS

42112 Monitoring Test

The purpose of the monitoring test is to verify that the RVR is properly reporting its operational status to the MPS A scheduled poll will be issued to the RVR from the MPS The RVR shall then initiate a message transfer of all continuously monitored performance data via site data report (SDR) messages

42113 Alarm Test

The purpose of the alarm test is to verify that the RVR is properly reporting RVR equipment alarm conditions to the MPS Following receipt of an RVR alarm the MPS will issue a specific poll to the RVR The RVR shall then initiate a message transfer of all continuously monitored performance data to the MPS

42114 Command Test

The purpose of the command test is to verify that the RVR is properly responding to commands issued at the MPS

7

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 13: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

42115 Diagnostic Test

The purpose of the diagnostic test is to verify that the RVR is properly responding to diagnostic commands (eg fault isolation performance data etc) issued via the MPS or MDT

42116 Certification Test

The objective of the certification test is to confirm that the RVR RMS equipment will correctly respond to certification commands sent by the MPS (eg parameter values tolerances required etc)

Category A testing shall verify the applicable requirements of the TVRTM listed in appendix A

422 Test Categopoundy B - RVRfMDT Interface

Category B will demonstrate RVRMDT operability by interfacing the subsystems functionally and physically It will verify the requirements related to the transmission of data exchange required from the RVR in accordance with NAS-SS-IOOO The data gathered during this test will be analyzed in detail to provide a comprehensive analysis of the RVRMDT interface Data will be recorded at the MDT and the RVR All requests and responses recorded will be compared to insure that the MDT can correctly send and accept data from the RVR

4221 Test Objectives

To verify the capability of the RVR to recognize and perform as required to a defined operational set of MDT commands

Category B testing shall verify the applicable requirements of the TVRTM listed in appendix A

423 Test CategohY C - RVRECTS

The RVR OTampEIntegration testing will not address the ECTS interface per Case File Number (NNl40-RVR-OOl)

424 Test Category D - RVRTCCC

Category D will demonstrate RVRTCCC operability by interfacing the two subsystems functionally and physically It will verify the requirements related to the transmission of products equipment status RVR modes and receipt of commands from the RVR subsystem to the TCCC located in the Airport Traffic Control Tower (ATCT) These tests may be accomplished through simulation as TCCCs are not yet available at this time The tests will verify that the RVR is capable of providing the appropriate data to the TCCC

8

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 14: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

4241 Test Objectives

a To verify that the RVR Data Processing Unit CDPU) will output RVR products every 2 seconds to the collocated TCCC via a dedicated line

b To verify that each RVR system shall transmit product and status data in the desired protocol to the TCCC

Category D testing shall verify the applicable requirements of the TVRTM listed in appendix A

425 Test Category E - RVRASOS

Category E will demonstrate RVRASOS operability by interfacing the two subsystems functionally and physically It will verify the requirement for RVR to send RVR data to ASOS The data will be derived from the visibility value reported by the sensor located at the touchdown zone of the designated runway The computation of this value shall always assume a runway light intensity setting of 5

4251 Test Objective

To verify that the RVR is capable of sending correct touchdown zone product(s) to the ASOS

426 Category F - Operational Evaluation of the CD

The Category F operational evaluation will be conducted to evaluate the operational suitability and effectiveness of the CD located at Kansas City International ATCT when it is operationally connected to the RVR Five air traffic controllers with previous operational RVR experience will complete questionnaires to evaluate the CD

4261 Evaluation Objective

The objective of this category is to obtain air traffic controller evaluations of the operational suitability and effectiveness of the CD in an RVR operational environment This category represents an evaluation only and has no TVRTM requirements or passfail criteria Results will be based on an overall analysis of the questionnaires

43 CRITICAL REQUIREMENTS

None identified

44 VERIFICATION METHODS

Two types of verification methods will be applied to the test categories The methods of verification are defined as follows

a Test (T) Test is a method of verification wherein performance is measured during or after the controlled application of functional andor environmental stimuli Quantitative measurements are analyzed to determine the degree of compliance The process uses laboratory equipment procedures items andor services

9

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 15: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

b Demonstration (D) Demonstration is a method of verification where qualitative determination of properties is made for an end-item including software andor the use of technical data and documentation The items being verified are observed but not quantitatively measured in a dynamic state

5 TEST PROGRAM FLOW DIAGRAM

Figure 51-1 graphically displays the flow of activities for the OTampEIntegration testing program

6 ORGANIZATIONAL ROLES AND RESPONSIBILITIES

61 RESPONSIBILITIES

611 Weather and Remote Maintenance Monitoring Systems Branch AGN-250

a ACN-250 is responsible to direct and conduct OTampEIntegration testing

b Provides the test director and other test personnel

c Provides a recommendation based on initial test results in support of the Executive Committee (EXCOM) Deployment Readiness Review (DRR) process

62 ROLES

621 Test Director

The test director is responsible for the overall management of the RVR OTampEIntegration test effort and will provide test management guidance to members of the test team The test director will maintain the ultimate authority over the specific test assigned The test director will be responsible for ensuring that test results and noted deficiencies are fully documented

622 Test Manager

The test manager is appointed by the test director and is responsible for upholding test schedules and maintaining authority at the test site during test conduct Duties include the following activities

a Test personnel are available and properly trained to conduct the required test

b Required equipment is available and in working order at the operational test sites

c Requirements for on-site test support personnel are coordinated

d Test activities are performed in accordance with approved test plans and procedures and that test objectives are successfully fulfilled

10

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 16: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

MAsnaTnT QnEIIMlEGlAlION Imiddot H IVI IPINt IIsnu

-lUTINGI bull OIMONSlAAnOMI

I I NOINASoSSo1000 ~ - - - - - _J

t- t-

I VERIFICATION MEtHOD II

~~~~~~~O~~~~

FIGURE 51-1 RVR OTampEINTEGRATION TEST PROGRAM FLOW DIAGRAM

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 17: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

e Noted test discrepancies are logged and appropriate remedial action for resolution of test problems is recommended

f Test logsobserver records are being documented properly

g Test data for analysis are collected and test results are documented

623 Test ObserversMonitors

a Technically qualified test observersmonitors to include field facility personnel will be assigned to monitor and record activities for specific RVR OTampEIntegration test activities Test observers will also maintain test observer notes as well as other assigned data sheets

63 SUPPORT CONTRACTORS

The UAL Corporation personnel will assist in the development of OTampEIntegration test plans and procedures and serve as test observersmonitors as required The Systems Engineering and Integration Contractor (SErC) will provide support in the development and maintenance of the test activities schedules

7 DOCUMENT REQUIREMENTS AND CONTROL

This section describes the required documents for planning conducting and reporting the RVR OTampEIntegration testing activities

71 DOCUMENTATION TREE

The RVR documentation hierarchy tree figure 71-1 illustrates the verification documentation

72 OPERATING AND CONTROL DOCUMENTS

721 OTampEIntegration Test Plan

This plan establishes the specific verification categories issues objectives schedules resource requirements test methodology and test management organization

722 Test Procedures

Test procedures containing the step-by-step testing instructions and required inputs outputs and expected results will be provided by ACN-250 and will address requirements as specified in appendix A of the TVRTM

12

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 18: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

I

NAS-SSmiddotl000

VOL I III V

RVR

SPECIFICATION FAA-E-2772

RVR

FAA-STD-024A MASTER TEST PLAN

RVR OTampEINTEGRAnON TEST PLAN

RVR OTampEiINTEGRATION

-- ~I TEST PROCEDURES --

1 --_

I

RVROTampEINTEGRATION QTampEINTEGRATIONEST CONDUCT TEST REPORTSFORMS

FIGURE 71-1 RVR VERIFICATION DOCUMENTATION TREE

13

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 19: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

723 Test Conduct Log

Test Conduct Logs will be prepared for each testing category The test manager will be responsible for completion of this form (See figure 723-1)

724 Test ObserverMonitor Record

Test ObserverMonitor Records will be used by the FAA to record relevant events test results for each requirement and to provide for an initial test assessment The records will be completed by a designated FAA test observer and signed by the test director (See figure 724-1)

725 ~est Discrepancy Reports

The test manager will ensure that all discrepancies observed during the tests are documented The following forms located in appendix B will be used to document all test discrepancies

a Software Discrepancy Repor~ - This form is initiated when any discrepancies or anomalies are RVR subsystem software related

b Hardware Discrepancy Report - This form is initiated when a problem is RVR subsystem hardware related

c Program Technical Report - This form is initiated when a problem is related to a non-RVR subsystemequipment maintenance-type discrepancy FAA-OR-110014B Program Technical Report Procedures delineates the purpose of this form

8 TRAINING

Training will be provided to ACN-250 test personnel prior to OTampElntegration testing

9 TEST SUPPORT

The following are the necessary requirements for test support

91 INSTRUMENTATION

RVR OTampEIntegration testing will require the following instrumentation

a 1 LMIOE protocol analyzer (version 70 or equivalent) b I portable printer c 1 ACD-350 synchronous MPS communications simulator d 2 telephones and voice telephone lines RVR to e 1 dedicated telephone line RVR to MPS f Telephones or radio communicators (as required) RVR equipment to RVR RMS g 3 stopwatches h 1 digilog protocol analyzer

14

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 20: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

---- ----

------

----------

----------------------------

------------------------------------

-----------------

-----------------

SITE

DEVICEPOSITION PAGE of

TEST DATE

TIME

PROCEDURE STEPI PAGE

ACTION OUTPUT PRODUCED

OBSERVAT ONS NOTED

TEST MANAGER

FIGURE 723-1 TEST CONDUCT LOG

15

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 21: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

SITE I

DEVI CEPOSITION PAGE OF - - shyTEST CATEGORY DATE --- shy

PROCEDURES P F A A

TIME PAGEl S 1

PARA OBSERVEDMONITORED RESOLUTION S L

-

1

I

I

I

I

I I

I I

I

I

NJA NOT APPLICABLE TEST OBSERVERMONITOR 5C~ T~AE)

FIGURE 724-1 TEST OBSERVERMONITOR RECORD

16

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 22: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

92 DATA ANALYSIS

The criteria for success will be determined by utilizing the identified method for each category requirement as specified in appendix A The required data will be gathered by designated test team members from test logs printer outputs video displays andor storage devices (eg disk drives tape drives) Data analysis shall be conducted using the following guidelines

a The systems output will be analyzed against the expected results to determine if appropriate responses were generated When appropriate responses are generated the requirement is considered as passed

b When appropriate responses are not generated the requirement is not met and the test is considered as failed The Test ObserverMonitor Record form will be marked to indicate the results at this time For failed tests the FAA will schedule retesting Anomalies found during testing will be appropriately documented If necessary Program Trouble Reports will be initiated

93 TEST SITE CONFIGURATION

The contractor will install the RVR system at each of the designated sites The OTampEIntegration test location will be at Kansas City MO Airport (MCl) The test site configuration will be identical to the Reliability Development Growth Test (RDGT) except displays will be relocated one each to the Terminal Radar Approach Control (TRACON) and the ATCT cab The region Facilities and Equipment (FampE) electronics personnel will make the appropriate cables

10 REVIEWS AND REPORTS

The following subsections identify the reviews meetings and reports that will be conducted andor completed prior to during and after the RVR OTampEIntegration test

101 TEST READINESS REVIEW (TRR)

Prior to the start of the RVR OTampElntegration test activities a Test Readiness Revew (TRR) shall be conducted and an overall assessment of the availability and completeness of the previous testing activitiesresults will be discussed

In this review the test director will present justification for assessment of the readiness of the test including but not limited to status of all necessary documentation the resolution of commentsquestionsproblems completion of configuration audits (software and hardware) availability of the RVR system and other system facilities and resources

102 TEST SCHEDULE STATUS REVIEW (TSSR) MEETINGS

Test Schedule Status Review meetings are scheduled on a monthly basis to track the status of testing activities and keep ANN-140 advised of any outstanding issuesactions These reviews are chaired by the ACN-250 Test Director or a designee in accordance with FAA Order l8104A

17

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 23: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

103 POST-TEST REVIEW

This review will be held at the test site upon test completion by the RVR OTampElntegration test team It will be chaired by the test manager and attended by all test personnel This meeting will review the results of the test activity Any discrepancies anomalies and exceptions which were recorded during the test will be discussed during this review

104 ORR

A ORR will be scheduled and conducted in accordance with the FAA Test and Evaluation (TampE) process Upon completion of the RVR OTampEIntegration test ACN-250 will provide recommendations to the DRR EXCOM

105 QUICK LOOK REPORTS

These reports will be completed by the test manager following the analysis of the test data A Quick Look Test Report will be produced upon completion of OTampElntegration testing This report will give the early status information for the system wrile the analysis process is still underway The Quick Look Report will be completed 15 working days from the completion of RVR OTampElntegration testing

106 FINAL TEST REPORT

The RVR test director will be responsible for preparing a Final Test Report A draft report will be delivered to the program manager after the completion of testing The Final Test Report will document the results of the detailed test analysis and assess the conformance to each test to defined criteria The status of problems identified previously in the Quick Look Test Reports will be reviewed An assessment will be made on the tested system and any suggested corrective actions will be recommended The Final Test Report will be completed 30 working days from the completion of the RVR OTampElntegration testing

11 SCHEDULES

This test plan includes schedules for RVR OTampElntegration test activities and post-test activities (See appendix C)

12 TVRTM

The TVRTM reflects all of the OTampElntegration requirements and serves as the single tracking tool accounting for their evaluationassessment throughout the OTampElntegration cycle

The TVRTM will be maintained as required by ACN-250 until OTampElntegration test activities are completed

18

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 24: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

121 COLUMN DEFINITIONS AND UTILIZATION

The following TVRTM column definitions are provided for better user understanding

NAS-SS-IOOO paragraph number

NAS-SS-IOOO REQUIREMENT STATEMENT - RVR OTampEIntegration requirement statements per NAS-SS-IOOO Volumes I III and V

VERF METHOD - Verification Method Denoted by

Tit for Test ltD for Demonstration Q for Deferred Qualification Requirement (the interface does

not presently exist)

VOL - Lists the NAS-SS-IOOO volume where the requirement can be traced

TEST PLAN CROSS REF CAT shyCategory A RVRMPS Category B RVRMDT Category D RVRTCCC Category E RVRASOS

TEST PLAN CROSS REF RLTD SECTS - The Related Sections column contains the section numbers where the requirement can be traced to the RVR OTampEIntegration Test Plan

TRACE PARAGRAPH - SPECIFICATION - Paragraph in Specification relating to requirement in NAS-SS-1000

C or NC - Indicates a Critical (C) or Non Critical (NC) requirement

19

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 25: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

13 ABBREVIATIONS AND ACRONYMS

ASOS Automated Surface Observing System

ATCT Airport Traffic Control Tower

CD Controller Display

OPU Data Processing Unit

ORR Deployment Readiness Review

EGTS External Coded Time Source

EXCOM Executive Committee

FAA Federal Aviation Administration

FAT Factory Acceptance Test

FCA Functional Configuration Audit

FampE Facilities and Equipment

IRD Interface Requirements Document

MCl Kansas City Missouri Airport

MDT Maintenance Data Terminal

MPS Maintenance Processing System

MTP Master Test Plan

NAS National Airspace System

NCP NAS Change Proposal

ORD Operational Readiness Demonstration

OTamppound Operational Test and Evaluation

PCA Physical Configuration Audit

RDGT Reliability Development Growth Test

RMMS Remote Maintenance Monitoring System

RMS Remote Monitoring Subsystem

RMSC Remote Monitoring Subsystem Concentrator

RVR Runway Visual Range

20

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 26: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

SAT

SErc

SDR

TCCC

TampE

TRACON

TRR

TSC

TSSR

TVRTM

VRTM

Site Acceptance Test

System Engineering Integration Contractor

Site Data Report

Tower Control Computer Complex

Test and Evaluation

Terminal Radar Approach Control

Test Readiness Review

Transportation Systems Center

Test Schedule Status Review

Test Verification Requirements Traceability Matrix

Verification Requirements Traceability Matrix

21

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 27: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

APPENDIX A

RUNWAY VISUAL RANGE (RVR)

TEST VERIFICATION REQUIREMENTS TRACEABILITY MATRIX (TVRTM)

Notes

1 ANN-100 has submitted an NAS Change Proposal (NCP) to delete External Coded Time Source (ECTS) requirement applicable to the Runway Visual Range (RVR) subsystem

2 The Remote Monitoring Subsystem Concentrator (RMSC) will not be tested using RVR it is transparent to the RVR-Maintenance Processing System (MPS) interface

3 RVR system accuracy requirements will be verified by Transportation Systems Center (TSC) following data collection and analysis performed on old and new generation RVR systems at three airports

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 28: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

------------- - --

II _iii ~ -I I I I TEST PLAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH IORI I I I I I INCI

NAS-SS-IOOO I NAS-SS-1000 IVERFI I ~ PUN I SPECIFICATION I IPARA NUMBER I REQUIREMENT IKTHDIVOLI CArl RLTD SECTS I FAA~E-2772 I I

I -1-1-1 I 1shy321 4 103 IRVR Functional D I I A I 421 I ILead-inI

IPhysical Characteristic D IIII I B I 422 I 1-1 2 INCI I I I I I I I

3214103-1 IRVR Interface D I IA I 421 I I ILead- in ICharacteristics D IIIII B 422 1-322I I INCII I I I I I

3214103-1A IRVR to ASOS Q IIII E I 425 32211 jNCISee Note 3 I I I I I

3214103-1B IMDT to RVR D IIII B I 422 1-3543213 INCI I

)- I I I I t- 3214103-1C IRVR to MDT D IIII B 422 1-3543213I INCI

I I I I I I3214103-1D IMPS to RVR 1 D IIII A I 421 1-354321 INC

I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I II I I I I I I I I I I I I I I I I I I I I I I I I I Imiddot I I I I I I I I I 1 I I I I

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 29: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

- - - - - I I I I TEST PlAN I TRACE I CI REMARKS I I I I CROSS REF I PARAGRAPH lOR I I I I I INC

NAS-SS-1000 I NAS-SS-1000 IVERFI I I PlAN I SPECIFICATION PARA NUKBER I REQUIREMENT IKTHOIVOLI CAT I RLTO SECTS I FAA-E-2772

I 1-1-1-1 3214103-1E IRVR to HPS I 0 IllII A I 421 I 1-354321 INC

I I I I I 3214103-1F IRKSC to RVR I D IIIII A I 421 I 1-35432 INCISee Note 2

I I I I I 3214103-1G IRVR to RMSC I 0 IIIII A I 421 I 1-35432 INCISee Note 2

I 1 3214103-1JIRVR to tcce II Q IllII D i 424 I 6-24 iNC

I I 30111 IMonitoring Designated

gt I

N

ISubsystem Performance IParameters 0 I 1 I A I 421 I 1-354326 INC IAppendix II I I I I I I I I

301113 IReport Disabling of a I I I I I I ISubsystem Alarml Alert I I I I I I las Performance Data 0 I I i A i 42i I 1-354328 INC IAppendix II I I I I I I I I

301114 IProvide Subsystem Cert-Iification 0

I I I

I I A

I I 421

I I 1-354327

I I INC IAppendix II I

I I I I I I I 301115 IProvide Subsystem Oiag- I I I I I I

Inostie Data D I I I A I 421 I 1-354327 INCIAppendix III I I I I I I I

3011 2 IProvide Subsystem I I I I I I IOperating Status Data I I I I I I IInc1uding Configuration I I I I I I land Mode of Operation D I I I A I 421 I 1-354327 INCIAppendix III

--------------~---

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 30: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

_ bullbullbullIillll___bullbull=-__ bullbullbullbull__bull _ bullbullbullbull_ _ __~___IIiI__ bull __ bull bull __bullbullbullbull_ _

I I I I TEST PLAH I TRACI I CI UHA1lKS I I I I CRosS REF I ARAGRAPH lOR I I I I I ~ I NCI

MAS-58-1000 I NAS-5S-1000 I VEO I I PLAN I SPECIPICATION I I PARA WHBER 1 ltEQUlUHENT I tmID IVOL I CAT I illTO SECTS I fM-E-2772 I I --------_------I-------middot---~30113 tP~id Subyat I I I I I IIStatu plorte tht I I

lcontain State Chaosee I I and AlarmAlerts D I A I 421 I 1-345328 INCIAppendix III

I I I I I I I I

Data I D I A I 421 1-345327 INCIAppendix III

r I I UJ 30115 Provide Subsystem Data I I

in Response to Requests I I from RHMS Subaystems I D I A I 421 I 1-345327 INCIAppendix III

I I 30116 provide Out of I D A I 421 I I I

Tolerance Alarms I D I B I 422 I 1-345328 INCIAppendix III I I I I I I

INormal Alarms I D I A I 421 I 1-345328 INCIAppendix III I I I I

301110 IProvide an Alert when

-----1-----1---1----1--------------1---middot -----bullbull~_-bullbull_ I III-I - __

30114 Provide Accumulation of Current Sub_yet Statue and Prformance

30119 IProvide Return to

I I I Iselected subsystem I I I Iparameters are outside I I I1amp predetermined range I D I A I 421 I 1-345327 INCIAppendix III I I I I I I I I

-----------__--------shy -------_---------------~------_--------~--__---~-----_ ~-~_--~---__~~ --shy

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 31: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

-------------------------------------__--~-----------__~----~--------~~-~--__----_-------------_---I TEST PLAN I TRACE I CI REMARKS I CROSS REF I PARAGRAPH IORI I I INCI

NAS-SS-1000 I HAS-5S-l0aO IVERPI I I PLAN I SPECIFICATION I I PARA NUHBER I REQUIREMENT IHTHDIVOLI CAT I RLTD SECT5 I FAA-E-2772 I I ________________ 1 middotmiddot 1 1 1 t----_middot_---middotmiddot---I-----------------middot---[--I----------shy30 L 111 ICapability to Set or I I I I I I

IChang AlarmAlert I I I I I I IRanges I D I I I A 421 I 1-345328 INCIAppendix Ill

I I I I I I I 301112 ICapabUity to Disable I I I I I

IAlarmAlert by On-Site D I A 421 I I I ISpecialist D I I B 422 I 1-345327 INCAppendix III

I I I II gt 32141013 IOata Proces8ing D jIll B 422 1-354321 INCI ~ I I I I I I

32141016 IMaintenance Data D 1111 B 422 I 1-354321 INCI

I l I I I 32141017 IMaintenance COlDDands 0 lIn B 422 I 1-354321 INC

I I I I 32141019 Standard Time Source D 1111 A I 421 I 3-2215 INC

I I I I 301118 IProvide for the Control I I I

Ito Change the Current I I I IOperating Hode of a I I I I ISubsystem to any Other I I I I I IProper Operating Hode I 0 I I A I 421 I IIncluding OnOff 10 I I I B I 422 I 1-32221 INCIAppendix III I I I I I I I I I I I I

---_~--~~--------------~--------------------------~-------_-----_-~--_~_-~~- ___----_--~--

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 32: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

------II_middotbullbullbull ~ middot_bullbull bull _ bullbullijiii~iII_____ -------------------------__------shyt I 1 I TEST PLAR flAC I CI RElWllS I CROSS up PARAGRAPH lOR I I I I I INCI

HAS-SS-lOmiddotOO I NAS-5S-l0GO IVERPt I I PLAN SPECIFICATION I PARA MUKBR I ImQUIlBMBHT tmmtvOLI CAT I RLto SECTS I FAA-E-2772 I I----bullbull-=-----middotIl---~ ------------ -Imiddot_I__middot_I ______IiIIIIIIIIIIII___middot

--I---middot-----~-----------I-middotI------middot~-~--301119 Provicl ch Capability to Ii II I I I I IIAdju_t Selected Subyatem D I I A I 421 I I Itrarampllletera D I I I B I 422 I 1-354326 INC Appendix III I 1 I I I I

301120 lProvide the Capability to 1

Iaebullbull t a Subsytem D I I I A I 421 1-354327 INC Appendix III I I I I

301121 IProvide for the InUtation I I I lof Subsystem Diagnostic I I Iraquo-

I ITests D I I 1 A 421 1-3543212 INC AppendiX III V1 I 1 I I

301122 IProvide for the Initiation I I I lof Subsystem Certification I I I Ilxerehes D I 1 I A I 421 1-3543212 INC AppendiX IIII I I

301124 Provide for Spedalist I I IAccaae to the RHMS Network D I I I B I 422 1-3543214 NCIAppendix IIII 1 I

301125 IProvide the Capability for I I I ILocal Input and Display of I I I IData via Maintenance I I Terminal I D I I B I 422 1-3543212 NC IAppend ix II I I I I I II I I I I I I I II I I I

-----------------------------------~_ bull __- bull Iii IIll __bullbull __ _ ~_~

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 33: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

-----------------_--------__-----------------~------- ------------------------------------------------------I I TEST PLAN I TRACE I CI JUIMARKS I I CROSS REF I PARAGRAPH lOR I

I I I I INCI HAS-5S-1000 I HAS-55-1000 IWIlI I-I PLAN I SPECIFICATION I I PARA HUHBER I REQUIllEMENT MTHDI VOL I CAT RLTO SECTS ~ FAA-E-2712 I I ----~-------=- - --------------- middot--1--- t---- --------bullbull----- I -----~_ ----------- J t-------- 301126 IProvide the Specialist the I I I I

middotto Obtain I I I I IIICpbl1ityIExclueive Control of a I I I I I ISubsyetem D I I B 422 I 1-3543212 ]NCIAppendix III I I I I I I

321161J IRunway Visual Range Data D I I I E 425 I 3-43 INCI I I I I I

3211411 Provide for the monitoring D I V I A 421 1-354326 INCI 3211412 lof designated subsystems I I I

fperformance parameters I I gt 01 r I I I

3211415 IProvide subsystem operat- I D V I A 421 1-354326 INC I ina status data including I Iconfiguration and mode of I Ioperation I I I

3211416 Provide subsystem status D V A 421 1-354327 INC Ireports that contain only I I_tate changes and alarms I I_lrts in response to a I rubsystem atatus request I I I

3211413 IAutomatically provide for D V A 421 1-354326 INC Ithe accumultion of I Icurrent Bubystem status I I Iand performance data tn a I I Ilocal data file I Ibullbullbull---_ --IIII--bullbull------- ---- -- _ 1111bullbullbull _bullbullbullbull

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 34: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

--------_--- -_-----~-=- _---~-------~-~~-----~------I I I TlST PLAN I TRACE I CI lWWUtS r I I CROSS uri PARAGRAPH 11 01 I I I II IHe I

HAS-55-1000 I NAS-S5-1000 lViPI I PLAN I SPECIfICATION I I PARA H1MBBR I IBQUIICEHHT ~HTlIDIVOL CAT I llLTD SECTS I PAA-~2772 I middot1

---- Imiddot--middot~-----middot~middot_middotmiddotmiddot~middot l -bull --- ~-middotmiddotI -middot--middotmiddot---------middotI--middot--41~middotmiddot-----middotmiddot- -I--I------- shy321111bull 14 IP~ld bullbullubtem data ia I D V A II 421 I 1-354326 INC

Irbullbullponbullbull to requbullbullt from I I I )HIS bullbullbaytems I I I I I I I I

3211417 IProvide an la~ when any I D V I A I 421 I 1-354324 INC Idbullbullisnated HAS ubt~ I I B I 422 I lmonitored parmeCer ia out I I I I lof tobrancill I I I I I I

3211419 IProvide a return-to-no~all D V A 421 I 1-354328 INCr Ialarm when an initial I I Iala~ condition iii I I

Icleared I I I I

32114110 IProvide an alert when D V A 421 I 1-354324 INC Iselected subsystem paTa- I lmater 8re outside a I I I I Ipredetermined range I I I I I I I I I

32114111 IProvide the capabUity to D I V A 421 I 1-354328 INCI leet or change ranges for I I I I Isubeystem alarm or alert I I I I parameteta I I I I I I I I I t

32114112 IProvide for the disabling D I V I A 421 I 1-3543214 INCI of a subsystem alarm or I I B 422 I I I ~lert by a specialist on- I I I I I

bull IsitemiddotI111_ Cl bull - _I~ I ~_~ IiI__ I iiiil__ bull bull I~ I bull _

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 35: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

----------------------I-bullbullbull-------bullbull--------------------------bullbull------------------bullbullbullbullbull-----------------shyI I I TEST PLAN TRACE I CI lWWUlS I I I CROSS iEP PARAGRAPH lOR I I I I INCI

~S-SS-lOOO HAS-5S-1000 IVEarl I I PLAN SPECIFICATION I I PARA HUMBER REQUIREMENT IMTHDVOLI CAT I RLTD SECTS FAA-F-2772 I I ------------- --------------------------I----I---I---Ml--------------- -----_middot_-------~-----I--I-----~----32114113 Report the disabling of a I D I V I A I 421 1-354328 INCI

aubytn alarm or alert I I I I I I as performance data I I I I

I I I I 32114114 Provide subsystem cert- I D I V I A I 421 1-354326 INC

ificacion data in response I I I to bull certification I I I exercise I I I

r 32114115 Provide subsystem diag- I D I V II A I 421 I 1-354326 INC

~ Inostic data in response tol I I a diagnostic teat I I I

I 32114118 IProvide for the control tol D I V A I 421 I 1-32221 INC

change the cu~rot oper- I 1 B I 422 ating mode of a subsystem I I to any other proper oper- I I ating of a subaystem I I including onoff I I I I I

I I I I I 32114119 IProvide the capability to I D V I A I 421 I 1-354326 INC

adjust selected subsystem I I B I 422 I I parameters I I I I I

I I I I I 32114120 IProvide the capability to I D V I A I 421 I 1-354327 INC

reset a 8ublilydem I I 8 I 422 II I ----~-~--_---_---- -----__~--------------------------_--~----__----_---------_------~--------~~----

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 36: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

----~--------------~-------~~----------~--~----- r --------------------~------------_~~-_----_~-~~-t I I I TEST LAB TRACE I c I lWfAJltS I I I I CROSS RIP PARAGRAIH OR I I J I I_---====_~ NCI

NAS-SS-lOOO I HAS-SS-lOOO IVIUlF I I I PLAN SPECIFICATION I PARA ltUMBER II UQUlllEHBHTIlft1ID VOL I CATI lUTD SCTS rAA-E-2172 I ---------_--= middotmiddot11 ---------shy---~--------middot--Imiddot_middot--------------_middot~--middot-----I---tmiddotmiddot--I -----------~32114121 P~ovid fo~ the inJt1aUonl D I V I A I 421 1-354 3215 NCI

of ube8tem d1_gnostic I I I II 1-354327 I t bullbullt for the purpose of I I I I I fault isolation I I I I I

I I I3211t131 Provide for the initiationl D V I A I 421 1-3543212 HCI

of 8ubeyetem certification I I I exercises I I I

I I I 32114124 Provide for peellist D V I B I 422 1-3543214 INCI

4) access to the INKS Deework 1-3543218 ~

I I I I through a maint_nance data I I I terminal with proper I I I author1z4l t ion I I I

I I I 321 1 41 25 IProvide the capability fori D V I B I 422 1-3543215 Hel

Ilocal input and diaply I I I lof data a_d commands to al I IIsubsystem via the main- I I I Itenance data terminal I I I I I I I

J 2 1 1 4 1 26 IProvide the specialist the I D V I B I 422 1-3543218 Hcl Icapability to obtain I I I lexclusive use of a sub- I I II-ystem while on-site I I I I I I _------------_ __ __~M bull______bull__ __ ___ ~lI I

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 37: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

- bullbull-----------bullbull-------------------bullbull-- __III--IIiI __ bull ___ ____ _-----~

TEST fLlN TRACE I CI llEMARIS CROSS REF PARAGRAPH IORI

INcl NAS-S5-1000 I HAS-S5-1000 IVERFI I -PLAN I SPECIFICATION I I PAIA NlraquofBR I IBqUIUHBRT IMTBDIVOLI CAT RLTD SECTS I FAA-E-2772 I I -middot_middot-middot--middotmiddot------I---------------middot---middotmiddot-I-M-middot~middot-middott--~-_--_---_-- ------~---------middot----I--Imiddotmiddot--------32114129 IProv1d an IO port for a I D I V I B 422 1-3543213 INCI

IportNle 1Ilaintenance data I I I I Iterminal I I I I II I I I I

32114130 IProvide for the transfer I D V I B 422 1-3543212 INCI of epecialiet lII8uagu I I 1 I between a MDT and _ USC I I I I ltPS I 1 I I

I I I I gt 3211424 ~X8cute control commands I T V I A 421 1-354321 INCI t-I and prOVide an indication I I I I o to the HPS within an I I I I I

averaga t~ of 2 bullbullconda I I I I and a madmum t 1m 0 f 5 I econdbullbull I

I 3211425 tAcknowledge receipt of a T ViA 421 1-354326 HC

Icommand to th HPS within IIan ~rg time of 2 IIbullbullcauda and a maximum t 1lne I10pound 5 bullbullconde I I I I I I I I I I I I Ibull bullbullbullbull-iiiiIiMbullbullbullbullbullbull bullbull_ _bullbull _-----_-----_--~-__ _-__

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 38: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

__~------~ __~------~-_-____ _--------------~_ -------- __---shyt I I I TEST PLAB I TRACE I CI IWWtKS

I I I CROSS REF I PARAGRAPH lOR I I I I I I INCI

HAS-S5-l000 I NAS-SS-IOOO IVRl I I I PLAN I SPECIFICATION I I PARA HUltBIR I UQUllEHBHT IHTHDiVOLj CAT I RLTD SECTS I PAA-I-2772 I I---middot---middotmiddotmiddot-=-middot-------middot~---middot----=- -I---middot-I bullbullbull _middot_middotI __bull bullbull __ I_ iiiii__=-_~__bull I-- 11

3211428 ITranfr gbullbull to the I D I V I A J 421 I 1-354329 INC IMPS on bull priority bbullbull i I I I IWith priority beiog ttusl I I imgbullbull mbullbullbullbullgdata I I I Iand prformance data I I I I I I I

~L211224 IAlara detction and I D 1 V I A I 421 I 1-354329 INC Iprbullbullbullntation I I I B I 422 I

Igtl- 3211226 IControl CommaDd I D I V I A I 421 I 1-354329 INC l- I I I I B I 422 I I

I I I I I I 3211421 IAlrmAlert Detection I D I V I B I 422 I 1-354329 NC

------------------=---------------- iII ~___- __~I11111_ ~_~ __

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 39: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

APPENDIX B

TEST DISCREPANCY REPORTS

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 40: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

OU-JCATI SOl IXISTS

1IOIaI

_-aWl

~uSHC1IO

suHIOG

1IHClCS)

o 1CU1l0N 0 NOItlM

SITI

SnTlM

All

bull

B-1

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 41: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

PLEASE TYPE HARDWAR - DISCRE ANCY REPORT o OUPliCATE HOR EXJSTS

I

~ITE _EES8URG

ATlANTA

SALT LAKE CITY

OTHER

HARDWARE HAROWARE

SUBSYSTEM TYPE

I REFERH4CE(S)

HARDWARE

MODEl

SvHEM

TAPE n

AnAC HMENT(5)

PRIORITY

DESCRIPTION OF PROBLEM

ACTION TAKEN

I ORtGlPljATOflS SIGNATURE AND itOUTI~ SYMBOL

B-2

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 42: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

PEASE rVJ)E PROGRAM TECHNICAl REPORT o ou OTE PT EXIS11

TYPE OF REPORT - tROUBLE SITE - IEES8uAG

tJ IMPOVE ME NT - ATLANTA

I

SuSPECTED I ~tCTION

SUBPROORAM I I

iYS TiE I

MOOE~ VERSION TAPE

I lO

I

REfERENCEltSi AnA( ME~S

- ~AL T ~Af(e (lTY

I PRIORITy

oeSCRIPTION OF PROBLEM

ACTION TAKEN

ORIGIN TORS SIGNATURE 01110 ROuTING SYM9010

B-3

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 43: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

APPENDIX C

TEST SCHEDULE

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 44: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan

Test Milestone Completion Date

Design Qualification Test Procedures Approved Aug lO 90 Design Qualification Testing Starts Aug 20 90 Design Qualification Tests Completed Oct 19 90 Functional Configuration Audit (FCA) Completed Oct 22 90 Physical Configuration Audit (PCA) Completed Oct 22 90 Production and Factory Checkout of First System Nov 01 90 System Delivered to First Reliability Demo Site (Chicago) Nov 16 90 Reliability Testing Begins (15 Sites) Nov 30 90 Integration Test Plan Approved Feb 15 91 Site Acceptance Test Plan Approved Mar 15 91 Shakedown Test and Evaluation Plan Approved Mar 29 91 System Delivered to FAA Academy Apr 23 91 Reliability Testing Complete Apr 30 91 Site Acceptance and Integration Testing Begins May la 91 Site Acceptance and Integration Testing Complete May 24 91 Shakedown Test and Evaluation Begins May 28 91 Shakedown Test and Evaluation Complete June 14 91 DRR Executive Committee (EXCOM) Deployment Decision July 08 91 First Operational Readiness Demonstration (ORO) Completed July 22 91 First Production System Delivered to Depot Aug 30 91 Last ORO Completed Oct 31 94

Note Dates are subject to change

C-l

Page 45: V Operat-'o,n,al* est Eva &,,)1 ,ntegra lioln Plan