Embed Size (px)
Citation preview
For nearly two decades, MetaVR® visuals have been used in the US Army’s unmanned aerial system (UAS) training simulators, primarily through the Multiple Unified Simulation Environment / Air Force Synthetic Environment for Reconnaissance and Surveillance (MUSE/AFSERS) simulation system. Within MUSE/AFSERS MetaVR Virtual Reality Scene Generator™ (VRSG™) provides simulated HD video feeds for various intelligence gathering platforms.
Developed by the Joint Technology Center/Systems Integration Laboratory (JTC/JSIL), MUSE/AFSERS is a general intelligence collection platform simulation for airborne collection systems with electro-optical (EO), infrared (IR), and synthetic aperture radar (SAR) payloads; it is the primary UAS training and simulation system used in the Department of Defense for command- and staff-level joint services training and provides the largest number of fielded simulation systems in the US. As result, MetaVR has become one of the largest suppliers of commercial licensed 3D visualization software for UAS simulation training in the US military, with nearly 2,500 active VRSG licenses in the field. The US Army uses VRSG in its Shadow Crew Trainer, and in Grey Eagle, Aerosonde, and Hunter trainers in portable, classroom, and embedded configurations at Fort Huachuca and other UAS training sites. VRSG is also embedded in the Army’s Universal Ground Control Station (UGCS) for training operators on multiple platforms. The US Air Force uses VRSG in the MALET-JSIL Aircrew Trainer (MJAT), which converts an operational MQ-9 ground control station (GCS) into a training simulator.
VRSG provides the visualization system component for the MUSE, which generates synthetic payload scene video and/or imagery of the 3D battlefield with simulated target entities. This video and imagery is subsequently fed to a tactical or generic UAS/intelligence platform control station where operators perform air vehicle and payload control functions, and an air vehicle and data link simulation.
A key feature of VRSG is its ability to stream real-time HD-quality simulated video with KLV metadata using the H.264 protocol, which is indiscernible in composition from actual UAV video feed. VRSG can encode STANAG 4609-compliant MISB ST 0601.8 KLV metadata and MISB security metadata standard 0104.5. When operators are not flying an actual UAS, they can fly a simulated UAS using the same hardware that they use to operate the actual aircraft and stimulate real ISR systems, with the MUSE air vehicle and data link simulation software and VRSG.
VRSG can be configured to simulate a UAS in ways that range from using VRSG’s internal camera payload model in which the telemetry of the simulated UAV is provided by a DIS or HLA entity, to fully integrated applications such as the MUSE UAV tactical trainer.
Simulation features include:
• Capturing high-resolution virtual world screen images remotely. VRSG can instruct the UAV camera to capture the current image in its field of view from remote operators in the simulation environment, save the image as a large format NITF file, and deliver the file for display on another computer. This feature simulates the Global Hawk large image sensor capability.
• Using VRSG as a simulated, live, sensor video feed used to classify ground information from a Geographical Situational Display. Airborne or space-borne collection systems that use Ground Moving Target Indication (GMTI) and target identi- fication devices create symbolic representations of moving entities over large geographic areas. VRSG enables the operator to refine target identification and classification.
• Streaming real-time KLV metadata multiplexed into an HD H.264 (MPEG-2) transport stream. Tactical exploitation systems can use this streaming MPEG feed to visualize sensor payload imagery in real time and extract the UAV metadata. The MPEG stream can be transmitted live over UDP to a remotely operated video-enhanced receiver (ROVER) device, or any device that can play video from an ISR video feed, or streamed to a file for later playback.
• Coupling VRSG with ROVER devices, often used by JTACs/ FACs. VRSG can generate the simulated 3D scene and the range and coordinates of a designated target on the ROVER.
One aspect of training UAS operators entails interacting with JTACs/FACs in joint mission training. Training in a networked synthetic environment, the UAS operator and the JTAC/FAC on the ground work together to identify the same target in a scene. Coupled with Battlespace Simulations’ Modern Air Combat Environment (MACE), VRSG can simulate Digitally Aided Close Air Support (DACAS) on a device running the government-off-the-shelf Android Team Awareness Kit (ATAK) app.
COMMERCIAL SIMULATIONUAS training lab at Embry-Riddle Aeronautical University Embry-Riddle Aeronautical University’s Daytona Beach campus uses eight VRSG desktop systems in its UAS Training Lab.
Images on the cover: MetaVR VRSG real-time scene of an MQ-9 Reaper entity monitoring the virtual terrain of Mischief Reef, Spratly Islands, South China Sea. Inset image is VRSG’s simulated sensor view from the MQ-9 camera.
Left: MetaVR VRSG real-time scenes featuring an MQ-9 Reaper UAS / RPA entity flying over MetaVR’s geospecific port city of Kismayo,Somalia. Center: The MQ-9’s simulated sensor view of activity below. Right: JTAC character examining MQ-9 video feed on a simulated MVR III Mini-ROVER.
in a classroom or portable environment. The UMS enables UAS operators to fulfill part of their qualification training and follow-on continuation training to maintain proficiency and currency.
The system uses the MUSE system with VRSG to stimulate the tactical Vehicle Control software (VCS) to simulate the following UGCS functions: air vehicle control, payload control, weapons control, communications, send and receive video data, and mission planning. The simulator incorporates multifunctional software approaches to provide UAS operators with a high-fidelity training experience for individual, crew, and collective training. In a classroom setting such as at the Army’s UAS Training Center at Fort Huachuca, AZ, the simulators are full-size mockups of the actual GCSs from which UASs are operated in the field.
VRSG is embedded directly in the UGCS, enabling a smooth training transition to a shelter in the field where soldiers can maintain flight time requirements and currency. The UGCS is a NATO STANAG 4586-compliant command-and-control platform that incorporates the Army’s Tactical Common Data Link (TCDL) for robust bandwidth and data security. It is designed to command and control multiple joint services UASs simultaneously. The TCDL, which sends secure data and streaming video from reconnaissance airborne platforms to ground stations, transmits radar, imagery, video, and other sensor information.
Since 2002, the US Army National Guard has purchased VRSG licenses for ongoing fielding in its embedded Shadow Crew Trainer (SCT). These licenses support embedded trainers in Shadow TUAS, Aerosonde, Hunter, and Grey Eagle UASs, which are used by both Army and Army National Guard units.
The SCT is a mission-level fully enclosed mobile classroom environment training device that enables users to train on their specific roles, as well as team-level communication and mission rehearsal. The SCT can train up to five students simultaneously in an integrated mode and enables recording of the mission for after-action review. Simple graphical user interfaces mimic the actual equipment. Trainees can log SCT hours as flight hours toward their overall requirements for Shadow UAS training. Each TUAS system is comprised of three air vehicles, two ground control stations, two ground data terminals, a launcher, a tactical automatic landing system, and an aerial vehicle transport. In normal operation, the GCS is used to control the flight of the UAS and receive its telemetry. When the system operators are not flying the actual UAS, they can fly a simulated UAS using the same hardware.
A key feature of these simulators is that VRSG can be driven by the Piccolo Command Center Interface Software, via a VRSG plugin developed by Georgia Tech Research Institute, which uses MetaVR’s CIGI interface. (The Piccolo software is a widely fielded commercial UAS ground control station software application.) In this way, students can train on the most current military and commercial applications. The lab hopes to eventually collect imagery from its own UAS for the purpose of using it to build 3D terrain in MetaVR Terrain Tools for Esri® ArcGIS® and render the terrain in the UAS simulators.
UAS simulation lab and SUAS at Mohawk Valley Community College Mohawk Valley Community College (MVCC) Utica, NY, campus uses MetaVR’s visuals and donated small Unmanned Aerial Systems (SUAS) in its state-of-the-art flight simulator lab built for the college’s Remotely Piloted Aircraft Systems degree program. MVCC purchased six VRSG licenses and six BSI’s MACE licenses for desktop pilot and sensor operator training stations in the lab, which was unveiled in September 2016. As part of the software delivery, MetaVR donated to MVCC a MetaVRC, the company’s small UAS used for imagery collection. The lab consists of five student stations, an instructor station, and a 3D terrain server which runs MetaVR 3D terrain, including CONUS++ Northeast region. Students learn mission planning and operations and flight skills in the lab as part of this Associates of Applied Science degree program.
The imagery collection SUAS that MetaVR donated to MVCC was built by SRP Aero for autonomous aerial surveying at low altitudes. The aircraft takes sub-inch resolution still-frame images, which MetaVR then orthorectifies and uses to build sub-inch resolution 3D terrain in MetaVR Terrain Tools for for rendering in VRSG. SRP Aero provided field training on the SUAS to professors in the program. Students use the SUAS as they learn about long range mapping and autonomous missions.
MILITARY SIMULATION US Army UAS classroom and embedded trainers VRSG provides the desktop and embedded 3D synthetic payload visualization system for training UAS operators on ground control stations such as the US Army’s UGCS. The Army’s UAS Universal Mission Simulator (UMS) is a Training Aids, Devices, Simulator and Simulations (TADSS) system that provides training for the operation of the Army’s UGCS for the MQ-5B Hunter, RQ-7 Shadow, and MQ-1C Gray Eagle platforms
Field training at Mohawk Valley Community College Utica campus on the SUAS donated by MetaVR. Photo courtesy of MVCC.
Simulation stations with VRSG in the UAS Training Lab at Embry-Riddle’s Daytona Beach Campus. Photo courtesy of Embry-Riddle.
AFRL’s PRINCE MQ-1/MQ-9 simulator The Air Force Research Laboratory’s (AFRL) Warfighter Readiness Research Division 711th Human Performance Wing at Wright Patterson Air Force Base has long used VRSG in various training research simulators. AFRL was an early adopter of VRSG as the IG for its JTAC training domes (precursors to the current JTC-TRS and AAJTS dome systems). Close air support (CAS) training missions that are run in their three JTAC dome systems include the AFRL-developed Predator training-research simulator, called the Predator Research Integrated Network Combat Environment (PRINCE). PRINCE is a high fidelity, networkable MQ-1 and MQ-9 Remotely Piloted Aircraft (RPA) simulator, which serves as an R&D tactical simulator for Predator pilots and sensor operators. As part of AFRL’s research in human performance methods and technologies that provide the warfighter the necessary knowledge and skill to dominate their operational environment, the objective of the PRINCE research program is to meet known training gaps in UAV tactical operations such as JTAC integration.
VRSG is currently integrated as the simulator’s IG for cross-training with the JTAC dome systems. PRINCE team members use VRSG Scenario Editor to populate the 3D terrain with culture (such as building up dense urban areas) and BSI’s MACE for creating realistic training scenarios. For example, the PRINCE can take part in a CAS training mission that includes a convoy overwatch with enemy targets in the area; VRSG generates the simulated MQ-1 camera feed that appears on both the GCS monitor and a ROVER device used by the JTAC.
US BICES Coalition Integration Lab The US Battlefield Information Collection and Exploitation Systems (US BICES) Coalition Integration Lab (CIL) uses VRSG with BSI MACE to provide a 3D model environment for simulating a battlefield or any other space that requires modeling and simulation. VRSG provides the simulated UAS streaming video used in preparedness training of traditional ISR activities such as collecting intelligence and sharing it among Allied nations for processing, exploitation, and dissemination. The BICES CIL shares VRSG coupled with MACE in rehearsal of concept (ROC) training with the Distributed Common Ground System (DCGS) program of record (DGS-1).
U.S. Navy’s ship-based Fire Scout UAV simulatorThe U.S. Navy at Naval Air Station Patuxent River, MD, and other locations use VRSG in MQ-8B/C Fire Scout simulators. Multiple portable training devices run VRSG in exercises that serve to both instruct and maintain proficiency of Fire Scout air vehicle operators (who fly the aircraft) and mission payload officers (who control the payload). VRSG controls the FLIR simulation that operates in EO/IR, used mainly for ship-based operations, and sometimes for shore-based operations. The FLIR EO/IR simu-lation enables operators to classify ships from a far distance, with narrow fields-of-view (FOVs), and in varying environmental conditions. Such usage benefits from VRSG’s real-time, physics-based thermal sensor simulation and ability to render a scene ac-curately with long-range narrow FOVs. In the 4-channel system, VRSG renders for the instructor a stealth view outside the Fire Scout for situational awareness and a shipboard camera view that is attached to the automatic approach system.
USAF MQ-9 Reaper RPA Simulator (MJAT) One of the many development efforts at the JSIL that involve VRSG is the MALET-JSIL Aircrew Trainer, or MJAT, a plug-and-play training capability that converts a current tactical MQ-9 GCS into a training simulator. The MJAT provides RPA operators the ability to conduct simulation training as part of their qualification and follow-on continuation training to maintain proficiency and currency in all required operator tasks. Like other JSIL developed UAS/RPA trainers, the embedded MJAT uses the AFSERS software to stimulate the tactical VCS to simulate GCS functions: control of air vehicle, payload, and weapons, communications, sending and receiving video data, and mission planning.
From 2016-2018, 56 MJATs were installed at USAF sites across the US that house the MQ-9 Reaper aircraft. As part of the on-going rollout of the MJAT, JSIL purchased an additional 148 new VRSG licenses in 2019.
All MJATs also use BSI’s MACE for scenario creation and computer-generated/semi-automated forces. Because all UAS/RPA simulators that use MetaVR visuals and BSI MACE are interoperable with JTAC simulators that also use MetaVR visuals, this common VRSG/MACE baseline provides enhanced interoperability and correlation between the MJAT and the large number of deployed VRSG/MACE-based JTAC simulators. This interoperability is critical in the simulated training environment, for emulating the interaction between Reaper sensor operators and JTACs during real-world missions.
VRSG real-time scene of an RQ-7 Shadow UAS in flight over MetaVR’s rugged virtual terrain of Afghanistan.
VRSG real-time ocean-based scene of an MQ-8B Fire Scout entity in flight above two CUSV vessels and a group of sea mines.
MetaVR and the MetaVR logo are registered trademarks, and Virtual Reality Scene Generator, VRSG, Metadesic, and the phrase “geospecific simulation with game quality graphics” are trademarks of MetaVR, Inc. Metadesic is protected by US Patent 7,425,952. Esri and ArcGIS are registered trademarks of Esri. All other brand or product names are trademarks of their respective companies. Copyright © 2019 MetaVR, Inc.
For more information, visit www.metavr.com or contact [email protected].
