Presented by: Adarryl Roberts Defense Logistics Agency Enterprise Sourcing, Medical, and Contingency Portfolio Manager

PIEE and the Data Lake

PROCURE-TO-PAY DEFENSE PROCUREMENT AND ACQUISITION POLICY

TRAINING SYMPOSIUM

May 30 – June 1, 2017 ● Hyatt Regency Orlando FL 1

Agenda

2017 Procure-to-Pay Training Symposium 2

• Procurement Integrated Enterprise Environment (PIEE) • What is the PIEE? • PIEE Current State • Procurement Systems View Level 8 Architecture

• Data Lake • What is the Data Lake? • Solution Architecture • Capabilities Overview • Current Report List • How are Reports Determined? • What is Possible? • How are Capabilities Designed? • Gaining Access to Production

What is the Procurement Integrated Enterprise Environment?

2017 Procure-to-Pay Training Symposium 3

An efficient effective hosting environment for functional procurement capabilities (e.g. WAWF, JCXS, CAGE, FEDMALL) PIEE will enable:

– Agile development and deployment – Lower maintenance cost – Standard and reduced system interfaces – Ability to leverage data across applications – Streamlined secure role based user access

Procurement Integrated Enterprise Environment

Current State Established a common hosting environment for enterprise

applications and data (FY17) ATO granted for FEDMALL and Data Lake Next Steps: • Enable enterprise role based access to environment • Determine other cloud ready applications to move to the

environment • Ensure technology framework for EDA is current, efficient

and effective

2017 Procure-to-Pay Training Symposium 4

EMMA

RA AIM

DM

DMDC

DPAP

Purchase Card Program

System for Award Management (SAM)

Future Phases:

TBD

Award Mgmt.

Performance Information

Wage Data

Assistance Data

WDOL

FPDS

PPIRS / CPARS / FAPIIS

FSRS / eSRS

CFDA FBO

USASpending

WAWF eBusiness Suite

DLA

DCMA

Common Services / APIs / Reports CLS (2015)

BI Extracts (2014)

BI Reports (2014)

Mobile Apps

Line Item Service

Labor Code Crosswalk PSD-OCC

Selection Tool (2015) DPAP DLA

DoDAAD

DLA

DoD Entity Identification eTOOLS

CBAR MOCAS

MOCAS API IWMS

JCCS Integrated Environment

Contract Administration Enterprise Solutions

Component Managed Enterprise Solutions

GSA

Solicitation / Proposal Management

Purchase Request / MIPR Workflow Management

Niche Contract Writing (20-40% of transactions)

Workload / Workforce Management

Records Management

Business Intelligence

Catalogs / Online Malls

IBEX

GSA Advantage

EMALL

Yet to be Determined In-Process Fully

operational

Legend

BPR: Virtual File Mgmt, Info SLINs, ELINs, & Reconciliation Tools

GSA

DLA

DLA

PDREP / W&S of Repair

Navy

PDS Validation (2008)

myInvoice Validation

PRDS Validation (2010)

GEX

Contract Distribution

Treasury

FEDMALL (2017) DLA

NG PPIRS-SR (Supplier Risk)

(2016)

CDR (2016)

Merged Bolted / Separate ly Built Module

(2009)

Automated Contract

Closeout (2015)

NCCS DD254 (2015)

D-C eMIPR workflow (2015)

myInvoice (2015)

CORT Tool (2013)

IUID / GFP Registry (2005)

Contract File (EDA, 2003)

IRAPT (2003)

Vendor Family Tree (2016)

cASM

CAGE (CONUS)

Common Services Platform

SAM - Entity Mgmt. (2012)

(2008)

(2003) (2015)

GFLSV (2015)

JCOP

AGATRS (2014)

TBC (2013)

3-in-1 (2010)

CERP

Dollars & Sense

Contract Reporting

Opportunity Posting

Vendor Vetting

DLA 5 Data Lake Phase

1 (2017)

Automating Solicitations

(2018)

Manual Closeout (2017)

What is the Data Lake?

2017 Procure-to-Pay Training Symposium 6

A capability that ensures data from procurement enterprise systems is searchable agnostic to system operations (e.g. consolidate MRS instances across WAWF) Ensure data aggregation can be separate from operational systems Successful proof of concept completed in FY16 Extraction capability developed • Data Lake is currently being populated with data from WAWF

• Limited initial access • Verification and Validation underway • Designed for government users • Developing extracts for DFAS to support audit

Data Lake Solution Architecture Built entirely on open source software,

eliminating license and maintenance costs

Scales linearly on demand to manage massive datasets

Runs on commodity, reusable hardware

Ingests, enriches, and relates structured and unstructured data sets

Supports advanced distributed analytics to derive knowledge

Enables teams to focus on developing a customer solution instead of worrying about the plumbing of data ingest, storage, and search

Provides an integrated analytic engine to allow users to load and execute analytics tuned to their needs 2017 Procure-to-Pay Training Symposium 7

Data Lake Phase 1 Capabilities Overview

2017 Procure-to-Pay Training Symposium 8

• Brings together data from various sources – iRAPT – EDA – myInvoice – CORT Tool – eMIPR – IUID Registry – DCMA EDRMS and Contract Closeout Database – WAWF CDR – WAWF Contract Closeout

• Provides method of storing and indexing multiple data formats • Uses

– Data migration – Reports - Samples follow

• Contract Execution History • Contract Closeout

Data Lake Current Report List

2017 Procure-to-Pay Training Symposium 9

Notification of Contract File Disposal from Data Repository Contract File Disposal from Data Repository Query Data* (handful of reports within this capability) Export Query Results Save Queries Track IDIQ Contracts Awarded and Closed by Base Award and By Order Track Recent Contracts Awarded and Closed (Annual) Track Older Contracts Awarded and Closed (Annual) Generate Record of Destruction of Contract File Contract Execution History Report

Contract Purple File Repository

CORT Submission of Status Reports to Contracting Officer

Service Contract with CORs Appointed in DoD CORT Tool Training Requirements for CORs Appointed in DoD CORT Tool Contract Phonebook DCAA Contract Brief Capability Bulk Download and Highlight

A list of completed Data Lake use cases available for users after initial deployment

A list of highlighted use cases planned for future Data Lake development efforts Total of 23 planned future use cases

2017 Procure-to-Pay Training Symposium

Contract Execution History Detailed Data

2017 Procure-to-Pay Training Symposium

Contract Execution History Contract Data

Contract Execution History CLIN change by Mod

Contract Execution History iRAPT Data by CLIN

Procurement Instruments Awarded and Closed

What is possible with the Data Lake?

2017 Procure-to-Pay Training Symposium 16

• Provides a robust view of a contract’s full lifecycle • Provide data analytic capabilities beyond traditional static reporting across multiple

enterprise-level data sets

• Improved data accessibility, integration and in-depth analytical capability from various emerging data sources into a single data repository

• Substantial benefit of growing data variety and metadata for analysis and reporting • Services associated with business function

• Various level of automated reporting solution across DoD, Service, and MAJCOM

levels

How are Lake capabilities designed? • Step 1: An organization sponsors a Lake capability • Step 2: A use case proposal is developed by the sponsor • Step 3: The proposed capability is reviewed by the PBORG • Step 4: If approved, a wireframe is developed • Step 5: Priority and resources are determined • Step 6: Development of new capability inserted into future sprint sessions • Step 7: Submitter conducts testing and V&V of new capability • Step 8: Capability is deployed for use to production users

2017 Procure-to-Pay Training Symposium 17

Sponsors may be required to resource the Lake capabilities

How to Gain Access to Data Lake?

2017 Procure-to-Pay Training Symposium 18

• Data Lake access is managed through WAWF and require approval from the Service/ Agency lead iRAPT GAMs

• Users must self register/ add a Data Lake role through WAWF • There are three types of Data Lake roles:

• Standard User: Most users will have this role. It grants users access to all reports that do not have sensitive pre-award data

• Enhanced User: Provides users will all standard reports plus the ability to view select reports that contain pre-award data

• Note: there are no current reports that contain pre-award data • Executive User: Provides users with all standard reports plus the ability to

view enhanced query capability • This is limited to the PMO user base

PROCURE PAY TO

TRAINING SYMPOSIUM

May 30 – June 1, 2017 ● Hyatt Regency Orlando FL

DEFENSE PROCUREMENT AND ACQUISITION POLICY

19