Big Data GovernanceMapR and AlyData

Jay ZaidiAugust 11, 2016

2

About Me.• Expertise: Data Management Expert, Author, and Entrepreneur• Background:

• 13 years at Fannie Mae. Reported to the Chief Data Officer for 5 years• Led data governance, data quality, master data management, metadata

management, business intelligence and big data programs for 8 years• 20+ Years industry experience, 11 years in consulting• M.S. In Computer Science and B.E. In Electronics and Communication

Engineering• Founded AlyData in 2014.

• Firm specializes in data governance, quality, MDM and Analytics services• Been on both sides of the fence, so we know what customers want and need

3

Thought Leadership.

Email – jayzaidi@alydata.comLinkedIn - www.linkedin.com/in/javedzaidiWeb – www.alydata.com

“Succeeding with data isn’t just a matter of putting Hadoop in your machine room, or hiring some physicists with crazy math skills. It requires you to develop a data culture that involves people throughout the organization.”

- DJ Patil, Chief Data Scientist of the U.S.

My books on “Data-Driven Leadership” launched worldwide on

Amazon and Kindle in July.

4

“The small and big data ecosystems are complex. They are essential for an

organization’s MISSION success but pose huge risks, if the two ecosystems

aren’t BRIDGED and GOVERNED well.”

There is a TECHNOLOGY COMPONENT and a PROCESS component here.

5

The MapR + AlyData Combination.

Two essential components

1. PLATFORM : Convince the customer that MapR is the only converged data platform.AND

2. GOVERNANCE : AlyData can help define, implement, and operationalize governance aspects including: policies, standards, quality, security, privacy, access, curation, lineage, metadata, master data, etc.

MapR has the PLATFORM technology and know how. AlyData brings GOVERNANCE expertise.

6

Some AlyData Partnerships.

Data wrangling for small and big data.

Smart Data Catalog - find, understand and govern data in Hadoop data lakes.

Data catalog for Hadoop and relational data stores.

Data Governance process automation.

Converged Data Platform.

7

Appendix.

8

Here’s AlyData’s 6-step data governance solution – a combination of Process, People and Technology.1. Assess: Data Management Maturity Assessment focused on Governance, Quality

and Master Data Management.2. Process: Apply AlyData’s Proprietary SPOCH framework.3. Agility: Use AlyData’s Agile Data Governance (DG), Data Quality (DQ) and Master

Data Management (MDM) processes.4. Standards/Policies: Define and monitor compliance.5. Alignment: Align DG with IT governance. 6. Automation: Implement tools to automate DG processes, DQ profiling, Tagging,

Discovery, etc.

9

Assess using DMM - CMMI for Data Management.

• Helps teams to align data management strategy with business goals of companies and institutions.

• Create a common terminology for describing data and the framework focuses on data management at strategic as well as planning levels.

• DMM model sets guides for achieving different capability levels based on measured improvements in specific process areas of data management.

• The key to CMMI is a series of levels of process improvements that in turn represent levels of IT maturity. Users work through a process in which they evaluate current data management capabilities, uncover gaps and highlight strengths. The method helps leaders establish priorities and create a roadmap for process improvements. 

10

Process - AlyData’s SPOCH Framework.

S – ScopeP – Process automationO – Ownership/accountabilityC – Cross-functional engagementH – Human intelligence