Embed Size (px)
Citation preview
April 27, 2020
Presented by: Jim Olsen, CTO
May 20th, 2020
Session #5: ModelOp Center + BI Tools
© Copyright 2020 ModelOp, Inc.
ModelOp Center Architecture
© Copyright 2020 ModelOp, Inc.
Model KPI Types
Understanding all of your models in businessWhat kinds of models are developed in your business?
How many of those models are eventually delivering business value?
What are the impacts of these models on your runtime environments?
Understanding a model’s impact on business valueA model serving in business role has real dollar impact on your business
Many different models may serve in that individual role
We must understand the predictions and how the model performance impacts business performance
© Copyright 2020 ModelOp, Inc.
ModelOp Center’s Solution - Integration
Reports are specific to a company, and change over timeFixed reports provide limited insight into what really affects your unique business.
Presentation, sharing, and modifying the reports are crucial to effective communication.
Reports must be able to be quickly generated and updated.
Tableau provides enterprise grade BI tools to design your own reportsRather than build out static reports ourselves, we choose to integrate with best in class industry standard tools
Tableau provides connectivity to external data sources through Web Data Connectors
Our solution embeds a Web Data Connector to communicate with our services
© Copyright 2020 ModelOp, Inc.
Tableau Web Data Connectors
Tableau downloads a web page with JavascriptThe ModelOp Center Gateway has the web data connector preinstalled
Nothing to install in your instance of Tableau
Our custom Javascript translates into Tableau formatDynamically identifies the schema of objects and translates
Flattens the complex objects into simplified rows of data required by Tableau
Allows two-way communication between Tableau and ModelOp CenterParameters can be passed in from Tableau to manage queries and filtering of data
Data can be refreshed in reports with minimal effort
Full Tableau functionality is available with live ModelOp Center Data
© Copyright 2020 ModelOp, Inc.
A Data Model Refresher
Stored ModelsStored Models are works in progress that represent up to the second model
Describes all assets, metadata, etc. about the model
Deployable ModelsRepresent a snapshot of the Stored Model at a specific point in time
Captured for all batch jobs that are run, so we can see the exact revision of the model that was used
Can be thought of as a model version
Deployed ModelsThese are deployable models that have actually been installed in the business
Contains the deployable model, but also full lineage of the lifecycle(s) followed to be installed
Model Test ResultsThe result of a parsed batch test run that captures results from the metrics function of a model
Can be any name/value pairs, and will be captured as is
© Copyright 2020 ModelOp, Inc.
Hands On – Let’s build some reports
How do we connect to the ModelOp Center Web Data Connector?What is the process for communicating with ModelOp Center?
What tables and data are available?
Building VisualizationsLook at Job Execution times across runtimes
Look at the types of models we have in flight
Examine the cost to business of model degradation over time
© Copyright 2020 ModelOp | This document is confidential and not to be shared without the explicit permission of ModelOp.
Thank you modelop.com
@ModelOp
vimeo.com/modelop
@ModelOp_Co
@ModelOp
© Copyright 2020 ModelOp | This document is confidential and not to be shared without the explicit permission of ModelOp.
