106
Quantitative Legal Prediction ( Or How I Learned to Stop Worrying and Embrace Disruptive Technology) Daniel Martin Katz Michigan State University - College of Law

Qualitative Legal Prediction - Prof. Daniel Katz

Embed Size (px)

DESCRIPTION

Professor Daniel Katz' presentation at lawTechcamp 2011 in Toronto, ON

Citation preview

Page 1: Qualitative Legal Prediction - Prof. Daniel Katz

Quantitative Legal Prediction( Or How I Learned to Stop Worrying and

Embrace Disruptive Technology)

Daniel Martin KatzMichigan State University - College of Law

Page 2: Qualitative Legal Prediction - Prof. Daniel Katz
Page 3: Qualitative Legal Prediction - Prof. Daniel Katz

(1) Big Data and Moore’s Law

Page 4: Qualitative Legal Prediction - Prof. Daniel Katz

(1) Big Data and Moore’s Law

(2) The ‘Soft’ AI Revolution

Page 5: Qualitative Legal Prediction - Prof. Daniel Katz

(1) Big Data and Moore’s Law

(2) The ‘Soft’ AI Revolution

(3) Prediction

Page 6: Qualitative Legal Prediction - Prof. Daniel Katz

(1) Big Data and Moore’s Law

(2) The ‘Soft’ AI Revolution

(3) Prediction

(4) Mental Models v. Aggregation

Page 7: Qualitative Legal Prediction - Prof. Daniel Katz

(1) Big Data and Moore’s Law

(2) The ‘Soft’ AI Revolution

(3) Prediction

(4) Mental Models v. Aggregation

(5) Quantitative Legal Prediction

Page 8: Qualitative Legal Prediction - Prof. Daniel Katz

This is the Era of “Big Data”

Page 9: Qualitative Legal Prediction - Prof. Daniel Katz

This is the Era of “Big Data”

Increasing Computing Power

Page 10: Qualitative Legal Prediction - Prof. Daniel Katz

This is the Era of “Big Data”

Increasing Computing Power

Page 11: Qualitative Legal Prediction - Prof. Daniel Katz

This is the Era of “Big Data”

Decreasing Data Storage Costs

Increasing Computing Power

Page 12: Qualitative Legal Prediction - Prof. Daniel Katz

This is the Era of “Big Data”

Decreasing Data Storage Costs

Increasing Computing Power

Page 13: Qualitative Legal Prediction - Prof. Daniel Katz

This is the Era of “Big Data”

Decreasing Data Storage Costs

Increasing Computing Power

Fundamentally Altering the Scope of Scientific Inquiry

Page 14: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

Page 15: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

Page 16: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

2008

Page 17: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

2008

Page 18: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

2008 2009

Page 19: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

2008 2009

Page 20: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

2008 2009 2010

Page 21: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

Page 22: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

Page 23: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

2011

Page 24: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

2011

Page 25: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

2011 2011

Page 26: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

Page 27: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

Page 28: Qualitative Legal Prediction - Prof. Daniel Katz

Highlighting the Data Deluge

Page 29: Qualitative Legal Prediction - Prof. Daniel Katz

Okay But ...

Page 30: Qualitative Legal Prediction - Prof. Daniel Katz

Data is only half the story

Page 31: Qualitative Legal Prediction - Prof. Daniel Katz
Page 32: Qualitative Legal Prediction - Prof. Daniel Katz

Computationand

Artificial Intelligence

Page 33: Qualitative Legal Prediction - Prof. Daniel Katz

The Artificial Intelligence Revolution is On

Page 34: Qualitative Legal Prediction - Prof. Daniel Katz

The Artificial Intelligence Revolution is On

Page 35: Qualitative Legal Prediction - Prof. Daniel Katz

The Artificial Intelligence Revolution is On

Page 36: Qualitative Legal Prediction - Prof. Daniel Katz

The Artificial Intelligence Revolution is On

Page 37: Qualitative Legal Prediction - Prof. Daniel Katz

The Artificial Intelligence Revolution is On

Page 38: Qualitative Legal Prediction - Prof. Daniel Katz

The Artificial Intelligence Revolution is On

Page 39: Qualitative Legal Prediction - Prof. Daniel Katz

An Meaningful ‘Soft’ AI Example

Page 40: Qualitative Legal Prediction - Prof. Daniel Katz

E-Discovery

Page 41: Qualitative Legal Prediction - Prof. Daniel Katz

Some Applicable Terms

Page 42: Qualitative Legal Prediction - Prof. Daniel Katz
Page 43: Qualitative Legal Prediction - Prof. Daniel Katz

Natural Language Processing

Page 44: Qualitative Legal Prediction - Prof. Daniel Katz

Natural Language Processing

Knowledge Representation

Page 45: Qualitative Legal Prediction - Prof. Daniel Katz

Natural Language Processing

Knowledge Representation

Feature Extraction

Page 46: Qualitative Legal Prediction - Prof. Daniel Katz

Natural Language Processing

Knowledge Representation

Feature Selection

Feature Extraction

Page 47: Qualitative Legal Prediction - Prof. Daniel Katz

Natural Language Processing

Knowledge Representation

Machine Learning

Feature Selection

Feature Extraction

Page 48: Qualitative Legal Prediction - Prof. Daniel Katz

Natural Language Processing

Knowledge Representation

Machine Learning

Feature Selection

Feature Extraction

Classification

Page 49: Qualitative Legal Prediction - Prof. Daniel Katz

Natural Language Processing

Clustering

Knowledge Representation

Machine Learning

Feature Selection

Feature Extraction

Classification

Page 50: Qualitative Legal Prediction - Prof. Daniel Katz
Page 51: Qualitative Legal Prediction - Prof. Daniel Katz

Prediction

Page 52: Qualitative Legal Prediction - Prof. Daniel Katz

A Few Words About Prediction

Page 53: Qualitative Legal Prediction - Prof. Daniel Katz

Imagine Two DifferentComplex Systems

Page 54: Qualitative Legal Prediction - Prof. Daniel Katz

Weather

Page 55: Qualitative Legal Prediction - Prof. Daniel Katz

Tides

Page 56: Qualitative Legal Prediction - Prof. Daniel Katz

vs.

Easy/ Predictable Difficult / Chaotic

Page 57: Qualitative Legal Prediction - Prof. Daniel Katz

vs.

Easy/ Predictable Difficult / Chaotic

Page 58: Qualitative Legal Prediction - Prof. Daniel Katz

vs.

Easy/ Predictable Difficult / Chaotic

Page 59: Qualitative Legal Prediction - Prof. Daniel Katz

The Caliber of Prediction is

Page 60: Qualitative Legal Prediction - Prof. Daniel Katz

A Function of Various Factors

Page 61: Qualitative Legal Prediction - Prof. Daniel Katz

Including ...

Page 62: Qualitative Legal Prediction - Prof. Daniel Katz

Underlying System

Variability

Page 63: Qualitative Legal Prediction - Prof. Daniel Katz

Quality of Inputs

Page 64: Qualitative Legal Prediction - Prof. Daniel Katz

Etc.

Page 65: Qualitative Legal Prediction - Prof. Daniel Katz

Formal Treatment of the question of

prediction in alternative Domains

Page 66: Qualitative Legal Prediction - Prof. Daniel Katz

Quantitative Legal

Prediction

Page 67: Qualitative Legal Prediction - Prof. Daniel Katz

It Already Exists ...

Page 68: Qualitative Legal Prediction - Prof. Daniel Katz
Page 69: Qualitative Legal Prediction - Prof. Daniel Katz
Page 70: Qualitative Legal Prediction - Prof. Daniel Katz
Page 71: Qualitative Legal Prediction - Prof. Daniel Katz

This is a Great Example

Page 72: Qualitative Legal Prediction - Prof. Daniel Katz

But What Does the Market Really Care About?

Page 73: Qualitative Legal Prediction - Prof. Daniel Katz

Disputes v. Decisions

Page 74: Qualitative Legal Prediction - Prof. Daniel Katz

Disputes, Filings, etc.

Page 75: Qualitative Legal Prediction - Prof. Daniel Katz

Bargaining in the Shadow of the Law

Page 76: Qualitative Legal Prediction - Prof. Daniel Katz

What is the Client’s First Question?

Page 77: Qualitative Legal Prediction - Prof. Daniel Katz

do i have a case?

Page 78: Qualitative Legal Prediction - Prof. Daniel Katz

how is that assessment generated?

Page 79: Qualitative Legal Prediction - Prof. Daniel Katz

Mental Models vs

Aggregated Data

Page 80: Qualitative Legal Prediction - Prof. Daniel Katz

lots of factors matter

Page 81: Qualitative Legal Prediction - Prof. Daniel Katz

Time Scales Matter

Page 82: Qualitative Legal Prediction - Prof. Daniel Katz

inherent system variability matters

Page 83: Qualitative Legal Prediction - Prof. Daniel Katz

‘complexity’ matters

Page 89: Qualitative Legal Prediction - Prof. Daniel Katz

standard client memo

+

statistical portrait of 10,000 ‘similar’ cases

Page 90: Qualitative Legal Prediction - Prof. Daniel Katz

How do we assess similarity?

Page 91: Qualitative Legal Prediction - Prof. Daniel Katz

Analogical Reasoning and the Science of Similarity

Page 92: Qualitative Legal Prediction - Prof. Daniel Katz

similarity measures

=~distance measures

Page 97: Qualitative Legal Prediction - Prof. Daniel Katz

Six Degrees of Marbury v. Madison A Sink Based Visualization

Page 104: Qualitative Legal Prediction - Prof. Daniel Katz

Some Reading For Your Consideration

Page 105: Qualitative Legal Prediction - Prof. Daniel Katz

@computational

Page 106: Qualitative Legal Prediction - Prof. Daniel Katz

AdditionalMaterialsAvailableOnline!