Database & Technology 1 _ Marcelle Kratchvil _ Why you should be storing unstructured data in oracle databases.pdf

The most comprehensive Oracle applications & technology content under one roof

Speaker Name Speaker Organisa/on Speaker Date


Why you should be storing unstructured data in the Oracle database

"Over 80% of data is unstructured and not managed - Isn't it about time you decided to manage it?"

Marcelle Kratochvil CTO Pic/on marcelle@pic/on.com


Inaugural International Unstructured Data with Multimedia SIG

For more information go to : http://eternal-donut.blogspot.com/

At OpenWorld – Sunday 9am (Moscone West)

To gather experts in the field to share ideas and to help those who are learning about multimedia and any unstructured data be able to find resources and share programs, papers, and ideas on anything in this field.

If you can't make OpenWorld, register at the blog site.


What is your jus/fica/on for not storing it in the database?

This is not the right ques/on to be asked

It should be

Why should I store unstructured data in the database?


What is Unstructured Data ?

l  Mul/media l  Photos

l  Audio

l  Video

l  Documents

l  Files

l  Raw Data

Structured = Relational Semi Structured = XML


Who needs it ?

l  Museums

l  Educa/on

l  Government

l  Marke/ng

l  Defence

Image Warehouses

Its now hard to find a business that doesn't need it


The Rules Change

l  Rela/onal is a well structured subset, with clearly defined rules

l  XML is structured but has variable rules

l  Mul/media introduces fuzzy concepts, normal referen/al rules stop making sense

l  Other data is the wild west


Interface

l  iPhone and iPad changed the interface

l  Augmented reality

l  More intui/ve

l  Simpler is beUer

l  Users are demanding this simplicity


Searching

l  Exact search doesn't make sense (unless rela/onal) l  Metadata is the rela/onal link

l  Fuzzy Searching l  Find images that look like

l  Find a scene with this actor in it

l  Find the posi/on in the audio file where the person says

l  Find the audio file with this bird song in it


Exactness

l  Does Image A = Image B? l  At what point are they different?

l  What if a byte changes?

l  What if there is a subtle color change

l  Checksums ?

l  Enforcing compliance and copyright

l  What about two images of the same scene?


Processing

l  Transform l  DNG, raw

l  Convert l  One format to another

l  Modify l  Crop, watermark

l  The data needs exercising

There is no “right” format�to store an Image in


So why Store it?

l  Manageability

l  Security

l  Backup/Recovery

l  Extensibility

l  Flexibility


Manageability

l  Focus is Metadata

l  Kept in Sync l  Metadata to External Images is painful

l  Try changing a loca/on

l  SQL / Object access

l  Well understood

l  PL/SQL access


Security

l  Row level protec/on

l  Audi/ng

l  Dynamic Security

l  Encryp/on

l  Proven


Backup/Recovery

l  Block level checking and recovery

l  Unified backup rela/onal + objects using rman

l  Simpler restore

l  Full use of rman features


Extensibility

l  Indexing

l  Object Oriented

l  Processing and Conversion


Flexibility

l  Manage metadata

l  Process en-‐masse

l  Link images together

l  Image Warehouse

l  RAC, Streams, Replica/on, Data Guard, Flashback


And the concerns?

l  Maturity

l  Performance

l  Database Size

l  Complexity


Maturity

l  Oracle is way ahead of the other vendors

l  Not all features are mature l  Oracle Mul/media

l  RAC

l  Exadata

l  Rman

l  Streams

l  Gateways


Performance

l  Loading and Retrieval l  Securefiles is very fast

l  Processing l  Java and Mul/media do not mix well

l  You need a GPU to process mul/media

l  VM's do not process mul/media well


Database Size

l  Block overhead wastage l  Larger block size needed

l  Securefiles addresses this


Complexity

l  Mul/media is hidden

l  Its not tangible like a file

l  You need an applica/on to get to it l  Solved by Oracle FileSystem (Linux Only)


Finally

l  There are more benefits to store all your data in the database

l  Protect it

l  Secure it

l  Add value to it


For more informa/on

l  marcelle@pic/on.com

l  hUp://eternal-‐donut.blogspot.com/