Upload
amro-shihadah
View
586
Download
9
Embed Size (px)
Citation preview
THE NEXT EVOLUTION IN VIDEO ANALYSIS & BIG DATA ANALYTICS
MISSIONProviding powerful & transformative video analytic capabilities:
Real-time Indexing, Matching and Exploitation of Video
A.I. Enabled Technologies with brand/logo, facial & object detection, recognition and Exploitation.
IDenTV 2017Contact: Amro Shihadah [email protected]
IDenTVConfidential&Proprietary2017
“To make video data into useful big data, we need to leap beyond this (human intervention).
We need true video analytics, powered by computer vision.”
Source: Wired
Technology OverviewIntelligentVideoPlatform(IVP):TheIVPisacommercial-ready,breakthroughtechnologythatenableshigh-speedvisualcontentrecognitionandindexing,withreal-timesearchandidentification
AutomaticNewAdsDetectionSystemdesignedtofindandcutnewunseenbeforeadsfortaggingandidentification
ArtificialIntelligence&ComputerVisionSupportforreal-timebrand/logorecognition,OCR,facialandobjectidentification
Scalable&HighAvailabilitySupportthousandsofchannelsidentifyingtensofthousandsofads/clipswithextremeaccuracy,efficiency,andscalabilityasneededTotallyover-the-top,reportingonvariablelengthclips
TheBigVideoIndex(BVI):Videoindexingandreal-timeidentificationcapableofrunningonmillionsofSmartTVs &mobiledevicesorin-appecosystems.
IDenTVConfidential&Proprietary2017
The Intelligent Video PlatformAfullsuiteofmarketprovenAutomatedContentRecognition(ACR)basedonvideoandaudiofingerprintingtechnologieswithA.I.integratedcapabilitiesincreasingthevalueofdataproducedsuchas:
• OCR,Brand/LogoRecognition,AutomaticSpeechRecognition,CCcapture/creation,aswellasFacial&Object,brand/logotracking,identification/recognition.
• Real-timeabilitytoprocessthousandsofliveTVchannels,videostreams,archivedvideo.
• Abilitytosimultaneouslyidentifythousandsofads/clipswithinmillisecondsacrossmillionsofhoursoflivestreamingorpre-recorded/archivedvideo.
• Performs40millionimagecomparisonspersecondusingonecoreofcommodityhardware(lowcost)
• Automaticextractionofrichvisualmetadataandcreationofcloud-basedindexesathyper-fastspeeds.
• Cleveruseofdeeplearningmakesautomatedin-videorecognitionsignificantlylessornothumandependentatall!
IDenTVConfidential&Proprietary2017
The Intelligent Video Platform (IVP): For the Automated Creation of Rich Metadata in-Video
5
Broadcast,SVOD,VOD,Archived,UserGeneratedVIDEO Ad-Cutter&ClipUploader/Tagging
CONTEXTUALMETADATA:OBJECTS,SCENESCLOSEDCAPTIONSANDMORE
• AutomatedIn-linefirstairingadcuttingsystem
• Usingourpowerfulscenedetectiontechnology,oursystemautomaticallydetectsindividualadvertisementswithinanadbreak/pod,andcutsthemintovideoclipsthelengthoftheadvertisement.
• NLPbasedAutomaticrichmeta-dataiscreatedthenclipsroutedtoQAandadtaggingsystemusingrichindustryacceptedtaxonomy
Automatic New Ad Detection Feature
IDenTVConfidential&Proprietary2017
- 13:01:40,3/01/2017,WED,Apple,Applie iPadPro:Tablet
- 13:02:10,3/01/2017WED,TrueCar,TrueCar :HowCarBuyingShouldBe
- 13:02:40,3/01/2017WED,Unilever,VenusEmbrace
- 13:01:40,3/01/2017,WED,Audi,AudiA4:Untouchable
- 12:50:31,3/01/2017WED,Tide,Tide:StainRemover
- 12:50:01,3/01/2017,WED,T-Mobile,T-Mobile:Un-carrier
Closed Caption Program & Ad Keyword Search for Contextual Re-TargetingFeature
8
Scene Detection, Identification/Recognition for Contextual Metadata Extraction
Feature
EmbeddedVideoPresentations
Real-TimeAutomatedCreationofRichVisualMetadataForContextualAnalyticsFromBigVideoData(Live/VOD/SVOD,UserGeneratedContent,Archival,CCTV/Aerial)ForNumerousApplicationsIncluding:
• WorkflowOptimizations:ReducesMillionsofLaborHours– Logging,SearchingandIdentifyingVideo(Broadcast,OnlineMedia,CCTV/AerialSecurity,andmore)enableshumaninterventiontobeminimal!
• AugmentServices:Vastlyimproveexistingservicesusingourtrulyunparalleled&actionableinsightsforincreasedrevenuegenerationviacontextualcuesfromthevideocontentitself.
• VerifiedPlayout– paststatisticalorpixeltracking.Capableofmonitoringmillionsoftargetedstreams&billionsofhoursofvideoinreal-timetoensurehighfidelityplayout
• BrandSafety– ensureyourplacementisnotonexplicitcontent.
• Anti-Piracy– Monitoringpeertopeerandothernetworksforcopyprotectedmaterial,canflagprotectedcontentfromsecondsofreferencevideo.
• NewServices: Tietovariousdatasetstounlocknewrevenuegeneratingproducts/servicesforclientspoweredbythemostcuttingedgevideoanalysis.
• ContextualMetadata&VideoSearchEngine– querybytextorbyvideocliptorecallexactvideofrommassiverepositoriesinstantly!Pasttitle,tagsordescriptionsearchesonwhatactualhappensinvideo!“TheGoogle&GoogleAnalyticsofVideo”
Artificial Intelligence Powered Automated Content, Object and Facial Recognition Across Real-Time or Historic Volumes of Video for Contextual Metadata Creation
IDenTVConfidential&Proprietary2017
Feature Applications
EmbeddedVideoPresentations
EmbeddedVideoPresentations
• Currentlydeployedasacontentandad-detectionplatformon292TVstations24/7ingestingandmatchingframebyframereferencedata.
• OCR. CC. ASR, Brand/logo, Facial and Object Recognition – Across real Time or Historic Volumes of Video
• Streaming Recognition matching at .4 seconds recognition and tracking of faces and logos and other objects in real-time across hundreds of thousands of hours of video.
• The big video indexing technology allows for rapid retrospective search across voice or image in milliseconds.
• Allows for the “real-estate” of video enabled devices to be monitored producing user-level data while keeping privacy intact
Artificial Intelligence & Automated Content, Object, Facial and Brand/Logo Recognition Across Real-Time or Historical Volumes of Video for Contextual Metadata Creation
IDenTVConfidential&Proprietary2017
Feature Applications
To index and identify all the footage on a mobile device as it is streaming (Social or Traditional Media, or the Device Camera)
To use image search, not audio (avoid difference in languages issue)
To index new added videos at the same rate they are produced (real time object and or facial detection of reference data)
Scalable to millions of devices
Can be in-device or in-app ecosystems
To Enable Cross-Platform TV Measurement
In-Device: Mobile & Smart TV Video Indexing and Tracking
IDenTVConfidential&Proprietary2017
Feature Application
Computer Video Vision Search and Indexing Performance CapabilitiesVideo Search Time:On a laptop, with 3000 hours of video, the query time is below 25 milliseconds.
Indexing Time:It is immediate and real time. Indexing can be done while watching a TV channel or the media source.
How does it scale:-It is designed to allow billions of hours of video and millions of clients.- If memory based: A single server will take thousands of indexed hours of video and around 15,000 simultaneous clients.- If DB driven: A single server will serve billions of indexed hours.-In summary, the scaling ability depends on external factors: mainly, network and database.- 40,000,000 image comparisons per second per core
IDenTVConfidential&Proprietary2017
The Future is Now
Big Video Index (BVI)– Computer Vision & A.I. Applied to Live TV, VOD, Social/User Generated Content & More. On Smart TVs, Set-top boxes & Mobile Devices and even In-Application Ecosystems For the Extraction Unparalleled User-Level Analytics.
The Future is Now
IDenTVConfidential&Proprietary2017
IDenTVhasalreadyprocessedmorethan1.7Millionhoursofvideoduringitsshortlifeasacompany(internalexplanation:100channelsonaveragex24hours/dayx365days/yearx2years).
EveryhourIDenTVmakesmorethan56TRILLIONimage-comparisonsjustonitsvideosearchengine
IDenTVautomaticallycapturesthousandsofnewclipsperday(thesearetheadsautomaticallycutfromtheTVstreams).Beforeanyhumanevenlooksatthem,theyareautomaticallyincorporatedtothemainsystemandtheystartprovidingfeedback.
IDenTVexpandsitsproprietaryreal-timeexecutionframework.Itnowincorporatestheabilitytorunnativeapplications(likeGPUintensiveprocessing)inanyoperatingsystem.Theseextensionsallowthesystemtoautomaticallyextractobjects,brands,logos,text,facesandotherthingsinanintegratedenvironment.
Computer Video Vision Search and Indexing Performance Capabilities
IDenTVConfidential&Proprietary2017
The Future is Now
AGENCIES & BRANDSAdvertisementtracking&Advancedanalytics
• Providingtruereal-timevideoverifiedreporting• StandardizingTV&digitaldataacrossmarketingchannels
foroptimizeddata-drivenmarketing.• Instantaneousverificationofairingsenablesoptimized
targeting&real-timeOmni-channelsynchronizedmarketing.• UnparalleledIntelligenceonyouorcompetitor’scampaigns.
• MEDIAAGENCIES,theIVPprovidesbetter,moretransparentvalue-addedservicestotheirclientsfordecisionsupportpurposes
• AugmentservicesdirectlytoBRANDSallowingthemfullTRANSPARENCY&controloftheirvideomediabuying,targeting/placements.
Actionable&BestInClassAnalyticsDatacanbeaccessedanywhereviaour web-enabledplatform,schedulereports(atanytimeinterval)orPuhReportingviaAPIorWebhook.
Real-timeSpottrackingQuicklyandeasilyseeexactspotairingtimeswithvideoverificationoranas-broadcastedclipofeachtimeanadvertisement aired.
BetterDecisiononMediaBuysSimplestandpowerfulwaytotrackyourmediabuyingwithconfidenceandTRANSPARENCY.
Product Vertical
IDenTVConfidential&Proprietary2017
Big Video Indexing and Video Fingerprinting: 24/7/365 Deployed Across National Buys for Cross-Channel Synchronization of Marketing Activities
• PROBLEM:BSThadclientssaturatingdigitalspendbuthesitanttobuyonTVduetolackofdata,unknownair-timesandinherent,lackoftransparency
• SOLUTION:Introducedhypertargetedcreativetestingandsynchronizedcross-channelmarketingremediedvia ONLY transparentreal-timevideoverifiedreal-timereportingforTV.
• RealTimeframebyframedetection24/7/365across200Channelsand asetof25creativestargetedtodifferentdemographics
• RESULTS:Real-timedataenabledinstantanalysis&re-targetingonothermarketingchannelsleadingtomaximizedROI– Aliftof20%indownloadsand16%inusageoverthe baseline weekoverweek!
Use-Case: Solution for Marketers
Business Intelligence: Real-time & Historic Insights via Custom Dashboards & Reporting
TRANSPARENY withasbroadcastedclipsoftheadastheyplayedout.
COMPETITORTRACKINGtrackyourcompetitorsairings,spendandstayaheadwithreal-timereporting!
DECISIONSUPPORT:Accessibleanywheremonitoringdetectedads,competitors,campaigns,industries&morealldisplayedinourweb-enabledcustomizableB.I.dashboards,includingallthepertinentmetadataandinsightsfordata-drivenandadvancedadvertising!
CUSTOMIZABLEREPORTS:VisualizationsofdataforfasterandmoreeasilyingestibleandactionableanalyticscreatedtodisplayclientspecificKPIsandanynumberofcriteria,suchasadsacrossaspecificnetwork,asingleadsperformanceacrossallnetworks,industryviews,competitortracking,andmuchmore.
Feature: Customized & Actionable Real-Time Reporting
IDenTVConfidential&Proprietary2017
TV Stations and NetworksMarketingAutomation,Ad Logging&Sales Intelligence
01
Easytouseplatformproducesreportsinnumerousformats&alladsarevideoverifiedforincreased transparency
03
REAL-TIME LANGUAGEAGNOSTIC EASYTOUSE OVERTHETOP
VIDEOFEED TheIVPingests streamsofachannel(s)toprovidereal-timeAd-LoggingServices
Ads can be cut from the stream or processed directly from networks’ current and growing advertisement database
Seamless integration with existing Trafficking & Billing & Broadcast Management Solutions, Drag and Drop FTP for dynamic scheduling and playout
Cost & Time Savings: Automation reduces manual intervention while remaining cost effective
New Revenue Generation: Web-based DVR recordings (14 days – 1 year) for multiplatform delivery of TV ads allowing for improved cross-platform measurement & compliance capabilities
Product Vertical: Advanced Analytics & Video Technology Services
IDenTVConfidential&Proprietary2017
UsingIVP,ourproprietaryVideoFingerprintingtechnology– AdsorVideoClipsaredetectedinReal-Time
NOWATERMARKING,SPECIALIZEDENCODING,RELIANCEONDELAYEDUNVERIFIEDMANUALINTENSIVEREPORTS
LANGUAGEAGNOSTIC:Theblendofourvideoanalysissolutionsallowourservicestobedeployedinanylanguagearoundtheworld!
AUTOMATION IDenTV’sAutomatedAdLogging& AdvancedAnalytics solutionenablestelevisionnetworkstoeliminatethetedious,expensive,andantiquatedanalogprocessofloggingadsmanuallyorviaunverifiedplayoutreports.
OPTIMIZESALESusingreal-timedata-drivenintelligencetoretaincustomersthickeningrevenuestreamsandgainnewcustomersbyofferingdata-drivencompetitiveintelligencetomaketheirbuysatapremium.
CONTEXTUALTARGETINGTie1st partydatasuchasviewershiporsimplybasedonthecontextextractedinreal-timefromstreams A.I.backedservicesincludingOBJECT,FACIAL,BRAND/LOGOrecognitionoffersmoreeffectivetargetingandad-placementsfornewrev.generatingservices.
DynamicAd-Insertions&Multi-PlatformDelivery:IPconversionallowsfordistributioninstantlyacrossmediums,additionallyA.I.servicesenableenhancedcontextualre-targetingtoensureclientsachieveKPIsandreachhighintenthighvalueend-users.
DecisionSupport:FullyintegratedREAL-TIMEVIDEOVERIFIEDreportingofaNetworkorGroupsentiread-libraryenableshigheractionabilityandcertaintyindata-drivenmarketingservices.
TV Stations and NetworksMarketingAutomation,Ad Logging&Sales Intelligence
IDenTVConfidential&Proprietary2017
ActionableAdvancedAnalyticsThickenGenerateNewRevenueStreams&Services
Product Vertical: Advanced Analytics & Video Technology Services
The Future is Now
TechnologiesprovidetheTRANSPARENCY&ACTIONABILITYneededtocreateaclosedloopmeasurableyetdynamiccross-platformvideomarketingecosystem-ContentDistributorsandOwners(Sellers)canprovidemorevaluabletargeting,dynamicad-insertionsonopeninventoryachievinganepremiumforeachsaleandAgencies/Brands/Marketers(Buyers)nowcanadjustontheflybasedonreal-timevideoverifieddatarealizingincreasedROIviaAUTOMATION&SYNCHRONIZATIONofDYNAMICHYPER-TARGETEDcross-platformvideoadvertising.
Synchronizecross-platformTVviaIPconversiontocross-channelmarketingmediumsandsocialmediausingdatafromthelargestspending&reachingchannelofmarketing- TV.WhetheryouarerunningaTVcampaignornot,synchronizeanytypeofmarketingbuyagainstcompetitorcampaign’sinreal-timewithactionablecompetitorintelligenceanddata-drivendecisionsupporttotargetthesameaudiences&deliverontheflypromotionsfornewrevenuegeneration!
Bridging TV & Digital Video Analytics for Real-Time Dynamic Data-Driven Contextual Targeted Insertions & Facilitating Programmatic Marketplaces in TV!
Synchronize&MeasureCross-PlatformVideoMarketing
Data-Driven not Driven by Data
National security
State of play
Real time video matching for special operations community. Initial pilot in 2 countries has expanded to Middle East, Africa and North Africa
IDenTV successfully deployed its machine learning and object recognition technology into a real time aerial C4ISR sensor – creating VID-INT or video intelligence that alerts analysts of threats or irregular activities in real-tme.
Product Vertical
IDenTVConfidential&Proprietary2017
Big Video Indexing and Video Fingerprinting: 24/7/365 Deployed Across USG Special Program w/ Analytics of Matches
RealTimeframebyframedetection24/7/365acrossagrowingcorpusof480,000hoursofrawvideofromaustereenvironments• Preforming40Millionimage
comparisonspersecondononeservercore
• DeploymentofScalablePlatformbasedreal-timespawningvirtualmachinesnodesasneeded.
• HIGHLYACTIONABLEDASHBOARDFORDATA-DRIVENREPORTINGOFVID-INT(videointelligence)
IDenTVConfidential&Proprietary2017
Use-Case : National Security
§ RealtimeObjectDetection§ Detectedobjectsidentifiedwithinthevideo§ ObjectsidentifiedagainstObjectLibrary§ Track1000’softrackupdatespersecond
§ Track identified objects of interest§ Create reports, real-time & forensic§ Continuous training of Object Library
National Security: IDenTV Object Detection Integrated SolutionAerial Video
23
Use-Case : National Security
UAVProgram§ Candetectandidentifyvehicleswith50x50pixels§ Cancontinuouslytrainobjectlibrary(car,truck,tank,boat,
plane)
Integrated Solution: Object Detection and Identification from Fixed Wing Aerial Surveillance Based on Reference Sample
AWSEnabledandFederated
Videodetectionsannotatedonlivemap
Tracksassignedauniqueidentifiers
IDenTVConfidential&Proprietary2017
Use-Case : National Security
Mohammad Shihadah Chairman and CEOOver 35 years experience in private and public company management for technology companies. Co-founder of AppTek, acquired by eBay.
Bob MilaniCTOOver 20 years experience in software development and design including enterprise entertainment/TV, mobile, VOIP.
Marco BaenaChief Scientist22 years experience in the field of software invention, development including software security systems, distributed computing, machine learning and enterprise web development.
Dr. Mark HughesComputer Vision Lead10 years experience in image and video search technologies.IBM Research Engineer at IBM’s Watson Health System.
Harish SeshadriChief Architect21 years experience in software invention, development and consulting including development of software security systems, distributed computing, machine learning.
Amro Shihadah Co-founder and COOExperience in M&A and Financial Accounting , serial entrepreneur with first start-up at age 16 and working on various tasks at an operational & leadership capacity.
Oliver Myers, EsqVP of Business DevelopmentExecutive Director of The US Chamber of Commerce in Turkey, Former Counsel to the Board of Large Turkish-Investment Group involved in Real Estate, Aerospace, Defense and Entertainment.
Mudar Yaghl Board MemberDecades of natural language processing (NLP) and human language technology (HLT) experience. Co-founded several technology companies, including AppTek, acquired by eBay
Hassan SawafAdvisorFormer Head of Artificial Intelligence, Scientific Advisor - eBay LabsCurrently Artificial Intelligence Director at Amazon
Stephanie Bellistri AdvisorInternational Affairs, Counterintelligence and Security expert. Former senior advisor to Palantir Technologies and former Senior Operations Officer at the CIA.
LeadershipandAdvisoryTeam
25
IDenTVConfidential&Proprietary2017