Dubai Open and Shared Data Frameworkdubaidata.ae/pdf/Dubai-Open-Shared-Data-Framework-20170427.pdf · Source: neXgen analysis Confidential Dubai Data Law Contents 9 Specific Obligations

Dubai Open and Shared Data Framework25 February 2016

2

AGENDA

1. DUBAI DATA MANAGEMENT FRAMEWORK & REQUIREMENTS

2. DUBAI OPEN & SHARED FRAMEWORK1. Data Management Organization2. Data Inventory3. Data Classification4. Final Preparation

3. APPENDIX1. Job Descriptions2. RACI Data Management

3

DUBAI DATA MANAGEMENT FRAMEWORK & REQUIREMENTS

Source: neXgen analysis Confidential 4

Source: neXgen analysis Confidential

Dubai Data Law Signed Oct. 16, 2015

5


Dubai Data Law Contents

9SpecificObligationsofDubaiGovernmentDepartments:

1. Classify/categorizetheentity’sdata

2. Developaplanforsharingofdata

3. Modifytheentity’sinfrastructuretopublishandsharedata

4. Takeallnecessaryactionstopublishandsharedata

5. IdentifyobstaclesforreviewbyConcernedBody

6. Ensurequalityandupdatingofentity’sdata

7. HandledatafromotherprovidersincompliancewithConcernedBody

8. ReportondatapublicationandsharingasrequestedbyConcernedBody

9. AdheretopoliciesandrequirementsadoptedbytheConcernedBody

6



ProtectsConfidentiality,PrivacyandIntellectualProperty:

• “Dataprovidersmust,inthecourseofthedatapublicationandsharingprocess,takeallnecessaryactionstosafeguardtheconfidentialityandprivacyofusers’datathatarelegallyprotected.”

• “Complywiththedataprivacyrulesandsafeguardintellectualpropertyrights.”

7



ProvidesguidelinesinDubaiDataManual(incl.Classification&Standards)

Dubaidatashallbeclassifiedas:1) Opendata(availabletopublic)2) Shareddata(withrestrictions)

DubaidataclassificationiscarriedoutinlinewiththeDubaiDataManual andDataClassificationFrameworkthatisadoptedbytheConcernedBodyinconsultationwithDESC.

8


Dubai Data Management FrameworkOverall Department Requirements

DataManagementFramework

Implement

DefineIdentify

Assess

BusinessProfileDataManagementBusinessProcessDataManagementOrganizationDataArchitectureDataQuality

DataInventory&RegistryAlignmentDataClassificationDataQualityRemediationDataSyndication/IngestionMethodology

DataLifecycleStandardsDataManagementOrganizationDataQualityMonitoringDataStrategyRoadmap

DataManagementOrganizationDataLifecycleStandardsDataExchangeSpecificationsDataModellingStandardsDataQuality&LifecycleStandards

9

10

DUBAI OPEN & SHARED DATA FRAMEWORK


Dubai Open and Shared Data FrameworkDepartment activities needed to release data to the Dubai Smart City Platform and in compliance with Dubai Data Law

DefineDataManagementOrganization

IdentifyDataInventory/AssetsandAlignwithPrimaryRegistry

ClassifyDataSets

PrepareFinalSubmission

1

2

3

4

DataManagementFrameworkImplement

DefineIdentify

Assess


SmartDubaiOfficeResponsibilities

Week4 Week25

Overview TimelineGovernmentDepartmentResponsibilities

Week37Week0

Week16 Week32 Week45

Week52

12

13



ClassifyDataSets


1

2

3

4


1.1SetupDataManagementOrganization

1.1.1IdentifyKeyPersonnel1.1.2EstablishOrganizationStructure1.1.3DefineRoles&Responsibilities1.1.4IdentifySkills&Competencies

14

1.0 Define a Data Management Organization


1.1.1 Identify Key Personnel

NewDGHRPositions

• ChiefDataOfficer• DataManagementAdministrator• DataExpert

CurrentStaff(VirtualRoles)

• DataSteward(s)• DataSpecialist(s)


RolesforexistingDepartmentStaff

NewPositionsasperDGHR

ChiefDataOfficer

DataExpert

DataManagementAdministrator

DataSteward DataSpecialist

16

1.1.2 Establish Organization Structure

DataSteward(s)DataSteward(s)DataSteward(s)–BusinessUnits

DataSteward(s)DataSteward(s)DataSpecialist(s)– IT,DBA,etc


1.1.3 Define Roles & ResponsibilitiesNew Positions in DGHR to be hired by the Department

CORERESPONSIBILITIES

Role&Brief Leadership Governance Compliance

ChiefData Officerv Senior‘champion’forimplementationof

DubaiDataregulations.Rolemustbefulfilledbyasenioremployee,tohavethenecessaryinfluenceandpowerwithinthedepartmenttobeeffectiveintherole.

v MainpointofcontactbetweenthedepartmentandSDO.

• Overseeing thedevelopmentofthedepartment’sImplementationPlanforDubaiData.

• Ensuringthatthebenefitsofopenandshareddataaremaximised,throughhighlevelsofadoptionandutilisationofthedatatoimproveservicesanddecision-making

• Puttinginplacethenecessaryroles(withtheappropriateskills)withintheirDepartment,asoutlinedintheDubaiDataManual

• ProvidingregularreportsandcomplianceinformationasrequestedbytheDepartmentorSDO

• IdentifyingandenablingthedeliveryofdatasetstotheDubaiDataPlatformforbothOpenandSharedDatapublication,andappropriatelyapplyingtheDataClassificationFrameworktotheirData

DataManagementAdministratorv Responsiblefordataqualityanddata

processesforadatasetormultipledatasets.SupportCDOtoimplementtheDubaiDataPolicy. SupportcomplianceandauditofdataforDubaiDataLawandotherregulatoryrequirements

• ProvidingsupportandadvicetotheDataStewardswithintheirDepartmentwhenclassifyingdatawithinthescopeoftheirmanagementandassessmentofrisksassociatedwithdisclosureorexchange

• SupportingtheChiefDataOfficertoensurethatthebenefitsofopenandshareddataaremaximised.

• DeterminingprioritieswithrespecttoOpenDatapublicationorSharedDataexchange

• Co-ordinatingtheworkoftheDepartmentasitpreparesitsopenandshareddataforpublicationandexchangethoughtheDubaiDataPortal.

• Preparingregular reportsandcomplianceinformationasrequestedtotheOpenDataCommittee

• AdministeringtheprocessofinventoryingandclassifyingtheDepartment'sData.

• CascadingknowledgeaboutclassificationprinciplesandprocedurestorequiredroleswithintheirDepartment.

DataExpertv Responsiblefor advisingandsupporting

theleadershiproleoftheCDOasachampionfordataregulationsimplementation.

• Guideoversight ofthedevelopmentoftheDepartment’sImplementationPlanforDubaiData.

• Advise theCDOonhowtoensurethatthebenefitsofopenandshareddataaremaximised,throughhighlevelsofadoptionandutilisationofthedatatoimproveservicesanddecision-making

• Support CDOinidentifyingtherightskillsandestablishingthenecessaryroleswithintheirDepartment,asoutlinedintheDubaiDataManual

• CraftreportsandcomplianceinformationasrequestedbytheDepartmentorSDO

• Support CDOinIdentifyingandenablingthedeliveryofdatasetstotheDubaiDataPlatformforbothOpenandSharedDatapublication,andappropriatelyapplyingtheDataClassificationFramework totheirData

JobDescriptionsinAppendix 17


1.1.3 Define Roles & ResponsibilitiesExisting Department Staff

CORERESPONSIBILITIES

Role&Brief Leadership Governance Compliance

DataStewardv RolewithinBusinessUnit(data

generator)v Primary“custodianship”ofthedata

withinthedepartment:thatis,theyhaveabusinessresponsibility(notatechnicaloralegalone)forensuringthatthedataisusedeffectivelytomeetboththebusinessneedsofthedepartmentandthewidergoalsoftheDubaiData.

v Doesnotneedtobethecreatorortheprimaryuseroftheasset,buttheymustunderstanditsvaluetotheorganisation.

• ThemanagementoftheassigneddataandtheassociatedDataExperts;

• Recommendingchangestodatamanagementpolicyandprocedures,dataqualityandtheimplementationofDataManagementStandardsandprocedures.

• Understanding andpromotion ofthevalueofdataforDubai-widepurposesandfacilitation ofdatasharingandintegration.

• Ensuringthequality,completenessandupdateofDataunderhis/hersupervision

• Workingincollaboration withtheDataManagementAdministratortodeterminepriorities andassociatedrisksofmakingdataaccessiblebythird parties

• Engagingwiththeexternaldevelopercommunitytodetermine howenhancementstothedatasetcouldfacilitategreaterlevelsofre-use.

§ Thecollectionandupdatingoftheassigneddata;

§ ManagementofanythirdpartyuseofthedatainaccordancewithDubaipoliciesandprocesses;.

§ AdvisingandReportingondatamanagement issues.

§ SuggestingthetermsandconditionsuponwhichtheSharedDatashouldbemadeavailable.

DataSpecialistv RolewithinIT,DBA,etc.v TechnicalResourcethatisafacilitator

betweenITandbusiness teams.v Providessupporttothebusinessfor

cross-businessdefinitionofdatastandards,rules,andhierarchy

v EnsuresthealignmentoftheBusinessDatarequirementswiththeISsystems

v Providessupporttoprojectsandinitiativesindevelopmentandrefinementofdataprocessesinaccordancewithdefinedstandards

• AssistswiththeresolutionofDataintegrationissuesasrequestedbytheDataSteward

• AssiststheDataStewardinthedefinitionofData requirementsandDatarules

• SupportsprojectsandinitiativesindevelopmentandrefinementofdataprocessesandmetricsinaccordanceasrequestedbyDataSteward

• Supportsdefinition,approvalandexecutionoftheDataQualityProgram

• UnderstandstheInformationTechnologyLandscapeand hastheabilitytoidentifywhatdataisstoredinwhatsystems.

• Supportseffortstoprovidedataawarenesseducationforsenioranduppermanagement

• WorkswiththeDataSteward intheidentificationofrootcausesofmajordataproblemsandthesupportingtheimplementationofsustainablesolutions

• Resolvesroutinedataproblems

§ AssiststheBusinessDataStewardwithdataproblemresolutionwhenrequested

§ Reviewsdatadeletionandarchivingrequestsfordataintheirspanofresponsibilityandforwardstoapproverwithappropriaterecommendations

§ EnsuresusersintheirDepartmentarekeptinformedofchangesindatastandardsandprocesseswhichimpacttheusers

§ Complieswithdatasecurityrequirementsandeducates/assistsothersintheirorganizationondatasecurity

JobDescriptionsinAppendix18


ChiefDataOfficer

• Abilitytocollaborateandnetworkwithsubjectmatterexperts,organizations,andindividualstoprovideeffectiveenterprisedatamanagement

• MaintainscompetencywithmultiplebusinessProcessScenarios

• Provenabilitytoleadcross-functionalteamsatallorganizationallevelsindealingwithcomplexissues


•AbilitytocollaboratewithseniormanagementofBusinessUnits,functionalorganizationsandindividualstoprovideeffectiveenterprisedatamanagement•AbilitytoprovidedataobjectdomaininsightanddirectiontoDataStewardsandDataExperts•Displaysunderstandingofallbusinessprocessesdependentondataintheirobjectdomain•Provenabilitytocreatepresentationsandeffectivelypresenttomanagement

DataExpert

• Proveninternationalcompetencyandexperiencewithbestpracticeopenandshareddataprinciples.

• Establishedconsultantwithstrongmanagement,dataandadvisorycapabilities.

• Provenleadershipabilityincrossculturalcontextsandteamsatallorganizationallevelsindealingwithcomplexissues

19

1.1.4 Identify Skills & Competencies


DataSteward

•CollaborationskillswithinthebusinessandDataManagementAdministratortohelpprovideeffectivesolutionstodataissuesandproblems

•Displaysmasteryoftheportionsofbusinessprocessesexecutedbytheirbusinessarea

•ProficiencywithMSOffice,basicandsomemoreadvanceddataanalysisandprocesscontrolmethods/techniques

•Understandsthefundamentalsofdatabasesanddatastructures(tables,hierarchicalstructures,flatfiles,etc.)

•Demonstratesunderstandingofallthefunctionsperformedbytheirbusinessarea

•Displaysfamiliaritywithsystemsusedwithin/bytheirbusinessarea

DataSpecialist(s)

•Displaysmasteryoffundamentalsofproblemsolvingandbasicdataqualityanalysis

•Displaysunderstandingoftheportionsofbusinessprocessesexecutedbytheirbusinessarea

•StrongunderstandingoftheSystemsDevelopmentLifeCycleandmethodologies,andfamiliaritywithprocessimprovementframeworks.

•ProficiencywithMSOffice,basicdataanalysisandprocesscontrolmethods/techniques

•Provenabilitytoworkwellandcontributetocross-functionalteams

•Provenabilitytopresenttopeersandsupervisors•Displaysfamiliaritywithsystemsusedwithin/bytheirorganization

•Displaysfamiliaritywithfunctionsperformedbytheirbusinessarea

20

1.1.4 Identify Skills & Competencies


1.0 Complete


IdentifyDataInventory/AssetsandalignwithPrimaryRegistry

ClassifyDataSets


OrganizationSetupcomplete

IdentifyKeyPersonnelEstablishOrganizationStructureDefineRoles&ResponsibilitiesIdentifySkills&Competencies

ü

22


IdentifyDataInventoryandAlignwithPrimaryRegistry

ClassifyDataSets


1

2

3

4


2.1PrepareDraftDataInventory

2.1.1Identifyalldatasets2.2UpdateInventoryDatasets

2.2.1UpdatedatasetwithMetadatainformation2.2.2CategorizedatasetperIPSV2.2.3UpdatedatasetwithDataPublishing/Sharingdetails

2.3DeliverInventoryforReview

2.3.1ReviewDatasetforcompleteness2.3.2IdentifypossiblePrimaryRegistries

2.4AlignwithPrimaryRegistry

2.4.1PrioritizeDataset(s)

23

2.0 Identify Data Inventory & Align with Primary Registry


2.0 Overview of Inventory Process Alignment between Department and Smart Dubai Office

Department

SmartDubaiOffice

• Identifyalldatasets

Prepare DraftData

Inventory

• ReviewDatasetsforcompleteness

• IdentifypossiblePrimaryRegistries

Deliver InventoryforReview

• UpdatewithMetadataInformation

• CategorizedatasetperIPSV

• UpdatedatasetwithDataPublishing/Sharingdetails

Update InventoryDatasets

• PrioritizeDatasets

AlignwithPrimary Registry

2.12.2

2.3

2.4

2.1 – Prepare Draft Data Inventory

WhattoincludeasaDatasets:•MasterData: Basicbusinessdatausedacrossall systems,applications,andprocessesfortheentiredepartment

• Conditional(orChildofMaster)Data:MasterDatathatisbasedoncertaincategoriesorspecialization.

• TransactionalData:DatathatiscreatedaspartoftheDepartmentcarryingoutthebusiness.Thiscanbefinancial,logisticalorwork-related.

• AggregateData:Datacombinedfromseveraltransactionsreportingpurposes.

WhatnottoincludeasaDataset• Referencedata:Referencedataisaspecialsubsetofmasterdatathat’susedforclassificationthroughoutyourentiredepartment:e.g.costcenters,financialhierarchiesetc.Thedatacouldbeexternallymandatedorinternallyauthored.

• ReportingData:Dashboardorbalancedscorecarddatathatisusedforanalysis.

2.1.1 – Identify all Datasets

25


2.1.1 Department Responsibilities & Steps to Prepare Draft Inventory

26

Department,DirectorGeneral

Department,Chief

DataOfficer


DataSteward

Approval ofData

Inventory

Request DepartmentDataset Inventory

Transmit DepartmentDataset Inventory

StartDataInventoryProcess

ReviewDataInventorySubmission

FinalizeDraftDataInventory

Step1Step2

Step3

Step4

Step5

Step6


2.2 – Update Inventory Datasets

Dataset Contributor Type(DCMIType) Coverage Creator Date Description Format(MIME) Identifier Language Publisher Relation Rights Title Source SubjectLevel1 SubjectLevel2 SubjectLevel3 AlreadyPublished? IfPublished,where? AlreadyShared? IfShared,withwhichEntities?CategorizationDetailsMetadataInformation Publishing/SharingDetails



Identifies:• Namesthedataset• Describesthedataset• Responsibilityfordataset• Location• FormatInformationcapturedpertheDublinCoreMetadataInitiative

Identifies:• SubjectAreaofDatasetInformationcapturedpertheIPSV

Identifies:• IfDataisalreadypublishedorshared• Ifshared,wherethedataispublishedand/or

withwhomitisshared.

2.2.1

2.2.2

2.2.3

27

2.2.1 Update Dataset with Metadata Information

28

Step1- IdentifyBasic

Information

• Type• Identifier• Title• Description• Subject• Coverage• Frequency

Step2-DescribeAccountability

• Contributor• Creator• Publisher• Steward

Step3– IdentifyTechnical

Information

• Source• Format• Language

Informationthatidentifiesanddescribesthedataset

Informationthatexplainsresponsibilityforthedataset

Informationthatidentifieslocationandformatofdata


IPSVisanencodingschemeforpopulatingthesubjectelementofmetadata.ItisfullycompliantwithISO2788andBS8723

29

2.2.2 Categorize Dataset per IPSV

DeterminethedatasetcategorizationaccordingtotheIntegratedPublicServicesVocabulary(IPSV)

Categorizationrequiresidentifying:SubjectLevel1

SubjectLevel2SubjectLevel3


2.2.3 Update Dataset with Data Publishing/Sharing Details

Recordontheinventoryspreadsheetif:• thedatapublishedbythedepartmentandisaccessibletocitizens/residentselectronically?

• thedataavailableforPrivatebusinessentities?• thedatasharedwithotherentities?


2.3 Deliver Inventory for ReviewStep

1 ReviewDatasetforcompletenessofinformation

Step

2 IdentifypossiblePrimaryRegistries

Steps to be taken by Smart Dubai Office:


Step 2.4 – Align with Primary Registry

RecordontheDataInventoryif:• Thedatasetisaprimaryreferencetomultiplegovernmentservices

• Thedatasethassignificantimpactonentitiesbusiness

IfYES• ThedatasetispartofthePrimaryRegistry

Steps to be taken by Department:


2.0 Complete

33


IdentifyDataInventoryandalignwithPrimaryRegistry

ClassifyDatasets


PrepareDraftDataInventoryComplete

IdentifyalldatasetsUpdateDatasetComplete

UpdatedatasetwithMetadatainformationCategorizedataperIPSVUpdatedatasetwithDataPublishing/Sharingdetails

DeliverInventoryforReviewComplete

ReviewDatasetforcompletenessIdentifypossiblePrimaryRegistries

AlignwithPrimaryRegistryComplete

PrioritizeDataset(s)

ü ü

34


IdentifyDataInventory/AssetsandalignwithPrimaryRegistry

ClassifyDatasets


1

2

3

4


3.1DatasetIdentification

3.1.1Identifyprioritydatasetsforclassification

3.2DatasetClassification

3.2.1Classifytheattributes3.2.2.Splitdatasetbasedonattributeclassification3.2.3IdentifyattributescausingaSecret,Sensitive,orConfidentialscoringinordertoarriveatopenclassification

3.3.ClassificationReview&Approval

3.3.1ReviewclassificationbySmartDubaiOffice3.3.2ReviewandagreeonfinalclassificationbySmartDubaiandDepartment

35

3.0 Classify Datasets


3.1 – Dataset Identification

IdentifiedDatasets

PriorityDataset

RegularDataset

• DoanyofthefollowingapplytotheDataset• PartofPrimaryRegistry• StrategicalignmentwithSmart

Dubaipriorities(inparticularSmartEconomyandSmartLiving)

• Userdemandforthedata• Governmentefficiencybenefits• Serviceimprovementbenefits• Economicgrowthbenefits• Transparency/accountability

benefits

Yes

No

3.1.1 Identify priority datasets for classification:

36


OpenData

SharedData

Confidential

Sensitive

Secret

37

3.2 – Dataset ClassificationTypes of Classification

Shareableinalimitedwaybetweencertainindividualsunderstrictcontrols

Shareablewithincertaingroupssubjecttostrictcontrols

Shareableacrossentitiesaccordingtoprofessionalresponsibilities

Ownedbyentities ismadeavailableforsharingandre-usebyotherentities

OpenlyDisclosedtoeveryone


3.2 Classification WorkflowUnderstanding the decision making process

InputDepartmentDataset

SharedDataProfileriskto

determinedamagelevelinorderto

classify

ConfidentialData

SecretData

SensitiveData

DisclosureaffectsNationalSecurity

Significant

Yes

NoDisclosureviolatesexistinglaw

Yes

No

OpenData

Doesdatadisclosurenegatively

impacton..

Theabilityoftheagencytoconductitstasks

Individuals’privacies

Competitivenessandcontinuityof

companies/institutionsThecourseofjusticeand

securityprocesses

Publichealthandsafety

NoimpactImpactfound3.2.2

Classifytheattributes

3.2.1

Splitdatasetbasedonattributeclassification

ReviewDatasetTodetermineattributestobe

removedtoarriveatopenclassification

3.2.3

38


Use the classification assistant to help determine the dataset classification through a series of questions

39

3.2 Classification AssistantSmart Dubai provided tool to aid data classification


3.2.3 – Process for Disagreement with Classification from the Assistant Tool

IfclassificationisdifferentfromtheClassificationAssistantsuggestion

DeterminetheclassificationbasedontheDepartment’sunderstanding

Thenprovideexplanationtosupporttherevised

classification


3.3 Classification Review & Approval Process

SmartDubaiOfficeReview

Agreewiththe

Classificationfromthe

department

JointReviewbetweenSmartDubaiandDepartment

DatasetClassificationApproved

Yes

No

SmartDubaiOfficereviewsclassification

3.3.1

SmartDubaiandDepartmentreviewandagreeonfinalclassification

3.3.2


3.0 Complete

42



ClassifyDatasets


DatasetIdentificationcomplete

IdentifyPrioritydatasetforclassificationDatasetClassification complete

Classify theattributesSplitdatasetbasedonattributeclassificationIdentifyattributescausingaSecret,Sensitive,orConfidential scoring inordertoarriveatopenclassification

DatasetReview&Approval complete

ReviewclassificationbySmartDubaiOfficeReviewandagreeon finalclassificationbySmartDubaiandDepartment

ü ü ü

43



ClassifyDatasets


1

2

3

4


4.1DetermineDataIngestionMethodology

4.1.1PreferredSyndication/IngestionMethod4.1.2AlternativeSyndication/IngestionMethod

44

4.0 Prepare Final Submission


4.0 Determine Data Ingestion Methodology

IstheDatasetavailableforaccessontheGovernmentInformationNetwork?

ProvideAccessDetailsandconnectivityinformation

Yes

Identifythemosttimeefficient,technicallyappropriateandcosteffectiveingestionmethodaccordingtothedepartment’senvironment(noteSmartDubaipreferences)

No


Entities should publish their data in structured, machine-readable, open formats.

– APIs: Publish data via APIs as the first choice – particularly when publishing data that is regularly updated, of potentially broad application for re-use, and where Data Users may wish to process the data programmatically.

– CSV: When not publishing via APIs, use CSV or a similar non-proprietary ‘structured data’ format (consider TSV, JSON and XML)

– Excel: Consider also publishing data in proprietary structured formats that are widely adopted by Data Users (such as Microsoft Excel)

– Do not publish structured data in unstructured formats such as PDF.

46

4.1.1 Preferred Data Syndication/Ingestion Method

NoteonAPIs:• TheSmartCityPlatformwillsupportagenericAPIthatwillpermitaccesstoall

publisheddatasetsinasimilarmanner.DetailsareexpectedtobecomeavailableduringQuarter32016.

• Asaminimum,EntitiesmustensurethatPrimaryRegistriesforwhichtheyarePrimaryRegistryControllerareaccessibleviaAPIs.


Alternative ingestion options available for Departments to share information with the Smart City Platform

47

4.1.2 Alternative Data Syndication/Ingestion Methods

Ingestion Method Description

FlatFiles • DatasharedintextorcsvfilesviahttporhttpsorFTPorpushed intotheSCPfilelandingzone.

RDBMS • ProvideDirectSQLaccessorexportdatatoHadoopDistributedFilesSystemnativefileformatsoraccesstoadatabase

DataWarehouse • ProvideaggregateddataviaSQLexportsorreportexports

HadoopDistributedFileSystem • If HDFSalreadyexistswithinthedepartmentthenutilizeOpenSourceorProprietaryToolsorNodeSynchronizationto transmitdata.

SemiorUnstructured • Datathatisnotin astructuredformwhichis intheformoflogfilesorsocialmediacaptures

DataVirtualization • Provideaccess byallowingpermanentvirtualaccessvisibility tothedatafromtheSmartCityPlatform

ApplicationProgrammingInterfaces

• WebAPIsarethedefinedinterfaceswhichareasetof HypertextTransferProtocol (HTTP)requestmessages,alongwithadefinitionofthestructureofresponsemessages,whichisusuallyinanExtensibleMarkupLanguage(XML)orJavaScriptObjectNotation(JSON)format.

GovernmentServiceBus • AlreadyshareddataorfunctionalityviatheGovernmentServiceBus

PleasenotethataDubaiDataPolicywillpublishedoncefinalizedwhichwilldetailoutthepreferredmethodofIngestion


4.0 Complete

48



ClassifyDatasets


üüüü

49

APPENDIX


Job Description - Chief Data Officer

Leadership:

•Overseeingthedevelopmentofthedepartment’sImplementationPlanforDubaiData.

•Ensuringthatthebenefitsofopenandshareddataaremaximised,throughhighlevelsofadoptionandutilisationofthedatatoimproveservicesanddecision-making.

Governance:

•Puttinginplacethenecessaryroles(withtheappropriateskills)withintheirDepartment,asoutlinedintheDubaiDataManual

•ProvidingregularreportsandcomplianceinformationasrequestedtotheOpenDataCommittee

Compliance:

•IdentifyingandenablingthedeliveryofdatasetstotheDubaiDataPlatformforbothOpenandSharedDatapublication,andappropriatelyapplyingtheDataClassificationFrameworktotheirData

• The Chief Data Officer is the senior ‘champion’ for the implementation of the Dubai Data regulations. This role must be fulfilled by a senior employee, either at board level within the Department or reporting directly to a board member, so that the individual has the necessary influence and power within their Department to be effective in the role.

• The Chief Data Officer is the main point of contact between the Department and the Concerned Body, responsible for communications, coordination and escalation to the Concerned Body.


Job Description - Data Management Administrator

Leadership:

• ProvidingsupportandadvicetotheDataStewardswithintheirDepartmentwhenclassifyingdatawithinthescopeoftheirmanagementandassessmentofrisksassociatedwithdisclosureorexchange

• SupportingtheChiefDataOfficertoensurethatthebenefitsofopenandshareddataaremaximised.

Governance:

• DeterminingprioritieswithrespecttoOpenDatapublicationorSharedDataexchange

• Co-ordinatingtheworkoftheDepartmentasitpreparesitsopenandshareddataforpublicationandexchangethoughtheDubaiDataPortal.

Compliance:

• PreparingregularreportsandcomplianceinformationasrequestedtotheOpenDataCommittee

• AdministeringtheprocessofinventoryingandclassifyingtheDepartment'sData.

• CascadingknowledgeaboutclassificationprinciplesandprocedurestorequiredroleswithintheirDepartment.

• The Data Management Administrator is responsible for data quality and data processes for a dataset or multiple datasets. The Data Management Administrator provides support to the Chief Data Officer to implement the Dubai Data Policy, and support compliance and audit of data for Dubai Data Law and other regulatory requirements within their datasets.


Job Description - Data Steward

Leadership:

•ThemanagementoftheassigneddataandtheassociatedDataExperts;

•Recommendingchangestodatamanagementpolicyandprocedures,dataqualityandtheimplementationofDataManagementStandardsandprocedures.

•UnderstandingandpromotionofthevalueofdataforDubai-widepurposesandfacilitationofdatasharingandintegration.

Governance:

•Ensuringthequality,completenessandupdateofDataunderhis/hersupervision

•WorkingincollaborationwiththeDataManagementAdministratortodetermineprioritiesandassociatedrisksofmakingdataaccessiblebythirdparties

•Engagingwiththeexternaldevelopercommunitytodeterminehowenhancementstothedatasetcouldfacilitategreaterlevelsofre-use.

Compliance:

•Thecollectionandupdatingoftheassigneddata;

•ManagementofanythirdpartyuseofthedatainaccordancewithDubaipoliciesandprocesses;.

•AdvisingandReportingondatamanagementissues.

•SuggestingthetermsandconditionsuponwhichtheSharedDatashouldbemadeavailable.

• The Data Steward is the person who has “custodianship” of the data within the Department: that is, they have a business responsibility (not a technical or a legal one) for ensuring that the data is used effectively to meet both the business needs of the Department and the wider goals of the Dubai Data strategy.

• The Data Steward does not need to be the creator or the primary user of the asset, but they must understand its value to the organisation.


Label Definition

Contributor Anentityresponsible formakingcontributions totheresource.

CoverageThespatialortemporaltopicoftheresource,thespatialapplicabilityoftheresource,orthejurisdiction underwhichtheresourceisrelevant.

Creator Anentityprimarilyresponsible formakingtheresource.

Date Apointorperiodoftimeassociatedwithaneventinthelifecycleoftheresource.Description Anaccountoftheresource.

Format Thefileformat,physicalmedium,ordimensions oftheresource.

Identifier Anunambiguous referencetotheresourcewithinagivencontext.Language Alanguageoftheresource.

Publisher Anentityresponsible formakingtheresourceavailable.Relation Arelatedresource.

Rights Informationaboutrightsheldinandovertheresource.

Source Arelatedresourcefromwhichthedescribedresourceisderived.Subject Thetopicoftheresource.Title Anamegiventotheresource.Type Thenatureorgenreoftheresource.

53

Dublin Core Metadata Terms

Moredetailscanbefoundathttp://dublincore.org/specifications/


• The Integrated Public Sector Vocabulary (IPSV) is an encoding scheme for populating the e-GMS Subject element of metadata. It is fully compliant with ISO 2788 and BS 8723, the International and British Standards for monolingual thesauri. The vocabulary was developed with the backing of the ODPM (Office of the Deputy Prime Minister) and the eGU (Cabinet Office e-Government Unit).

• More information can be found at http://standards.esd.org.uk/?uri=list%2Fsubjects&tab=details

54

Integrated Public Services Vocabulary (IPSV)


Primary Registries

CitizenRegistry

Source: http://urbanopus.net/

APrimaryRegistrywillactasthesourceofrecordforthedatawhichitcontains.

PrimaryRegistriesareessentialDataSetsthatmustbemadeOpentothegeneralpublicorSharedamongGovernmentandGovernmentRelatedEntities.

AllotherGovernmentEntitiesmustusePrimaryRegistrydatasourcedfromtheController.

ThePrimaryRegistryControlleristhesingleCustodianoftheRegistrydataandtheonlyDepartmentallowedtogatherthisinformation.

55


FunctionA

FunctionB

LOBC

Work ProcessX

Work ProcessY

EnterpriseEnterprise/ External Party

LOB/ Function(Confidential/Sensitive)

Enterprise (Shared)

Federated (Open)

Local (Secret)

Local– Datathatisself-containedwithintheLineofBusiness– notshared.

Federated– Datathatisshared/exchangedbetweentheEnterpriseandanyexternalparty

Enterprise – Datathatis shared/exchangedinternally withintheEnterprise,acrossmorethanoneWorkProcess

LineofBusiness/Function – Datathatisshared/exchanged acrossmorethanoneapplicationwithinoneLOB,FunctionorWorkProcess

• EnterpriseisGovernmentofDubaiortheSmartDubaiOffice• WorkProcessistheGovernmentDepartment• LineofBusiness/Function iswithintheGovernmentDepartment• ExternalPartyistheanyoneoutsidetheGovernment(citizens,

Expats,Privateentities)

Enterprise Representation of Data

56


Data Preparation & Release Plan

57

CreateaninitialroadmapforyourDepartment’sDatawork

Setprocesses,infrastructure,governance,dataintegrity,lifecyclemanagementneededfordatacompliance

ITRole

AssesscapabilitiesandprepareDepartmentformeetingDubaiDatarequirements

Objective

Determinepersonnelneeds:skills,roles,training

HRRole

BURole

EvaluatehowtomeetthedatarequirementsfortheDepartment StrategyRole

AligndatarequirementswithDept goalsandcommitments


DepartmentandSDOGoals&FutureState

SDORequirements

CriticalSuccessFactors

Personnel

CurrentCapabilities

Content

ProgressEvaluation

Criticalsuccessfactors– Whatwillsuccesslooklike,specifictodatasharingandpublishing?

Individuals orgroup- Roles,Responsibilities; andApprovalAuthority

RegulatoryandTechnicalrequirements

PrimaryRegistryDataSetsandInventoryList

• Strengths(i.e.leadershipsupport,resources,skillset,datamaturity,etc.)• Weaknesses(i.e.Process; Infrastructure;Resources(retrain,longtermor

temphire,reassignment);Budget;Timelineforaction)• TechnologyCapacity– systemsandprocesssophistication

RequiredDubaiDataDeadlines

PlanEvaluation– measurementmechanism;atwhatintervals;whoistheresponsible body;andhowresultswillbeincorporated?

Step 1 - Gather Information

58


Step 2 – Assemble Plan• WhythePlanexistsandwhatit’stryingtoachieve• Requiredbehaviors/actionsthatneedtobetakenObjective

• Model• WorkflowProcess• ApprovalProcess

Governance

• Deliverables• Activities• Resources

Approach

• Dates• Dependencies• Milestones

GANTT

• Potentialrisks• impact• RemedialActions

Risks

• Howwillsuccessbemeasuredandwhen• Whatwillsuccesslooklike• Howwilllearningsbeincorporated

Measurement

60

QUESTIONS

Documents

Dubai Open and Shared Data Frameworkdubaidata.ae/pdf/Dubai-Open-Shared-Data-Framework-20170427.pdf · Source: neXgen analysis Confidential Dubai Data Law Contents 9 Specific Obligations