Long-term management of datasets

Hamish JamesStatistics New Zealand

Datasets at Statistics New Zealand

• Statistics New Zealand’s core business revolves around the collection, analysis and publication of data

• Our main focus is on preparing accurate summary statistics for release

• The Information Management team takes the lead in the long-term management of datasets, publications and records

Strategic framework

Maintaining an enduring national statistical resource acknowledges that information collected today is not only important to people now, but also to the researchers and policy makers of the future. The purpose of retaining datasets is to … allow for analysis in ways that were not thought of, or not possible, at the time the data was collected.

Augu

st

Dec

embe

r

Janu

ary

Febr

uary

Mar

ch

Apri

l

May

June July

Augu

st

Sept

embe

r

Oct

ober

Nov

embe

r

Dec

embe

r

Janu

ary

Febr

uary

Mar

ch

Apri

l

May

June July

2007 2008 2009

0

1

2

3

4

5

http://www.flickr.com/photos/26664862@N04/2499573972/sizes/l/

46

Of a

person

Census

2006

As at 7 March 2006

In years

Age

46

Of a GEO

IRD GST

data

In the

period 1-31 March 2007

$(000)

NZ$

Sales

12,300

Data needs context

Digital preservation of datasets

Binary data + data model + functionality

stored onembodied

bycreated by

media format software

Approach

• Complex data but low volumes of data: a file system based archive with manual and semi-automated processes

• Loss of knowledge occurs quickly: Internal ‘Retention, Preservation and Disposal’ Statements:– to identify data ready for archiving before

knowledge is lost– leave operational data with the operational units

• Offer archiving service for rest of the OSS

Records Management

DataArchiving

StatisticalMetadata

Thank you

Hamish JamesManager, Information Managementhamish.james@stats.govt.nz04 931 4237