a DOC Conundrum
Star Ying, Data Scientist at Department of Commerce
first, some background
grow the economy
⅓ of all federal public data
new data released constantly
$
a DOC conundrum
how to impart better understanding of our data
of any data
so really a data conundrum
a different perspective
def wdtd()……
def wdtd()……
#wdtd: what did this
#do?
is inherited
a quick quiz
american community survey
how many erratas have been issued for 2016?
how many erratas have been issued for 2016?
http://www.census.gov/programs-surveys/acs/technical-documentation/errata.html
viirs nighttime lights
which pixels are really blank?
which pixels are really blank?
http://ngdc.noaa.gov/eog/viirs/download_monthly.html
survey of income and program participation
which weights do I use?
which weights do I use?
http://www.census.gov/programs-surveys/sipp/methodology/weighting.html
how do we convey the necessary information to use our product
now, an anecdote
can we tie satellite images to economic
activity?
accounted for cloud coverage,
population, etc...
forgot the earth is a
sphere
tendency to silo ourselves
real insights and outcomes can only be derived from true synthesis of
knowledge of the data and mechanics in processing it
so what are we doing about it?
it is a communication problem
Data Usabilitycommerce.gov/datausability
handcrafted tutorials with working open code
I’d love to hear your ideas
no really