Upload
simon-koh
View
217
Download
0
Embed Size (px)
Citation preview
7/27/2019 InformationWeek_2012_11_19
1/17
Next >>
Are PMOs a bad idea? >
VMware dances with op
Table of contents >>
NOV. 19, 2012
PLUS
Predictive analysis is getting faster, more accurate and more accessible.
By Doug Henschen
informationweek.com
THE BUSINESS VALUE OF TECHNOLOGY
Combined with big data, its driving a new age of experimentation. >>
7/27/2019 InformationWeek_2012_11_19
2/17
informationweek.com
CONTENTSTHE BUSINESS VALUE OF TECHNOLOGY Nov. 19, 2012 Is sue 1,351
Previous Next
MORE INFORMATIONWEEK
Let The News Find You
Get the news topics you follow including s
computing delivered to your inbox.
informationweek.com/getalerts
IN-DEPTH REPORTS
New Approach T
IT organizations
software-defined
can reduce costs
network efficien
yet few have imp
offer a strategy for assessing this emerging te
informationweek.com/reports/sdn
Do You Need This Security Software?Answer these 10 questions to determine whe
information and event management system m
your company.
informationweek.com/reports/siemsense
GET INFORMATIONWEEK HEALTHC
Mobile Power
The November issue ofInformationWeek
Healthcare looks at mobile apps that
promise to re-energize healthcare.informationweek.com/gogreen/111212hc
7
This all-digital issue ofInformationWeekis part of our 10-year strategy to reduce the publications carbon footprint
COVER STORY
7 Advanced AnalyticsPredictive analysis is getting faster, more accurate
and more accessible. Combined with big data,
itsdriving a new age of experimentation.
3 CIO Profiles
Chasing technology doesnt work, says this CIO
4 Global CIOAre project management offices a mistake?
5 CommentaryVMwares doing a tricky tango with open source
CONTACTS
16 Editorial Contacts17 Business Contacts
7/27/2019 InformationWeek_2012_11_19
3/17
informationweek.com
Title: Senior VP and CIO
Degree: Creighton
University, BS in
computer science
Favorite pro sports
team coach: Mike
Tomlin of the Pittsburgh
Steelers, because he
coaches his team like I
feel I coach my team
were both involved and
personal
Best book read
recently: Unbroken,
a well-written and
incredible story about
Louis Zamperini
If I werent CIO, Id be ...
a COO I love
operations
CAREER TRACK
How long at UniGroup: About a year at thislogistics services company.
Career accomplishment Im most proud of:
Making the transition from the business to IT.
Education in IT made me a better business leader;
business experience makes me a better IT leader.
Decision I wish I could do over: In the past, I
made the mistake of chasing technology.
Theres a balance between implementing newtechnologies that offer a competitive advantage
and developing reliable, consistent systems.
ON THE JOB
IT budget: $30 million
Size of IT team: 180
Top initiatives:
>> Building a supply chain management
system.
>> Moving more systems to an open source
stack from a mainframe
>> Engaging a colocation facility.
VISION
One thing Im looking to do better: I want to
improve collaboration. We just have too many
walls today.
How I give my team room to innovate:
I ask for individuals or teams to present ideas
to me that they feel have potential to make a
difference. This demonstrates initiative and
passion for the idea. If an idea has merit,I free up their time to pursue the idea and
ask for regular updates.
The most common cause w
go wrong: A breakdown in
between IT and the busines
support from the business is
projects fail.
What I want from tech ven
truly unique, innovative app
lems from our vendors inste
repackaging of the same old
The most overrated IT mo
computing. Its not that I do
believe that its going to hathere are so many case stud
ply not true. Lets face it, the
work to be done to make it
affordable.
Kids and tech careers: Im
to steer my kids toward tech
Theyre still young, but I bel
ogy will always have a futur
Ranked No. 12 in the 2012
CIO
profilesPrevious Next
Table of Contents
ANTHONY DECANTI UniGroup
7/27/2019 InformationWeek_2012_11_19
4/17
informationweek.com
Will most companies that implement a proj-
ect management office take on higher IT costs
without improving performance?
Tha ts the bold con cl us ion of a Hacket t
Group study of more than 200 organizations.
And I agree that the risks of a disastrous PMO
implementation have never been greater.
PMOs can be incredibly valuable when they
manage the right projects through to busi-
ness-focused completion and kill the projects
that dont measure up. Trouble is, creating a
PMO under the wrong circumstances is likely
to produce only more project overhead.The Hackett Group, a research and consulting
firm, found that PMO use for companies of
every stripe grew from 2007 through 2009 then
steadily declined. Its report backs up some find-
ings in InformationWeeks 2012 Enterprise Proj-
ect Management Survey, which traced a reduc-
tion in PMOs and formal PMO skills. Hacketts
bombshell: In some cases, IT performance actu-
ally improved once the PMO was eliminated.
Hackett also found that more PMO oversight
doesnt necessarily improve results. PMOs that
dont spot and manage risks may only increase
pressure to push through badly designed proj-
ects. In a weak PMO, poor management of
time, resources, requirements or customer ex-
pectations encourages shortcuts that increase
design weaknesses that drive higher mainte-
nance and support costs, Hackett said.
Many poor-performing PMOs have staff with
Project Management Institute and other cer-
tifications, Hackett found. The problem is that
those employees often lack a strong k nowl-
edge of the business or its technology infra-
structure, so theyre mainly task-list keepers
and process cops. Ive seen this problem mostoften when management doesnt want to pay
extra for business leadership.
Hackett found four practices as key to PMO
success: centralized IT demand management,
accountability for business benefits, standard-
ization of processes and architecture, and
program and project reviews. Translating con-
sultant-speak into English: PMOs work with
business units to review and set priorities for
the IT services they use. Theyre responsible for
results and cant say, Well, you didnt listen to
me! They revisit projects after theyre com-
pleted to assess lessons an
Yet those key practices st
a PMO. Hackett said that u
ment and collaboration m
as Scrum sometimes can
for heavyweight PMOs.
I dont think the PMO is d
research findings and my
proceed with caution. Wa
builders who prioritize pad
(I built a PMO!) over deliv
Be minimalist: Anything
mented should have a plaiAbove all, ensure that th
committed to the PMO. W
wont get the resources or
it needs to succeed. Tha
linger on, inflicting cost a
both project managers and
til its put out of everyones
Jonathan Feldman is director of
growing North Carolina city. See
informationweek.com/jonathanfeld
Are Project Management Offices A Waste Of Money?
global
CIOPrevious Next
Table of Contents
JONA
Get This And
All Our Reports
Our full report on projectmanagement is free with
registration. Find out how your
peers are using project manage-ment tools and what problems
theyre having.
DownloadDownload
7/27/2019 InformationWeek_2012_11_19
5/17
informationweek.com
When it comes to the future data center, its
well understood that servers and storage will
function as pools of virtualized resources that
can automatically switch from task to task.
Virtualizing the network also will be essen-
tial, but its a much harder nut to crack than
servers and storage. It remains unvirtualized
and has lagged far behind the other two. But
without it, well never get to the flexible, auto-
mated data center of the future whats en-
visioned as a private cloud.
Thats why I sat down to ta lk to Martin Ca-
sado, the former Stanford grad student whosePh.D. thesis turned into the OpenFlow net-
working protocol. Casado co-founded virtual
networking firm Nicira, which sells software to
program and manage virtual networks using
the principles of OpenFlow. Nicira is the lead
contributor to an open source virtual network-
ing project, Quantum. Quantum is the net-
working piece of OpenStack, the broader
open source platform for managing virtual-
ized data centers.
Heres the rub: VMware bought Nicira for
$1.26 billion in July. (Not bad for a startup with
100 employees.) So I asked Casado: How can
Nicira continue leading development of vir-
tual networking in OpenStack?
Its a key question because OpenStack com-
petes with VMware to manage the virtualized
part of the data center. It seeks to let IT create
systems that allow employee self-provision-
ing, automated expansion to meet demand
and charging business units for use all key
options in a private cloud. VMware aims to
manage private clouds through its vCloud Di-
rector and vCloud Suite.
After listening to Casado, I felt I understoodhow these dissimilar pieces proprietary
product line and open source code contribu-
tions fit together. See what you think.
First, Casado notes that Quantum isnt a par-
ticular set of networking features or a new kind
of hardware that combines switches, routers
and controllers. It is a framework of open in-
terfaces you use to build up virtual networking
for a software-defined data center or a cloud.
Virtualized networks are essential to pr ivate
clouds because, without them, the virtual ma-
chines connection to a network is buried as a
software switch in a hyper
switch functions more effi
ing its processing to a near
as Cisco and Hewlett-Packa
be easier if the server, stora
could all be virtualized up f
sources, with capacity s
when a virtual machine is
provides the virtual netw
OpenStack provides the
three fit in, says Casado.
The Quantum network vir
embeds route-building andcapabilities into a network
ages the switches and route
change. (Nicira offers comm
the name Network Virtual
the size of a virtual server ne
to match its growing traffi
can be increased at the sam
Both VMware-owned N
the open source Quantum
the principles of the Ope
working standard. Open
oped as a cooperative e
VMwares Tricky Tango With Open Source CHAR
Previous Next
Table of Contents Commentary
7/27/2019 InformationWeek_2012_11_19
6/17
informationweek.com
vanced networking groups at Stanford and
Berkeley. (How often does that happen?)
The OpenFlow prot ocol in many sett ings
could gradually displace the widely used span-
ning tree networking protocol, which applies a
hardwired answer to the question of what
route and on what type of network a particular
message should travel. OpenFlow lets a net-
work controller react to demand, then deter-
mine what resources and routes to use.
To make use of that flexibility, the Quantum
part of OpenStack attempts to put a pro-
grammable, vendor-neutral interface be-
tween a human network manager and the
network. The operational interface to the
network has always been a proprietary one
for the last 20 years, says Casado.
The vendor that provides this programmatic
interface will be in a strong position to man-
age the whole private cloud. But if that inter-
face isnt able to handle virtualized gear and
software from many vendors, the private
cloud wont function in the way it was con-
ceived. OpenStack and VMware both say
theyll provide that neutral virtualization man-
agement platform for the private cloud.
The benevolent view is that both have rea-
son to support Quantums development as
the virtual network platform. Without Quan-
tum, OpenStack doesnt offer a complete pri-
vate cloud because it cant handle virtual net-works. VMware needs the Quantum-based
Nicira products to help companies build the
software-defined data center it envisions.
Asked about VMwares commitment to Open-
Stack, Casado says: It is important that we sup-
port our customers deploying on OpenStack
and other open source technologies. VMware
will add that support, keep making code contri-
butions through Nicira and fund OpenStacks
development foundation as a sponsor.
Boris Renski, co-founder of OpenStack con-
sultancy Mirantis, doubts VMware as an Open-
Stack backer: VMware ca
Stack and compete with it
But Frank Rego, business d
ager at Novells SUSE Linux
open source strategy is ch
Microsofts did, when Micro
posing Linux to now supp
virtual machines in the Mic
VMware has had such an a
I agree, except that VMwa
a conversion to make. Whil
etary company, VMware ne
ment opposition to open so
But the main point is thatis essential to the expansio
in general, and VMware
more companies running a
software-defined data cen
as the management softw
much interest as anyone i
cles from the virtual nets p
it will keep backing OpenS
Y ou ca n rea d more stori es fro
informationweek.com/charlesba
The benevolent view is that both
VMware and OpenStack have
reason to support Quantums
continued development as
the virtual network platform.
Previous Next
Table of Contents Commentary
7/27/2019 InformationWeek_2012_11_19
7/17
Five years ago, companies were standardizing
on one or a couple of business intelligence prod-
ucts. Broad interest in advanced analytics, espe-
cially the predictive kind, was just emerging.
Today, companies of all sizes and industries
are experimenting with and using analytics, and
veteran users are going for new levels of sophis-
tication, according to our new InformationWeek
Analytics, Business Intelligence and Information
Management Survey. Companies are embrac-
ing analytics to optimize operations, identify
risks and spot new business opportunities.
Advanced analytics is all about statistical
analysis and predictive modeling being able
to see whats coming and take action before
its too late, rather than just reacting to what
has already happened. That latter practice, de-
risively known as rearview-mirror reporting,
is associated with conventional BI.
The more data companies use, the more accu-
rate their predictions become. But the big data
movement isnt just about using more data. Its
also about taking advantage of new data ty
such as social media conversations, clickstre
and log files, sensor information and other
time feeds. Experienced practitioners are ta
cutting-edge approaches, including in-data
analytics, text mining and sentiment analys
In each of the past six years, responden
our analytics and BI survey have rated the
terest in 10 leading-edge technologies, and
vanced analytics has always been the N
choice. Advanced data visualization is No. 2
Previous Next
Table of Contents
Predictive analysis is getting faster, more accurate
and more accessible. Combined with big data,
its driving a new age of experimentation.
By Doug Henschen
informationweek.com
7/27/2019 InformationWeek_2012_11_19
8/17
informationweek.com
year, up from being ranked third in 2009 (see
chart at right). Last year we added big data
analysis to the list of cutting-edge pursuits,
and this year it ranked No. 4 along with collab-
orative BI.
We also see clear evidence that companies
are investing in software, people and ad-
vanced techniques. For starters, this year we
added in-database analysis for predictive or
statistical modeling to our list of leading-
edge technologies, and respondents rated
their interest higher than for more-estab-
lished categories such as mobile BI and cloud-
based BI.
With in-database analysis, statistical and pre-
dictive algorithms are rewritten to operate in-
side databases that run on massively parallelprocessing (MPP) platforms. In-database analy-
sis is faster than the old approach to data min-
ing, where analysts moved data sets from data
warehouses into specialized analytic servers to
create and test predictive models. Data move-
ment delays plagued the old approach, and
the analytic servers were underpowered. As
data sets have grown, time and power con-
straints limit work to small data samples rather
than all available information, limiting the ac-
curacy of the resulting models.
Businesses that have embraced in-database
approaches say they can develop models in
less time for more precisely targeted seg-
ments, whether theyre trying to predict cus-
tomer behavior, product performance, busi-
ness risks or other variables. Whats more, MPP
power lets them crunch through massive data
sets, so they can use all ava
liver far more accurate mo
In-Database-Enabled Tex
In-database approaches
breaking into new areas. T
ADVANCED ANALYTIPrevious Next
Get This AndAll Our Reports
Our full report, 2013 Analytics &
Info Management Trends, is freewith registration. In it youll find
more data from our survey of
nearly 550 business technology
professionals and more detail on
our user examples.
DownloadDownload
Previous Next
Table of Contents
Whats Your Companys Level Of Interest In Analytics And BI Techno
Data: InformationWeek 2013 Analytics, Business Intelligence and Information Management Survey of 417 busine
at companies using or planning to deploy data analytics, BI or statistical analysis software, October 2012
Advanced analytics (predictive and statistical analysis, etc.)
Advanced data visualization capabilities (sparklines, treemaps, heat maps, etc.)
Embedded BI (reports and visualizations deployed within enterprise apps, portals, etc.)
Analysis of big data, particularly unstructured and nonrelational data
Collaborative BI (tools promoting broad sharing and input on analyses)
In-database analysis for predictive or statistical modeling
In-memory BI and analytics (fast analysis and what-if planning on large data sets)
Mobile BI (alerts, reports and visualizations delivered to smartphones and other devices)
Software-as-a-service and cloud computing-based BI and analytics
Social media and social network analysis (sentiment analysis, customer influencer and behavior analysis)
3.6
3.5
3.5
3.4
3.4
3.3
3.2
3.2
2.8
2.7
1 Not interested
(Mean average)
http://prevpage/http://prevpage/http://prevpage/7/27/2019 InformationWeek_2012_11_19
9/17
informationweek.com
vanced analytics technique applied to unstruc-
tured text, has become popular for social media
analysis, according to our survey respondents.
Areas include competitive intelligence gather-
ing, customer behavior analysis, and brand and
product reputation analysis (see chart, below).
Health insurer UnitedHealthcare, for exam-
ple, is testing text mining using SASs in-data-
base High Performance Analytics software,
which runs on Teradata and EMC Greenplum
platforms, as well as commodity grids. Work-
ing in partnership with SAS and EMC, United-
Healthcare is using HPA to develop deeper,
more accurate predictive models to analyze
customers call center communications.
In the past 18 months, UnitedHealthcare has
collected more than 160 million rows of un-
structured information from its call center notes
and call recording transcriptions. It uses SASs
text mining software to look for indications that
customers didnt have their questions or con-
cerns resolved during a call, email or postal
mail interaction. The softwares predictive
models identify suspect customer interac-
tions that require follow-u
The scale of all of this uns
tion, coupled with the com
performance of conventio
tiprocessor servers runnin
ware, previously made th
time consuming and inacc
UnitedHealthcare used a
cal data to train the pre
the data to be analyzed. T
the more accurate the mod
it used about 50,000 rows
set, but with SASs HPA in-d
UnitedHealthcare can use
develop the model in the
time, says Mark Pitts, direc
solutions and strategy for Our data scientists are m
with more training data, ou
discriminating, Pitts says. T
Healthcare is finding more c
low-up and getting fewer fa
line: Customer satisfaction s
Customer Retention 101
The University of Kentu
advanced analytics this ye
dent retention. Since the 2
many colleges and univ
ADVANCED ANALYTIPrevious Next
Table of Contents
Previous Next
What factors are driving, or would drive, your companys interest in using social media and social media analysistechnologies?
The Social Factor
Competitive intelligence
Customer behavior analysis (spotting influencers and churn threats)
Brand/product/reputation management (including voice of the customer apps)
Customer service (including product and service quality and warranty apps)
Customer segmentation (for up-sell and cross-sell)
Compliance (financial services, insurance risk management and fraud detection)
Social media and social network analysis technologies arent a priority for my company
Data: InformationWeek 2013 Analytics, Business Intelligence and Information Management Survey of 417 business technology pros at companies
using or planning to deploy data analytics, BI or statistical analysis software, October 2012
41%
38%
34%
27%
25%
24%
27%
7/27/2019 InformationWeek_2012_11_19
10/17
informationweek.com
country are seeing a higher percentage of
their students drop out before they complete
their degrees. Lower retention rates can lead
to shrinking enrollment and contraction of
courses, degree programs and faculties.
The baseline measures universi ties use to
predict whether a student will fit in and suc-
ceed include high school grade point average
and ACT and SAT test score
also factors in ethnicity, so
ground, alumni status of p
formation in deciding wh
ADVANCED ANALYTIPrevious Next
Table of Contents
Previous Next
Taylor University, a small, private Chris-
tian university in Upland, Ind., with
1,900 undergrads, 320 distance learners
and 120 grad students, is proof that analytics
is filtering down to small organizations.
Late last year the university bought Informa-
tion Builders RStat module for its existing Web-
Focus BI deployment. RStat provides predictive
analytics and modeling capabilities based onthe R programming language. We knew it
would be important for us to be able to do data
mining to pull data together from divergent
systems and begin to answer a variety of oper-
ational questions, says Edwin Welch, director
of institutional research and associate registrar.
Taylors student retention rate began to
fall five years ago, and it wanted to turn that
number around. Instead of hiring a statisti-
cian to lead the effort, Welch boned up on
analytics and started experimenting with
the RStat software. With a Ph.D. in comput-
erized instructional systems, he wasnt an
analytics neophyte. He read up on the latest
techniques and turned to Taylors sociology
professors for advice on statistical methods.
Nevertheless, Welch admits he faced a
number of challenges. For starters, he had dif-
ficulty integrating data from disparate sys-
tems using batch extract, transform and loadprocesses and was able to come up with only
6,300 complete student records, 460 of which
pertained to students who had dropped out
after their freshman year. Thats not a large
sample, particularly when you consider that
the Information Builders software splits that
data, randomly choosing 70% of the records
to build models and holding aside 30% for
testing accuracy.
Despite the thin sample, Welch built a variety
of models that varied from 78% to 86% accu-
racy in predicting whether
would leave the university.
best predictors were a stud
GPA, SAT and ACT scores, G
percentage of credit hours co
term, number of midterm gr
the fall term and the number
student registered for in the
Not satisfied with the accmodels, Welch combined th
best models, improving ov
90%, he says. The combin
dicted that 25 students wou
end of the 2010-2011 acad
the 68 students who actua
Welch says. That result was s
than the nine students out o
been identified by faculty
on Taylors academic aler
school year.
Small University Graduates To Advanced Analytics
AT-RISK STUDENTS
7/27/2019 InformationWeek_2012_11_19
11/17
informationweek.com
plicants. Once students are enrolled, collegesand universities collect all sorts of new data
that shows how theyre faring.
How does UK predict whos in danger of
dropping out so that it can intervene? It ana-
lyzes student record data going back to 1988
to model the characteristics of students who
did and didnt drop out. In addition to taking
into account preadmission variables, the uni-
versity can tap information on scholarships,
parental participation, courses of study, in-
structors, degree programs, dorms students
lived in, extracurricular activities and, of
course, grades and attendance. Given the factthat UK has about 22,000 undergrads and
6,000 to 7,000 grad students enrolled at any
one time, thats a lot of data.
UK began a proof-of-concept project in
March, using the past six years of student
data. Within two months, it had a baseline pre-
dictive model using high school GPA and col-
lege entrance exam scores, and since May a
statistician hired from another university has
been adding variables to the model from the
universitys Blackboard learning management
system. UK thinks retention is closely related
to the level of student en
adding data on the numbe
log in to their class Web
labuses, download home
collaborate online with c
in homework assignments
The university is using SAAnalysis software in large
ready uses SAPs ERP syste
jects BI software. UK is doin
ses and statistical mod
programming language,
Hana in-memory databas
fast, ad hoc analysis acro
variables. Hana handles qu
out the need to constantly
mensional cubes and dataIf we have people on ca
know what the prediction
certain socioeconomic ba
tain combinations of any
ables, we can quickly ask t
adjust our model, as oppo
nightly [batch] loading job
tenwald, UKs enterprise a
UK built an iPad-based a
the universitys business an
data, selecting the dimensio
in. They can look at data acr
ADVANCED ANALYTIPrevious Next
Table of Contents
Previous Next
How does your company deploy, or plan to deploy, analytics and BI technologies?
Where Analytics And BI Fit In
Data:InformationWeek 2013 Analytics, Business Intelligence and Information Management Survey of 417 business technology pros at companies
using or planning to deploy data analytics, BI or statistical analysis software, October 2012
20%
30%30%
17%
3%
We deploy them as part of othertechnology initiatives
We deploy them on aproject-by-project basis
We have standardized on oneor a few analytics and BIproducts company-wide
We have many productsscattered throughout
departments, operations andlocations
We dont plan on deploying
7/27/2019 InformationWeek_2012_11_19
12/17
informationweek.com
or graduating class, examining segments and
microsegments based on those 85 variables.
Right now, the retention analytics that most
large schools are doing tend to look at stu-
dents in large swaths, such as high-perform-
ing students and low-performing students,
Recktenwald says. We want to bring thisdown to microsegments, so we can better un-
derstand the needs of individual students.
Once the retention program is proved, UK
plans to develop models that will help it pre-
dict revenue and physical facility needs.
Crowdsourcing Analysis
As corporate data stores grow in volume, va-riety and complexity, they provide advanced
analytics practitioners wit
predictive models. But the
theyre making full use of a
Property and casualty insu
that conclusion when it st
Kaggle, a big data crowdso
With more than 16 millstate has no shortage of d
shortage of analytics expe
predictive modeling team
for the companys produ
helping guide coverage an
Allstates analytics gur
about what they do, so mu
them participate in Kagg
their spare time. Founded
ganizes competitions in government agencies and
data sets and problems. Ka
61,700 participants submit
entries to more than 65 co
sors pay prize money in e
tellectual property behind
In early 2011, Allstates
search, Eric Huls, overhea
ployees talking about a K
and was captivated by the
Allstate hosted a competit
plied three years of aut
ADVANCED ANALYTIPrevious Next
Table of Contents
Previous Next
What data sources or challenges are driving, or would drive, your companys interest in using big data analysis?
Whats Spurring Interest In Big Data Analysis?
Finding correlations across multiple, disparate data sources (clickstreams, geospatial, transactions, etc.)
Predicting customer behavior
Predicting product or service sales
Predicting fraud or financial risk
Identifying computer security risks
High-scale machine data from sensors, Web logs, etc.
Social network comments for consumer sentiment
Web clickstreams
My company isnt interested in big data analytics
Data:InformationWeek 2013 Analytics, Business Intelligence and Information Management Survey of 417 business technology pros at companies
using or planning to deploy data analytics, BI or statistical analysis software, October 2012
52%
45%
34%
28%
23%
22%
18%
11%
15%
7/27/2019 InformationWeek_2012_11_19
13/17
informationweek.com
asked competitors to beat Allstates baseline
model for predicting which covered autos
would be involved in bodily injury claims and
how much those claims would cost. The mod-
els were created and trained using two years
of data and then tested for accuracy against
the third year of data.All personally identifiable information was
stripped from the data, but still included were
plenty of details about the make, model, horse-
power, weight and length of the vehicles, along
with the cost of any bodily injury claims. In the
vast majority of cases, there were no bodily in-
jury claims, so the cost figure was zero.
Several Kaggle competitors handily beat All-
states baseline, and the winner beat Allstates
model by 270%, meaning it was that muchmore accurate in predicting which vehicles
would be involved in accidents and how
much related bodily injury claims would cost.
It was well worth the $10,000 in prize money
that Allstate put up. The insurer has since in-
corporated some of the techniques used in
that winning model, Huls says.
The appealing thing about Kaggle and crowd-
sourcing, Huls says, is that the competitors ap-
proach problems from many different angles.
Kaggles top competitors include astronomers,
hedge fund quants, statisticians, physicists, econ-
omists and mathematicians, and they dont have
preconceived we do things this way notions
about how to solve a problem.
By putting some of these problems out there
for others to work on, it prevents us from being
more satisfied with the job that were doing
than we should be, Huls says. Were doing a
good job, but this will push us to do better.
Allstate started another Kaggle competition
in September to study cu
this time its using an invi
whereby a select group of
invited to join the commer
ect. To participate, contesta
disclosure agreements so t
have to worry about givin
secrets and it can share mo
no personally identifiable in
ADVANCED ANALYTIPrevious Next
Table of Contents
Previous Next
Big data expertise is scarce and expensive
Data warehouse appliance platforms are expensive
We arent sure how big data analytics will create business opportunities
Analytical tools are lacking for big data platforms like Hadoop and NoSQL databases
Our datas not accurate
Hadoop and NoSQL technologies are hard to learn
We dont have enough data
Hadoop and other NoSQL technologies lack management features
I have no concerns about big data analytics
Data:InformationWeek2013 Analytics, Business Intelligence and Information Management Survey of 417 business t
using or planning to deploy data analytics, BI or statistical analysis software, October 2012
3
31%
22%
21%
17%
13%
12%
16%
What Are Your Primary Concerns About Using Big Data Software?
7/27/2019 InformationWeek_2012_11_19
14/17
informationweek.com
but Allstate has included details on prices paid
for policies, coverage plans and other products
purchased, and whether those customers stuck
with Allstate or switched to another insurer. All-
state also offered contestants more context,
more detail on the methods it uses internally,
and insight into what has and hasnt worked forthe company in the past, Huls says.
From Standardization To Experimentation
Veteran analytics users like Allstate that are
trying out crowdsourcing and other advanced
techniques have come a long way from 2009,
when 47% of respondents to our survey said
they had standardized on one or a few BI
tools deployed throughout the company.
That percentage has since declined to 30% ofthis years 417 survey respondents using or
planning to use data analytics, BI or statistical
analysis software (see chart, p. 11). Whats
more, fewer respondents now report their
companies have a standard BI platform.
Why the reversal? For starters, the standard-
ization movement started around the time of
a significant consolidation of BI vendors that
culminated in 2007 when SAP acquired Busi-
nessObjects, Oracle acquired Hyperion and
IBM acquired Cognos. Microsoft was moving
aggressively into BI at that time, and all four of
those companies were pushing customers to
consolidate BI investments around their big,
broadly capable BI suites. Market-share gains
followed for the four vendors.
Before they were acquired, BusinessObjects,
Hyperion and Cognos had snapped up many
smaller, innovative companies. A new wave ofnimble and innovative BI companies in-
cluding QlikTech, Tableau Software and TibcoSpotfire has since emerged, and they are
now the fastest-growing BI vendors.
IBM, Microsoft, Oracle and SAP hold more
than half (53.2%) of the total BI software tools
market, in terms of 2011 revenue, according
to IDC. Their BI sales are also growing at dou-
ble-digit rates, but theyre not growing as
quickly as smaller, innovative rivals focusing
on advanced data visualization and self-ser-
vice BI (requiring minimal IT support).
SAS and IBMs SPSS unit have long domi-
nated the advanced analytics software cate-
gory, with 35.2% and 16.8
ket, respectively, according
third with just a 2.5% share
competitors each have les
Open source offerings suc
statistical programming ar
gaining commercial adopthasnt escaped the notice
have since introduced R-ba
ules tied to their BI suites. I
was among the first to mak
with the release of its RStat
fire followed, along with Ora
Big Data Ambitions
Where Allstates Kaggle co
volved highly structured dquantities, many Kaggle co
big data tens of hundr
highly variable data with
tures, complex data such a
log files, and minimally stru
text and social network da
growing world of big data
and BI practitioners are eag
What are the top reaso
spondents are interested
correlations across dispa
predict customer behavio
ADVANCED ANALYTIPrevious Next
Table of Contents
Previous Next
Our data scientists are more
productive and with more
training data, our models are
more discriminating.
Mark Pitts, UnitedHealthcare
7/27/2019 InformationWeek_2012_11_19
15/17
informationweek.com
uct or service sales (see chart, p. 12). Their biggest con-
cerns? Scarcity of expertise, expense of platforms and
lack of a clear business case (see chart, p. 13).
Hand in hand with the big data trend is a debate
about the future of data warehousing, analytics and BI,
sectors where relational databases and the SQL query
language have held sway for more than 30 years. Com-panies are now experimenting with Hadoop and
NoSQL databases, which let them work with unstruc-
tured, variable and complex data without all of the
data modeling steps that relational databases require.
Many of those adopting these new platforms are try-
ing out new tools as well as new vendors, such as Data-
meer and K armasphere. Theyre also raising concerns
about finding people with the skills to use these tools.
As companies embrace new platforms such as Ha-
doop and NoSQL databases, todays relational plat-forms will likely be focused even more on specialized
analytical tasks and applications. Relational databases
dont adapt quickly or well in places where new data
types, such as complex data and varied data, are con-
stantly showing up. And where data volumes are ex-
treme, Hadoops lower costs will make it a winner. That
means there will be a big opportunity for new analyt-
ics and BI tools built on Hadoop. These changes are
likely to take another five years, but theyre coming.
Read more stories by Doug Henschen at informationweek.com/
doughenschen. Write to him [email protected].
[COVER STORY]ADVANCED ANALYTICSPrevious Next
Table of Contents
7/27/2019 InformationWeek_2012_11_19
16/17
informationweek.com
Print, Online, Newsletters, Events, Research
UBM TECH
Paul Miller CEO
Kathy Astromoff CEO,Electronics
Robert Faletra CEO,Channel
Edward GrossmanPresident, BusinessTechnology Media
Marco Pardi President,
Business Technology EventsDavid Berlind ChiefContent Officer
John Dennehy CFO
David Michael CIO
Martha Schwartz ChiefSales Officer, BusinessTechnology Media
Scott Vaughan ChiefMarketing Officer
Simon Carless Exec.VP,Game & App Developmentand Black Hat
Lenny Heymann Exec.VP,New Markets
Harris Grayman Sr.V P,
People & Culture
INFORMATIONWEVIDEO
informationweek.com/v
Fritz Nelson [email protected]
INFORMATIONWEBUSINESSTECHNOLOGYNETWORK
DarkReading.comSecurityTim Wilson, Site [email protected]
NetworkComputing.coNetworking, Communictions and StorageAndrew [email protected]
READER SERVICESInformationWeek.comThe destination forbreaking IT news, and instant analysis
Electronic Newsletters Subscribe toInformationWeek Daily and other newsletters atinformationweek.com/newsletters/subscribe.jhtml
Events Get the latest on our live events and Netevents at informationweek.com/events
Reports reports.informationweek.comfor original research and strategic advice
How to Contact Us
informationweek.com/contactus.jhtmlEditorial Calendar informationweek.com/edcal
Back IssuesE-mail: [email protected]: 888-664-3332 (U.S.)847-763-9588 (Outside U.S.)
Reprints Wrights Media, 877-652-5295Web:wrightsmedia.com/reprints/?magid=2196Email: [email protected]
List Rentals Specialists Marketing Services Inc.Email: [email protected]: 631-787-3008 x3020
Media Kits and Advertising Contactscreateyournextcustomer.com/contact-us
Letters to the Editor [email protected] name, title, company,city, and daytime phone number.
Subscriptions
Web: informationweek.com/magazineEmail: [email protected]: 888-664-3332 (U.S.)847-763-9588 (Outside U.S.)
REPORTERSDoug Henschen Executive Editor
Enterprise software
[email protected] 201-660-8467
Charles BabcockEditor At Large
Open source, infrastructure, virtualization
[email protected] 415-947-6133
Thomas Claburn Editor At Large
Security, search, Web applications
[email protected] 415-947-6820
Paul McDougall Editor At Large
Software, IT services, outsourcing
J. Nicholas Hoover Senior Editor
Government IT, cybersecurity,
federal IT policy
[email protected] 516-562-5032
Michael Endler Associate Editor
[email protected] 415-361-9957
Michelle McNickle Associate Editor
Mobile health, social media
[email protected] 207-318-4853
Eric Zeman
Mobile and Wireless
CONTRIBUTORS
Michael Biddick [email protected]
Michael A. Davis [email protected]
Jonathan [email protected]
Randy George [email protected]
Michael Healey [email protected]
Kurt Marko [email protected]
EDITORS
Jim Donahue Chief Copy [email protected]
ART/DESIGNMary Ellen Forte Senior Art Director
Sek Leung Associate Art Director
INFORMATIONWEEK REPORTSreports.informationweek.com
Art Wittmann VP and Director
[email protected] 408-416-3227
Lorna Garey Content Director, Reports
[email protected] 978-694-1681
Heather Vallis Managing Editor, Research
[email protected] 508-416-1101
INFORMATIONWEEK.COM
Paul Travis Managing Editor
[email protected] 516-562-5217
Roma NowakSenior Director,
Online Operations and Production
[email protected] 516-562-5274
Tom LaSusa Managing Editor,
Newsletters
Jeanette Hafke Web Production Manager
Joy CulbertsonWeb Producer
Nevin Berger Senior Director,
User Experience
Pleasedirectallinquirestoreporters
intherelevantbeatarea.
Copyright2012UBM LLC.Allrightsreserved.
Rob Preston VP and Editor In [email protected] 516-562-5692
John Foley [email protected] 516-562-7189
Chris Murphy [email protected] 414-906-5331
Art Wittmann VP and Director, [email protected] 408-416-3227
Laurianne McLaughlin Editor In Chief,[email protected] 516-562-7009
Stacey Peterson Executive Editor, [email protected] 516-562-5933
Lorna Garey Content Director, [email protected] 978-694-1681
Fritz Nelson VP and Editorial [email protected] 949-223-3608
Eric Lundquist VP and Editorial Analyst,InformationWeek Business Technology [email protected] 978-289-7306
David Berlind Chief Content Officer, TechWeb [email protected] 978-462-5315
ADVISORY BOARD
Dave Bent
Senior VP and CIO
United Stationers
Robert Carter
Executive VP and CIO
FedEx
Michael Cuddy
VP and CIO
Toromont Industries
Laurie Douglas
Senior VP and CIO
Publix Super Markets
Dan Drawbaugh
CIO
University of Pittsburgh
Medical Center
Jerry Johnson
CIO
Pacific Northwest Natio
Laboratory
Kent Kushar
VP and CIO
E.&J.Gallo Winery
Carolyn Lawson
CIO
Oregon Health
Authority
Jason Maynard
Managing Director
Wells Fargo Securities
Randall Mott
CIO
General Motors
Previous Next
Table of Contents
mailto:[email protected]:[email protected]:[email protected]:andrew.conry-murray%[email protected]:andrew.conry-murray%[email protected]:andrew.conry-murray%[email protected]:[email protected]7/27/2019 InformationWeek_2012_11_19
17/17
Chief Sales Officer, Business Technology Media,Martha Schwartz(212) 600-3015,[email protected]
Sales Assistant, Tabitha Sprague(212) 600-3327,[email protected]
SALES CONTACTSWESTWestern U.S.(Pacific and Mountain states)and Western Canada (British Columbia,
Alberta)
Western Regional Sales Director, Sandra Kupiec(415) 947-6922,[email protected]
Strategic Account Director, Coretta Wright(415) 947-6245,[email protected]
District Sales Manager, Vanessa Tormey(805) 284-6023,[email protected]
Account Manager, Ashley Cohen(415) 947-6349,[email protected]
Account Executive, Silas Chu(415) 947-6330,[email protected]
Account Executive, Rose Lin(415) 947-6157,[email protected]
Strategic Accounts
Account Manager, Vesna Beso(415) 947-6104,[email protected]
Account Executive, Matthew Cohen-Meyer(415) 947-6214,[email protected]
SALES CONTACTSEASTMidwest, South, Northeast U.S.and Eastern Canada(Saskatchewan, Ontario, Quebec, New Brunswick)
District Manager, Jenny Hanna(516) 562-5116,[email protected]
District Manager, Michael Greenhut(516) 562-5044,[email protected]
District Manager, Cori Gordon(516) 562-5181,[email protected]
Inside Sales Manager East, Ray Capitelli(212) 600-3045,[email protected]
Senior Sales Associate, Bill Myers(212) 600-3163,[email protected]
Sales Assistant, Anna Maria Charalambous(212) 600-3193,[email protected]
Strategic Accounts
District Manager, Mary Hyland(516) 562-5120,[email protected]
Account Manager, Tara Bradeen(212) 600-3387,[email protected]
Account Manager, Jennifer Gambino(516) 562-5651,[email protected]
Strategic Account Manager, Amanda Oliveri(212) 600-3106,[email protected]
Account Executive, Kathleen Jurina(212) 600-3170,[email protected]
Sales Assistant, Devin Rosenberg(212) 600-3157,[email protected]
SALES CONTACTSNATIONALDr.Dobbs
Sales Director, Michele Hurabiell(415) 378-3540,[email protected]
District Sales Manager, Steven Sorhaindo(212) 600-3092,[email protected]
SALES CONTACTSMARKETINGAS A SERVICEDirector of Client Marketing Strategy,Jonathan Vlock(212) 600-3019,[email protected]
Director of Client Marketing Strategy,Julie Supinski(415) 947-6887,[email protected]
SALES CONTACTSEVENTSSenior Director,InformationWeek Events,Robyn Duda(212) 600-3046,[email protected]
MARKETINGVP, Marketing, Winnie Ng-Schuchman(631) 406-6507,[email protected]
Senior Marketing Manager, Monique Kakegawa(949) 223-3609,[email protected]
Promotions Manager, Angela Lee-Moll(516) 562-5803,[email protected]
Marketing Assistant, Hilary Jansen
(415) 947-6205,[email protected]
AUDIENCE DEVELOPMENTDirector, Karen McAleer(516) 562-7833,[email protected]
Subscriptions: informationweek.com/magazineEmail: [email protected]: (888) 664-3332 (U.S);(847) 763-9588 (outside U.S.)
ADVERTISING AND PRODUCTIONPublishing Services Manager, Lynn Choisez(516) 562-5581 Fax: (516) 562-7307
MAILING LISTSSpecialists Marketing Services Inc.(631) 787-3008 [email protected]
REPRINTS AND RIGHTSFor article reprints, e-prints, and permissions, pleasecontact: Wrights Media, (877) 652-5295,[email protected]
Back Issues Phone: (888) 664-3332 (U.S.);(847) 763-9588 (outside U.S.)Email: [email protected]
BUSINESS OFFICEGeneral Manager, Marian Dujmovits
EDITORIAL OFFICEFax (516) 562-5200
United Business Media LLC600 Community DriveManhasset, N.Y.1 1030 (516) 562-5000Copyright 2012. All rights reserved.
UBM TECHPaul Miller CEO
Kathy AstromoffCEO, E
Robert Faletra CEO, Cha
Edward Grossman PresTechnology Media
Marco Pardi President, B
David Berlind Chief Con
John Dennehy CFO
David Michael CIO
Martha Schwartz ChiefTechnology Media
Scott Vaughan Chief M
Simon Carless Exec.VP, and Black Hat
Lenny Heymann Exec.V
Harris Grayman Sr.VP, P
informationweek.com
Business ContactsPrevious Next
Table of Contents