HBASE + HUETHE UI FORAPACHE HADOOPAbraham ElmahrekLA HBase User Group - Dec 12, 2013
1
WHATIS HUE?
WEB INTERFACE FOR MAKING HADOOP EASIER TO USE
Suite of apps for each Hadoop component,like Hive, Pig, Impala, Oozie, Solr, Sqoop2, HBase...
2
VIEW FROM30K FEET
Hadoop Web Server You and eventhat friend
that uses IE9 ;)
3
ECOSYSTEM
PIGJO
B BROWSER
JOB DESIG
NER
OOZIE
HIVE IMPA
LA
METASTO
RE BROWSERSEARCH
HBASE BROWSER
SQOOP
ZOOKEEPERUSER ADMIN
DB QUERY
SPARK
HOME ...
GUI DESIG
N
FILE BROWSER
USER
USER WORKFL
OWS
USER
4
TARGETOF HUE
GETTING STARTED WITH HADOOP
BEING PRODUCTIVE EXPLORING DIFFERENT ANGLES OF THE PLATFORM
LET ANY USER FOCUS ON BIG DATA PROCESSING
BEING COMPATIBLE WITH ANY HADOOP VERSION (0.20/1.2.0/2.3.0)
5
OPEN SOURCE
2560+ COMMITS
31 CONTRIBUTORS
477 STARS
157 FORKS
github.com/cloudera/hue
6
THE CORETEAM PLAYERS
team.gethue.com
ABRAHAM ELMAHREK
ROMAIN RIGAUX
ENRICO BERTI
CHANG BEER
7
GROWINGCOMMUNITY
0
125
250
375
500
Posts
Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov
0
17.5
35
52.5
70
Topics
hue-‐user@
8
HISTORY
HUE 1
Desktop-‐like in a browser, did its job but preGy slow, memory leaks and not very IE friendly but definitely advanced for its Kme (2009-‐2010).
9
HISTORY
HUE 2
The first flat structure port, with TwiGer Bootstrap all over the place.
10
HISTORY
HUE 2.5
New apps, improved the UX adding new nice funcKonaliKes like autocomplete and drag & drop.
11
HISTORY
HUE 3 ALPHA
Proposed design, didn’t make it.
12
HISTORY
HUE 3
TransiKon to the new UI, major improvements and new apps.
13
HISTORY
HUE 3.5
Where we are now, new UI, several new apps, the most user friendly features to date.
14
BIG DATA MEANS HARDER SEARCH PROBLEMS.
HBASE APPLICATION DEVELOPMENT WOES.
UNDERSTANDING DATA BETTER.
15
HBASE BROWSERPROBLEMS
LACK OF ACCESSIBILITY
LACK OF FAMILIARITY
USABILITY CHALLENGES
16
HBASE BROWSERDESIGN CHALLENGES
PROBLEM
HBase is a key-‐value store, not a tradiKonal RDB
SOLUTION
Collapse Sparse Data across HBase Tables
17
HBASE BROWSERFLEXIBLE SEARCH BAR
PROBLEM
Need high-‐level tool for complex data fetching & analysis
SOLUTION
Simple custom query languageSupports HBase filter languageSupports selecKon & Copy + Paste, gracefully degrades in IEAutocomplete Help Menu
Row$Key$
Scan$Length$
Prefix$Scan$
Column/Family$Filters$
Thri=$Filterstring$
Searchbar(Syntax(Breakdown(
18
HBASE BROWSERDOES IT SCALE?PROBLEM
Performance on Millions of Columns
SOLUTION
Lazy loading & TruncaKon using Thri` FilterStringStream raw data cached MEM > DOM elements dynamically generatedb64encode binary data to preserve during ASCII dumpDetect schema on preview reading byte headersCapped, Lazy Loaded & Bound to DOM via MVVM PaGern
IT DOES.
19
ZOOKEEPER BROWSER
TECHNICAL DETAILS
Communicate with Contrib. REST APIView Node StatsView and Edit Node DataAnd and Remove ZNodes
20
QUERY HBASEWITH HIVE
HIVE EDITOR
21
QUERY HBASEWITH PIG
PIG EDITOR
22
INDEX HBASEAND SEARCH IT
HUE
LILY INDEXER
CLOUDERA SEARCH
23
DEMO TIME
24
MISSEDSOMETHING?
learn.gethue.com
25
WHAT’S MISSING?
Use of Thri` interface over REST interface for HBase Browser
You tell us!KerberosSSLHBASE-‐8818 Thri` V2 Please!
SECURITY STARGATE? ANYTHING ELSE?
26
LINKS
WEBSITE
hGp://gethue.com
BLOG
hGp://blog.gethue.com
@gethue
USER GROUP
hue-‐user@
27
GET HUE
Try in advance the latest and greatest but you’ll have to configure everything on your own.
Get to play with Hue and various Hadoop components in 5 minutes. It’s a self contained CDH environment ready to use.
Newer version than HDP, close to the original 2.5 minus apps like HBase, Impala, Sqoop, Search.
The newest addiKon, ships Hue 3.0 through the GreenBuGon products.
Stable and highly tested releases perfectly integrated with the Hadoop ecosystem, automagically configured by Cloudera Manager.
In HDP there’s an old forked version of Hue 2.3.
CLOUDERA’S CDH TARBALL CLOUDERA’S DEMO VM
HORTONWORKS* MAPR* HP CLOUD*
* YOUR MILEAGE MAY VARY.
28
WHAT ARE YOUR USE CASES?
WHICH COMPONENTS DO YOU USE?
WHAT WOULD YOU LIKE TO SEE IN HUE?
INTERESTED IN CONTRIBUTING? WANNA SAY HELLO? DO YOU WANT A TAILOR
MADE TEAM RETREAT?
29