Upload
mk-kim
View
157
Download
1
Tags:
Embed Size (px)
Citation preview
2013.7
www.bicube.co.krBigdata Knowledge Discovery
BICube 2
ArchitectureArchitectureArchitectureArchitecture
Sqoop Flume
HDFS (Hadoop Distributed File System)
Zookeeper
Yarn(2.0)
MapReduce
HivePig
Mahout
Mashup
RDB
Preprocess Classify Cluster Associate Visual
BICube
RDB Mashup SNS Crawler
Authent ication
CubeM
anager
Log Crawler
Machine Learning Engine
Spark
SparkSQL
SparkStream GraphXML
Storm Kafka Akka
BioinfoManipul
Tachyon
Mesos
BICube 3
In-MomoryIn-MomoryIn-MomoryIn-Momory
In-memory MapReduce
BICube 4
Cross IndustryCross IndustryCross IndustryCross Industry
Domain Standard Analytics
Finance HealthCare Traffic Disaster
Logistics Security CRM Customer Document
Convergence
Images
BICube 5
Regression, MultiLinearRegression, KoreanMorphemeLogistic Regression, SVM, Adaboost, Neural Network RandomForest, NaiveBayssian, Timeseries AnalysisKmeans, LDA, HMM, PCA, SVD, CRF, TDACovariance, Correlation, ROC, LSA, EigenFace ImageCF Recommender, ConfusionMatrix, AUC Bagging, Wagging, ArcX4,LogitBoost,ModestAdaboostSAMME,BinaryClibration, IsonicCalibration...Discriminant Adaptive Nearist NeighborHierachical agglomerative clusteringKernel Recursive Least Square,Radial Base NetworkLocal scaled density base clustering, EMGaussianMixtureSequential minimum optimization,Dual coordinate Descent T-Test, F-Test, G-Test, Chi-square-Test Anova etc….
• Statistics and Machine Learning Algorithms on Mapreduce
• Run on Hadoop Distributed File System
• Run on Spark In-Memory Resilient Distributed Dataset
Main AlgorithmsMain AlgorithmsMain AlgorithmsMain Algorithms
BICube 6
Sentiment AnalysisSentiment AnalysisSentiment AnalysisSentiment Analysis
BICube 7
Sentiment AnalysisSentiment AnalysisSentiment AnalysisSentiment Analysis
BICube 8
Topic AnalysisTopic AnalysisTopic AnalysisTopic Analysis
Document-Topic Matirx ViewerDocument-Topic Matirx Viewer
BICube 9
Topic AnalysisTopic AnalysisTopic AnalysisTopic Analysis
Word-Topic Matirx ViewerWord-Topic Matirx Viewer
BICube 10
Similarity AnalysisSimilarity AnalysisSimilarity AnalysisSimilarity Analysis
BICube 11
Similarity AnalysisSimilarity AnalysisSimilarity AnalysisSimilarity Analysis
BICube 12
Word CloudWord CloudWord CloudWord Cloud
BICube 13
Social AnalysisSocial AnalysisSocial AnalysisSocial Analysis
BICube 14
Relation AnalysisRelation AnalysisRelation AnalysisRelation Analysis
BICube 15
Confusion MatrixConfusion MatrixConfusion MatrixConfusion Matrix
BICube 16
ClusteringClustering ClusteringClustering
3D Visualization on GPU3D Visualization on GPU
BICube 17
MBAMBA MBAMBA
BICube 18
CV on HadoopCV on Hadoop CV on HadoopCV on Hadoop
BICube 19
CV on HadoopCV on Hadoop CV on HadoopCV on Hadoop
BICube 20
OLAP ad-hocOLAP ad-hoc OLAP ad-hocOLAP ad-hoc
BICube 21
Geo AnalysisGeo Analysis Geo AnalysisGeo Analysis
BICube 22
PDF analysisPDF analysis PDF analysisPDF analysis
BICube 23
Neural NetworkNeural NetworkNeural NetworkNeural Network
Timeseries forcasting
Recurrent Neural Network Feedfoward Neural Network(Elman) Counterpropagation Neural Network
Hopfield Neural NetworkBoltzman Neural NetworkNeat Neural NetworkSom Neural NetworkArt 1 Neural NetworkBam Neural NetworkAdaline Neural Network
BICube 24
Log AnalysisLog Analysis Log AnalysisLog Analysis
BICube 25
Mash-up to BigdataMash-up to Bigdata Mash-up to BigdataMash-up to Bigdata
BICube 26
3D Visualization3D Visualization3D Visualization3D Visualization
PointCloud on GPU for Topological Data AnalysisPointCloud on GPU for Topological Data Analysis
BICube 27
Module Manager Add components by yourself–
DIY-ComponentDIY-ComponentDIY-ComponentDIY-Component
BICube 28
Process Manager- Process UI Design Manager
DIY-UIDIY-UIDIY-UIDIY-UI
BICube 29
Thank You ...