36
1 Lee Tae Young

Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

1

Lee Tae Young

Page 2: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

2

Page 3: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

3

Page 4: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

4

Page 5: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

5

Big Data Data

Refinery

Data

Delivery Web

Services

Interface

Page 6: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

6

Command Line Interface

Core Spring Batch

Cluster Integration

Visual Rules Integration

Event Management Integration

Cluster

Registry

Artifact

Repository

Visual Rules Batch Platform

Page 7: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

7

branch

Main

Office

Batch Job

Processing

Mainframe

?

? ?

?

Page 8: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

8

Page 9: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

9

Web

HDFS

MR

HBASE

User

RHIVE HIVE

Nutch

Spring framework batch

JBOSS (WAS)

PIG

Page 10: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

10

Page 11: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

11

S

Page 12: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

12

S

Page 13: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

13

1 2

S

Page 14: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

14

1 2

Page 15: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

15

Page 16: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

16

C

Page 17: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

17

F

Page 18: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

18

F

Page 19: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

19

Page 20: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

20

~라도

~가

Page 21: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

21

N

Page 22: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

22

Page 23: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

23

Page 24: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

24

Page 25: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

25

Page 26: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

26

Page 27: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

27

Distribution

Based sampling

Probability

Distribution calc.

Sampler

Local Disk

Visualization

Reporting

Flow Designer

HDFS

Hadoop/Hive/Hbase

M/R R UDP

RServe TCP/IP

M/R R UDP

RServe TCP/IP

M/R R UDP

RServe TCP/IP

Export-R

R

rJava

R-Hive

Bridge

Hive

Client

R Studio

Ad-hoc analysis

Cleansing

Console

Page 28: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

28

Page 29: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

29

Page 30: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

30

Page 31: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

31

Page 32: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

32

Page 33: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

33

Page 34: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

34

Page 35: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

35

Page 36: Lee Tae Youngnexr.com/upload/legacy.pdf · 2020-04-16 · Based sampling Probability Distribution calc. Sampler Local Disk Visualization Reporting Flow Designer HDFS Hadoop/Hive/Hbase

36

branch

Main

Office

Batch Job

Processing

Mainframe

?

? ?

?