5
 Abinitio | Question 193 of 193 Print Phase verses Checkpoint Difference between a phase and checkpoint as far as i know it something related with how temporary files containing the data landed to disk is handled. that is phases are used to break u p a graph so that it do es not use up all the memory , it reduce the no of component running in parallel hence improves the performances (used for performance fine tuning, by managing the resource in perfect manner) Check points are used for the purpose of recovery. To tal Answers and Comments: 6 Last pdate! "pril #$, %&&' "sked by! sito!dsilva  est ated "nswer  *  "ubmitted b#! abhi+fresh+as+dew  hases are used in case to u se the resources such as memory, disk space, and C cycles for the most demanding part of the -ob.ay, we have memory consuming components in the straight flow and the data in flow is in millions,we can separate the  process out in one phase so as the cpu allocation is more for the process to consume less time for the whole process to get over. /n contrary, Checkpoints are like save points while we play a C game.0hese are re1uired if we need to run the graph from the saved last phase recover y file(phase break checkpoint) if it fails u ne2pectedly. se of phase breaks which includes the checkpoints would degrade the performance but ensures save point run.0oggling Checkpoints could be helpful for removing checkpoints from phase break. "eptember $%& '$$( $$:3$:1)  *1 

Abinitio Interview

Embed Size (px)

Citation preview

Page 1: Abinitio Interview

8/11/2019 Abinitio Interview

http://slidepdf.com/reader/full/abinitio-interview 1/5

Abinitio | Question 193 of 193 Print

Phase verses CheckpointDifference between a phase and checkpoint as far as i know it something related withhow temporary files containing the data landed to disk is handled.that is phases are used to break up a graph so that it does not use up all the memory , itreduce the no of component running in parallel hence improves the performances (usedfor performance fine tuning, by managing the resource in perfect manner)

Check points are used for the purpose of recovery .

Total Answers and Comments: 6 Last pdate! "pril #$, %&&' "sked by!si to!dsilva

est ated "nswer *

"ubmitted b# ! abhi+fresh+as+dew

hases are used in case to use the resources such as memory, disk space, and Ccycles for the most demanding part of the -ob. ay, we have memory consuming

components in the straight flow and the data in flow is in millions,we can separate the process out in one phase so as the cpu allocation is more for the process to consume less

time for the whole process to get over.

/n contrary,Checkpoints are like save points while we play a C game.0hese arere1uired if we need to run the graph from the saved last phase recovery file(phase break

checkpoint) if it fails une2pectedly.

se of phase breaks which includes the checkpoints would degrade the performance butensures save point run.0oggling Checkpoints could be helpful for removing checkpoints

from phase break.

"eptember $%& '$$($$:3$:1)

*1

Page 2: Abinitio Interview

8/11/2019 Abinitio Interview

http://slidepdf.com/reader/full/abinitio-interview 2/5

chandu'34' +ember "ince: "eptember '$$( Contribution:

1

,-: Phase verses Checkpoint

hase does not create temp files in the host directory whereas checkpoint creates .tempfile in host directory of the operating system.

.s this answer useful/ 0es 5 o

2ctober 1(& '$$( $1: ):1$

*'

ravula sudheer +ember "ince: 2ctober '$$( Contribution:

)

,-: Phase verses Checkpoint

hase is a stage in a graph that runs before staratup of ne2t stage.Check point is intermediate stoping point of the graph to save guard against failure.

e can arrange phase without check points.e dont assign checkpoint without phases.

0hankusudheer

.s this answer useful/ 0es 5 o

ovember 1%& '$$($):4$:'9

*3

sidharth sharma +ember "ince: ovember '$$( Contribution:

Page 3: Abinitio Interview

8/11/2019 Abinitio Interview

http://slidepdf.com/reader/full/abinitio-interview 3/5

1

,-: Phase verses Checkpoint

0he ma-or difference between these to is that phasing deletes the intermediate files madeat the end of each phase as soon as it enters the ne2t phase. 7n the other hand whatcheckpointing does is...it stores these intermediate files till the end of the graph. 0hus wecan easily use the intermediate file to restart the process from where it failed. ut thiscannot be done in case of phasing.

.s this answer useful/ 0es 5 o

5ecember 11& '$$($4:1':$3

*

abhi+fresh+as+dew +ember "ince: "eptember '$$( Contribution:

11

,-: Phase verses Checkpoint

hases are used in case to use the resources such as memory disk space and C cyclesfor the most demanding part of the -ob. ay we have memory consuming components inthe straight flow and the data in flow is in millions we can separate the process out inone phase so as the cpu allocation is more for the process to consume less time for thewhole process to get over.

/n contrary Checkpoints are like save points while we play a C game.0hese are re1uiredif we need to run the graph from the saved last phase recovery file(phase breakcheckpoint) if it fails une2pectedly.

se of phase breaks which includes the checkpoints would degrade the performance butensures save point run.0oggling Checkpoints could be helpful for removing checkpointsfrom phase break.

Page 4: Abinitio Interview

8/11/2019 Abinitio Interview

http://slidepdf.com/reader/full/abinitio-interview 4/5

"bhisek .fresh as dew8

.s this answer useful/ 0es 5 o 1 $

7verallating! 61

April $%& '$$9 $%: 3: ' *4 annegrace# +ember "ince: Au7ust '$$( Contribution:

14

,-: Phase verses Checkpoint

"bove 9D: version #.; checkpoint is automatic.

hasing is when you design the graph it should not have more than %& components. /nthat particular phase the component in that phase will alone run.

Check point is also associated with phasing. e can see a blue color block filled aroundthe phasing that is check point. hen the e2ecution of the graph is interrupted and it hasfetched #& &&& record. when you re<run the graph it will ask for option restart orcontinue. o checkpoint is used to run the graph from where its interrupted.

.s this answer useful/ 0es 5 o

,-: Phase verses Checkpoint

hase is breaking the graph into different block. /t create some temp file while runningand deletes it once the completion is done.

Checkpoint is used for recovery purpose. when the graph is interrupted instead ofrerunning the graph from the start. the e2cution starts from the stop where it is stopeed

Page 5: Abinitio Interview

8/11/2019 Abinitio Interview

http://slidepdf.com/reader/full/abinitio-interview 5/5