Embed Size (px)
Citation preview
Research Methods
Research Methods Outline
Introduction [3]Project Management [2]Experimental Computer Science [3]Role of Mathematics [1]Designing User Experiments [2]Qualitative Research [2]Writing [3]
Research Methods
Outline
Network AnalysisGantt ChartsRisk ManagementProject Control
4 3
A0 00 2
0 2
D0 02 7
2 7
C3 15 9
2 6 I1 112 14
11 13
J0 011 14
11 14G0 07 11
7 11
F2 19 12
7 10
H2 27 14
5 12
E1 06 12
5 11B1 03 6
2 5
5
4
3 6
2
7
2 3
Research Methods
What is Network Analysis?
Project tasks (activities):Are often interdependentBut need to be done in parallel for teamwork to be effective
Task networks are graphical depictions of task dependenceNetwork analysis is a project planning method that:
Determines the critical pathEstablishes “most likely” time estimatesCalculates boundaries to stop project slippage
Research Methods
History of Network Analysis
1958 PERT (Program Evaluation and Review Technique) used in U.S. Navy Polaris Missile Program1959 CPM (Critical Path Method) devised1960’s Massive U.S. Government Projects
Vietnam, Nuclear Power Plants, NASA ApolloRequired extensive Computer Aided planning and control
Research Methods
Terminology
Earliest Start/FinishEarliest a task can begin/end if all preceeding tasks are completed in the shortest time
Latest Start/FinishLatest a task can begin/end without delaying the minimum project completion time
Critical PathChain that determines overall project duration
Slack (Float)The amount of surplus time or leeway allowed while still retaining earliest project completion
Research Methods
Example: Task Network
Research Methods
Network Analysis
Tasks are shown as boxesSequence constraints are lines connecting the boxes
Activity Description
Earliest Start
Latest Start
Earliest Finish
Latest Finish
Total Float Free Float
Research Methods
Analysis: Step #1
Draw networkLabelling tasks in order (left to right, top to bottom)
A
D
C I
JG
F
H
EB
Research Methods
Analysis: Step #2
Write the estimated time for each activityCarry out a “forward pass”Fill in Earliest Start, Earliest Finish
A0 2
D2 7
C2 6 I11 13
J11 14G7 11
F7 10
H5 12
E5 11B2 5
5
4
3 6
2
7
4
2
3
3
Research Methods
Analysis: Step #3
Carry out a “backward pass”Fill in Latest Start, Latest Finish
A0 2
0 2
D2 7
2 7
C5 9
2 6 I12 14
11 13
J11 14
11 14G7 11
7 11
F9 12
7 10
H7 14
5 12
E6 12
5 11B3 6
2 5
5
4
3 6
2
7
4
2
3
3
Research Methods
Analysis: Step #4
Fill in Total FloatTime by which an activity may be delayed without affecting the final completion date
A00 2
0 2
D02 7
2 7
C35 9
2 6 I112 14
11 13
J011 14
11 14G07 11
7 11
F29 12
7 10
H27 14
5 12
E16 12
5 11B13 6
2 5
5
4
3 6
2
7
4
2
3
3
Research Methods
Analysis: Step #5
Fill in Free FloatAmount of time an activity can expand without affecting the start or finish of any other activity
FF = ES (next) – EF (current)
A0 00 2
0 2
D0 02 7
2 7
C3 15 9
2 6 I1 112 14
11 13
J0 011 14
11 14G0 07 11
7 11
F2 19 12
7 10
H2 27 14
5 12
E1 06 12
5 11B1 03 6
2 5
5
4
3 6
2
7
4
2
3
3
Research Methods
Analysis: Step #6
Critical PathThis path is the manager’s primary concern
A0 00 2
0 2
D0 02 7
2 7
C3 15 9
2 6 I1 112 14
11 13
J0 011 14
11 14G0 07 11
7 11
F2 19 12
7 10
H2 27 14
5 12
E1 06 12
5 11B1 03 6
2 5
5
4
3 6
2
7
4
2
3
3
Research Methods
Exercise: Network Analysis
Do network analysis for a joint research project
Task Duration
Depend.
L: Literature Review 6
P: Research Proposal 8 L
I1: Implementation (Phase 1)
12 L
I2: Implementation (Phase 2)
8 I1
I3: Implementation (Phase 3)
14 P
X: Experimental Analysis 5 I2, I3
R1: Report (Background) 10 L
R2: Report (Results) 10 R1, X
Research Methods
Solution: Network Analysis
L
R1
I1 X
R2
I2
I3P
10
12
8 14
56 8
10
Graph and Label
Research Methods
Solution: Network Analysis
L0 6
R16 16
I16 18 X28 33
R233 43
I218 26
I314 28P6 14
10
12
8 14
56 8
10
Earliest Start/Finish
Research Methods
Solution: Network Analysis
L0 6
0 6
R123 33
6 16
I18 20
6 18 X28 33
28 33
R233 43
33 43
I220 28
18 26
I314 28
14 28P6 14
6 14
10
12
8 14
56 8
10
Latest Start/Finish
Research Methods
Solution: Network Analysis
L00 6
0 6
R11723 33
6 16
I128 20
6 18 X028 33
28 33
R2033 43
33 43
I2220 28
18 26
I3014 28
14 28P06 14
6 14
10
12
8 14
56 8
10
Total Float
Research Methods
Solution: Network Analysis
L0 00 6
0 6
R117 1723 33
6 16
I12 08 20
6 18 X0 028 33
28 33
R20 033 43
33 43
I22 220 28
18 26
I30 014 28
14 28P0 06 14
6 14
10
12
8 14
56 8
10
Free Float
Research Methods
Solution: Network Analysis
L0 00 6
0 6
R117 1723 33
6 16
I12 08 20
6 18 X0 028 33
28 33
R20 033 43
33 43
I22 220 28
18 26
I30 014 28
14 28P0 06 14
6 14
10
12
8 14
56 8
10
Critical Path
Research Methods
Outline
Network AnalysisGantt ChartsRisk ManagementProject Control
Research Methods
History of Gantt Charts
Developed by Henry L. Gantt in 1917Widely used for WW1 ship buildingBelow: an early precursor (1910) showing productivity of workers in a sewing factory
Red = idle, black = productive
Research Methods
Gantt Charts
Horizontal Bar Charts:Horizontal axis represents project time spanVertical axis represent project tasks
Capture:Task completionSimple dependenciesMilestones and Deliverables
Don’t handle complex task dependenciesExtensively supported by automated scheduling tools
E.g., Microsoft Project
Research Methods
Milestones and Deliverables
Milestone:Recognisable end-product of a taskRequires a formal, measurable output“Coding 80% complete” is not adequate
Deliverable:A project result that is delivered to the customer (supervisor)Milestones are not always deliverables. Can be internal
Research Methods
Before Project
Major project deliverables listed in bold and capped with a diamond
Major project deliverables listed in bold and capped with a diamond
Arrows represent dependenciesArrows represent dependencies
The timeline provides a chronological referenceThe timeline provides a chronological reference
Activity bars represent activity duration - the longer the bar, the longer the duration
Activity bars represent activity duration - the longer the bar, the longer the duration
Research Methods
During ProjectCurrent date represented by a dotted vertical lineCurrent date represented by a dotted vertical line
Bars filled to show progressBars filled to show progress
Colour-coding assigns tasks to team membersColour-coding assigns tasks to team members
Research Methods
Outline
Network AnalysisGantt ChartsRisk ManagementProject Control
Research Methods
Managing Research Risks
Why?Research projects have a high level of uncertaintyBetter to anticipate problems in advance
How?Identify specific risks to the projectAnalyze the risksRank them in a particular orderPlan for monitoring, mitigation, managementRevisit during project
Research Methods
Some Typical Research Risks
Solving the wrong problemTrying to hit a moving targetDifficulties with data collectionOverlooking previous workBeing blindsided by the competitionMisinterpreting resultsContravening research conventionsOutside interruptions (e.g., ill-health)
Research Methods
Risk Matrix
Sort risk by a combination of:Probability (high, medium, low)Impact - catastrophic (project failure), critical (massive delay), marginal, negligible
Probability
Low Medium
High
Impact
Catastrophic
C B A
Critical D C B
Marginal E D C
Negligible F E D
Research Methods
3M’s
Mitigation:How can we avoid or reduce the risk?
Monitoring:What factors can we track that will enable us to determine if the risk is becoming more or less likely?
Management:What contingency plans do we have if the risk becomes a reality
Research Methods
Risk Examples
Turnover in research programmers
Postgraduate students fail to meet research objectives
Risk Condition
Consequence
Mitigation Monitoring
Manage-ment
Up-date
High turnover in prog-rammers
Costs and delays in replacing, loss of knowledge capital
Performance incentives, SE procedures to distribute knowledge
Six monthly employee reviews
Recruit replac-ement, transfer skills once notice given
…
Students fail to complete research
Delays while alternative research is undertaken
Memoran-dum of understand-ing, research proposal
Regular supervision& monthly present-ations
Reallocate research to post-docs or staff
…
Research Methods
Outline
Network AnalysisGantt Charts
DevelopProposal
ProjectManager
DevelopProjectPlan
Revisit Risk List
StaffProject
EvaluateIteration
ExecuteIteration
Plan
DevelopIteration
Plan
IdentifyRisks
Risk ManagementProject Control
Research Methods
Planning vs. Management
PlanningPre- and post-Network analysis, resourcing, risks, schedule
ManagementDuringControlling resources and timescales
PLANNINGMANAGEMENT
Research Methods
Some Tips on Project Control
Remember to update planning documentsShow progress in Gantt ChartReassess risks
Use an iterative life-cycleResearch is often exploratory - well suited to prototypesResearch can require complex algorithms - avoid the monolithResearch often builds on previous work and may itself be extended
