Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
Module Human Resource Management
logoTBD
Gerrit MullerUniversity of South-Eastern Norway-NISE
Hasbergsvei 36 P.O. Box 235, NO-3603 Kongsberg Norway
Abstract
The module Human Resource Management addresses the HRM aspects of systemsarchitects, such as the profile of an architect, selection, education, appraisal andmotivation.
DistributionThis article or presentation is written as part of the Gaudí project. The Gaudí project philosophy is to improveby obtaining frequent feedback. Frequent feedback is pursued by an open creation process. This document ispublished as intermediate or nearly mature version to get feedback. Further distribution is allowed as long as thedocument remains complete and unchanged.
All Gaudí documents are available at:http://www.gaudisite.nl/
version: 1.0 status: planned September 1, 2020
Contents
1 Function Profiles; The Sheep with Seven Legs 11.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11.2 Systems Architect Profile . . . . . . . . . . . . . . . . . . . . . . 2
1.2.1 Most discriminating characteristics . . . . . . . . . . . . 21.3 Test Engineer Profile . . . . . . . . . . . . . . . . . . . . . . . . 31.4 Developer Profile . . . . . . . . . . . . . . . . . . . . . . . . . . 41.5 Operational Leader Profile . . . . . . . . . . . . . . . . . . . . . 41.6 Line Manager Profile . . . . . . . . . . . . . . . . . . . . . . . . 41.7 Commercial Manager Profile . . . . . . . . . . . . . . . . . . . . 51.8 Definition of Characteristics . . . . . . . . . . . . . . . . . . . . 5
1.8.1 Interpersonal skills . . . . . . . . . . . . . . . . . . . . . 51.8.2 Know-how . . . . . . . . . . . . . . . . . . . . . . . . . 61.8.3 Reasoning Power . . . . . . . . . . . . . . . . . . . . . . 71.8.4 Executing Skills . . . . . . . . . . . . . . . . . . . . . . 81.8.5 Process Skills . . . . . . . . . . . . . . . . . . . . . . . . 81.8.6 Project Management Skills . . . . . . . . . . . . . . . . . 81.8.7 Commercial Skills . . . . . . . . . . . . . . . . . . . . . 91.8.8 Human Resource Management Skills . . . . . . . . . . . 9
1.9 Acknowledgements . . . . . . . . . . . . . . . . . . . . . . . . . 10
2 How to appraise or assess an architect? 112.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112.2 When is the architect successful? . . . . . . . . . . . . . . . . . . 122.3 How to assess the architect? . . . . . . . . . . . . . . . . . . . . 13
Chapter 1
Function Profiles; The Sheep withSeven Legs
co
mm
un
ica
tio
n
tea
mw
ork
do
cu
me
nta
tio
n
mu
ltita
skin
g
fle
xib
le, o
pe
n
au
tho
rity
by e
xp
ert
ise
sp
ecia
list
ge
ne
ralis
t
co
nce
ptu
al
pra
gm
atic
co
nstr
uctive
critica
l
fast a
bso
rptio
n o
f kn
ow
led
ge
cre
ativity
ma
nu
al skill
s
pro
ce
ss in
sig
ht
po
litic
al in
sig
ht
imp
rove
me
nt
co
mp
lete
ne
ss
cu
sto
me
r va
lue
sa
les fe
atu
res
co
mm
erc
ial in
sig
ht
co
ach
ing
se
lectio
n
ap
pra
isa
l
mo
tiva
tio
n
1
2
3
4
5
6
7
8
9
1
2
3
4
5
6
7
8
9
de
cis
ion
ma
kin
g
mo
nito
r p
rog
ress
sch
ed
ule
initia
l co
st
1.1 Introduction
Many human resource and line managers struggle with the questions:
• What people have the potential to become good system architects?
• How to select (potential) system architects?
Employees thinking about their careers might similarly wonder if they have thecapabilities to become a good systems architect.
We list a number of characteristics of individual humans. We map the thesecharacteristics on different jobs, such as system architect, developer, and line manager,indicating the relative importance of this characteristic for that job. We first discussthe different jobs and their typical characteristics in 1.2 to 1.7. Then we elaboratethe characteristics in 1.8.
The attention for this subject is increasing. Recent research is being carried outby Keith Frampton, see amongst others [1].
co
mm
un
ica
tio
n
tea
mw
ork
do
cu
me
nta
tio
n
mu
ltita
skin
g
fle
xib
le, o
pe
n
au
tho
rity
by e
xp
ert
ise
sp
ecia
list
ge
ne
ralis
t
co
nce
ptu
al
pra
gm
atic
co
nstr
uctive
critica
l
fast a
bso
rptio
n o
f kn
ow
led
ge
cre
ativity
ma
nu
al skill
s
pro
ce
ss in
sig
ht
po
litic
al in
sig
ht
imp
rove
me
nt
co
mp
lete
ne
ss
cu
sto
me
r va
lue
sa
les fe
atu
res
co
mm
erc
ial in
sig
ht
co
ach
ing
se
lectio
n
ap
pra
isa
l
mo
tiva
tio
n
1
2
3
4
5
6
7
8
9
1
2
3
4
5
6
7
8
9
de
cis
ion
ma
kin
g
mo
nito
r p
rog
ress
sch
ed
ule
initia
l co
st
Figure 1.1: The function profile of the systems architect
1.2 Systems Architect Profile
The profile of the “ideal” system architect shows a broad spectrum of requiredskills. Quite some emphasis in the skill set is on interpersonal skills, know-how,and reasoning power.
This profile is strongly based upon an architecting style of technical leadership,where the architect provides direction (know-how and reasoning power) as well asmoderates the integration (interpersonal skills).
The required profile is so requiring that not many people fit into it, it is a so-called sheep with seven legs. In real life we are quite happy if we have peopleavailable with a reasonable approximation of this profile. The combination ofcomplementary approximations of such ideal architect allows for the formationof architecture teams. Such a team of architects can come close to this profile.
1.2.1 Most discriminating characteristics
In practice the following characteristics are quite discriminating when selecting(potential) systems architects:
• Generalist
• Multi-tasking
• Authority by expertise
Gerrit MullerFunction Profiles; The Sheep with Seven LegsSeptember 1, 2020 version: 1.0
University of South-Eastern Norway-NISE
page: 2
• Balance between conceptual and pragmatic
Generalist The first reduction step is to select the generalists only, reducing theinput stream with one order of magnitude. The majority of people feels morecomfortable in the specialist role.
Multi-tasking The next step is to detect those people that need undisturbed timeand concentration to make progress. These people become unnerved in thejob of the systems architect, where frequent interrupts (meetings, telephonecalls, people walking in) occur all the time. Ignoring these interrupts isnot recommendable, this would block the progress of many other people.Whenever the people with poor multi-tasking capabilities become systemsarchitect, then they are in severe danger of stress and burn out. Hence it isalso the benefit to the person self to assess the multi-tasking characteristicfairly.
Authority by expertise The attitude of the (potential) architect is important forthe long term effectiveness. Architects who work on the basis of delegatedpower instead of authority by expertise are often successful on the shortterm, creating a single focus in the beginning. However in the long runthe inbreeding of ideas takes its toll. Architecting based on know-how andcontribution (e.g. authority by expertise) costs a lot of energy, but it paysback in the long term.
Conceptual thinking and pragmatic The balance between conceptual thinkingand being pragmatic is also rather discriminating. Conceptual thinking is amust for an architect. However the capability to translate these concepts inreal world activities or implementations is crucial. This requires a pragmaticapproach. Conceptual-only people dream up academic solutions.
1.3 Test Engineer Profile
The test engineer function at system level requires someone who feels and under-stands the system. Test engineers are capable of operating the system fluently andknow its quirks inside out.
The main difference between an architect and a test engineer is the differentbalance between conceptual thinking and practical doing. Test engineers oftenhave an excellent intuitive understanding of the system, however they lack theconceptual expression power and the communication skills to use this understandingpro-active, for instance to lead the design team.
Gerrit MullerFunction Profiles; The Sheep with Seven LegsSeptember 1, 2020 version: 1.0
University of South-Eastern Norway-NISE
page: 3
co
mm
un
ica
tio
n
tea
mw
ork
do
cu
me
nta
tio
n
mu
ltita
skin
g
fle
xib
le, o
pe
n
au
tho
rity
by e
xp
ert
ise
sp
ecia
list
ge
ne
ralis
t
co
nce
ptu
al
pra
gm
atic
co
nstr
uctive
critica
l
fast a
bso
rptio
n o
f kn
ow
led
ge
cre
ativity
ma
nu
al skill
s
pro
ce
ss in
sig
ht
po
litic
al in
sig
ht
imp
rove
me
nt
co
mp
lete
ne
ss
mo
nito
r p
rog
ress
cu
sto
me
r va
lue
sa
les fe
atu
res
co
ach
ing
se
lectio
n
ap
pra
isa
l
mo
tiva
tio
n
1
2
3
4
5
6
7
8
9
1
2
3
4
5
6
7
8
9
de
cis
ion
ma
kin
g
sch
ed
ule
initia
l co
st
co
mm
erc
ial in
sig
ht
Figure 1.2: The function profile of the test engineer
1.4 Developer Profile
The core value of developers is their specific discipline know-how. Good devel-opers excel in a limited set of specialties, knowing all tricks of the trade. On topof this they should be able to deploy this know-how in a creative way. In today’slarge development teams a reasonable amount of interpersonal skills are requiredas well as reasoning power and project management skills.
1.5 Operational Leader Profile
The operational leader, for instance a project leader, is totally focused on the result.This requires project management skills, the core discipline for operational leaders.
The multi-tasking capability is an important prerequisite for the operationalleader too. If this capability is missing the person runs a severe risk of getting aburn out.
Note also that the operational leader functions as kind of gatekeeper, where thecompleteness is important.
1.6 Line Manager Profile
The line manager manages the intangible assets of an organization: the people,the technology and the processes. Technology and process know-how are tightly
Gerrit MullerFunction Profiles; The Sheep with Seven LegsSeptember 1, 2020 version: 1.0
University of South-Eastern Norway-NISE
page: 4
co
mm
un
ica
tio
n
tea
mw
ork
do
cu
me
nta
tio
n
mu
ltita
skin
g
fle
xib
le, o
pe
n
au
tho
rity
by e
xp
ert
ise
sp
ecia
list
ge
ne
ralis
t
co
nce
ptu
al
pra
gm
atic
co
nstr
uctive
critica
l
fast a
bso
rptio
n o
f kn
ow
led
ge
cre
ativity
ma
nu
al skill
s
pro
ce
ss in
sig
ht
po
litic
al in
sig
ht
imp
rove
me
nt
co
mp
lete
ne
ss
mo
nito
r p
rog
ress
cu
sto
me
r va
lue
se
lectio
n
ap
pra
isa
l
mo
tiva
tio
n
1
2
3
4
5
6
7
8
9
1
2
3
4
5
6
7
8
9
de
cis
ion
ma
kin
g
co
mm
erc
ial in
sig
ht
sch
ed
ule
initia
l co
st
sa
les fe
atu
res
co
ach
ing
Figure 1.3: The function profile of the developer
coupled with people, this know-how largely resides in people and is deployed bypeople. Human resource management skills and process skills are the core disci-pline for line managers, which need to be supported with sufficient specialist know-how.
1.7 Commercial Manager Profile
The commercial manager needs a commercial way of observing and thinking. Thisway of thinking appears to be fuzzy and not logical for technology oriented people.From technology oriented perspective a strange mind warp is required to performa commercial manager function.
The commercial manager is a valuable complement to the other functions,responsible for aspects such as salability and value proposition.
1.8 Definition of Characteristics
1.8.1 Interpersonal skills
communication The ability to communicate effectively. Communication is a two-way activity, presenting information as well as receiving information is important.
teamwork The ability to work as member of a team, in such a way that the teamis more than the collection of individuals.
Gerrit MullerFunction Profiles; The Sheep with Seven LegsSeptember 1, 2020 version: 1.0
University of South-Eastern Norway-NISE
page: 5
co
mm
un
ica
tio
n
tea
mw
ork
do
cu
me
nta
tio
n
mu
ltita
skin
g
fle
xib
le, o
pe
n
au
tho
rity
by e
xp
ert
ise
sp
ecia
list
ge
ne
ralis
t
co
nce
ptu
al
pra
gm
atic
co
nstr
uctive
critica
l
fast a
bso
rptio
n o
f kn
ow
led
ge
cre
ativity
ma
nu
al skill
s
pro
ce
ss in
sig
ht
po
litic
al in
sig
ht
imp
rove
me
nt
co
mp
lete
ne
ss
mo
nito
r p
rog
ress
cu
sto
me
r va
lue
se
lectio
n
ap
pra
isa
l
mo
tiva
tio
n
1
2
3
4
5
6
7
8
9
1
2
3
4
5
6
7
8
9
de
cis
ion
ma
kin
g
co
mm
erc
ial in
sig
ht
sch
ed
ule
initia
l co
st
sa
les fe
atu
res
co
ach
ing
Figure 1.4: The function profile of the operational leader
documentation The ability to create clear, accessible and maintainable documen-tation in a reasonable amount of time.
multi-tasking The ability to work on many subjects concurrently, where (frequent)external events determine the task switching moments.
flexible, open The attitude to respect contributions of others, the willingness toshow all personal considerations, even if these are very uncertain, the willingnessto adopt solutions of others, even in case of strong personal opinions.
Note that this overall attitude does not mean that a flexible and open personalways adopts the ideas of others (chameleon behavior). The true strengthof this characteristic is to apply it when necessary, so adopt an alternativesolution if it is better.
authority by expertise The personality which convinces people by providing data,instead of citing formal responsibilities. Hard work is required before authorityby expertise is obtained; a good track record and trust have to be build up.Authority is earned rather than being enforced.
1.8.2 Know-how
In terms of characteristics the know-how is qualified in 2 categories, generalist andspecialist.
Gerrit MullerFunction Profiles; The Sheep with Seven LegsSeptember 1, 2020 version: 1.0
University of South-Eastern Norway-NISE
page: 6
co
mm
un
ica
tio
n
tea
mw
ork
do
cu
me
nta
tio
n
mu
ltita
skin
g
fle
xib
le, o
pe
n
au
tho
rity
by e
xp
ert
ise
sp
ecia
list
ge
ne
ralis
t
co
nce
ptu
al
pra
gm
atic
po
litic
al in
sig
ht
imp
rove
me
nt
co
mp
lete
ne
ss
mo
nito
r p
rog
ress
cu
sto
me
r va
lue
sa
les fe
atu
res
co
mm
erc
ial
insig
ht
co
ach
ing
se
lectio
n
ap
pra
isa
l
mo
tiva
tio
n
1
2
3
4
5
6
7
8
9
1
2
3
4
5
6
7
8
9
de
cis
ion
ma
kin
g
sch
ed
ule
initia
l co
st
fast a
bso
rptio
n o
f kn
ow
led
ge
co
nstr
uctive
critica
l
ma
nu
al skill
s
cre
ativity
pro
ce
ss in
sig
ht
Figure 1.5: The function profile of the line manager
Generalist The persons which are always interested in the neighboring areas, howdoes it fit in the context? How does the “whole” work.
Specialist The persons which are always interested in knowing more detail.
1.8.3 Reasoning Power
conceptual The ability to create the overview, to abstract the concepts from detaileddata. The ability to reason in terms of concepts.
pragmatic The ability to accept non-ideal solutions, to go after the 80% solution.The ability to connect ”fuzzy” concepts to real world implementations.
constructive critical The ability to identify problems, formulate the problems andto trigger solutions. The term critical thinking is also used. Note that criticsserves a constructive goal: to achieve better results.
fast absorption of know-how The ability to jump into a new discipline and toabsorb the required know-how in a short time. Systems architect are neverable to know all about the technologies used in the systems. This capabilityhelps them to get the right knowledge when needed.
creativity The ability to come with new, original ideas. A specific subclass of thisability is lateral thinking: applying know-how from entirely different areason the problem at hand.
Gerrit MullerFunction Profiles; The Sheep with Seven LegsSeptember 1, 2020 version: 1.0
University of South-Eastern Norway-NISE
page: 7
co
mm
un
ica
tio
n
tea
mw
ork
do
cu
me
nta
tio
n
mu
ltita
skin
g
fle
xib
le, o
pe
n
au
tho
rity
by e
xp
ert
ise
sp
ecia
list
ge
ne
ralis
t
co
nce
ptu
al
pra
gm
atic
co
nstr
uctive
critica
l
fast a
bso
rptio
n o
f kn
ow
led
ge
po
litic
al in
sig
ht
imp
rove
me
nt
co
mp
lete
ne
ss
cu
sto
me
r va
lue
sa
les fe
atu
res
co
mm
erc
ial in
sig
ht
co
ach
ing
se
lectio
n
ap
pra
isa
l
mo
tiva
tio
n
1
2
3
4
5
6
7
8
9
1
2
3
4
5
6
7
8
9
de
cis
ion
ma
kin
g
mo
nito
r p
rog
ress
sch
ed
ule
initia
l co
st
ma
nu
al skill
s
cre
ativity
pro
ce
ss in
sig
ht
Figure 1.6: The function profile of the commercial manager
1.8.4 Executing Skills
Manual Skills The ability to do things, for instance build or test something. Thisability is complementary to the many ”mental” skills in this list of character-istics.
1.8.5 Process Skills
process insight The ability to understand specific processes, the ability to recognizethe de facto processes, the ability to asses formal and de facto processes, boththe strong points as well as the weak points.
politics insight The ability to recognize the political factors: persons, organiza-tions, motivations, power. The ability to use this information as neutralizingforce “depoliticizing”: facts and objectives based decision making instead ofpower based decision making.
improvement drive The ever present drive to improve the current situation, nevergetting complacent.
1.8.6 Project Management Skills
Completeness The ability to pursue all information. This is often done by meansof spreadsheets or databases. Large collections of issues are maintained andprocessed.
Gerrit MullerFunction Profiles; The Sheep with Seven LegsSeptember 1, 2020 version: 1.0
University of South-Eastern Norway-NISE
page: 8
This ability is often complementary to, or even conflicting with, the ability tocreate understanding and overview: the parts view versus the holistic view.
schedule The ability to create schedules: activities and resources with their relation-ships, scheduled in time.
monitor progress The ability to monitor progress, the ability to chase people, andthe ability to find and resolve the causes of delays.
initial cost The ability to create initial cost estimates and to refine these into budgets.The ability to understand and reason in terms of initial costs. Initial costs arethe one time investments needed to develop new products and or businesses.
decision making The ability to make choices and to handle the consequences ofthese choices.
1.8.7 Commercial Skills
customer value The ability to see and understand the value of a product or servicefor a customer. The ability to asses the value for the customer.
sales feature The ability to recognize features needed to sell the product. Theability to characterize the relevant characteristics of these features (“tick-mark only”, “competitive edge”, “show-off”, et cetera).
commercial insight The ability to think in commercial terms and concepts, rangingfrom “branding” to “business models”.
1.8.8 Human Resource Management Skills
coaching The ability to coach other people; help other people by reflection, bystimulating independent thinking and acting.
selection The ability to select individuals for specific jobs. The ability to interviewpeople and to asses them.
appraisal The ability to asses employees and to communicate this assessment ina fair and balanced way.
motivation The ability to make people enthusiastic, to motivate them beyondnormal performance.
Gerrit MullerHow to appraise or assess an architect?September 1, 2020 version: 0.1
University of South-Eastern Norway-NISE
page: 9
1.9 Acknowledgements
Pierre America applied fine tuning of translations, spelling and capitols. LennartHofland suggested an improvement for the description of the commercial manager.Sjir van Loo suggested an increase of coaching and selection skills of the architect.Keith Frampton pointed me to recent research about this subject.
Gerrit MullerHow to appraise or assess an architect?September 1, 2020 version: 0.1
University of South-Eastern Norway-NISE
page: 10
Chapter 2
How to appraise or assess anarchitect?
John Brown
(product
architect)
Jim Green
(family architect)
Yo Nerd(SW engineer)
Joe Go
(project leader)
D. Blackhat (product
architect)
po
ten
tia
l
Ju Nior (product
architect)
Se Nior(chief designer)
The Boss
(business
manager)
valu
e fo
r th
e co
mp
any
1 ask for ranking
2 ask for justification
(why ...?)
3 clarify criterions
4 iterate ranking and
justification
very high
low
2.1 Introduction
The responsibilities of system architects are ill defined. Either the responsibilitiesoverlap significantly with other players in the Product Creation Process, or theresponsibilities are very abstract and vague (not specific and measurable), see [3].
- difficult to define yardstick
- difficult to measure
- difficult to compare
- difficult to certify
- difficult to translate in (financial) consequences
abstract (vague) responsibilities
lot of overlap of responsibilities
How to assess an architect?
Figure 2.1: The function of an architect is difficult to evaluate
Figure 2.1 provides the problem statement: How to asses the architect, when itis difficult to define a yardstick, measurements, comparisons, or certifications due
to the ill defined responsibilities. The financial remuneration, which is normallybased on measurements and comparisons also becomes very difficult.
Section 2.2 formulates the success criterions for architects. These criterionsare used in section 2.3 to describe an assessment method.
2.2 When is the architect successful?
In [3] the deliverables, responsibilities and activities of the system architect arediscussed. Figure 2.2 summarizes this article. The deliverables of the architectare abstract paperwork or electronic information, no tangible modules or systems.The primary responsibilities are not easily measured: how sound (balanced, welldecomposed, consistent, et cetera) is the system specification and design? Thearchitect is spending most of his time on activities which do not result in one ofthe deliverables and most of the activities do not directly contribute to the primaryresponsibilities. However all of these activities are indispensable for the role of thearchitect and together ensure the architecture quality.
V4aa
IOIdea
Bla Bla
system
subsystem
module
Requirement
Spec
Design
Realization
modules
Fun
ctio
nQuality
KISS
many very detailed
Activitiesnecessary but invisible
Responsibilitiesabstract and qualitative
Deliverablespaperwork only
Spec DesignReport
Re
po
rt
Report
Design
Design
Spec
Spec
Report
Re
po
rt
Report
repo
rt
spec
design
balance consistencydecomposition
integrationoverview simplicity integrity
thinking, talking, discussing, scheduling, presenting, measuring, writing, reviewing, visiting customers
analyzing, listening, brainstorming, supporting, teaching, testing, reading, visiting trade-shows
simulating, communicating, troubleshooting, selling, integrating, browsing, consolidating, visiting suppliers
Figure 2.2: Tangible deliverables based upon many invisible activities
Figure 2.3 shows the architecting function and the criterions for successfularchitecting. Architecting is the transformation of problem and solution know howand often an already existing architecture into a new architecture. This processtakes place in the context of many stakeholders, with their expectations, needs,concerns and constraints. The architecting is done by the product creation team(project leader, engineers, product manager and the system architect), although thearchitect should take the lead in this process.
The architect has played his role successful if the 2 criterions which are shownare fulfilled:
• the resulting architecture satisfies the stakeholders
• the architect has enabled the product creation team by leading the archi-tecting process.
Gerrit MullerHow to appraise or assess an architect?September 1, 2020 version: 0.1
University of South-Eastern Norway-NISE
page: 12
preceeding architecture
Architecting
architecture
Stakeholdersexpectations, needs,
concerns, constraints
PCP team
architect, project leader,
engineers,
product manager
problem know how
solution know how
legenda
business context
technology
context
human context
result
satisfies
team
isen
able
dFigure 2.3: Criterions for successful architecting
2.3 How to assess the architect?
The criterions discussed in section 2.2 must be explored in order to facilitate theassessment of the architect. Most appraisal systems are based on formalized yardsticks,such as the (generic) function appraisal system, the (specific) job description andthe (also specific) personal career development plan.
formalized expectations actual architect performance
function appraisal system,f.i. from Hay Management Consultants
impact
scope of control
freedom of thinking
job descriptiondeliverables
timing
career development planskills
know how
architecture fitness
sales turnover
business success
market continuity
internal stakeholder satisfaction
contribution
deliverables
timing
skills
know how
Figure 2.4: Yardsticks for architect assessment
Figure 2.4 shows the formal yardsticks at the left hand side. The main issuesaddressed in the yardsticks are also mentioned.
The function appraisal systems, such as defined by Hay Management, are basedon parameters as scope of control, impact and freedom of thinking. The Haymanagement system is calibrated over multiple companies, domains and functions,by the active participation of the Hay Management company.
The experience is that the architect function does not easily fit in this method.ASML has defined all their functions in this system, with a multiple ladder approachand were able to fit the system engineer function in an acceptable way in thismodel. Other companies are struggling more with the architect function, due to
Gerrit MullerHow to appraise or assess an architect?September 1, 2020 version: 0.1
University of South-Eastern Norway-NISE
page: 13
the problems described in section 2.1.The reference for the individual appraisal is the specific job description, which
defines the deliverables and the timing. Deliverables are a poor performance indicator,lots of paper is a sign of a bad architect! However a small amount of paper is notyet a sign of a good architect. Instead of measuring the deliverables the architecturefitness can be assessed, which in turn is a measure for the architecting contributionof the architect.
Complementary is the personal career development plan, which defines thedesired skills and know how. The measurement of skills and know how can bedone by assessing the internal stakeholder satisfaction.
The right hand side of figure 2.4 shows the actual architect performance, interms of architecture fitness and internal stakeholder satisfaction. The architecturefitness is characterized by parameters such as sales turnover, business success andmarket continuity. The internal stakeholder satisfaction is characterized by theopinion of the stakeholders of the architects role in terms of contribution, deliver-ables, timing, skills and know how.
architect
engineeroperational managermanufacturing, logistics, service
group leader
product manager project leader
colleague architect
Figure 2.5: 360 degree assessment
An informal 360 degree approach can be used to ”measure” the internal stake-holder satisfaction with respect to the architect. A subset (3 to 6) of internal stake-holders is interviewed, where the performance of the architect is discussed in termsof contribution, deliverables, timing, skills and know how, see figure 2.5.
The stakeholders to be interviewed should have had sufficient interaction withthe architect and should have complementary, somewhat overlapping viewpoints.By asking specific, but open questions, the role of the architect can be articulated.
Assessment is a relative act, in order to provide meaning to the input data,the data needs to be calibrated. This calibration can be done by comparing thearchitect being assessed with colleagues. It is useful to ask for a ranking withmultiple colleagues, both architects and non architects. The ranking question askedto the interviewees has mostly a trigger function: by forcing a one dimensionalcomparison the performance in different dimensions has to be combined in a single
Gerrit MullerHow to appraise or assess an architect?September 1, 2020 version: 0.1
University of South-Eastern Norway-NISE
page: 14
John Brown
(product
architect)
Jim Green
(family architect)
Yo Nerd(SW engineer)
Joe Go
(project leader)
D. Blackhat (product
architect)
po
ten
tia
l
Ju Nior (product
architect)
Se Nior(chief designer)
The Boss
(business
manager)
valu
e fo
r th
e co
mp
any
1 ask for ranking
2 ask for justification
(why ...?)
3 clarify criterions
4 iterate ranking and
justification
very high
low
Figure 2.6: Ranking as trigger for discussions
assessment figure.The relative position and the distance between ranked people will generate new
questions: ”Why do you think that Yo Nerd has a greater value than Se Nior?".Also the differences in ranking between interviewees gives a lot of insight in the(often implicit) criterions which are used by the interviewees, for instance: ”JuNior is highly valued by the engineer for his excellent technical solutions, whilethe product manager criticizes him for not listening to the customer”.
Gerrit MullerHow to appraise or assess an architect?September 1, 2020 version: 0.1
University of South-Eastern Norway-NISE
page: 15
Bibliography
[1] K. Frampton, J. M. Carroll, and J. A. Thom. What capabilities do IT architectssay they need? In 10th United Kingdom Academy for Information Systems(UKAIS) Proceedings, 2005.
[2] Gerrit Muller. The system architecture homepage. http://www.gaudisite.nl/index.html, 1999.
[3] Gerrit Muller. The role and task of the system architect. http://www.gaudisite.nl/RoleSystemArchitectPaper.pdf, 2000.
HistoryVersion: 1.0, date: March 25, 2004 changed by: Gerrit Muller
• created reader