46
POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION OF PHASE 1: POE PROTOCOL DEVELOPMENT Prepared by: KEEN ENGINEERING 116 - 930 West First Street North Vancouver, BC V7P 3N4 Ph: (604) 986-5336 Fax: (604) 980-3747 Contact: Rosie Hyde, P.Eng., Ph.D. [email protected]

POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

POST OCCUPANCY EVALUATION PROJECT REPORT

COMPLETION OF PHASE 1: POE PROTOCOL DEVELOPMENT

Prepared by:

KEEN ENGINEERING

116 - 930 West First Street

North Vancouver, BC V7P 3N4

Ph: (604) 986-5336

Fax: (604) 980-3747

Contact:Rosie Hyde, P.Eng., Ph.D. [email protected]

Page 2: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Preface

i

FUNDERS:

Industry Canada

Terasen Gas

Clivus Multrum Inc.

Page 3: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Preface

ii

RATIONALE FOR POST-OCCUPANCY EVALUATION PROJECT:SUSTAINABILITY AND COMPETITIVENESS

Excellence in Canada’s building design community has the potential to protectthe environment, contribute to better living and working conditions for everyone inCanada, and become an influential component of Canada’s exported services. Asustainable built environment needs to provide good indoor environmental qualitywhile minimizing use of resources. Better, more sustainable building designpractices can be developed by evaluating the success of existing buildings andincorporating lessons learned into new building projects.

The process of evaluating buildings (POE) is not presently in widespread use inCanada. To increase the use of POE and the uptake of lessons from POEs,three things are required: a practical POE protocol needs to be developed, theprotocol needs to be piloted with input from the design community to ensure thatit is extracting information in a form that can be used by designers, and thefindings of completed POEs need to be made available to all designers.

Use of POE offers the following sustainability and competitiveness benefits toCanada:

1) Sustainability: improving building energy performance through evaluation andfeedback to designers can reduce building energy consumption and free upresources to be committed to more sustainable activities.

2) 2) International economic competitiveness in general: improving occupantcomfort in buildings through evaluation and feedback to designers cancontribute to better productivity in our nation’s buildings, reducing thesubstantial economic impacts of absenteeism and building-related illness, andpromoting more focused, creative activities in our region’s workplaces.

3) International competitiveness of our nation’s building design industry: in themedium term, as learning from POEs becomes more widespread in theCanadian building design community, building design quality and reputationwill improve, giving Canada an edge in the international marketplace.

4) Local and international saleability of building design services: in the nearterm, Canadian building design reputation and marketing will be strengthenedby the development and use of a reliable, streamlined post-occupancyevaluation protocol which can be used to identify excellent buildingperformance and can be highlighted as evidence of a culture of continuousimprovement.

Page 4: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Preface

iii

POST-OCCUPANCY EVALUATION FEEDBACK PLAN

The overall goal of the Post-Occupancy Evaluation Project is to improve thedesign of buildings while minimizing their environmental impacts. By learningfrom the successes and deficiencies of built projects, as revealed through Post-Occupancy Evaluation, designers can strengthen their capacity to designbuildings with reduced energy and emissions and satisfactory occupant comfort.The project plan is in two phases: protocol development, and protocol pilotingwith concurrent and subsequent sharing of results through an evaluatededucational process.

Phase 1

Jan to March 2005: POE Protocol Development

Through a charrette process, a Post-Occupancy Evaluation Protocol for OfficeBuildings is developed.

Phase 2

April to Dec, 2005: POE Protocol Piloting and Formative Presentations

The Protocol is piloted on 6 office buildings in Canada. Piloting is doneconsecutively, with revisions to the Protocol as indicated by each successivePOE. For buildings with higher numbers of occupants (100+), two versions ofOccupant Satisfaction Survey component are tested and compared.

As results for each pair of POEs emerge, a total of three public presentations aremade to audiences of building designers to share the results, promote the use ofthe Protocol, and invite designers’ feedback on how the usefulness of theinformation from the POEs could be enhanced. Each presentation is evaluatedby attendees and suggestions for improvements are incorporated into thesubsequent presentations. The intention to track POE learnings is explicitlystated, and attendance at presentations is tracked in order to survey attendeeslater for uptake of POE information.

Jan to March 2006: Summative presentations about POEs, and evaluation

A presentation summarizing the overall experience of piloting the POE protocol isrepeated in five Canadian cities. Each presentation is evaluated by attendeesand suggested improvements are incorporated into subsequent presentations.

In March 2006, a market intelligence organization surveys 10% of attendees ateach of the presentations to assess uptake into design practice of the informationfrom the POE presentations.

Page 5: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

i

SCOPE OF THIS POST-OCCUPANCY EVALUATION PROTOCOL

This document presents a protocol for evaluating the performance of buildings inuse, an activity generically called Post-Occupancy Evaluation (POE). Theevaluation finds, collates and encourages reflection upon information about:

- building’s resource consumption (energy, water),

- occupant satisfaction with building (overall satisfaction, social capitaldevelopment1, thermal comfort, lighting, acoustic and indoor air quality,washroom usability),

- building operation experiences, and

- to what extent the building meets the design intention

The information is fed back to the design team and to the building designcommunity with the purpose of helping to improve design practice.

This protocol is presently in the piloting stage. It will be piloted on six buildings,and improvements will be incorporated into the protocol throughout and at theend of the pilot process, with planned subsequent release of the finalizedprotocol to the public domain for general use.

1 “…[S]ocial capital refers to connections among individuals – social networksand the norms of reciprocity and trustworthiness that arise from them.” (RobertPutnam 2000:19)

Page 6: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

ii

TABLE OF CONTENTS

Funders: .................................................................................................................i

Post-Occupancy Evaluation Feedback Plan ........................................................ iii

Scope of this Post-Occupancy Evaluation Protocol ...............................................i

INTRODUCTION TO POST-OCCUPANCY EVALUATION ................................. 1

Why do Post-Occupancy Evaluation of Buildings?.................................... 1

Why use this protocol ................................................................................ 2

How to use this protocol ............................................................................ 2

How this protocol was developed .............................................................. 5

POE Resources and References .............................................................. 6

POE Protocol Format ................................................................................ 7

POE Component 1: ................................................................................... 8

Kick-off discussion with Owner ....................................................... 8

POE Component 2: ................................................................................. 10

Kick-off discussion with design team ............................................ 10

POE Component 3: ................................................................................. 12

Energy Consumption and Demand Measurements ...................... 12

POE Component 4: ................................................................................. 14

Water Consumption Measurement ............................................... 14

POE Component 5: ................................................................................. 15

Information from building operator ................................................ 15

POE Component 6: ................................................................................. 17

Information from Occupants (through web-based survey) ............ 17

POE Component 7: ................................................................................. 19

Information from Occupants (Qualitative) ..................................... 19

POE Component 8: ................................................................................. 22

Washroom and Washroom Fixture Evaluation ............................. 22

POE Component 9: ................................................................................. 24

Indoor Air Quality Measurements ................................................. 24

POE Component 10: ............................................................................... 25

Page 7: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

iii

Lighting Measurements ................................................................ 25

POE Component 11: ............................................................................... 26

Acoustic Measurements ............................................................... 26

POE Component 12: ............................................................................... 27

Thermal Comfort Measurements .................................................. 27

POE Component 13: ............................................................................... 29

Wrap-up discussion with design team and occupant representatives...................................................................................................... 29

POE Component 14: ............................................................................... 30

Process Reflection and Conclusions ............................................ 30

APPENDIX A: POE REPORT OUTLINE............................................................ 31

APPENDIX B: INDOOR AIR QUALITY MEASUREMENTS............................... 32

APPENDIX C: THERMAL COMFORT MEASUREMENTS ................................ 35

APPENDIX D: LIGHTING MEASUREMENTS ................................................... 37

APPENDIX E: CBE BUILDING OPERATOR SURVEY...................................... 38

APPENDIX F: CBE OCCUPANT IEQ SURVEY................................................ 39

Page 8: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

1

INTRODUCTION TO POST-OCCUPANCY EVALUATION

Why do Post-Occupancy Evaluation of Buildings?

Sustainable building design aims to create buildings which minimize resourceuse while maintaining occupant satisfaction and, ideally, fostering vibrantsustainable communities. Success in sustainable building design cannot beconfirmed without doing Post-Occupancy Evaluation to determine both thebuilding's resource consumption in use, and the occupant and operatorexperience with the completed building project, as well as assessing socialcapital development associated with the building. Post-Occupancy Evaluationcan contribute to improvement in the built environment in several ways, including:

1. immediate fix: problems identified in the evaluated building are fixed,including, if necessary, providing operator and occupant education to improvebuilding operation.

2. designer learning: designers of the evaluated building, as well as otherdesigners, apply to future designs what they have learned from the buildingevaluation.

3. design guidelines: development or revision of design guidelines incorporateswhat is learned from Post-Occupancy Evaluation.

4. designer-user connection: building users and designers develop a moretrusting relationship, through being involved in POEs.

This particular POE Protocol was developed with the primary intention ofgathering data geared to informing designers about how to design more efficient,more comfortable buildings in the future.

In the long term, including Post-Occupancy Evaluation in the project budget forevery new building may be feasible. Each time this protocol is applied, the resultscan contribute to a database of evaluated buildings, which can be made availableto designers.

Page 9: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

2

Why use this protocol

Building researchers wishing to conduct Post-Occupancy Evaluations have anumber of existing protocols to choose from, in addition to the possibility ofcreating their own. Using one protocol for a series of evaluations offers uniformityof results. The advantages of using this protocol are as follows:

• this protocol is in the public domain, so it can be used by different members ofthe community and provides potential for comparing buildings across differentevaluators.

• this protocol was designed for North America and uses a North America-based occupant satisfaction survey

• this protocol is specifically directed at helping designers learn from operatorand occupant experiences with built projects

• this protocol is based on two generations of protocol development, and willcontinue to be improved through piloting it on six buildings

• this protocol incorporates suggestions for reflection on whether it hasidentified the most significant issues related to the building's performance inuse, and whether designers can learn from those issues.

Feedback from anyone applying this protocol would be welcomed [email protected].

How to use this protocol

This protocol is intended to be a guideline to help evaluators apply a reasonablyuniform procedure to each building evaluated. Some application considerationsfollow:

Who takes the lead on evaluation: At present there are no rigid cultural normswithin the construction industry for who takes the lead on getting Post-Occupancy Evaluations done. The driving force may be the building owner, thebuilding designers or a third party, for example a government agency or researchorganization. Similarly, there are no set patterns for where funding may beaccessed for Post-Occupancy Evaluation. The building owner, the designers(from marketing and/or professional development budgets), governmentagencies and research groups may assist.

Cost of evaluation: The goal for this protocol was to provide a thoroughevaluation for a modest price. The plan is to streamline the protocol through apiloting process designed to identify and retain the most useful questions andmeasurements. The streamlined protocol (next generation) will offer similarbenefits to this version, with a substantial decrease in cost.

Page 10: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

3

Choice of building: This protocol is designed for office buildings, because theyrepresent a large part of Canada’s building inventory and offer a clear connectionbetween indoor environmental quality and productivity/profitability. Since theprotocol serves the primary purpose of providing timely feedback to designerswith the intention of quickly improving design practice, there is an advantage inevaluating newer buildings rather than older ones. About one year of operation isneeded in order to accumulate experience with the building, including energy andwater consumption, and occupant comfort in different seasons.

Team expertise: To use this protocol, it is necessary to bring together a POEteam which includes experts qualified to make the measurements and analyzethe data sets suggested in the guideline. Each POE component contains anindication of the skill sets required in evaluators using the POE component.

Protocol flexibility: Every building is different, and every set of POE resultscontains some surprises. The protocol is written in an open-ended manner tosuggest directions of inquiry while leaving space for unanticipated outcomes.

Customization: The protocol permits changes to the occupant satisfactioncomponents to accommodate the differences that exist between buildings (forexample, different layouts, different types of spaces, different types of occupantsand occupant behaviour).

Required and optional components: Some of the POE components aremarked as optional, recognizing that there may be limitations on the funds orexpertise available. But a Post-Occupancy Evaluation should at a minimuminclude occupant satisfaction information and water and energy consumptioninformation.

Measuring and understanding water consumption is important since futurebuildings need to use less water and produce less sewage, because ofescalating shortages of water in many communities, as well as limitations toexisting water supply and wastewater removal infrastructure. Measuring andunderstanding energy consumption is important because of the need to reducegreenhouse gas emissions related to building energy use.

However, emphasis on water and energy performance needs to be balanced withattention to occupant satisfaction and social capital development, in order toensure that buildings provide comfortable and productive workspaces. Post-Occupancy Evaluation can contribute to design improvement both in reduced useof resources and increased productivity of occupants.

Web-based surveys: This protocol also integrates the use of two web-basedsurveys developed and administered by the Center for the Built Environment(CBE) at the University of California at Berkeley, California. One survey gathersinformation from building operators, the other gathers information from

Page 11: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

4

occupants. Use of these surveys is available from CBE for a fee. Moreinformation is available on the web site at www.cbe.berkeley.edu.

This protocol can be applied without the use of the CBE surveys. Operatorinterviews can be used to gather the same information as the Building Operatorsurvey, and interviews, focus groups or other surveys can gather informationfrom occupants about satisfaction. However, the CBE surveys were chosen to beintegrated in this protocol because of their availability, existing data set,reasonable cost, North American origin, amenability to customization, andpowerful data-filtering capabilities. It is expected that they will continue to beavailable and supported for several years.

The CBE occupant satisfaction survey consists of a core survey with additionalmodules which can be included as requested. The survey is customized bydiscussing with CBE’s research staff the specific features of the building beingsurveyed. Customizations may include:

- additional modules (washroom, other)

- a plan of the building’s floorspace to be used to elicit information fromparticipants on where their workspace is located

- a demographic page which can be changed to invite additional informationabout the workplace groups to which the respondent belongs (for a school,teacher, student, other)

- a list of four building features selected for particular scrutiny (selected from listof 20 including "operable windows", "automatic daylight controls", "recyclingsystems")

- an opening page which can be edited to present the survey appropriately torespondents

Qualitative research: Qualitative analysis can help to round out a quantitativestudy and enable cross-reference of data across methodological approaches.This protocol mentions the types of questions worth addressing and some of theways in which they might best be addressed, while leaving the decision abouthow to structure the final evaluation up to those involved with specific projects.Each technique has its advantages and drawbacks. It is advisable that multipletechniques are employed simultaneously such that the advantages of one canovercome the drawbacks of another.

Presentation of results: upon completion of the required components of thePOE, results can be written up following the outline given in Appendix A.

Page 12: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

5

How this protocol was developed

A much more limited form of this protocol, which did not include anymeasurements of physical conditions or consideration of social capitaldevelopment, was piloted on five green buildings in British Columbia in 2003.Reflection on the robustness of the data from this earlier POE series led to thedecision to look for objective measurements on certain building characteristics(Indoor Air Quality, Acoustics, Lighting, Thermal Comfort) to supplementsubjective occupant satisfaction data.

The POE components involving objective measurements of physicalcharacteristics are identified as "optional", since they involve additional expertiseand equipment which could put a POE out of reach if these components were“required” . Because results from the 2003 POEs indicated some occupantdissatisfaction with thermal comfort and acoustic quality, the POE componentsfor these two aspects of indoor environmental quality are identified as "optionalbut preferred".

A POE component on social capital development was also added to the protocol,to recognize the importance of the built environment in facilitating humanconnections that help lead to sustainability.

A further improvement prompted by the 2003 POEs and included in this protocolis a structured process by which POE results will be fed back to the design teamsfor the evaluated buildings.

This protocol was developed in part through a charrette involving ten buildingdesign and operation experts, as follows:

Name Professional role

Present at the charrette:

Ray Cole, PhD Professor, Architecture, University of British Columbia

Murray Hodgson, PhD,C.Eng.

Acoustician and Professor, Mechanical Engineering andOccupational Health and Safety, University of BritishColumbia

Karen Bartlett , PhD Indoor Environmental Quality expert and AssistantProfessor, Occupational Health and Safety, University ofBritish Columbia

Martin Nielsen, MAIBC,P.Eng.

Architect, Busby Perkins + Will Architects

Page 13: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

6

Sylvia Coleman Sustainability Research, Busby Perkins + Will Architects

Jorge Marques, P.Eng. Energy Manager, University of British Columbia

Chris Leaming Commissioning technician, KD Engineering

Jennifer Sanguinetti,P.Eng.

Mechanical Engineer, Keen Engineering

Mary O’Brien Energy Analyst, Keen Engineering

Rosamund Hyde, PhD,PEng.

POE Expert and Director of Research, Keen Engineering

Contributing questions:

Ezra Goldman Qualitative Building Analyst, Sustainable Evolution

Don Mills Sales Director, Clivus Multrum Inc.

POE Resources and References

Usable Buildings Trust web site: “Usable Buildings is a free resource forpractitioners, managers, building owners, developers, students and anyone elsewho wants to make buildings more suitable for the people who use them, lessdamaging to the natural environment and a better long-term investment.” – fromthe Usable Buildings web site at www.usablebuildings.co.uk

Center for the Building Environment web site: “New technologies mean thattoday’s buildings can be more efficient, more attractive, and more responsive totheir occupants’ needs than before. The challenge to building owners, operatorsand tenants is understanding the opportunities offered by these technologies,and learning how best to apply them. In May 1997, a group of industry andgovernment leaders teamed up with faculty and researchers at the University ofCalifornia, Berkeley to address this challenge. Together we created the Centerfor the Built Environment—a dynamic, collaborative place where people canshare ideas for improving the design and operation of commercial buildings.” –from the Center for the Built Environment website at www.cbe.berkeley.edu

Page 14: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

7

POE Protocol FormatThe Post-Occupancy Evaluation has 14 components, all presented in the sameformat.

POE Component [#]:

Descriptive name of component

Status of POE component: Whether component is “required” or “optional”.Other considerations to guide whether to include the component.

Purpose: what the purpose of this component is.

Evaluator skills: what skills the evaluator will require

Participants in discussion: who will participate in any discussion componentsof this POE.

Time required: What time is needed for the different evaluation activities of thiscomponent.

Cost: total resources needed in hours + equipment costs.

1.

2. Questions for discussion or analysis

3. etc.

Comments or directions for further investigation or decision-making.

Page 15: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

8

POE Component 1:Kick-off discussion with Owner

Status of POE component: Required for POE.

Purpose: to develop rapport with the owner and elicit necessary information andpermission to proceed with the POE.

Evaluator skills: interviewing; knowledge of building studied

Participants in discussion: building owner (representative), evaluator

Time required: 1 hour discussion of building. Evaluator time to write up.Evaluator time to review design documents.

Cost: ten hours

1) Explain the purpose and process of the POE.

2) Ask whether the design of the building meet the owner's requirements.

3) Ask whether the building is operating satisfactorily according to design.

4) Review with owner (representative)

- the questions that will be asked in the POE

- the possible levels of release of the POE results (confidential within owner’sorganization, publicly released without building name attached, publiclyreleased in its entirety.)

Secure owner’s permission to proceed with POE and agreed-upon level of publicrelease.

5) Elicit contact information for all the individuals whose help will be requiredduring the course of the POE:

a) Design team

b) Building operator

c) Occupant representative

d) Other (security staff, washroom cleaning and maintenance personnel)

6) What hours is the building occupied, with what level of occupancy, on a daily,weekly and annual basis?

7) Are there anomalies in occupancy (special events using large amounts ofelectricity, building shut-downs for organization holidays).

Page 16: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

9

8) Are certain demographic groups disproportionately represented, overall andat specific times, in the building (mostly women at night, mostly men onweekends, bias to older or younger occupants)?

9) What is the level of responsibility and experience of the building operator? Isservice and maintenance done in-house? Is a DDC expert available tomanage the building controls system.

10) What design and descriptive documents are available for review by theevaluators? Secure design documents and review them.

• schematic design information

• as-built drawings

• minutes of design meetings

• educational materials provided to occupants

• O & M manual provided to building operators

• sustainability studies done during design and construction

• marketing pieces describing building’s features

• case studies about the building

At the conclusion of this interview, the evaluators need to exercise theirjudgement to decide whether they have received information indicating thatproceeding with a POE on this building, at this time, will be a constructive use oftheir energy. The owner may have stated that the building is not performingaccording to design. This alone should not disqualify the building as a POEopportunity, but there may be other complicating factors, such as an ongoinglawsuit brought by the building owner against the building designers, which wouldcontraindicate undertaking a POE at this time. Similarly if there are labour issuesso significant that communication between evaluators and building occupants isgoing to be compromised, it might be better to postpone the POE.

Page 17: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

10

POE Component 2:Kick-off discussion with design team

Status of POE component: Discussion with project architect is required forPOE. Discussion with full design team is preferred.

Purpose: to gain an understanding of the goals of the design and of thedesigners’ own questions.

Evaluator skills: interviewing; knowledge of building studied

Participants in discussion: key members (preferably all members) of designteam.

Time required: 2 hour discussion of building. Evaluator time to write up.

Cost: ten hours for evaluator

1. What was the proposed use and proposed occupancy of the building?

2. What specific design targets were agreed upon in the following areas:

- Energy consumption- Water consumption- Indoor air quality- Thermal comfort- Lighting- Acoustics- Social capital development

3. Were there points during the target-setting process where opportunities formore sustainable design were abandoned? What could have helped toprevent this?

4. What was the design process like? Would you say that this building hadan integrated design process? Why? Were there any challenges orlessons to be learned from this building about the integrated designprocess?

5. Was provision made, during design, for the building to be ready for a Post-Occupancy Evaluation. If so, what? (specific target-setting, planning ofinstrumentation, setting up of files for accumulating utility bills, agreementon an evaluation event or sequence, contractual provision for evaluation)?

6. What was learned about the designed features/technologies of thisbuilding during the construction, commissioning and hand-over process(difficulties with materials chosen, resistance from contractors, unusualcommissioning challenges)?

Page 18: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

11

7. Was the building built as planned and designed? Describe anydivergences which may have significantly impacted energy consumptionand occupant comfort.

8. What features of this building have the most to offer in terms of educatingthe design community through POE (innovative, little or no previouslyavailable performance information, unusual combination of features, useof feature in unusual climate, exemplary performance targeted).

9. With the design team, choose four features to specifically evaluate in theOccupant Indoor Environmental Quality Survey, with the purpose of betterunderstanding the features available for occupants to adjust to improvetheir own comfort.

10. As the design team, what questions do you have about the building’sperformance which could be answered by:

- facilities personnel- maintenance personnel- occupants- non-occupant community members

Page 19: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

12

POE Component 3:Energy Consumption and Demand Measurements

Status of POE component: Required for POE

Purpose: to compare actual energy consumption, demand and on-siteproduction with what was projected for this building as well as what is observedin other similar buildings.

Evaluator skills: ability to interpret utility bills and normalize energy consumptioninformation.

Participants in discussion: none.

Time required: Time to collate and analyze energy bills.

Cost: ten hours for evaluator

1. Examine utility bills over at least one year to determine total energyconsumption, as well as fuel share (how much electricity? how muchnatural gas? how much central steam, central chilled water, other?).Determine electrical demand by month.

2. Ensure that the floor space of the building supplied with electricity throughthe monitored meter is clearly identified.

3. Normalize energy consumption to account for local weather characteristicsand compare with known benchmark data for the building’s location (useMetrix or similar software package for normalization).

4. Express energy from each fuel in terms of heated, occupied floor area. Ifbuilding includes parking space, remove metered or estimated energyconsumption for parking lighting from overall energy consumption.

5. Elicit any further records of energy use including separately meteredaspects of the building, (e.g., separate wiring for plug loads, meteredcontribution of photovoltaic panels).

6. Analyze energy demand and energy consumption per unit floor area.Compare with figures for similar buildings in the same climate zone.

7. Compare with projections based on modelling, if available.

8. If major disparities exist between projected and measured energy demandand consumption, or between energy information for benchmark buildingsand the study building, seek and document possible causes for thedisparity, such as occupancy hours, unexpected new equipment etc.

9. Extract any evident lessons on what makes for good and bad energyefficient design. What went right? What major errors or problems occurredthat impacted energy use?

Page 20: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

13

10. Based on the utility bill information, prepare questions to ask the buildingoperator about the building’s energy performance.

Page 21: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

14

POE Component 4:Water Consumption Measurement

Status of POE component: Required for POE

Purpose: to compare measured water consumption in the building withprojections for this building and/or with measured water consumption in otherbuildings, taking into consideration any water reuse.

Evaluator skills: ability to interpret water utility bills, access to comparativefigures.

Time required: time to collate and analyze water bills.

Cost: five hours for evaluator + software costs

1. Examine utility bills to determine total annual water consumption.

2. Ensure that the floor space area of the building supplied with waterthrough the monitored meter is clearly identified.

3. If metered water is used solely to supply building space (not landscaping),calculate water intensity per unit floorspace area and per occupant hour.Compare with projected water use, taking into account male/female wateruse differences.

4. Elicit and analyze records of water harvesting or reuse systems(greywater recycling, rainwater harvesting). Compare with designcapacities and expectations.

5. If major disparities exist between projected and measured waterconsumption (and reuse/harvested volume, if applicable), seek anddocument possible causes for the disparity.

6. Extract any evident lessons on what makes for good and bad water reuseand water efficient design.

7. Based on the utility bill information, prepare questions to ask the buildingoperator about water system performance.

Page 22: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

15

POE Component 5:Information from building operator

Status of POE component: Required for POE

Purpose: to get feedback on building performance from the perspective ofsomeone who is responsible for the whole building including the building’sresponse, and occupants’ responses, to building operation strategies.

Evaluator skills: interviewing skills, knowledge of building and building systems

Participants in discussion: building operator(s), evaluator

Time required: One hour discussion about building. Evaluator time to write up.

Cost: ten hours for evaluator

1. (Prior to interview) Use CBE Building Operator Satisfaction web-basedsurvey to determine the effectiveness of the building design in thefollowing areas:

- energy efficiency- operations and maintenance- building operations and control systems- HVAC- lighting- plumbing- building hand-over

2. Discuss with the Building Operator the results from the EnergyConsumption and Water Consumption measurements and analysis toelicit explanations for any anomalous energy and water consumptionstatistics, and to find out the Operator’s perception of whether the systemsperform well.

3. Interview the building operator to ask:

- What is most successful about the building?- What is least successful about the building?- Is the building complete or are there still deficiencies?- Is the building operated with the goal of minimizing occupant

complaints? Of minimizing energy use? other? how does the operatorreceive direction about goals for operation? through documentedpolicies? other?

- How well can you monitor system performance prior to hearing ofproblems from occupants?

- How knowledgeable are occupants in how to operate building or inmaking (or requesting) adjustments to systems?

Page 23: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

16

- Have any occupant complaints about building operation beenspecifically addressed, or not? What were they?

- Should the four features identified by the designer be the ones chosenfor detailed study in the Occupant Indoor Environmental Survey

- Are there specific areas in the building that should be separately zonedon the Occupant Indoor Environmental Quality Survey due to good orpoor performance or unusual occupancy patterns?

- Are there season-specific issues that should be explored in more detailwith occupants?

- Based on experience operating the building, what suggestions wouldyou make to designers about future designs?

Page 24: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

17

POE Component 6:Information from Occupants (through web-based survey)

Status of POE component: Either this POE component or the POE componenton “Information from Occupants (Qualitative)” is required for POE. Preferable touse both. This component is a prerequisite for Components 9-14.

Purpose: to get feedback on building performance from a range of persons whohave detailed, longitudinal knowledge of being located in, and trying to makingthemselves comfortable in, one or more specific areas of the building.

Evaluator skills: ability to specify changes needed to customize survey, workwith occupant representative to elicit broad participation, analyze results ofsurvey.

Participants in discussion: owner and occupant representative participate indiscussion on how to customize and administer survey, occupants

Time required: evaluator time to discuss and set up survey, encourageparticipation and analyze results, filtering responses to identify areas of thebuilding which are performing well and poorly.

Cost: 30 hours for evaluator + survey administration fees

1. Use CBE web-based Occupant Indoor Environmental Quality survey.

- With owner and occupant representative, set goals and implementationplan for achieving participation in survey (reminder messages, rewardsfor participation).

- Identify any specific demographic information which will be needed forfiltering to assess the occupant experience of different groups withinthe building (people with different activity levels, part-time/full-time).

- Based on information provided by designer and building operator,customize building map in survey to represent building floorplan,choosing zones so as to isolate potential problem areas. Pilot byshowing the map to several occupants in diverse locations in thebuilding, to ensure that individuals can correctly signify the locationupon which they will base their responses.

- Customize the survey with the four focus features identified inconsultation with the designer and the building operator

- Administer survey, meeting participation goals.

- Analyze results of survey, filtering to separately assess differences inperceptions of occupants in:

- best-performing areas of the building

Page 25: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

18

- problem areas of the building

- gender groups and age cohorts

- other specific occupant groups as identified

- Extract any evident design lessons.

- Feed survey results forward into planning measurements for POEComponents 9 to 12.

- Meet with owner to confirm permission to perform desiredmeasurements.

Page 26: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

19

POE Component 7:Information from Occupants (Qualitative)

Status of POE component: Either this POE component or the POE componenton “Information from Occupants (through web-based survey)” is required forPOE. Preferable to use both.

Purpose: to explore how the building influences human relationships andcontributes to developing social capital, sustainable behaviour and efficient workpractices.

Evaluator skills: social scientists skilled in fields such as anthropology,sociology, urban design, psychology, or industrial organizational design

Participants in discussion: varies, depending on method(s) chosen, see below.

Time required: varies, depending on methods chosen, see below.

Cost: 30 hours for evaluator

1. Use at least two of the four following methods, choosing the methods thatseem most appropriate to the building being evaluated:

Site-Specific Survey

- What: Paper-based survey of usage patterns of one building or site

- Emphasis: Usage of common spaces (who, why, how often, when, etc.),effectiveness of space for inter- and intragroup communication, ability ofspace to stimulate users, favourite spaces, functionality of signage andpathways, open-ended questions for retrofit suggestions, etc.

- Advantages: Focus is on specific site, taps into knowledge of user group,open-ended questions generate creative responses.

- Disadvantages: Possibility of people avoiding taking survey or trying tosecond guess the “right” answers, hard to get “actual” usage date.

- Considerations: Try to administer at different times of day and differentdays, make notes of any contextual issues (is it “normal” user group? userresponse to taking survey? did responders understand questions? etc.)

Observation-Based Survey

- What: Observation of usage patterns of one building or physical area

- Emphasis: Actual usage patterns, fit of spaces to user needs, how wellspaces promote communication, usefulness of signage and pathways,transit and street accessibility, adequate seating, comfortability, availabilityand usage of recycling, “fit” of building design with street, etc.

Page 27: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

20

- Advantages: Observation enables one to see how people actually usespace as opposed to how they report using space; observation is focusedand conducted by trained observer; drawing up maps, tables and tallies(eg traffic flows) provides visual aides for analysis and presentation

- Disadvantages: Difficult to “get inside peoples’ heads” to find out who theyare, why they use space, how often, etc.

- Considerations: Try to “blend in” if possible, observe at different times,take notes on contextual cues (weather, meetings, time, etc.)

Guided Informal Interviews

- What: Interviews of users of a particular building space

- Emphasis: How people use spaces, how well spaces promotecommunication and networking between which groups, how well spacesmeet user needs, signage, attitudes and opinions about the space,attitudes towards sustainability, suggestions for improvement, etc.

- Advantages: Allows more flexibility and free-form than surveys, enablesquestions to be rephrased, enables more in-depth and unrestrictedresponses, “rounds out” more quantitative data, provides “stories”

- Disadvantages: People may not be as comfortable speaking in person asanonymously filling out forms, harder to analyze data, difficult to determineprofessed usage versus actual

- Considerations: Combine predetermined questions with loose topics, notenon-verbal communication, shift order of questions around, considertaping interviews, analyze interview technique itself before analyzing data,do not take content at face value without thinking of linguistic context

Focus Group Surveys

- What: Led discussion with cross-section of occupants

- Emphasis: Development of sustainability ethic, effects of design on inter-and intragroup communication, networking and resource sharing, attitudesabout building, understanding of green features, retrofit suggestions

- Advantages: Brings user group into a focused dialogue based on topicquestions, draws out responses above and beyond focus of the questionsposed, facilitates intergroup discussion which may not otherwise happen

- Disadvantages: People may try to second guess the “right” responses,may not be comfortable speaking openly, can’t get “actual” usage data

Page 28: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

21

- Considerations: Try to get a demographically representative cross-section,leading a walkthrough of spaces can stimulate discussion and beengaging

Page 29: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

22

POE Component 8:Washroom and Washroom Fixture Evaluation

Status of POE component: Optional. Use of the CBE Occupant SatisfactionSurvey, with inclusion of its specialized “Washrooms” module, supports this POEcomponent but is not a prerequisite.

Purpose: To gather information about the acceptability and co-benefits of thevarious types of washroom fixtures presently in use.

Evaluator skills: Interviewing skills, understanding of washroom fixtures andresource use.

Participants in discussion: washroom cleaning and maintenance personnel.

Time required: time to analyze occupant satisfaction results,

Cost: five hours for evaluator

1. Filter Occupant Satisfaction Survey data if available to determine whetherwashrooms are rated differently by different demographic groups or indifferent parts of the building.

2. Visit washrooms, at least one for each gender. Check for generalcondition. Note any educational signage.

3. Interview building operator to determine:

- frequency and length of maintenance required on washrooms

- maintainer acceptance

- maintainer preference, if more than one type of fixture is in place

- for composting toilets, volume and potential fertilizer value of end-products

- for composting toilets, greywater treatment systems and blackwatertreatment systems, end-product test data and use to which end-products are put

4. Interview plumbing designer to determine:

- what values and priorities guided decisions related to the washroomfixtures?

- was the cost of obviated infrastructure a factor in the design choices?

5. Where water-conserving technologies are in use, estimate volume ofwater saved. Use water consumption information to estimate volume of

Page 30: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

23

sewage not created compared to conventional fixtures, and determineenvironmental impacts averted by not creating this sewage.

Page 31: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

24

POE Component 9:Indoor Air Quality Measurements

Status of POE component: Optional. Component 6 (web-based OccupantSatisfaction Survey) is a prerequisite for this component.

Purpose: to complement subjective occupant satisfaction data with objectivemeasurements of indoor environmental quality.

Evaluator skills: skilled at understanding conditions that influence indoor airquality and at gathering and interpreting indoor air quality measurements

Participants in discussion: n/a

Time required: time on-site to take measurements, analyze, and write upresults.

Cost: ten hours for evaluator

1. Filter Indoor Air Quality web-based survey reports to identify areas of thebuilding where sensate properties of indoor air quality are most and leastsatisfactory.

2. Based on the results from step 1 above, choose ten situations to do airquality measurements: five situations with most satisfactory perceivedindoor air quality, five situations with least satisfactory perceived indoor airquality.

3. In each situation, measure:

- bio-effluents: CO2, CO, temperature, relative humidity

- fine particulates

- aldehydes and volatile organic compounds

and record:

- weather, time of day, season, fenestration configuration

4. Analyze air quality results for each location and identify any apparentreasons for good or bad IAQ.

5. Extract any evident lessons on what design features make for good andbad IAQ.

See Appendix B for detailed information regarding indoor air qualitymeasurements.

Page 32: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

25

POE Component 10:Lighting Measurements

Status of POE component: Optional. Component 6 (web-based OccupantSatisfaction Survey) is a prerequisite for this component.

Purpose: to complement subjective occupant satisfaction data with objectivemeasurements of lighting quality.

Evaluator skills: skilled at filtering Occupant Satisfaction Survey results,understanding conditions that influence interior lighting, gathering andinterpreting lighting data.

Participants in discussion: n/a

Time required: time on-site to take measurements, analyze the results and writeup.

Cost: ten hours for evaluator

1. Filter Lighting Quality web-based survey reports to identify areas of thebuilding where lighting quality is perceived by occupants to be most and leastsatisfactory.

2. Based on the results from step 1 above, choose ten situations to do lightingmeasurements: five situations with most satisfactory perceived lightingquality, five situations with least satisfactory perceived lighting quality.

3. At each location, measure:

- glare

- light levels at desk surface

- lighting contrast between computer screens and adjacent sight-lines

and record:

- weather, time of day, season, fenestration configuration

4. Analyze results for each location and identify any apparent reasons forsatisfactory and unsatisfactory lighting conditions.

5. Extract any evident lessons on what makes for good and bad lighting.

See Appendix D for more detailed information about Lighting measurement.

Page 33: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

26

POE Component 11:Acoustic Measurements

Status of POE component: Optional but preferred. Component 6 (web-basedOccupant Satisfaction Survey) is a prerequisite for this component.

Purpose: to complement subjective occupant satisfaction data with objectivemeasurements of acoustic quality.

Evaluator skills: skilled at filtering Occupant Satisfaction Survey results,understanding how conditions influence acoustic quality, performing andanalyzing acoustic measurements.

Participants in discussion: n/a

Time required: time on-site to take measurements, analyze and write-up.

Cost: twenty hours for evaluator

1. Filter Acoustic Quality web-based survey reports to identify areas of thebuilding where acoustic quality is perceived by occupants to be most andleast satisfactory.

2. Based on the results from step 1 above, choose ten situations to doacoustic measurements: five situations with most satisfactory perceivedacoustic quality, five situations with least satisfactory perceived acousticquality. These situations may involve different locations, different times ofday (rush hour or not), environmental conditions (summer or winter,windows open or closed), different activities taking place in the space,building operational modes etc.

3. At each location, measure:

- Speech Intelligibility Index

- Noise Criterion (NC) Level

- Reverberation Time

and record:

- weather, time of day, season, fenestration configuration

4. Analyze results for each location and identify any apparent reasons forsatisfactory and unsatisfactory acoustic conditions.

5. Extract any evident lessons on what makes for good and bad acoustics.

Page 34: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

27

POE Component 12:Thermal Comfort Measurements

Status of POE component: Optional but preferred. Component 6 (web-basedOccupant Satisfaction Survey) is a prerequisite for this component.

Purpose: to complement subjective occupant satisfaction data with objectivemeasurements of thermal conditions.

Evaluator skills: skilled at understanding how conditions influence thermalcomfort, gathering information from measurements and analysing.

Participants in discussion: n/a

Time required: time on-site to take measurements, analyze and write up results.

Cost: twenty hours for evaluator

1. Filter Thermal Comfort web-based survey reports to identify areas of thebuilding where thermal comfort conditions are perceived by occupants tobe most and least satisfactory, in summer conditions and in winterconditions.

2. Filter Thermal Comfort web-based survey reports to identify whatadjustments are available to occupants in areas and in seasons in whichthermal comfort conditions are perceived to be satisfactory andunsatisfactory.

3. Based on the results from steps 1 and 2 above, choose ten situations todo measurements of thermal conditions: five situations with mostsatisfactory perceived thermal comfort, five situations with leastsatisfactory perceived thermal comfort. These situations may involvedifferent locations, different times of day, environmental conditions(summer or winter, windows open or closed, bright sunshine on façade orotherwise), different activities taking place in the space, buildingoperational modes etc.

4. At each location, measure:

- ambient air temperature

- ambient air relative humidity

- air movement

- mean radiant temperature

- radiant asymmetry

Page 35: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

28

and record:

- weather, time of day, season, fenestration configuration

Repeat at three different times:

- first thing in the morning

- noon

- late afternoon

Ideally, repeat all readings when outside air is warm and when it is cool.

5. Analyze results for each location and identify any apparent reasons forsatisfactory and unsatisfactory thermal conditions.

6. Extract any evident lessons on what makes for good and bad thermalcomfort management.

See Appendix C for more detailed information about Thermal Comfortmeasurement.

Page 36: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

29

POE Component 13:Wrap-up discussion with design team and occupant representatives

Status of POE component: Required for POE.

Purpose: to feed POE learnings back to design team and occupantrepresentatives immediately and elicit any helpful clarification and reflection.

Evaluator skills: discussion facilitation

Participants in discussion: design team, occupant representatives, evaluationteam

Time required: two-hour meeting, evaluator time to write up results

Cost: fifteen hours for evaluator (assuming that design team and occupantrepresentatives contribute their time free of charge)

1. Compare building performance to targets set, in the following categories(including objective and subjective results):

- Energy consumption

- Water consumption

- Indoor air quality

- Thermal comfort

- Lighting

- Acoustics

- Social capital development

2. Explore the implications of what has been learned:

- in future, what will the designer do differently, based on the POEresults?

- what changes in practice will the designer advocate to otherdesigners? How can these changes be effectively communicated tothe whole design community?

- how will these changes be trackable?

3. What changes could be made to this POE protocol to improve it and makeit less onerous?

Page 37: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

30

POE Component 14:Process Reflection and Conclusions

Status of POE component: Required for pilot (first six buildings evaluated usingthis protocol).

Purpose: to include a meta-evaluation of the POE process as an input toimproving and streamlining the practice.

Evaluator skills: discussion facilitation

Participants in discussion: evaluation team

Time required: one hour discussion and time to write up results.

Cost: five hours for evaluator

1. Based on all the preceding elements of this protocol, what were the topdesign lessons learned, about design practices that make buildingssuccessful, and design deficiencies that make buildings less successful?

2. Based on all the preceding elements of this protocol, what were the six toplessons learned about processes outside the control of the designer thatmade the building better and made the building less successful?

3. Any ideas about how designers could reduce the vulnerability of theirdesigns to alterations outside their control?

4. Which parts of the POE protocol yielded the most useful information andwould be most important to retain in a streamlined protocol?

5. Which parts of the POE protocol yielded the least useful information andwould be least important to retain in a streamlined protocol?

6. For tracking uptake from POE learning as discussed in this evaluation, dofeasible methods exist? What kind of changes in the construction industryand design professions could make it easier to track the uptake of POElearning?

7. What steps can be taken to communicate the results of this POE to thewhole design community?

Page 38: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

31

APPENDIX A: POE REPORT OUTLINE

This outline represents the result of a Post-Occupancy Evaluation which includesall the optional components in the Protocol. The goal of the report is tocommunicate to building designers those of the POE findings that may begeneralizable across office building design projects. To be engaging for thereader, the report should include both quantitative and anecdotal information.

Building Description: background on how the building came to be designed,details and dates on the design and construction process, firms involved, presentuses of the building.

Design Process: description of the design process, why that process waschosen, what worked well in the process, what improvements could be made infuture.

Design Intent: overall purpose of the building and how the design processsupported that purpose, design targets and what design strategies were chosento achieve them, performance projections. People and/or activities that werecrucial to the success of the design process and . Slippages that occurred in thedesign process and how, in retrospect, they could have been minimized.

Construction, Commissioning and Hand-Over: description of what worked well inconstruction and commissioning and what improvements could be made in futurethrough the influence of designers. Description of education provided tooperators and occupants: what was well received and what could have beenimproved.

Building Performance in Use: energy and water performance, occupantsatisfaction with the building in general, occupant understanding of building andoccupant success in making adjustments (operable windows, blinds, diffusers) toachieve comfort conditions, assessment of Acoustics, Thermal Comfort, Lightingand Indoor Air Quality in terms of occupant satisfaction and in terms of physicalmeasurements, development of social capital facilitated or discouraged bybuilding design.

Measuring Up and Recommendations: Comparison of building performance withperformance projections. For aspects where performance is better thanprojected, description of how the design process contributed to success. Foraspects where performance is not as good as projected, recommendations forhow design could be improved in future projects.

Reflection on application of POE protocol: Discussion of the experience ofapplying the POE protocol. Information gained, compared with difficulty inapplying, each component of the POE. Recommendations for improving the POEprotocol to make it more streamlined and better focused on generating usefulrecommendations for design practice.

Page 39: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

32

APPENDIX B: INDOOR AIR QUALITY MEASUREMENTS

Target variables:

CO2: Carbon dioxide (CO2) is produced by occupants at about 0.3 L/min. If thespace is not sufficiently ventilated to dilute the bioeffluent, CO2 accumulates inthe space. Symptoms reported by office workers at concentrations from 600 –1000 ppm include fatigue, headaches, and an increased perception of warmthand unpleasant odours.

CO: Carbon monoxide (CO) is a product of combustion. It combines withhaemoglobin to form carboxyhaemoglobin which reduces the amount of oxygenreaching the tissues. Symptom of CO exposure above acceptable short-termexposure ranges is headache. Symptoms of CO poisoning (e.g.carbooxyhaemoglobin concentrations about 2.5% in blood) include decreasedecercise capacity, impaired psychomotor performance and adverse affects to thecardio-vascular system. Acceptable short term exposure ranges are < 11 ppm 8hour concentration or < 25 ppm 1 hour concentration.

Aldehydes: Formaldehyde, acrolein, acetaldehyde may be off gassed fromfurnishings, wall or floor treatments, or by consumer products used by buildingoccupants. Formaldehyde is an irritant and sensitizer and carcinogen.Symptoms reported for aldehyde exposures are dry sore throat, nose bleeds,headaches, fatigue, memory and concentration problems, dizziness,breathlessness, burning, stinging eyes. The effects of aldehydes are additive,therefore, the following equation is used to determine the combined exposure

limit: 1

3

3

2

2

1

1 ≤

++

Cc

Cc

Cc

.

Where: c1 = measured concentration of Formaldehyde

C1 = target level Formaldehyde = 0.05 ppm

c2 = measured concentration of Acrolein

C2 = target level Acrolein = 0.02 ppm

c3 = measured concentration of Acetaldehyde

C3 = target level Acetaldehyde = 5.0 ppm

Total Volatile Organic Compounds (TVOCs): Sources of TVOCs in offices canbe from furnishings, wall or floor treatments or from consumer products used byoccupants. Research in Europe and North America indicates TVOCconcentration much lower than the ACGIH TLV can cause complaints.

Page 40: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

33

Symptoms of low TVOC exposure include fatigue, headaches, drowsiness,dizziness, weakness, joint pains, peripheral numbness or tingling, euphoria,tightness in the chest, unsteadiness, blurred vision, and skin and eye irritation.Target exposure limit for TVOCs in the EU is 0.3 mg/m3.

Particulates: Particulates are solid or liquid matter with aerodynamic diametersranging from 0.005 to 100 ì m. Dusts , fumes, smoke, and biologic organisms aresolid particulate matter. Indoor particles come from both indoor and outdoorcourses and can be drawn into the building via infiltration and outdoor air intakes.Ultra fine particles (< 1 ì m) are a combustion product (e.g. automobile exhaust,tobacco smoke, etc.). The measurement of ultra fine particles can be used todetect defects the filtration of supplied air, or envelope leaks allowing particulateinto the interior spaces. Ultra fine particles do not have a target concentration.The indoor concentration should be reduced from the outdoor concentration bythe specification of the filtration system.

Measurement:

• Q-Track is a direct-reading, data-logging device that measures CO2, CO,temperature and relative humidity.

• ppbRAE is a direct reading photo-ionization detector (PID) measuringTVOCs.

• P-Track is a direct reading instrument that counts ultrafine particulatenumbers.

• Passive monitors may be used to measure concentration of aldehydes.

Protocol:

• Q-Track are attached to a wall or post in an area that best represents theareas of interest (e.g. most workers per m2). A week long sample will yieldmore information than would a short term sample. Cost per week = $320.00external/$160.00 internal.

• ppbRAE and P-Track are direct reading instruments that can be used duringa walk through. Cost per week $600 external/$400 internal.

• Passive monitors are attached to a wall or post as for Q-Track. Cost persample including analysis = $720 per set of 1 – 10/ internal $400.

Page 41: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

34

Indoor Air Quality References:

Exposure Guidelines for Residential Indoor Air Quality. A Report of the Federal-Provincial Advisory Committee on Environmental and Occupational Health.Health Canada, 1995.

Indoor Air Quality in Office Buildings: A Technical Guide. Health Canada, 1995.

Page 42: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

35

APPENDIX C: THERMAL COMFORT MEASUREMENTS

Target variables:

Thermal comfort: Humans must maintain homeostasis, and balance the heatexchange between the body and environment. Heat transfer mechanisms thatoccur between the environment and the human body can be expressed in thefollowing equation:

Where: M = energy gained from metabolism

W = work accomplished

E = evapourative exchange

R = radiant exchange

C = convective exchange

K = conductive exchange

S = heat energy stored (for heat balance, S = 0)

Units of energy are watts per second (W/s). Heat losses or gains are calculatedas watts per square meter total body surface area (W/m2).

1. There are four major components that determine thermal comfort.

2. Air temperature is determined by dry bulb thermometer reading. ASHRAEstandard 55 recommends winter temperature range from 20 – 23.5 oC, andsummer range from 22.5 – 26 oC to accommodate clothing typically wornduring these seasons.

3. Radiant temperature is the mean radiant transfer. This can be measured witha globe thermometer.

4. Air speed is the movement of supplied air and can be measured using athermal anemometer. Acceptable air movement is 0.15 m/s (winter) and 0.25m/s (summer).

5. Relative humidity is the amount of water vapour in the air relative to thesaturation concentration at the same temperature. It is measured with a wetbulb thermometer or hygrometer. Ranges of %RH are 30 – 60% in summerand 30 – 50% in winter.

SKCREWM ++++=−

Page 43: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

36

All four parameters are taken into consideration by determining the comfort zoneusing a psychrometric chart.

Protocol

• TSI thermoanemometer measures air flow, temperature and relative humidity.Measurements can be taken during walk through.

• WiBGeT measures dry, wet and globe temperatures. Measurements can betaken during walk through.

Thermal Comfort References:

ASHRAE Standard 55 Thermal Environmental Conditions for Human Occupancy.

Indoor Air Quality Handbook. Eds. JD Spengler, JM Samet, and JF McCarthy.McGraw Hill, Toronto, 2001.

Page 44: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

37

APPENDIX D: LIGHTING MEASUREMENTS

Protocol:

- room characteristics: measure the incident and reflected light from ceiling,walls and floors. Optimal reflectance from ceiling is 80% of incident; walls 40 -50%; floors, 10 - 20%.

- glare: a simple method to determine and correct undesirable and uncontrolledincident light is to place a mirror on the plane of reflectance and visually identifysources of light producing glare.

- light levels at desk surface: take average measurement using a light meter(SPER Scientific 850071 or equivalent, NOT photographic light meter).Measurements should be in range of 200 - 500 lux.

- lighting contrast. Measure light reading output of computer screen. Measurebackground lighting around computer screen. Optimal contrast level should beless than 5:1 ratio of the measurements, and never greater than 10:1. For deskwork, a 3:1 ratio is optimal between visual task and background.

Page 45: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

38

APPENDIX E: CBE BUILDING OPERATOR SURVEY

This web-based survey, developed by the Center for the Built Environment atUniversity of California at Berkeley, elicits information from the building operatoron topics including:

- energy efficiency of the building operation

- operations and maintenance

- building operations and control systems

- heating, ventilating and air-conditioning system

- lighting system

- plumbing system

- procedure for building handover

Page 46: POST OCCUPANCY EVALUATION PROJECT REPORT COMPLETION …ecosmart.ca/Docs/POEProtocol1.pdf · Post-Occupancy Evaluation Project Report - Protocol i SCOPE OF THIS POST-OCCUPANCY EVALUATION

Post-Occupancy Evaluation Project Report - Protocol

39

APPENDIX F: CBE OCCUPANT IEQ SURVEY

This web-based survey, developed by the Center for the Built Environment atUniversity of California at Berkeley, elicits information from building occupants ontopics including:

- demographic information (age, gender, how long they have worked in thebuilding)

- workspace location

- satisfaction with four building features (selected by evaluator)

- education on how to use or adjust building features

- office layout

- visual privacy

- ease of interaction

- office furnishings

- thermal comfort

- temperature

- air quality

- lighting

- acoustic quality

- washrooms (optional)

- cleanliness and maintenance

- cleaning service (optional)

The core survey can be viewed online athttp://www.cbe.berkeley.edu/research/survey.htm