54
Test Cases and Results --------------------------------- ENERGY STAR PORTFOLIO MANAGER August 31, 2009 Release Updated Warehouse Model New House of Worship Model New Optional Hotel Attributes Model New Required Retail Attribute New/Modified Energy Fuels, Units and Factors On-Site Renewable Energy Sources Renewable Energy Credits Includes Portfolio Manager, Target Finder, Public Web Site and ABS and Web Services * (* ABS and Web Services Test Cases/Scripts are managed outside of this document) Revision History Revision Revised By Date Revised V1.0 Initial Draft Chris Bailey 7/31/2009 Test Plan Version 1.0 – PM Aug 31, 2009 Release Page 1

Test CASES and RESULTS AUG 2009 Release - … · Web viewTest Cases and Results-----ENERGY STAR PORTFOLIO MANAGER August 31, 2009 Release Updated Warehouse Model New House of Worship

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Test Cases and Results---------------------------------

ENERGY STAR PORTFOLIO MANAGER

August 31, 2009 Release

Updated Warehouse ModelNew House of Worship Model

New Optional Hotel Attributes ModelNew Required Retail Attribute

New/Modified Energy Fuels, Units and FactorsOn-Site Renewable Energy Sources

Renewable Energy Credits

Includes Portfolio Manager, Target Finder, Public Web Site and ABS and Web Services *

(* ABS and Web Services Test Cases/Scripts are managed outside of this document)

Revision History

Revision Revised By Date RevisedV1.0 Initial Draft Chris Bailey 7/31/2009V1.1 – added Retail Data Test Cases, updated status and notes

Chris Bailey 8/4/2009

Note: status updates made daily by testers – version number not changed.V1.2 – added a couple tests - UM-0078, UO-013. Status updates

Chris Bailey 8/12/2009

Test Plan Version 1.0 – PM Aug 31, 2009 Release Page 1

1. INTRODUCTIONThe document includes all the Test Cases (User tests and Data tests) for the August release. Note: these tests were originally documented in the “Test Plan AUG 2009 Release.doc” but will be maintained in this document.

Testers will be submitting test results which will also be maintained in this document.

For any details of the August Release, including reference documents, scheduling and resources, refer to the Test Plan.

2. TEST CASES Test cases are intended to be a set of scenarios and instructions to the test team that will validate all components and functionality in the release. The test case includes a test case ID and name that describes the intent of the case. The test cases are listed below. A supplemental document takes each test case and provides additional details such as: setup, test data required, scripting instructions, and validations points.

This release includes three categories of test cases:

- Use Case Application Testing (A) – Test cases that specifically address the display and navigation of specific use case scenarios within screens in PM, TF, and iSTAR.

- Data Testing (D) - Test cases that are built around specific building types in order to validate the correct results for metrics, eligibility, ratings, etc.

The test Cases documented below include the following information:

- Test Case ID

- Test Case Name

- Test Case Description, including how to test and what to look for to verify results.

- Test Status, including tester name, relevant dates and status of the test in each environment.

- Notes, including description of problems encountered and related Mantis ERs.

Status Update as of 8/11/2009Total User Test cases 88# Items Not Yet in Test 25# Items In Test 63 # Items Approved 35 # Items Rejected back to dev 7 # Items in progress 21

Of the Data Test Cases, none of the OSR tests are “in test”. The HOW and Warehouse can all technically be tested but we are waiting for the Building Import process to be done so we can import the buildings for re-usability in staging and prod.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 2

# Name Description Status Notes / Mantis ERs

BUILDING IMPORTS

UBI-001House of Worship Building Import Test

Using the new Building Import Template for House of Worship (HOW), add buildings to match SCR HOW data – include BIDs from NSTARTB – (TBD)Confirm successful import of all dataConfirm matching metrics to SCR report

Not in test (15413)

UBI-002

Refrigerated Warehouse Building Import Test

Using the modified Building Import Template for Refrigerated Warehouse, add buildings to match SCR Refrigerated Warehouse data – include BIDs from NSTARTB – (TBD)Confirm successful import of all dataConfirm matching metrics to SCR report

Not in test (15413)

UBI-003

Unrefrigerated Warehouse Building Import Test

Using the modified Building Import Template for Unrefrigerated Warehouse, add buildings to match SCR Unrefrigerated Warehouse data – include BIDs from NSTARTB – (TBD)Confirm successful import of all dataConfirm matching metrics to SCR report

Not in test (15413)

UBI-004 Retail Building Import Test

Using the modified Building Import Template for Retail, add buildings and ensure the new External Entrance attribute is included in the template, yes and no can be selected, and data saves properly.

Not in test (15413)

UBI-005 Hotel Building Import Test

Using the modified Building Import Template for Hotel, add buildings and ensure the new optional attributes are included in the template, appropriate values can be selected, and data saves properly.

Not in test (15413)

UBI-006New Energy Building Import Test

Using any import template, add several new buildings with meters that utilize new or modified energy Types (DCW-all types, District Hot Water, Electricity-all types) and new Units (liters, cubic meters). Confirm successful import of all data[Note: OTHER fuel type is no longer selectable on imports; Electricity-OSR types are selectable but without any additional energy entries.]

Not in test (15413)

UBI-007 Access Building Import Templates

Confirm Import web page (via HELP and PM Home page) provides access to all the latest versions of templates.Test Note: web page often uses fixed production locations so cannot always test template access. Confirm that new HOW and two Warehouse template links are on web page.

Not in test Note: this HELP page with new templates needs to be part of pre-release announcements (14477)

Test Plan Version 1.0 – PM Aug 31, 2009 Release Page 1

# Name Description Status Notes / Mantis ERs

HOTEL OPTIONAL ATTRIBUTES

UH-001

Hotel Optional Attributes and Existing Hotel Spaces (Conversion)

View space data for existing Hotel Space type, and verify:1. Optional attributes are added with records in the space_attribute

table (start and effective date matching earliest date of gross floor area, end date = 1/1/2200, no value).

2. Optional attributes initially display in PM correctly (as defined above)

3. Attributes show correct names, drop down choices an/or units.4. User can “Correct” or “Update” attribute values (and change

effective dates).5. User does not receive “might lose rating” message when

effective date is not earliest (using Correct and changing date).

Approved in Test (CB)

Note: Order on “hours guests on site” was fixed.

Note: Test Case has incorrect step. User WILL still receive the “might lose the rating” message even when editing optional attributes. Turns out this is how is is working in production too. So, step 5 is incorrectly documented. The displayed message is OK and displays at the right time (when dates is changed to be prior to earliest date of any attribute.)

Note: Different name on one of the attributes per Guidance doc. Implemented as “Quantity of laundry processed on-site annually” instead of “Annual quantity of laundry processed on-site”. OK as is.

UH-002Add New Hotel Space with Optional Values

Add new building or new Hotel space to existing building and verify:1. Optional attributes initially display with no values (and same

effective date as other attributes)2. Attributes show correct names, drop down choices an/or units3. User can enter and save values for all new attributes4. User cannot set attribute to use default values5. User does not receive “might lose rating” message when

effective date is not earliest.6. Attribute values can be “Updated” after initial value entered.

Approved in Test (CB)

See note above.

UH-003

Hotel Optional Attributes and Data Checklist and Facility Summary Report

Using buildings in test cases U-005 and U-006, generate the “SEP” in two scenarios:a) non-label scenario, andb) label application scenarioConfirm optional attribute values, as entered in space screens, properly display in the Data Checklist and the Facility Summary Report (and display with the “o” superscript to indicate “optional” )Confirm Data Checklist questions per spec.

In Test Noted that on Facility Summary Report that units are not included on attributes that have units. Entered as 15862 – not for Aug release.

UH-004Target Finder & Optional Hotel Attributes

Add a Hotel space to Target Finder and confirm optional attributes do not display. (Regression test that proper Hotel attributes display)

Approved in test-live - CB

RETAIL EXTERNAL ENTRANCE ATTRIBUTE

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 2

# Name Description Status Notes / Mantis ERs

UR-001

New External Entrance Attribute and Existing Retail Spaces (Conversion)

View space data for existing Retail Space type, and verify:1. External Entrance attribute initially displays with (converted)

value of “YES” (and same effective date as earliest gross floor area date)

2. Attribute shows correct name, yes/no choices and no units3. User can “Correct” or “Update” attribute value (and change

effective date).4. User does receive “might lose rating” message when effective

date is changed to something later than earliest attribute date.

Approved in Test (CB)

(also in prod-beta)

Note: need to check on Staging that the updated by (as saved in DB and displayed on space attrib screen) is SYSTEM and not ER14531.

LK Notes- I confirmed this and do still see what Chris says above.

UR-002

Add New Retail Space with New External Entrance Attribute

Add new building or new Retail space to existing building and verify:1. External Entrance attribute initially displays with no value (and

same effective date as earliest gross floor area)2. Attribute shows correct name, yes/no choices and no units3. User can select Yes, No, or set to use default value (and change

effective date).4. User does receive “might lose rating” message when effective

date is changed to something later than earliest attribute date.

Approved in Test (CB)

(Note for a Staging test: confirm new attribute is showing last on list when adding new retail space. (14533) – this was a fix in test)

LK Notes- shows last on list.

UR-003

Retail External Entrance and Rating Eligibility (Adding Retail Spaces)

In each scenario, start with a building that has no retail space, has energy data from 1/1/2007 through last month and many years of space data (e.g., effective dates 1/1/2000) and has a rating, then add a Retail space (with typical attribute values)a) Add new retail space and set External Entrance to default –

confirm building still has a rating.b) Add new retail space and set External Entrance to “YES” –

confirm building still has a rating.c) Add new retail space and set External Entrance to “NO” –

confirm building Baseline and Current PED does not change, but loses the rating and has the appropriate NA reason for no rating.

Approved in Test (CB)

LK Notes- used b_id 1682140. Confirmed this.

UR-004

Retail External Entrance Attribute and Data Checklist and Facility Summary Report

In all buildings above, “Generate SEP” and confirm correct External Entrance attribute and value display on Data Checklist and Facility.Summary Report. (SEP can be the not-for-label kind) Confirm Data Checklist questions per spec.

In Test

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 3

# Name Description Status Notes / Mantis ERs

UR-005

Retail External Entrance and Rating Eligibility (Existing Retail Space 1)

Start with a building that has one retail space (could have other spaces), has energy data from 1/1/2007 through last month and many years of space data (e.g., effective dates 1/1/2000), External Entrance = YES, and has a rating, then make changes to the Retail space as follows:a) CORRECT the External Entrance attribute to NO – confirm

building Baseline and Current PED does not change, but loses the rating and has the appropriate NA reason for no rating.

b) Then… CORRECT the External Entrance attribute to YES – should now get a rating.

c) Then… UPDATE it to NO (where the effective date of the up-date is a few months later than the current effective date; e.g., 3/1/2000) – confirm building Baseline and Current PED does not change, but loses the rating and has the appropriate NA reason for no rating.

d) Then… UPDATE it to YES (where the effective date of the up-date is 6 months ago) – no change –Baseline & Current PED but no Rating.

Approved in test (CB)

Special test to double check – check that unrelated metrics (e.g. Current Source Energy Intensity, Change from Baseline: Adjusted Energy Use (%), Emissions, etc.) are no NA when the Rating is NA.

LK Notes- Confirmed this with B_ID 1685133. Did notice that I get “N/A” for some GHG emissions metrics but it remained constant through all scenarios so I don’t think it is related to this particular change.

UR-006

Retail External Entrance and Rating Eligibility (Existing Retail Space 2)

Start with a building that has one retail space (could have other spaces), has energy data from 1/1/2007 through last month and many years of space data (e.g., effective dates 1/1/2000), External Entrance = NO and has no rating, then make changes to the Retail space as follows. a) UPDATE External Entrance to YES (where the effective

date of the update is a few months later than the current effective date; e.g.; 3/1/2000) – should have different baseline date with rating, same current date with rating.

Approved in test (CB)

LK Notes-

B_ID 1685140- Dec 2007 is baseline before update. I think this test case is saying to change the effective date to a few months after the energy data start date, otherwise I am not sure why it would change the baseline PED. If so, then yes, it changed the baseline PED to Feb 2008 and ratings are correct.

UR-007

Retail External Entrance and Rating Eligibility (Two Retail Spaces 1)

Start with a building that has one retail spaces, has energy data from 1/1/2007 through last month and many years of space data (e.g., effective dates 1/1/2000), External Entrance = YES, and has a rating: a) Add a Retail space, External Entrance = YES – should still have

a rating. b) Then… for Retail Space #1, CORRECT the External Entrance

attribute to NO – should still get a rating. c) Then… for Retail Space #2, CORRECT the External Entrance

attribute to NO – confirm building Baseline and Current PED does not change, but loses the rating and has the appropriate NA reason for no rating.

Approved in test (CB)

Special test to double check: (b) this was a late fix to the code.

LK Notes- B_ID 1685145. Confirmed that it works correctly.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 4

# Name Description Status Notes / Mantis ERs

UR-008

Retail External Entrance and Rating Eligibility (Two Retail Spaces 2)

Start with a building that has two retail spaces, has energy data from 1/1/2007 through last month and many years of space data (e.g., effective dates 1/1/2000), External Entrance = YES for both spaces, and has a rating, a) UPDATE External Entrance attribute for Retail Space #1 to NO

(effective date of the update is 1/1/2009) (no change in baseline, current PED and rating)

b) UPDATE External Entrance attribute for Retail Space #2 to NO (effective date of the update is 1/1/2008)

Results expected:- No Baseline change- No Current PED change but no rating.

Approved in test (CB)

LK Notes- Using B_ID- 1685148, this works as expected EXCEPT the current period did not get reset to December 2008. This is the last period that can get a rating, but it still shows the current period as June 2009. CB Note: test case was incorrectly documented.

UR-009Retail External Entrance and Baseline

Start with a building that has one retail space, has energy data from 1/1/2007 through last month and many years of space data (e.g., effective dates 1/1/2000), External Entrance = NO (no Rating for baseline or current) a) UPDATE External Entrance attribute to YES (effective date of

the update is 2/1/2008) Results expected:- Baseline should be set to Jan 2009- Current PED should get set to latest month and get a rating.

Approved in test (CB)

LK Notes- Confirmed with 1685132.

UR-010

Retail External Entrance and new Label Questions – Single Facility Labeling (1)

Start with a building with one retail space and eligible for a label. Apply for the label and …a) Confirm new “is this a single store?” question – Answer N and

receive appropriate message and no ability to continue with la-bel

b) Then change answer to Y and confirm you can continuec) Confirm new “is this store part of a larger building?” question

(and appropriate choices) – Answer with the unacceptable choice and confirm you cannot continue

d) Then change answer each of the acceptable choices and con-firm you can continue.

Approved in Test

One conditional approval – the message for mixed use is going to need a link to the public web page once the page url is available.

LK Notes- Confirmed with 1685152.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 5

# Name Description Status Notes / Mantis ERs

UR-011

Retail External Entrance and new Label Questions – Single Facility Labeling (2)

Confirm that the Retail questions only display when appropriate:a) Eligible Building with NO Retail space – no Retail questions

asked.b) Eligible Building with one Retail space > 50% of building – Retail

questions asked.c) Eligible Building with one Retail space <= 50% of – No Retail

questions asked.d) Eligible Building with two Retail spaces totaling > 50% of build-

ing – Retail questions asked.e) Eligible Building with two Retail spaces totaling <= 50% of build-

ing – No Retail questions asked.

Approved in Test- Lia

LK Notes:

a) Found during HOW testing, b_id 1684294 did show a question about retail but it does not now so this must be fixed. Have not seen it happen with any other testing.b) Confirmed with 1685183.c) Confirmed with 1685179 for a retail space that is smaller then the other space. Having a problem creating a scenario were retail space is = 50%.. then the bldg is not eligible for a rating or ES.d) Confirmed with 1685177.e) Confirmed with 1685182.

UR-012

Retail External Entrance and new Label Questions – Multi-Facility Labeling

Confirm the new Retail questions properly display when a Retail building is processed through the Multi-Facility Labeling process.

Approved in Test- Lia

To be retested: Still have a problem with MFL. I said NO to the Single Store question (and picked the first answer for the other question) and was able to continue. No for single store is not supposed to be acceptable. I was stopped when the answer to the second question was unacceptable.

Also need to watch for buildings not showing on list to add to MFL.

This is Fixed.

LK Notes: Tested with 1685279 in LAM, receive error message and cannot proceed if I select “No” to first question.

UR-013Retail Label (and Rating) Eligibility Regression Test

Confirm the existing eligibility requirements for Retail space gross floor area must be >= 5,000 ft.

Approved in Test

Lk Notes- Confirmed in Test with 1685291.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 6

# Name Description Status Notes / Mantis ERs

UR-014 Retail Model Documentation

Confirm the information about the new Retail Attribute is reflected on all appropriate Help and Web pages, including:- Appropriate pages in Target Finder Help- Appropriate pages in PM Help- Retail Technical Description Document http://www.energystar.gov/index.cfm?c=evaluate_performance.bus_portfoliomanager_model_tech_desc - Space Type Definitions web pagehttp://www.energystar.gov/index.cfm?c=eligibility.bus_portfoliomanager_space_types - Rating Criteria pagehttp://www.energystar.gov/index.cfm?c=eligibility.bus_portfoliomanager_eligibility - Operating Characteristics Summary Tablehttp://www.energystar.gov/ia/business/evaluate_performance/OperatingCharacteristics.pdf

Partially in test (not HELP)

14479 – PM Help

14486 – TF Help

HELP Drafts were sent to EPA.

14469 – Technical docs and Operating Char PDF

14470 – web page changes (although this should be replaced by other ERs entered by Stephanie)

UR-015Target Finder & Required Retail Attributes

Add a Retail space to Target Finder and confirm the new External Entrance attribute displays. If Yes is selected, confirm building can be rated; if No is selected, confirm message displays at top of results screen explaining why no rating.(Regression test that other proper Retail attributes display)

In test Site-source problems on OSR

Emissions wrong values

14485

WAREHOUSE SPACE MODELS(Refer to Data Testing for specific Warehouse Building/Space tests)

UW-001 Warehouse Conversion

Pull space, attribute and PVL data in test (PMEST10) prior to conversion script run. Pull data after and confirm:1. Spaces converted to new st_id (479 to 1001, 480 to 1002)2. Existing attributes unchanged (exception – Number of Workers

(sat_id = 32) converted to Workers on Main Shift (sat_id = 19))3. Optional attribute (unrefrigerated only) not added.4. PVL remains unchanged except for Rating (confirmed in Data

Testing) and metrics related to Predicted Source.

Approved in test-beta, test-live and prod-beta - CB

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 7

# Name Description Status Notes / Mantis ERs

UW-002

Space Attribute Editing – Existing Space – Refrigerated Warehouse

View space data for existing Refrigerated Warehouse Space type, and verify:1. Three required attributes (no optionals) show with correct

names, drop down choices an/or units 2. User can “Correct” or “Update” attribute values (unless set to

Default, then only “Correct” is applicable)3. User does receive “might lose rating” message when effective

date is not earliest.

Approved in test-live- Lia

Confirmed with b_id 1684296

UW-003

Space Attribute Editing – Existing Space – Unrefrigerated Warehouse

View space data for existing Unrefrigerated Warehouse Space type, and verify:- Six required attributes show with correct names, drop down

choices an/or units- One new optional attribute displays with no value- User can “Correct” or “Update” attribute values (unless set to

Default or optional value, then only “Correct” is applicable)- Required Attributes - User does receive “might lose rating”

message when effective date is not earliest.- Optional Attribute - User does not receive “might lose rating”

message when effective date is not earliest.

Approved in test-live - CB

NOTE- Optional attribute displays with value of NO due to not-null field in the database.  OK as is.

Note: Test Case has incorrect step. User WILL still receive the “might lose the rating” message even when editing optional attributes. Turns out this is how is is working in production too. So, step 5 is incorrectly documented. The displayed message is OK and displays at the right time (when dates is changed to be prior to earliest date of any attribute.)

UW-004Add New Refrigerated Warehouse Space

Add new building or new Refrigerated Warehouse space to existing building and verify:b) Three required attributes initially display with no values (and

correct default effective dates to match building date).1. Attributes show correct names, drop down choices an/or units2. User can enter and save values for all attributes

Approved in test-live- Lia Confirmed with b_id 1684303

UW-005Add New Unrefrigerated Warehouse Space

Add new building or new Unrefrigerated Warehouse space to existing building and verify:1. Six required and one optional attributes initially display with no

values (and correct default effective dates to match building date).

2. Attributes show correct names, drop down choices an/or units3. User can enter and save values for all attributes4. Optional attribute cannot be set to default.

Approved in test-live- Lia

NOTE- If a user chooses not to select an option for Distribution Center, then it gets recorded as NO. We should clarify this to user. Entered low-priority ER to address this someday: 15712.

Otherwise this looks fine. Confirmed with B_id 1684304

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 8

# Name Description Status Notes / Mantis ERs

UW-006 Warehouse Default Value Tests

Create four buildings with identical energy such that each building gets a rating:a) One Refrigerated Warehouse space with all default values

(except gross floor area)b) One Unrefrigerated Warehouse space with all default values

(except gross floor area)c) One Refrigerated Warehouse space with same gross floor area

and all attribute values set according to default.d) One Unrefrigerated Warehouse space with same gross floor

area and all attribute values set according to default.Buildings (a) and (c) should have identical RatingBuildings (b) and (d) should have identical Rating

Approved in test-live- Lia Confirmed with b_ids 1684307,

1684305, 1684306 and 1684308. Group UH-006 Default Values.

UW-007

Warehouse Space on Data Checklist and Facility Summary Report

Using buildings in previous Warehouse test cases, generate the “SEP” in two scenarios:a) non-label scenario, andb) label application scenarioConfirm attribute values, as entered in space screens, properly display in the Data Checklist and the Facility Summary Report (and optional attributes display with the “o” superscript to indicate “optional”)Confirm Data Checklist questions per spec.Specifically confirm values are properly displayed for the buildings with all default values.

In Test

UW-008Warehouse Attributes and Target Finder

Add a Warehouse space and an Unrefrigerated Warehouse space to Target Finder and confirm correct attributes display (only required attributes).

Approved in test-live- Lia (Note – other issues with TF – rejected

with 14485 - will require that this gets retested.)

UW-009Warehouse Rating Eligibility – Single Space

The following test is performed twice – once for Refrigerated Warehouse and once for Unrefrigerated Warehouse:Create a building with one Warehouse space and all attributes and energy such that the building is eligible for a rating (i.e., gross floor area >= 5,000 sq ft, weekly operating hours >= 30, # workers > 0). Make each of these changes individually (i.e., make the change and then restore the value) and confirm that building loses the rating and appropriate NA reason displays:a) Change (“correct”) gross floor area to < 5,000 sq ftb) Change (“correct”) weekly operating hours < 30c) Change (“correct”) # workers = 0

Approved in test-live- Lia

Was able to confirm using b_ids 1684308 and 1684305.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 9

# Name Description Status Notes / Mantis ERs

UW-010Warehouse Rating Eligibility – Two Spaces Same Type

The following test is performed twice – once for Refrigerated Warehouse and once for Unrefrigerated Warehouse:Create a building with two Warehouse spaces (of same type) and all attributes and energy such that the building is eligible for a rating when the spaces are totaled but not eligible as each individual space. i.e.:- gross floor area for each space = 3,000 sq ft- weekly operating hours for each space = 20 - # workers = 0 for one space, 1 for the other spaceThis test confirms that the attribute values are “additive” for the same space types and the building should get a rating.

Approved in test-live- Lia

NOTE- Operating hours are not additive but are weighted by floor space. Therefore buildings in this example do not get a rating because the average operating hours is still 20. This is working as designed.

Used b_ids 1684305 and 1684308Confirmed that the operating hours are being weighted correctly by changing floor area and op hours for one space to be much higher and building now gets a rating.

UW-011

Warehouse Rating Eligibility – Two Spaces Different Types

Create a building with one Refrigerated Warehouse space and one Unrefrigerated Warehouse space, energy such that the building is eligible for a rating, but spaces are not eligible based on attributes. i.e.:- gross floor area for each space = 3,000 sq ft- weekly operating hours for each space = 20 - # workers for each space = 0This test confirms that the attribute values are not “additive” for different warehouse space types and the building should NOT get a rating. Confirm NA reason is appropriate.

Approved in test-live- Lia

Was able to confirm using b_id 1684308.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 10

# Name Description Status Notes / Mantis ERs

UW-012

Refrigerated Warehouse Label Eligibility Alerts and LAT Alerts – Single Facility Labeling

Create a building with one Unrefrigerated Warehouse space and all attributes and energy such that the building is eligible for a rating AND is eligible for a label.By changing the space attribute values appropriately (but maintaining a rating of > 75), create each of these conditions (where possible create multiple conditions with one label application but make sure all conditions are tested):(a) # of workers between 0.05 and 1.5 per 1,000 sq ft (no alert)(b) # of workers > 1.5 per 1,000 sq ft (alert)(c) # of workers < 0.05 per 1,000 sq ft (alert)Apply for a label and confirm that the appropriate alerts either do not appear or appear and require user input. After creating each condition, submit the application, then go to iSTAR Label Application Tracking (LAT) and confirm that the appropriate alerts and user explanations display. Reject the application and return to PM to create different conditions.

Approved in Test- Lia

(A)- B_id 1684385- no alerts showed which is correct.

IN LAT- It shows as “Action Required” even though worker density is in range (1 per 1,000).

Rejected ER 14471This is FIXED.(B)- B_id 1684393- correct alert showed.

(C)- B_id 1684398- correct alert showed.

IN LAT- it shows as “Pass” even though the worker density is out of range (0.02/1,000 sq.ft.)

Rejected ER 14471This is FIXED.All notes appeared correctly in LAT.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 11

# Name Description Status Notes / Mantis ERs

UW-013

Unrefrigerated Warehouse Label Eligibility Alerts and LAT Alerts - Single Facility Labeling

Create a building with one Refrigerated Warehouse space and all attributes and energy such that the building is eligible for a rating AND is eligible for a label.By changing the space attribute values appropriately (but maintaining a rating of > 75), create each of these conditions (where possible create multiple conditions with one label application but make sure all conditions are tested):a) # of workers between 0.05 and 1.5 per 1,000 sq ft (no alert)b) # of workers > 1.5 per 1,000 sq ft (alert)c) # of workers < 0.05 per 1,000 sq ft (alert)d) Walk-in Refrig Units <= 0.1 per 1,000 sq ft (no alert)e) Walk-in Refrig Units > 0.1 per 1,000 sq ft (alert)Apply for a label and confirm that the appropriate alerts either do not appear or appear and require user input. After creating each condition, submit the application, then go to iSTAR Label Application Tracking (LAT) and confirm that the appropriate alerts and user explanations display. Reject the application and return to PM to create different conditions.

Approved in Test- Lia

(A, D)- b-id 1684743- no alerts showed.

In LAT- it shows “Action Required” for Number of Workers even though Worker Density is 1 per 1,000 which is in the range.Rejected ER 14471This is fixed.

(B, E)- 1684745- Correct alerts show, however message for Walk-In’s is incorrect. It currently shows the same message as for Number of workers.Rejected ER 14473This is fixed.

In LAT- it does not show comment for Walk-in density.Rejected ER 14471This is fixed.

(C, E)- 1684744- Correct alerts show, however message for Walk-In’s is incorrect. It currently shows the same message as for Number of workers.Rejected ER 14473This is fixed.

In LAT- it shows “Pass” for Number of Workers even though worker density is 0.01 per 1,000. For Walk-in Density, it did not show note I entered.Rejected ER 14471This is fixed.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 12

# Name Description Status Notes / Mantis ERs

UW-014

Warehouse Label Eligibility Alerts and LAT Alerts – Multi-Facility Labeling

Confirm the above alerts properly display when Refrigerated Warehouse and Unrefrigerated Warehouse buildings are added to the Multi-Facility Labeling process.Note: to repeat the entire test would be impractical so spot check with several key alert conditions.

Approved in Test- Lia

REFRIGERATED TEST-

Both conditions (no alert and alert showed correctly both in LAM and LAT).

UNREFRIGERATED TESTS

(A,D)- b_id 1684748- no alerts showed which is correct.

IN LAT- shows “Action Required” for Number of Workers even though Worker Density is 1 per 1,000 which is in range.

Rejected ER 14471. This is fixed.

(B,E)- b_id 1684749- correct alerts showed.

LAT alerts showed correctly with notes.

(C,E)- B_id 1684750- correct alerts showed.

IN LAT- shows “Pass” for worker density even though it is not in range.

Rejected ER 14471This is fixed.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 13

# Name Description Status Notes / Mantis ERs

UW-015 Warehouse Source EUI LAT Alert

The following test is performed twice – once for Refrigerated Warehouse and once for Unrefrigerated Warehouse:Create a building with one Warehouse space and all attributes and energy such that the building is eligible for a rating AND is eligible for a label.Adjust energy and space data such that the Source EUI (in kBtu/ft2) for the building meets the conditions below:For Refrigerated Warehouses:- Source EUI is between 54 and 536 (no alert)- Source EUI is < 54 (alert)- Source EUI is > 536 (alert)For Unrefrigerated Warehouses: - Source EUI is between 11 and 106 (no alert)- Source EUI is < 11 (alert)- Source EUI is > 106 (alert)Apply for a label (Source EUI alert should never appear to the user). Go to iSTAR Label Application Tracking (LAT) and confirm that the appropriate alerts display. Reject the application and return to PM to create different conditions.

Approved in Test (Lia)

REFRIGERATED TESTS

Refrigerated with normal source EUI- B_ID 1684303. Showed correctly in LAT.

Refrigerated with low source EUI- B_id 1684753. Showed correctly in LAT.

**Refrigerated with high source EUI- b_id 1684752- cannot get source EUI to be high without losing 75 rating.

UNREFRIGERATED TESTSUnrefrigerated with low source EUi- B_id 1684754

Unrefrigerated with normal EUI- B_id 1684755

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 14

# Name Description Status Notes / Mantis ERs

UW-016 Warehouse Model Documentation

Confirm the information about the new Warehouse Model is reflected on all appropriate Help and Web pages, including:- Appropriate pages in Target Finder Help- Appropriate pages in PM Help- Warehouse Technical Description Document http://www.energystar.gov/index.cfm?c=evaluate_performance.bus_portfoliomanager_model_tech_desc - Space Type Definitions web pagehttp://www.energystar.gov/index.cfm?c=eligibility.bus_portfoliomanager_space_types - Rating Criteria pagehttp://www.energystar.gov/index.cfm?c=eligibility.bus_portfoliomanager_eligibility - Operating Characteristics Summary Tablehttp://www.energystar.gov/ia/business/evaluate_performance/OperatingCharacteristics.pdf - Performance Ratings Technical Methodology PDFhttp://www.energystar.gov/ia/business/evaluate_performance/General_Overview_tech_methodology.pdf- FAQs (two questions related to warehouse; search on

“Warehouse’)http://energystar.custhelp.com/cgi-bin/energystar.cfg/php/enduser/std_alp.php

Partially in test (not HELP)

14479 – PM Help

14486 – TF Help

HELP Drafts were sent to EPA.

14469 – Technical docs and Operating Char PDF

14470 – web page changes (although this should be replaced by other ERs entered by Stephanie)

UW-017ES Labeled Building and Plant Registry

Ensure Warehouse buildings can be searched for and properly display on the public Labeled Building tool.Label Registry needs to be tested in the existing version plus the new “mash-up” version (planned for release Aug 24th)

In Test (14472) Does NOT work on the OLD Registry. Lia – please check this out on new registry with buildings you approve.

HOUSE OF WORSHIP SPACE MODELS(Refer to Data Testing for specific House of Worship Building/Space tests)

UH-001

House of Worship Conversion (from Other-Religious Worship)

Pull space, attribute and PVL data in test (PMEST10) prior to conversion script run. Pull data after and confirm:1. Spaces converted to new st_id (1003 from st_id 42 + sto_id 25)2. Three existing attributes unchanged (floor area (3), Weekly

Operating Hours (18), Number of PCs (20))3. New records added for new attributes (set to default)4. PVL remains unchanged except for Rating (confirmed in Data

Testing) and metrics related to Predicted Source. Building Type may change.

Approved in test-beta, test-live and prod-beta - CB

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 15

# Name Description Status Notes / Mantis ERs

UH-002

Space Attribute Editing – Existing Space – House of Worship

View space data for existing House of Worship Space type (converted from Other-Religious Worship), and verify:1. Seven required attributes show with correct names, drop down

choices an/or units2. User can “Correct” or “Update” attribute values (unless set to

Default, then only “Correct” is applicable)3. User does receive “might lose rating” message when effective

date is not earliest.

Approved in test-live- Lia

NOTE- The update user for the new attributes is showing as “ER14073”. Should be SYSTEM and CB believes that this was already reported as an ER.

Was able to verify 1,2,3 with building 1684128.

UH-003 Add New House of Worship Space

Add new building or new House of Worship space to existing building and verify:1. Seven required attributes initially display with no values (and

correct effective dates)2. Attributes show correct names, drop down choices an/or units3. User can enter and save values for all attributes

Approved in test-live- Lia

Was able to confirm 1, 2, 3 with building 1684179.

UH-004 House of Worship Default Value Tests

Create two buildings with identical energy such that each building gets a rating:a) One House of Worship space with all default values (except

gross floor area)b) One House of Worship space with same gross floor area and all

attribute values set according to default.Buildings should have identical Ratings

Approved in test-live - CB

UH-005

House of Worship Space on Data Checklist and Facility Summary Report

Using buildings in previous House of Worship test cases, generate the “SEP” in two scenarios:a) non-label scenario, andb) label application scenarioConfirm attribute values, as entered in space screens, properly display in the Data Checklist and the Facility Summary Report.Confirm Data Checklist questions per spec.Specifically confirm values are properly displayed for the buildings with all default values.

In Test (14480) Per Supriya- changes are not in for data checklist yet.

Statement for Display purposes doesn’t have building’s rating.

UH-006House of Worship Attributes and Target Finder

Add a House of Worship space to Target Finder and confirm correct attributes display (only required attributes).

In test Site-source problems on OSR

Emissions wrong values

14485

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 16

# Name Description Status Notes / Mantis ERs

UH-007House of Worship Rating Eligibility – Single Space

Create a building with one House of Worship space and all attributes and energy such that the building is eligible for a rating (i.e., gross floor area >= 1,000 sq ft, # seats >= 25 and <= 4,000 *). Make each of these changes individually (i.e., make the change and then restore the value) and confirm that building loses the rating and appropriate NA reason displays:f) Change (“correct”) gross floor area to < 1,000 sq ftg) Change (“correct”) # seats < 25h) Change (“correct”) # seats > 4,000* Note: Weekly hours of operation, # PCs, # Refrig/Freezers just need to be non-negative so set to 0 for all.

Approved in test-live- Lia

Was able to confirm with b_id 1684179.

UH-008House of Worship Rating Eligibility – Two Spaces

Create a building with two House of Worship spaces and all attributes and energy such that the building is eligible for a rating when the spaces are totaled but not eligible as each individual space. i.e.:- gross floor area for each space = 600 sq ft- # Seats for each space = 2,500 - Weekly hours of operation, # PCs, # Refrig/Freezers = 0This test confirms that the attribute values are “additive” for the same space type and the building should get a rating.

Approved in test-live- Lia

Was able to confirm with b_id 1684180.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 17

# Name Description Status Notes / Mantis ERs

UH-009

House of Worship Label Eligibility Alerts and LAT Alerts – Single Facility Labeling

Create a building with one House of Worship space and all attributes and energy such that the building is eligible for a rating AND is eligible for a label.By changing the space attribute values appropriately (but maintaining a rating of > 75), create each of these conditions (where possible create multiple conditions with one label application but make sure all conditions are tested):- # seats between 10 and 55 per 1,000 sq ft (no alert)- # seats < 10 per 1,000 sq ft (alert)- # seats > 55 per 1,000 sq ft (alert)- Hours of Operation between 10 and 100 (no alert)- Hours of Operation < 10 (alert)- Hours of Operation > 100 (alert)- # PCs <= 1.0 per 1,000 sq ft 10 (no alert)- # PCs > 1.0 per 1,000 sq ft 10 (alert)- # Ref/Freezer Units <= 0.055 per 1,000 sq ft (no alert)- # Ref/Freezer Units > 0.055 per 1,000 sq ft (alert)Apply for a label and confirm that the appropriate alerts either do not appear or appear and require user input. After creating each condition, submit the application, then go to iSTAR Label Application Tracking (LAT) and confirm that the appropriate alerts and user explanations display. Reject the application and return to PM to create different conditions.

Approved in Test- Lia

(A, D, G, I)- Building id 1684323 with space attribute values that should prompt NO alerts This is okay.

(B, E, H, J)- Building ID 1684322 with four space attributes that prompt alerts. The alerts did appear in PM, however the notes I entered did not make it to LAT. DEFECT

This is fixed.

(C, F, H, J)- Building ID with four space attributes that prompt alerts. The alerts did appear in PM, however the notes I entered did not make it to LAT. DEFECT

This is fixed.

UH-010

House of Worship Label Eligibility Alerts and LAT Alerts – Multi-Facility Labeling

Confirm the above alerts properly display when a House of Worship building is added to the Multi-Facility Labeling process.Note: to repeat the entire test would be impractical so spot check with several key alert conditions.

Approved in Test-Lia

Using the LAM for HOW, B_ID 1684756- The LAM prompts a question for Operating Hours even though it is in range (90).Rejected 14473This is fixed.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 18

# Name Description Status Notes / Mantis ERs

UH-011House of Worship Source EUI LAT Alert

Create a building with one House of Worship space and all attributes and energy such that the building is eligible for a rating AND is eligible for a label.Adjust energy and space data such that the Source EUI (in kBtu/ft2) for the building meets the conditions below:- Source EUI is between 13 and 129 (no alert)- Source EUI is < 13 (alert)- Source EUI is > 129 (alert)Apply for a label (Source EUI alert should never appear to the user). Go to iSTAR Label Application Tracking (LAT) and confirm that the appropriate alerts display. Reject the application and return to PM to create different conditions.

Approved in Test-Lia

Confirmed with b_id 1684760 and 1684761 (low and normal.) Was not able to reproduce high Source EUI situation without losing ability to apply for label.

UH-012ES Labeled Building and Plant Registry

Ensure House of Worship buildings can be searched for and properly display on the public Labeled Building tool.Label Registry needs to be tested in the existing version plus the new “mash-up” version (planned for release Aug 24th)

Approved in Test- Lia

Used building HOW LABEL Alerts 1 and was able to find it in both old and new registries.

LET’S RETEST THIS AFTER 14472 GETS TO TEST TO MAKE SURE IT STILL WORKS.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 19

# Name Description Status Notes / Mantis ERs

UH-013House of Worship Model Documentation

Confirm the information about the new Warehouse Model is reflected on all appropriate Help and Web pages, including:- Appropriate pages in Target Finder Help- Appropriate pages in PM Help- New House of Worship Technical Description Document http://www.energystar.gov/index.cfm?c=evaluate_performance.bus_portfoliomanager_model_tech_desc - Space Type Definitions web pagehttp://www.energystar.gov/index.cfm?c=eligibility.bus_portfoliomanager_space_types - Rating Criteria pagehttp://www.energystar.gov/index.cfm?c=eligibility.bus_portfoliomanager_eligibility - Operating Characteristics Summary Tablehttp://www.energystar.gov/ia/business/evaluate_performance/OperatingCharacteristics.pdf - Portfolio Manager Overview (new space type)http://www.energystar.gov/index.cfm?c=evaluate_performance.bus_portfoliomanager - Performance Ratings Technical Methodology PDFhttp://www.energystar.gov/ia/business/evaluate_performance/General_Overview_tech_methodology.pdf (Note: ensure references are removed to the Religious Worship “Other” type)

Not in test 14479 – PM Help

14486 – TF Help

HELP Drafts were sent to EPA.

14469 – Technical docs and Operating Char PDF

14470 – web page changes (although this should be replaced by other ERs entered by Stephanie)

ENERGY TYPES/UNITS & CONVERSIONS, GHG EMISSIONS, FUEL COSTS

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 20

# Name Description Status Notes / Mantis ERs

UF-001Fuel, Energy, Emissions ref and xref tables updated

Confirm that all fuel and energy ref and xref tables are properly populated with new columns and/or data as documented in the EPA Guidance doc and related spreadsheet. Refer to separate .SQL file for queries. The following tables will be confirmed.Ref_unit_of_measureXref_uom_fuel_typeRef_fuel_typeMstr_fule_typeXref_avg_fuel_rateXref_elec_percentRef_rpg (need new factors for non-baseload emissions rates)Xref_district_emission_factor (new table)Ref_ghg_global_warming (new table)Ref_fuel_generation new table)Xref_fuel_generation_conv (new table)Ref_rec_generation (new table)Rec (new table)

Approved in test-live

(15179)

Tested in test-beta, test-live and prod-beta.

Also confirmed new non-load factors in ref_rpg.

NOTE: final confirmation (of ref_rpg) was only done in test-live.

UF-002 Fuel Generation Conversion

Confirm (via database queries) that the correct new generation code (fg_code) has been applied to each existing meter [Electricity: fg_code = EGP, District Chillled Water: appropriate code DCWEDCNG, DCWACNG, DCWEDC, or DCWO, all other: NONE). Note: a data pull prior to conversion is necessary to confirm the DCW conversion.

Approved in test-beta, test-live and prod-beta - CB

UF-003 Fuel Generation Selection

To any facility, add seven new meters to confirm the ability to utilize the new generation method when adding a fuel. Add three types of Electric meters and four types of District Chilled Water. (Pick any units) Confirm that District Chilled Water is only available as a single “non-hyphenated” choice.

Approved in test

UF-004 Other Fuel Type Extra Information

To any facility, add one new meters of fuel type “Other” and confirm the requirement to add “type of fuel” free-text entry.

Approved in Test (Debra)

14527

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 21

# Name Description Status Notes / Mantis ERs

UF-005

Fuel/Unit Entries, kBtu Multipliers, and Site/Source Conversion factors

Add a building with multiple meters: include with all combinations of valid fuel types and units as documented in specifications. Confirm all valid combinations are selectable and save properly and confirm invalid combinations are not possible. (Note: for simplicity, do NOT include Electric Solar or Wind; those will be confirmed in another test)While adding each meter, add the same 12 months of simple energy data (e.g. 100 units per month). Confirm the following (as displayed on facility Summary and on My Portfolio (to confirm PVL update). Note: Confirmations can be done once at the end in a spreadsheet or after each meter entry to confirm each new addition.a) Current Total Site Energy Use (kBtu) using the new/updated

conversion factors as specified. [Note: Natural gas conversion will also take into account Elevation factors – see test UM-001)

b) Current Site Electric Use (kWh) and Current Site Natural Gas Use (therms)

c) Current Source Energy Intensity (kBtu/Sq.Ft.) using the new/updated site-source conversion factors.

Approved in Test (Debra)

UF-006

Indirect Emissions Calculations (District Systems Only)

Add a new building and add a meter for each type of fuel that con-tribute to Indirect Emissions: District Steam, District Hot Water (new), District Chilled Water (Electric Driven Chiller, Absorption Chiller using Natural Gas, Engine-Driven Chiller using Natural Gas.) *Using the revised emissions conversion factors and the appropriate eGrid subregion rate, confirm the metric “Current Indirect GHG Emissions (MtCO2e)”. (Confirm the metric value on both Facility Summary and My Portfolio) [Electricity is also an Indirect Emission but will be calculated in other tests for all three generation types. See test UO-xxx.]

In Test (14542) DC – indirect emission was incorrect (14542) - RETEST

DC – rejected because the On-site are not calculating correctly for attribute not owned.

UF-007 DCW-Other and No GHG Emissions

To the building in the previous test, add another Meter: “District Chilled Water” with Generation Method: “Other”. Confirm that all GHG Emissions metrics now display NA and popup up an appropriate message.(Note: this functionality is identical to existing functionality for a build-ing that has a meter type of “Other”.)

In Test

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 22

# Name Description Status Notes / Mantis ERs

UF-008 Direct Emissions Calculations

Add a new building and add a meter for each type of fuel that con-tribute to Indirect Emissions: Natural Gas, Fuel Oil (No. 1, No. 2, No.4, No.5, No. 6), Diesel (No. 2), Propane, Liquid Propane, Kerosene, Coal (anthracite and bituminous), Coke

Using the appropriate on-site emissions factors, confirm the metric “Current Direct GHG Emissions (MtCO2e)”. (Confirm the metric value on both Facility Summary and My Portfolio)

Passed test - DC

UF-009 Total GHG and Wood

Using a building with one type of direct and one type of indirect fuel, confirm the “Current Total GHG Emissions” metric as a sum of the two individual metrics.Add Wood as a fuel with meter data entries.Confirm that the addition of the Wood fuel does NOT add to the direct or indirect emissions but does add appropriately to the total.

In test - Debra ER14542 is back in test so this can now be verified.

Wood and Direct are working correctly.

UF-010 Target Finder and Fuel Percentages

In Target Finder, run several tests with different zip codes and different building types (office, supermarket, etc) and enter no energy. Confirm that the correct electric/natural gas percentage is applied in the calculations.Note 1: Only a few combinations need be checked – ref data was confirmed via database.Note 2: Open ER regarding issue with short zip vs. state – when entering a zip that crosses state lines, the expected percentage may not be applied.

In test Site-source problems on OSR

Emissions wrong values

14485

UF-011 Target Finder and Fuel Rates

In Target Finder, run several tests with different zip codes (building type not relevant) and enter energy and no fuel costs. Confirm that the correct fuel cost is applied in the calculations. Only certain fuel types have fuel rates available – make sure all those are tested for one state: Electricity, Natural Gas, Propane, #2 Heating Oil, Coal.Note 1: Only a few combinations need be checked – ref data was confirmed via database.Note 2: Open ER regarding issue with short zip vs. state – when entering a zip that crosses state lines, the expected fuel rate may not be applied.

In test Site-source problems on OSR

Emissions wrong values

14485

Note that On-Site Wind and On-Site Solar are using the same Electricity-Grid fuel rates and not sure if this is correct (NEED ER)

UF-012

Fuel, Energy, Emissions Documentation Changes

Confirm the information about the new fuels, new units, and new conversion factors is reflected on all appropriate Help and Web pages, including:- Appropriate pages in Target Finder Help- Appropriate pages in PM Help- Confirm there are no other public web pages that should be

updated with this information.

Not in test Waiting for HELP comments back from EPA.

14479 – PM Help

14486 – TF Help

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 23

# Name Description Status Notes / Mantis ERs

UF-013

Energy Data on Data Checklist and Facility Summary Report

Using buildings in previous Energy test cases, generate the “SEP” in two scenarios:a) non-label scenario, andb) label application scenarioConfirm metrics and energy data is properly displayed

In Test (14480)

ONSITE RENEWABLE ENERGY

UO-001

On Site Electric Generation Methods and Meter Data (Add)

Add four buildings, each with one meter according to the building descriptions below (see also data tests DO-001 – DO-004)a) Building #001 – On-Site Solar, Resell=YES, Own=YESb) Building #002 – On-Site Solar, Resell =NO, OWN=YESc) Building #003 – On-Site Wind, Resell =YES, OWN=NOd) Building #004 – On-Site Wind, Resell =NO, OWN=NOFor all buildings:- Confirm the two new questions (re-selling renewable energy

back to the grid, and do you own the environmental attributes) display properly according to spec. Confirm the data is saved.

- Based on the answer to the “Resell” question, confirm that, per spec, the correct columns display when adding meter data.

For all buildings, enter at least 14 months of energy data (enter data such that baseline and current period will produce different results), enter the same energy data for the two wind meters and for the two solar meters and confirm:- Meter data can be entered and saved in all columns correctly - Meter data can be edited after the initial data entry,- New meter energy data can be added after the initial data entry.

Back In Dev (14540)

Test Case Passed. Have not passed ER yet.

(Generation method not defaulting)

UO-002

On-Site Electric Generation Methods and Meter Data (Edit)

Using COPIES of some of the buildings above (save these four buildings for future use as data tests DO-001 thru DO-004), perform various edits to the energy type, units, generation method and REC question and ensure all changes save properly and affect the entry of meter data appropriately.

In Test (14540) Test Case Passed.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 24

# Name Description Status Notes / Mantis ERs

UO-003 Metric Calculations for On-Sites

For the four buildings in test UO-001 (also data tests DO-001 – DO-004), confirm the energy is correctly used, per spec, to calculate the following existing metrics: - Current Total Site Energy Use (kBtu) - Current Site Electric Use (kWh) - Current Source Energy Intensity (kBtu/Sq.Ft.) - Current Direct GHG Emissions (MtCO2e)- Current Total GHG Emissions (MtCO2e)- Baseline Total Site Energy Use (kBtu) - Baseline Site Electric Use (kWh) - Baseline Source Energy Intensity (kBtu/Sq.Ft.) - Baseline Direct GHG Emissions (MtCO2e)- Baseline Total GHG Emissions (MtCO2e)(Confirm the metric values on both Facility Summary and My Portfolio)Note: the site and source calculations differ depending on the answer to the “resell” question; the emissions metrics differ depending on the answer to the “own environmental attributes” question.

In test New ER15832 opened due to incorrect Source Intensity for On-Site - FIXED

New ER15835 opened due to NA not displaying. – IN TEST

UO-004

All Electric Generation Methods and Meter Data (Add)

Add four buildings, each with two meters, one standard electric meter (generation= Grid) and a second meter according to the descriptions below (see also data tests DO-005 – DO-008)a) Building #005 – On-Site Solar, Resell=YES, Own=YESb) Building #006 – On-Site Solar, Resell=NO, Own=YESc) Building #007 – On-Site Wind, Resell=YES, Own=NOd) Building #008 – On-Site Wind, Resell=NO, Own=NOFor all buildings:- Confirm the two new questions (re-selling renewable energy

back to the grid, and do you own the environmental attributes) only display on the on-site meter.

- Based on the answer to the “Resell” question, confirm that, per spec, the correct columns display when adding meter data. (Confirm the Electric/Grid meter data displays properly)

- Enter at least 14 months of energy data for all meters (enter data such that baseline and current period will produce different results). Enter the same energy data for all four electric/grid meters; enter the same energy data for the two wind meters and for the two solar meters.

In Test (14540) Confirmed new questions.

Confirmed correct columns display in meter data for the “Resell’ question.

RETEST - Rejected due to column heading for ‘Energy Use’ not showing for grid.

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 25

# Name Description Status Notes / Mantis ERs

UO-005 Metric Calculations for On-Sites

For the four buildings in test UO-004 (also data tests DO-005 – DO-008), confirm the energy is correctly used, per spec, to calculate the following existing metrics: - Current Total Site Energy Use (kBtu) - Current Site Electric Use (kWh) - Current Source Energy Intensity (kBtu/Sq.Ft.) - Current Direct GHG Emissions (MtCO2e)- Current Total GHG Emissions (MtCO2e)- Baseline Total Site Energy Use (kBtu) - Baseline Site Electric Use (kWh) - Baseline Source Energy Intensity (kBtu/Sq.Ft.) - Baseline Direct GHG Emissions (MtCO2e)- Baseline Total GHG Emissions (MtCO2e)(Confirm the metric values on both Facility Summary and My Portfolio)

In Test RETEST - New ER15832 opened due to incorrect Source Intensity for On-Site (looks OK – CB)

UO-006 New Renewable Energy Metrics

Add a new custom view and confirm that the following new columns are available for selection and display in a new section called “Renewable Energy”. Create a new view with these metrics:- Current Total On-Site Renewable Electric Use (kWh)- Baseline Total On-Site Renewable Electric Use (kWh)- Total Renewable Energy Sold to Grid (kWh)- Total Revenue From Energy Sold to the Grid ($)- Total On-Site Electric Generation

Approved in Test

View displays OK.

UO-007 Renewable Metric Calculations

Using the eight buildings created in tests UO-001 and UO-004 (i.e., data tests DO-001 thru DO-008), a) Create a group to include these buildings. b) Display the group and select the custom view created in test

UO-006. c) Confirm the values displayed for the 5 new metrics.d) Go to the Facility Summary screen for each building. Select the

new custom view – confirm the same values display for the 5 attributes.

Note: confirm that Current Total On-Site Renewable Electric Use (kWh) + Total Renewable Energy Sold to Grid (kWh) = Total On-Site Electric Generation.

In test (15826) RETEST - ER 15826 – incorrect Revenue on My Portfolio screen

Also need to retest all NA valuies

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 26

# Name Description Status Notes / Mantis ERs

UO-008 Various Meter Scenarios

Using the new on-site meters, enter various scenarios of meter data such that:a) meter data entries fall on exact calendar months b) meter data entries start and end mid-month (in this scenario,

also confirm the calculations for the 5 new metrics in test UO-006)

c) meter data is missing for a month (gaps)d) meter data overlaps more than one daye) meter data entry is > 65 daysf) meter data entered for 11 months (should extrapolate)g) meter data entered for less than 11 monthsh) meters can be inactivatedAll scenarios should behave exactly as if the meters were entered as electric/grid meters (i.e., basic rules apply for meter alerts, setting current period ending dates, etc)

In Test

UO-009Tracking Renewable Energy Certificates

For new or existing building(s), run the following tests to confirm the entry and saving of facility-level REC data.- Confirm the display of a new section (per wireframe) on the

Facility Summary screen that shows the REC summary. - Confirm a new REC record can be added; confirm all data entry

fields are available per spec (Provider name, Generation Facility ID or Name, Quantity (two unit choices), Period of Generation (select Quarter), Fuel Type (6 choices).

- Confirm the new entered REC data is displayed properly on the Facility Summary screen.

- Confirm a REC can be deleted- Confirm a REC can be edited.

In test (14543) RETEST

On the Facility Summary REC table:1) Delete link does not lead to a popup confirmation.2) Table is not sorting per spec. Should sort in reverse chronological Period of Generation and then alphabetical by Provider Name within each quarter.On the Add REC screen:1 - According to spec, the Generation FAcility ID should have a type-ahead. This did not happen.

2 - The Generation Facility Name is hidden by default. If the Gen Fac ID is known, then populate with the name and deactivate the field. If unknow Gen Fac ID shows name as an editable field

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 27

# Name Description Status Notes / Mantis ERs

UO-010 REC Metrics

On My Portfolio and Facility Summary, confirm the following two new metrics for several buildings with Facility-level RECs.a) Total Renewable Energy Certificates Purchased (MWh) – will be

total of facility-level RECs only. On My Portfolio, this value is for the “current period”. On Facility Summary this value for the selected month. This should be confirmed for two building types:

o Current Period Ending Date falls at the end of a quarter (and REC entries can be fully included in the total), and

o Current Period Ending Date falls in the first or second month of a quarter and RECs are pro-rated for the quarters.

b) Total Avoided Greenhouse Gas Emissions from RECs – will be calculated value of avoided GHG emissions for all RECs. On My Portfolio, this value is for the “current period”. On Facility Summary this value for the selected. This should be confirmed for three building types:

o Facility ID found in the ref_pgp table, and Current Period Ending Date falls at the end of a quarter (and REC entries can be fully included in the total), and

o Facility ID found in the ref_pgp table, and Current Period Ending Date falls in the first or second month of a quarter and RECs are pro-rated for the quarters.

o Facility ID is not found in the table – ensure this metric displays an “NA” with appropriate message.

In Test (14545) Change column name to be Avoided Greenhouse Gas Emissions from REC(MtCO2e) on Facility Summary so labels are consistent.

UO-011OSR and REC Documentation Changes

Confirm the information about on-site renewables and RECs is reflected on all appropriate Help and Web pages, including:- Appropriate pages in Target Finder Help- Appropriate pages in PM Help- Confirm there are no other public web pages that should be

updated with this information.[Note: there is a new OSR FAQ page that will be linked to from HELP]

Not in test 14479 – PM Help

14486 – TF Help

HELP Drafts were sent to EPA.

UO-012

OSR Data on Data Checklist and Facility Summary Report

Using buildings in previous OSR test cases, generate the “SEP” in two scenarios:a) non-label scenario, andb) label application scenarioConfirm metrics and energy data are properly displayed according to specification and wireframes.

In Test (15318 – Supriya)

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 28

# Name Description Status Notes / Mantis ERs

UO-013 OSR Fuels and Target Finder

Confirm the new Electricity-On Site energy types can be selected. Confirm results (site, source, costs when nothing entered)

In test (14485) Bombs on some fuels; incorrect msg on one HOW space, incorrect msg when energy usage too high.

Question – should the Energy Rate of the OSR fuels be the same as the energy rate for the Electricity-Grid? Or do we think the Electricity Costs provided by EPA should ONLY apply to the Grid selection?

ADDITIONAL MISCELLANEOUS TESTS

UM-001

Elevation Factors used in Natural Gas kBtu conversions

(ER 14934) Ensure the elevation, as determined by a buildings zip code, is properly used when calculating the Natural Gas site energy consumption (in kBtu) for any building with Natural Gas meters. Test this with:a) Building with a Natural Gas meter located in zip 80901

(elevation factor = 0.799) – try different units for the Natural Gas Meter (i.e, cc, ccf, therms, etc)

b) Building with a Natural Gas meter located in zip 06401 (elevation factor = 1.0) – try different units for the Natural Gas Meter (i.e, cc, ccf, therms, etc)

In Test (14934) 14934 back in test and this issue is fixed: Problems with metric displays on cubic meters, mbtu, kbtu, therms.

Will do further testing after PVL update.

UM-002Better Messaging to Skip Meter Data Entry

(ER 14552) Confirm new format of screen after adding a meter – refer to spec/wireframe. Test adding a meter and then adding data. Test adding a meter and not adding data.

Approved in test (14552)

Passed test. DC

UM-003 Home Energy Yardstick (HEY) (ER 15460) Ensure proper functionality of this tool (regression test) Not in test -

Andrew

UM-004

PM Login page and Home page pre-release and release announcements

(ER 14477) When available in test, confirm the pre-release announcements are posted properly.(ER 14476) When available in test, confirm the release announcements are posted properly.

Not in test Draft sent to EPA.

UM-005 Campus Meters and OSR

(ER 14550) All OSR functionality (screen displays, data entry, metric calculations) related to building meter must be applied to Campus meters. Note: might not be done for August Release.

Not in test

UM-006 General Public Web Page Review

Review the C&I public web pages and confirm that all August changes are reflected on all pages. (This is related to tests within each section above but is included an individual test to ensure all public web pages were updated as applicable.)

Not in test - Andrew

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 29

# Name Description Status Notes / Mantis ERs

UM-007 Regression Test Site Energy Totals

Confirm that the Total Site Energy numbers in PM are correct for:a) one energy meter with energy matching calendar months b) one energy meter with energy entered with mid month

datesc) two energy meters – one mid-month, one matching

calendar months.

In test

UM-008 Regression Test LEADERS

Need to check Leaders functionality (try adding some OSR fuels to some buildings in a Leaders acct)

In test

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 30

# Building Names [or Types] Specific Tests *(* in additional to general metric confirmations)

Status Notes / Mantis ERs

For each of the model tests below, create a new building with the spaces as described in the building name. Create each building with:- Same zip code- Identical energy data in all buildings such that the building will get a different baseline and current period ending date (e.g., 14 months of an electric (grid) meter;

01/01/2008 thru 02/28/2009)- Attribute values that allow for a rating:

- Warehouse spaces: gross floor area > 5000 sq ft; weekly operating hours > 30, # workers > 0- House of Worship spaces: gross floor area > 1000 sq ft; # seats > 25 and < 4,000)

- and, if eligible, will get a rating that is > 1 and < 100. If rateable, ratings of these buildings will be confirmed using the appropriate model verification spreadsheet.

RW=Refrigerated Warehouse URW=Unrefrigerated WarehouseHOW=House of Worship

WAREHOUSE

DW-001 (A) One RW Confirm Rating

For all Warehouse Data tests – waiting for Building Imports to be available be-fore adding these buildings

DW-002 (A) One URW Confirm Rating

DW-003 (A) One RW - all defaults Confirm Rating

DW-004 (A) One URW - all defaults Confirm Rating

DW-005 (A) One RW-One URW Identical gross floor areasBuilding should not get a rating

DW-006 (A) One RW 60 -One URW 40RW=60% of floor areaConfirm Rating and Building Type

DW-007 (A) One RW 40-One URW 60RW=40% of floor areaConfirm Rating and Building Type

DW-008 (A) Two RWAll spaces identical floor areaConfirm Rating

DW-009 (A) Two URWAll spaces identical floor areaConfirm Rating

DW-010 (A) One RW 40-One Office 60RW=40% of floor area Confirm Rating and Building Type

DW-011 (A) One URW 40-One Office 60URW=40% of floor area Confirm Rating and Building Type

DW-012 (A) One RW 60-One Office 40RW=60% of floor area Confirm Rating and Building Type

DW-013 (A) One URW 60-One Office 40URW=60% of floor area Confirm Rating and Building Type

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 31

# Building Names [or Types] Specific Tests *(* in additional to general metric confirmations)

Status Notes / Mantis ERs

DW-014 (A) One RW-One URW-One OfficeAll spaces identical floor areaBuilding should not get a rating

DW-015 (A) Two RW-One OfficeAll spaces identical floor areaConfirm Rating and Building Type

DW-016 (A) One RW-One ParkingRW gross floor area > 50%Confirm Rating

DW-017 (A) One URW-One ParkingURW gross floor area > 50%Confirm Rating

DW-018 (A) One RW 90-One Other 10RW gross floor area =90%Confirm Rating

DW-019 (A) One URW 90-One Other 10URW gross floor area =90%Confirm Rating

DW-020 (A) One RW 89-One Other 11RW gross floor area =89%Building should not get a rating

DW-021 (A) One URW 89-One Other 11URW gross floor area =89%Building should not get a rating

DW-022 (A) One RW Time Weight

Update all attributes with change in the Current PED Confirm rating

DW-023 (A) One URW Time Weight

Update all attributes with change in the Current PED Confirm rating

HOUSE OF WORSHIP

DH-001 (A) One HOW Confirm Rating

For all HOW Data tests – waiting for Building Imports to be available before adding these buildings

DH-002 (A) One HOW - all defaults Confirm Rating

DH-003 (A) Two HOW Confirm Rating

DH-004 (A) One HOW 40-One Office 60RW=40% of floor area Confirm Rating and Building Type

DH-005 (A) One HOW 60-One Office 40RW=60% of floor area Confirm Rating and Building Type

DH-006 (A) Two HOW-One OfficeAll spaces identical floor areaConfirm Rating and Building Type

DH-007 (A) One HOW-One ParkingRW gross floor area > 50%Confirm Rating

DH-008 (A) One HOW 90-One Other 10RW gross floor area =90%Confirm Rating

DH-009 (A) One HOW 89-One Other 11RW gross floor area =89%Building should not get a rating

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 32

# Building Names [or Types] Specific Tests *(* in additional to general metric confirmations)

Status Notes / Mantis ERs

DH-010 (A) One HOW Time Weight

Update all attributes with change in the Current PED Confirm rating

RETAIL

For each of the tests below, create a new building with the spaces as described in the building name. Create each building with:- Same zip code- Identical energy data in all buildings from 1/1/2007 thru 6/30/2009- Attribute values that allow for a rating (gross floor area > 5000 sq ft)- and, if eligible, will get a rating that is > 1 and < 100. (These should be done with Building Import, if possible)

DR-001 (A) Retail EE YES

Confirm: Baseline Dec 2007 with Rating, Current June 2009 with Rating

DR-002 (A) Retail EE NO

Confirm: Baseline Dec 2007 with NO Rating, Current June 2009 with NO Rating

DR-003 (A) Retail EE NO 2007 YES 2008 2009

Confirm: Baseline Dec 2008 with Rating, Current June 2009 with Rating

DR-004 (A) Retail EE YES 2007 NO 2008 2009

Confirm: Baseline Dec 2007 with Rating, Current June 2009 with NO Rating

DR-005 (A) Retail EE YES 6 months then NO

Confirm: Baseline Dec 2007 with NO Rating, Current June 2009 with NO Rating

DR-006 (A) Two Retail EE YES

Confirm: Baseline Dec 2007 with Rating, Current June 2009 with Rating

DR-007 (A) Two Retail EE NO

Confirm: Baseline Dec 2007 with NO Rating, Current June 2009 with NO Rating

DR-008 (A) Retail EE YES and Retail EE NO

Confirm: Baseline Dec 2007 with Rating, Current June 2009 with Rating

DR-009 (A) Retail EE YES 2007 EE YES 2008

Confirm: Baseline Dec 2007 with Rating, Current June 2009 with Rating

DR-010

(A) Two Retail EE Mix 1- EE NO 2007 YES 2008 2009- EE NO

Confirm: Baseline Dec 2008 with Rating, Current June 2009 with Rating

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 33

# Building Names [or Types] Specific Tests *(* in additional to general metric confirmations)

Status Notes / Mantis ERs

DR-011

(A) Two Retail EE Mix 2- EE YES 2007 NO 2008 2009- EE NO

Confirm: Baseline Dec 2007 with Rating, Current June 2009 with NO Rating

DR-012

(A) Two Retail EE Mix 2- EE YES 6 months then NO- EE NO

Confirm: Baseline Dec 2007 with NO Rating, Current June 2009 with NO Rating

ON SITE RENEWABLES

For the energy test buildings 001 through 008 below, create these buildings with the meters characteristics as described in the name and with:

- Same valid zip code

- One space of the same type for all buildings (i.e. use office to separate this test from HOW and Warehouse)

- Identical space attributes.

- When creating the meters, enter 14 months of energy data that would not be affected by weather data (e.g., use 01/01/2008 through Feb 28, 2009) and such that the building will get a different baseline and current period ending date.

- Use identical energy data entries for the same meter types.

- The building should get a rating and the rating should fall between 1 and 100

-

DO-001 (A) On-Site Solar Resell Own

Confirm entry of meter dataConfirm metrics related to Site Energy, Source Energy, and Emissions.

Not in test

DO-002 (A) On-Site Solar NoResell Own

Confirm entry of meter dataConfirm metrics related to Site Energy, Source Energy, and Emissions.

Not in test

DO-003 (A) On-Site Wind Resell NoOwnConfirm entry of meter dataConfirm metrics related to Site Energy, Source Energy, and Emissions.

Not in test

DO-004 (A) On-Site Solar NoResell NoOwnConfirm entry of meter dataConfirm metrics related to Site Energy, Source Energy, and Emissions.

Not in test

DO-005 (A) Grid plus On-Site Solar Resell Own

Confirm entry of meter dataConfirm metrics related to Site Energy, Source Energy, and Emissions.

Not in test

DO-006(A) Grid plus On-Site Solar NoResell Own

Confirm entry of meter dataConfirm metrics related to Site Energy, Source Energy, and Emissions.

Not in test

DO-007 (A) Grid plus On-Site Wind Resell NoOwn

Confirm entry of meter dataConfirm metrics related to Site Energy, Source Energy, and Emissions.

Not in test

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 34

# Building Names [or Types] Specific Tests *(* in additional to general metric confirmations)

Status Notes / Mantis ERs

DO-008 (A) Grid plus On-Site Solar NoResell NoOwn

Confirm entry of meter dataConfirm metrics related to Site Energy, Source Energy, and Emissions.

Not in test

DO-009 (A) OSR Example Building 1Enter all data according to the example building in the guidance document.Confirm all metrics.

Not in test

Test Plan Version 1.2 – PM Aug 31, 2009 Release Page 35