Upload
sai-global-apac
View
213
Download
0
Embed Size (px)
Citation preview
7/31/2019 AS NZS ISO IEC 25062-2006 Software engineering - Software product Quality Requirements and Evaluation (SQua
1/10
AS/NZS ISO/IEC 25062:2006ISO/IEC 25062:2006
Australian/New Zealand Standard
Software engineeringSoftwareproduct Quality Requirements andEvaluation (SQuaRE)CommonIndustry Format (CIF) for usability testreports
AS/NZS
ISO/IEC25062:2006
7/31/2019 AS NZS ISO IEC 25062-2006 Software engineering - Software product Quality Requirements and Evaluation (SQua
2/10
AS/NZS ISO/IEC 25062:2006
This Joint Australian/New Zealand Standard was prepared by Joint TechnicalCommittee IT-015, Software and Systems Engineering. It was approved on behalfof the Council of Standards Australia on 27 October 2006 and on behalf of theCouncil of Standards New Zealand on 11 November 2006.This Standard was published on 11 December 2006.
The following are represented on Commit tee IT-015:
Australian Computer Society
Australian Electrical and Electronic Manufacturers Association
Australian Society or Technical Communications
Australian Software Metrics Association
Engineers Australia/ACTS Joint Board in Software Engineering
Griffith University
National Association of Testing Authorities Australia
National ICT Austral iaNew Zealand Organisation for Quality
Software Quality Association, ACT
Software Quality Association, NSW
Systems Engineering Society of Australia
The University of Queensland
University of Auckland, NZ
University of South Australia
University of Technology, Sydney
Vendor Interests, NZ
Keeping Standards up-to-date
Standards are living documents which reflect progress in science, technology andsystems. To maintain their currency, all Standards are periodically reviewed, andnew editions are published. Between editions, amendments may be issued.Standards may also be withdrawn. It is important that readers assure themselvesthey are using a current Standard, which should include any amendments whichmay have been published since the Standard was purchased.
Detailed information about joint Australian/New Zealand Standards can be found byvisiting the Standards Web Shop at www.standards.com.au or Standards NewZealand web site at www.standards.co.nz and looking up the relevant Standard in
the on-line catalogue.Alternatively, both organizations publish an annual printed Catalogue with fulldetails of all current Standards. For more frequent listings or notification ofrevisions, amendments and withdrawals, Standards Australia and Standards NewZealand offer a number of update options. For information about these services,users should contact their respective national Standards organization.
We also welcome suggestions for improvement in our Standards, and especiallyencourage readers to notify us immediately of any apparent inaccuracies orambiguities. Please address your comments to the Chief Executive of eitherStandards Australia or Standards New Zealand at the address shown on the backcover.
This Standard was issued in draft form for comment as DR 06544.
7/31/2019 AS NZS ISO IEC 25062-2006 Software engineering - Software product Quality Requirements and Evaluation (SQua
3/10
AS/NZS ISO/IEC 25062:2006
Australian/New Zealand StandardSoftware engineeringSoftwareproduct Quality Requirements andEvaluation (SQuaRE)CommonIndustry Format (CIF) for usability testreports
First published as AS/NZS ISO/IEC 25062:2006.
COPYRIGHT
Standards Australia/Standards New Zealand
All rights are reserved. No part of this work may be reproduced or copied in any form or byany means, electronic or mechanical, including photocopying, without the written
permission of the publisher.
Jointly published by Standards Australia, GPO Box 476, Sydney, NSW 2001 and Standards
New Zealand, Private Bag 2439, Wellington 6020
ISBN 0 7337 7909 3
7/31/2019 AS NZS ISO IEC 25062-2006 Software engineering - Software product Quality Requirements and Evaluation (SQua
4/10
ii
PREFACE
This Standard was prepared by the Joint Standards Australia/Standards New Zealand CommitteeIT-015, Software and Systems Engineering.
The objective of this Standard is to provide software usability professionals within supplier
organizations and customer organizations with a software usability testing Standard; the
Standard is a key factor in predicting successful deployment of software.
This Standard is identical with, and has been reproduced from ISO/IEC 25062:2006, Software
engineeringSoftware product Quality Requirements and Evaluation (SQuaRE)Common
Industry Format (CIF) for usability test reports.
As this Standard is reproduced from an international standard, the following applies:
(a) Its number appears on the cover and title page while the international standard number
appears only on the cover.
(b) In the source text this International Standard should read this Australian/New Zealand
Standard.
(c) A full point substitutes for a comma when referring to a decimal marker.
References to International Standards should be replaced by references to Australian or
Australian/New Zealand Standards, as follows:
Reference to International Standard Australian/New Zealand Standard
ISO/IEC AS/NZS ISO/IEC
9126 Software engineeringProduct
quality
9126 Software engineeringProduct
quality
9126-1 Part 1: Quality model 9126.1 Part 1: Quality model
9126-2 Part 2: External metrics 9126.2 Part 2: External metrics
9126-3 Part 3: Internal metrics 9126.3 Part 3: Internal metrics
9126-4 Part 4: Quality in use metrics 9126.4 Part 4: Quality in use metrics
14598 Information technologySoftware
product evaluation
14598 Information technologySoftware
product evaluation
14598-5 Part 5: Process for evaluators 14598.5 Part 5: Process for evaluators
Only international references that have been adopted as Australian or Australian/New Zealand
Standards have been listed.
The term informative has been used in this Standard to define the application of the annex to
which it applies. An informative annex is only for information and guidance.
7/31/2019 AS NZS ISO IEC 25062-2006 Software engineering - Software product Quality Requirements and Evaluation (SQua
5/10
ii i
CONTENTS
Page
1 Scope ..................................................................................................................................................... 12 Conformance......................................................................................................................................... 13 Normative references ........................................................................................................................... 24 Terms and definitions........................................................................................................................... 25 Report Format ....................................................................................................................................... 45.1 Title page ............................................................................................................................................... 45.2 Executive summary .............................................................................................................................. 45.3 Introduction ........................................................................................................................................... 55.4 Method ................................................................................................................................................... 55.5
Results ................................................................................................................................................. 11
5.6 Appendices.......................................................................................................................................... 14Annex A (informative) Checklist ..................................................................................................................... 15Annex B (informative) Glossary...................................................................................................................... 19Annex C (informative) Report Template......................................................................................................... 23Annex D (informative) Example ...................................................................................................................... 29Bibliography ..................................................................................................................................................... 46
7/31/2019 AS NZS ISO IEC 25062-2006 Software engineering - Software product Quality Requirements and Evaluation (SQua
6/10
iv
INTRODUCTION
Usability of software is a key factor in predicting successful deployment of that software. Softwaremanufacturers subject software to usability testing at various stages in a products development; somecompanies that purchase software also test products for usability before making purchasing decisions. Testingoften involves (1) subjects who are representative of the target population of users of the software, (2)representative tasks, and (3) measures of efficiency, effectiveness and subjective satisfaction. When this typeof experimental situation exists, the testing is termed summative, i.e., the results can be expressed asstatistically meaningful measures of central tendency (e.g. mean or median) and variability (e.g. standarddeviation). The Common Industry Format (CIF) for Usability Test Reports is intended for use by usabilityprofessionals to report the results of summative usability testing.
The CIF standardizes the types of information that are captured about testing with users. The level of detail
allows the same or another organization to replicate the test procedure. The major variables are userdemographics, task descriptions, context of the test, including the equipment used, the environment in whichthe test is conducted, and the protocol by which the subjects and the test administrator(s) interact, as well asthe particular metrics chosen to code the findings of the study.
The CIF is intended to replace the proprietary formats employed by companies that perform usability testing,
both vendors and purchasers of software. Until now there has been no standard format for reporting usability
testing results. Advantages of using a standardized reporting format include (1) a reduction in training time for
usability staff since an individual only needs to learn to use one form regardless of how many companies he
works for and (2) enhanced potential for increased communication between vendors and purchasing
organizations since readers of CIF-compliant reports will share a common language and expectations.
The purpose of this International Standard is to facilitate incorporation of usability as part of the procurement
decision-making process for interactive software products so that it is easier to judge whether a product meets
usability goals. Examples of decisions include purchasing, upgrading and automating. It provides a common
format for human factors engineers and usability professionals in supplier companies to report the methods
and results of usability tests to customer organizations.
Audience
The Common Industry Format (CIF) is meant to be used by usability professionals within supplier
organizations to generate reports that can be used by customer organizations in the CIF report. The CIF is
also meant to be used by customer organizations to verify that a particular report is CIF-compliant. The
Usability Test Report itself is intended for two types of readers:
Usability professionals in customer organizations who are evaluating both the technical merit of
usability tests and the usability of the products; and
Other technical professionals and managers who are using the test results to make business decisions.
The CIF may also be used within a single organization if a formal report of a summative usability test needs to
be generated. In this case additional material such as a list of detailed findings may be included.
The report is in two main sections, an Executive Summary and a main body. The main body contains the
Methods and Results sections and is aimed at the first audience above. These sections (1) describe the test
methodology and results in sufficient technical detail to allow replication by another organization if the test is
repeated, and (2) support application of test data to questions about the products expected costs and benefits.
Understanding and interpreting these sections will require technical background in human factors or usability
engineering for optimal use. The second audience is directed to the Introduction, which provides summary
information for non-usability professionals and managers. The Introduction may also be of general interest to
other computing professionals. Decision makers without usability engineering expertise may find the
information in the main body to be useful but should rely on expert interpretation when necessary.
Organization
Clause 1 describes the scope of this specification and the conformance criteria. Clause 4 provides definitions
7/31/2019 AS NZS ISO IEC 25062-2006 Software engineering - Software product Quality Requirements and Evaluation (SQua
7/10
v
of the terms used throughout the document. Clause 5 is the main description of the specification.
Additional Information
Annex A provides a checklist that can be used to ensure inclusion of required and recommended information.
A glossary is provided in Annex B to define terminology used in the report format description. A Word templatefor report production can be found at: http://www.ncits.org/ref-docs/CIF/CIF_template.dot. A printed version of
the template can be found in Annex C. An example is provided in Annex D illustrating how the format is used
followed by an informative bibliography.
7/31/2019 AS NZS ISO IEC 25062-2006 Software engineering - Software product Quality Requirements and Evaluation (SQua
8/10
vi
NOTES
7/31/2019 AS NZS ISO IEC 25062-2006 Software engineering - Software product Quality Requirements and Evaluation (SQua
9/10
AUSTRALIAN/NEW ZEALAND STANDARD
Software engineering Software product QualityRequirements and Evaluation (SQuaRE) Common IndustryFormat (CIF) for usability test reports
1 Scope
This International Standard is intended to be used to report the measures obtained from a test of usability asdefined in ISO 9241-11: effectiveness, efficiency and satisfaction in a specified context of use.
NOTE Metrics for other more-detailed usability requirements can be found in ISO/IEC 9126 parts 2 and 3.
This International Standard is intended to be used by:
usability professionals within supplier organizations to generate reports that can be used by customerorganizations;
customer organizations to verify that a particular report conforms to this International Standard;
human factors or other usability professionals in customer organizations who are evaluating both thetechnical merit of usability tests and the usability of the products; and
other technical professionals and managers in the customer organization who are using the test results tomake business decisions about product suitability and purchase.
The Executive Summary and Introduction in 5.2 and 5.3 provide summary information for nonusabilityprofessionals and managers.
Subclauses 5.4 and 5.5 describe the test methodology and results in technical detail suitable for replication,and also support application of test data to questions about the products expected costs and benefits.Understanding and interpreting these sections will require technical background in human factors or usabilityengineering for optimal use.
The report format assumes sound practice [1, 2] has been followed in the design and execution of the test.Test procedures which produce measures that summarize usability should be used, i.e. the test is summative
in nature. Some usability evaluation methods, such as formative tests, are intended to identify problems ratherthan produce measures; the format is not structured to support the results of such testing methods.
2 Conformance
A usability test report conforms to this International Standard if it complies with all the requirements in thisInternational Standard (stated as shall). The recommendations (stated as should) should be implementedwhenever appropriate.
This International Standard specifies the minimum information that should be provided. Additional informationmay be included. For example, if an organization finds that an additional list of findings is useful, the list may
be included even though it is not specified as part of a conformant CIF report.
COPYRIGHT
7/31/2019 AS NZS ISO IEC 25062-2006 Software engineering - Software product Quality Requirements and Evaluation (SQua
10/10
This is a free preview. Purchase the entire publication at the link below:
Looking for additional Standards? Visit SAI Global Infostore
Subscribe to ourFree Newsletters about Australian Standards in Legislation; ISO, IEC, BSI and more
Do you need to Manage Standards Collections Online?
Learn about LexConnect, All Jurisdictions, Standards referenced in Australian legislation
Do you want to know when a Standard has changed?
Want to become an SAI Global Standards Sales Affiliate?
Learn about other SAI Global Services:
LOGICOM Military Parts and Supplier DatabaseMetals Infobase Database of Metal Grades, Standards and Manufacturers
Materials Infobase Database of Materials, Standards and Suppliers
Database of European Law, CELEX and Court Decisions
Need to speak with a Customer Service Representative - Contact Us
AS/NZS ISO/IEC 25062:2006, Software engineering- Software product Quality Requirements andEvaluation (SQuaRE) - Common Industry Format(CIF) for usability test reports
http://infostore.saiglobal.com/store?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Newsletters/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Collections/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Law/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/StandardsWatch/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Affiliate/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Databases/LOGICOM/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Databases/LOGICOM/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Databases/Metals/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Databases/Materials/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Databases/European-Law/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://infostore.saiglobal.com/store/getpage.aspx?path=/InformationServices/shop/pages/ContactingUs.htm&utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://infostore.saiglobal.com/store/Details.aspx?ProductId=394870&utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://infostore.saiglobal.com/store/getpage.aspx?path=/InformationServices/shop/pages/ContactingUs.htm&utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Databases/European-Law/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Databases/Materials/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Databases/Metals/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Databases/LOGICOM/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Affiliate/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/StandardsWatch/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Law/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Collections/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://www.saiglobal.com/Information/Standards/Newsletters/?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSiteshttp://infostore.saiglobal.com/store?utm_source=PDF&utm_medium=Website_Infostore&utm_campaign=DocSharingSites