archive.arc.gov.auarchive.arc.gov.au › Quantitative · Web viewAustralian Research Council ERA 2015 Evaluation HandbookPage 1 of 1. Australian Research Council . ERA 2015 . Evaluation

Australian Research Council ERA 2015 Evaluation Handbook Page 1 of 135

ISBN: 978-0-9924254-6-3

© Commonwealth of Australia 2015

This publication is available for your use under a Creative Commons BY Attribution 3.0 Australia license, with the exception of the Commonwealth Coat of Arms, the Australian Research Council (ARC) logo, the Excellence in Research for Australia (ERA) logo, images, signatures and where otherwise stated.

Use of ARC material under a Creative Commons BY Attribution 3.0 Australia license requires you to attribute the work. Attribution is not to be done in any way that suggests that the ARC endorses you or your use of the work. The ARC prefers the following attribution: Australian Research Council material used ‘as supplied’.

Provided you have not modified or transformed ARC material in any way the following attribution is preferred: Source: The Australian Research Council, Excellence in Research for Australia.

If you have modified, transformed, or derived new material from the ARC in any way, the ARC prefers the following attribution: Based on Australian Research Council, Excellence in Research for Australia data.

Requests and enquiries regarding this licence should be addressed to ARC Legal Services on +61 2 6287 6600.

Front Cover Image Credits:Blue green wave stream texture background iStockphoto.com / © rionmWay energy iStockphoto.com / © alengo Water splash iStockphoto.com / © kirstypargeter Green leaves iStockphoto.com / © Zaharov


Table of ContentsAddendum.....................................................................................................................................6

1 How to use this Publication.....................................................................................................7

2 Background.............................................................................................................................9

2.1 Objectives of ERA...................................................................................................................9

2.2 Definition of Research...........................................................................................................9

2.3 FoR codes...............................................................................................................................9

2.3.1 Two-digit FoR code........................................................................................................9

2.3.2 Four-digit FoR code........................................................................................................9

2.3.3 Six-digit FoR code.........................................................................................................10

2.3.4 Implications of the FoR code hierarchy........................................................................10

2.4 Unit of Evaluation (UoE)......................................................................................................10

2.4.1 Low Volume Threshold................................................................................................11

2.4.2 Low volume and national benchmarks........................................................................11

2.5 Interdisciplinary and multidisciplinary research..................................................................11

2.5.1 Institutional coding......................................................................................................12

2.6 Reference Period.................................................................................................................12

2.7 ERA Submission Journal List.................................................................................................12

2.8 ERA Indicator Development.................................................................................................13

2.9 Development of arrangements for ERA 2015......................................................................13

3 ERA Roles and Responsibilities..............................................................................................14

3.1 Expert Review......................................................................................................................14

3.2 Peer Review.........................................................................................................................14

3.3 Responsibilities of the Research Evaluation Committee (REC).............................................14

3.4 Responsibilities of a REC member........................................................................................15

3.5 Responsibilities of a REC Chair.............................................................................................15

3.6 Responsibilities of a Peer Reviewer.....................................................................................16

3.7 Review of ERA processes and feedback...............................................................................16

3.8 ERA Scrutiny Committee......................................................................................................16

3.9 Confidentiality.....................................................................................................................16

3.10 Conflict of interest (COI)......................................................................................................16

3.11 Research Integrity and Research Misconduct......................................................................17

3.12 Other sensitivities................................................................................................................17

3.12.1 Commercially Sensitive research outputs....................................................................17

3.12.2 Culturally Sensitive research outputs...........................................................................18

3.12.3 Australian Government Security Classified research outputs......................................18

3.13 Assignment outside area of expertise..................................................................................18

3.14 Copyright.............................................................................................................................18


4 The ERA Evaluation Process...................................................................................................19

4.1 ERA phases...........................................................................................................................19

4.1.1 Submission...................................................................................................................21

4.1.2 Assignment..................................................................................................................21

4.1.3 Evaluation and moderation..........................................................................................21

4.1.4 Reporting.....................................................................................................................22

5 The ERA Indicators: Background............................................................................................23

5.1 Introduction to the ERA Indicator Suite...............................................................................23

5.2 The ERA Indicator Principles................................................................................................25

5.3 ERA Rating Scale..................................................................................................................26

5.3.1 Notes on the Rating Scale............................................................................................26

5.4 A Dashboard of Indicators...................................................................................................27

5.5 Drilldowns............................................................................................................................27

5.6 Explanatory Statements.......................................................................................................27

5.7 Volume and Activity vs. Quality...........................................................................................27

5.8 Assignment of FoRs to Research Outputs............................................................................27

5.9 FTE and Headcount..............................................................................................................28

5.10 Research Income and Research Commercialisation Income................................................28

5.11 Applied Measures (excluding Research Commercialisation Income)...................................28

5.12 Esteem Measures................................................................................................................28

5.13 SEER warnings......................................................................................................................29

6 The ERA Indicators: Detail.....................................................................................................30

6.1 Indicator contextual information.........................................................................................30

6.1.1 Interdisciplinary profile................................................................................................30

6.1.2 Intradisciplinary profile................................................................................................31

6.2 UoE Indicator Summary.......................................................................................................32

6.3 Volume and Activity.............................................................................................................33

6.3.1 Research Outputs.........................................................................................................33

6.3.2 FTE Profile by Academic Level......................................................................................36

6.3.3 Research Output by Year.............................................................................................38

6.4 Publishing profile.................................................................................................................39

6.5 Citation Analysis...................................................................................................................45

6.5.1 Relative Citation Impact (RCI) Profile...........................................................................45

6.5.2 Centile Analysis Profile.................................................................................................47

6.5.3 Distribution of papers by RCI Classes...........................................................................49

6.6 Peer Review.........................................................................................................................52

6.7 Research Income.................................................................................................................58

6.8 Applied Measures................................................................................................................61


6.8.1 Research Commercialisation Income...........................................................................62

6.8.2 Patents.........................................................................................................................64

6.8.3 Registered Designs.......................................................................................................66

6.8.4 Plant Breeder’s Rights..................................................................................................67

6.8.5 NHMRC Endorsed Guidelines.......................................................................................69

6.9 Esteem Measures................................................................................................................70

7 Glossary................................................................................................................................72

8 Abbreviations.......................................................................................................................75

9 Discipline Clusters.................................................................................................................76

Appendix 1: Research Output Drilldowns......................................................................................77

Appendix 2: Peer Review Drilldowns and Peer Reviewer template...............................................82

Appendix 3: HERDC Category 1 Research Income Drilldown..........................................................84

Appendix 4: Applied Measure Drilldowns.....................................................................................86

Appendix 5: Citation Benchmark Methodology.............................................................................88

Appendix 6: ERA 2015 Discipline Matrix by Cluster.......................................................................96

Appendix 7: Fields of Research code summary............................................................................104

Appendix 8: Aboriginal and Torres Strait Islander Studies...........................................................133

Appendix 9: Eligible ERA Institutions...........................................................................................134


AddendumA number of units were deemed to be unassessable by the RECs during the evaluation meeting. These are identified in the National Report as: n/r – not rated due to coding issues.


1 How to use this PublicationThe Excellence in Research for Australia (ERA) 2015 Evaluation Handbook has been written for Research Evaluation Committee (REC) members to assist in their evaluation of the quality of research undertaken in eligible higher education institutions (‘institutions’).

The Handbook discusses the ERA approach, outlines the evaluation process and the principles of the ERA indicator suite and provides detailed information about each of the indicators. The Handbook is organised into five sections:

Background This section discusses the underlying ERA framework including: the ERA objectives, definition of research, the Fields of Research codes (FoR) and the Unit of Evaluation (UoE). It also summarises changes to the ERA approach for 2015.

ERA Roles and ResponsibilitiesThis section discusses ERA Expert Review and ERA Peer Review. It also outlines the roles and responsibilities of the REC, as well as detailing how issues such as conflict of interest (COI), copyright and confidentiality are addressed in ERA.

The ERA Evaluation ProcessThis section outlines the four stages of the ERA process—submission, assignment, evaluation and reporting.

The ERA Indicators: BackgroundThis section introduces the ERA Indicator Suite. It includes the ERA Indicator Principles and the ‘dashboard’ approach to evaluation. It also details how FoR codes are apportioned to submission data in ERA.

The ERA Indicators: DetailThis section provides an in depth description of each of the ERA indicators, including the graphical presentation of data, Australian and world benchmarks (where applicable) and a description of the role of various indicators in the evaluation process.

This Handbook should be read in conjunction with the policy documents in the list below.

Policy documents

ERA 2015 Submission Guidelines —provides guidance to institutions about ERA 2015 submission rules and components.

ERA 2015 Discipline Matrix —provides indicator applicability for disciplines. It is available in Appendix 6 of this Handbook or in Excel format from the ARC website .

ERA 2015 Peer Reviewer Handbook —outlines the evaluation process for ERA Peer Reviewers and provides information about the conduct of peer review.


http://www.arc.gov.au/excellence-research-australia




Technical documents

ERA-SEER 2015 Technical Specifications —provides technical instruction for institutions preparing and submitting ERA 2015 submissions.

ERA-SEER 2015 Technology Pack —comprises technical documentation, Code Tables and XML schema related to the ERA 2015 submission process.

Further information about ERA is available on the ARC website. The ERA Team can be contacted by email at [email protected] or phone 02 6287 6755.


mailto:[email protected]




2 Background

2.1 Objectives of ERAThe objectives of ERA are to:

1. establish an evaluation framework that gives government, industry, business and the wider community assurance of the excellence of research conducted in Australia‘s higher education institutions

2. provide a national stocktake of discipline-level areas of research strength and areas where there is opportunity for development in Australian higher education institutions

3. identify excellence across the full spectrum of research performance

4. identify emerging research areas and opportunities for further development

5. allow for comparisons of research in Australia, nationally and internationally, for all discipline areas.

2.2 Definition of ResearchFor the purposes of ERA, research is defined as the creation of new knowledge and/or the use of existing knowledge in a new and creative way so as to generate new concepts, methodologies, inventions and understandings. This could include synthesis and analysis of previous research to the extent that it is new and creative.

Institutions must ensure that all research outputs submitted to ERA meet this definition of research. Outputs that do not meet this definition may be excluded from submissions during the ERA submission process or, where they are not excluded from submissions, their inclusion may adversely affect the quality rating assigned during the evaluation process.

2.3 FoR codes A Unit of Evaluation (UoE) in ERA is the discipline within an institution. For the purposes of ERA, disciplines are defined as four-digit and two-digit FoRs as identified in the Australian and New Zealand Standard Research Classification (ANZSRC). The ANZSRC provides 22 two-digit FoR codes, 157 four-digit FoR codes, and an extensive range of six-digit codes. The ANZSRC was released in 2008 by the Australian Bureau of Statistics (ABS) and Statistics New Zealand. It provides important information about each four-digit and two-digit FoR. The ANZSRC is available in full from the ABS website.

2.3.1 Two-digit FoR codeThis is the highest level of the ANZSRC hierarchy. A two-digit FoR code relates to a broad discipline field, such as 02 Physical Sciences. A two-digit FoR code consists of a collection of related four-digit FoR codes, such as 0201 Astronomical and Space Sciences, 0203 Classical Physics, and all other four-digit FoRs within the 02 Physical Sciences code.

2.3.2 Four-digit FoR codeThis is the second level of the ANZSRC hierarchy. A four-digit FoR code is a specific discipline field of a two-digit FoR code, for example, 0201 Astronomical and Space Sciences. A four-digit FoR code consists of a collection of related six-digit FoR codes. Institutions submit data for ERA at the four-digit FoR level.


http://www.abs.gov.au/AUSSTATS/[email protected]/DetailsPage/1297.02008?OpenDocument

http://www.abs.gov.au/AUSSTATS/[email protected]/DetailsPage/1297.02008?OpenDocument

2.3.3 Six-digit FoR codeThis is the lowest level of the hierarchy of ANZSRC codes. A six-digit FoR code is a further breakdown of a four-digit FoR code, for example, 020101 Astrobiology is within 0201 Astronomical and Space Sciences. Six-digit FoR data is not collected in ERA and evaluation is not conducted at this level.

2.3.4 Implications of the FoR code hierarchyERA has been designed to provide flexibility for, and recognition of, discipline-specific research behaviours at both the four-digit and two-digit FoR code levels.

Although six-digit FoR codes are not assessed in ERA, it is important that REC members are aware of the diversity of six-digit FoR codes beneath the four-digit FoR codes. For many disciplines, the six-digit FoR codes represent a wide and diverse range of sub-disciplines which may have quite different publishing practices. For this reason, the profile for a particular four-digit FoR code for one institution may look very different from another institution’s because of the differences in focus at the six-digit level. For example, FoR 0502 Environmental Science and Management includes 12 diverse six-digit fields.

This means that the 0502 UoE at an institution with a focus on 050209 Natural Resource Management may have very different publishing behaviours and research outlets to another 0502 UoE at an institution which focuses primarily on 050201 Aboriginal and Torres Strait Islander Environmental Knowledge.

Similarly, REC members must be cognisant of the six-digit codes which sit beneath the 99 (‘other’) codes. In many cases, important sub-disciplines with significant research activity may be represented in the 99 (‘other’) codes. For example, FoR 1699 (Other Studies In Human Society) includes six separate six-digit fields, such as Gender Specific Studies and Studies of Asian Society.

For some broad discipline areas, related disciplines are located in different parts of the ANZSRC. For example, some areas of Materials Science can be found in 02 Physical Sciences, 03 Chemical Sciences, 09 Engineering Sciences, and 10 Technology. REC members should ensure they are aware of the boundaries for their allocated FoR codes, and the interaction of the related FoR codes. Please refer to Appendix 6: Discipline Matrix ERA 2015 for further information.

2.4 Unit of Evaluation (UoE)ERA evaluation occurs at both the four-digit and two-digit FoR code levels. A UoE for ERA is the research discipline, as defined by the ANZSRC four-digit and two-digit FoR codes, for an eligible institution (Appendix 9). UoEs do not correspond to named disciplines, departments or research groups within an institution.

Data for ERA is submitted by institutions at the four-digit FoR code level, and is aggregated to create four-digit and two-digit UoEs. Research Evaluation Committees (RECs) are formed around broad discipline groupings for the purpose of administering the ERA evaluations. RECs will evaluate both four-digit and two-digit UoEs.

The four-digit FoR codes generally align with their two-digit code within the same REC, with the exception of the four-digit FoR codes beneath ‘10—Technology’ which are split across three RECs. The construction of the ‘10—Technology’ two-digit UoEs for evaluation will include all the four-digit codes beneath (i.e. 1001–1099). The evaluation of the two-digit ‘10-Technology’ UoEs will occur by a cross-REC evaluation.


2.4.1 Low Volume ThresholdFour-digit and two-digit UoEs will only be assessed where there is a meaningful level of data to be evaluated. An institution is only evaluated in ERA in a four-digit or two-digit discipline if the number of research outputs reaches a low volume threshold.

For disciplines where citation analysis is used, no evaluation will be conducted for the FoR at a given institution if the number of indexed journal articles over the six year reference period is fewer than 50 in any four- or two-digit FoR.

For disciplines where peer review is used, no evaluation will be conducted for the FoR at a given institution where, over the six year reference period, there are fewer than the equivalent of 50 submitted research outputs. Books are given an effective weighting of 5:1 compared with other research outputs for the purposes of determining the low volume threshold in these disciplines; for other purposes in ERA they are counted as a single research output.

For some FoRs at some institutions, there may be insufficient research volume to undertake a valid analysis at the four-digit level, but sufficient research volume at the two-digit level. In these instances, evaluation will take place at the two-digit FoR code level only.

The two-digit profiles include all data from the four-digit FoR codes beneath, regardless of whether they reached the low volume threshold at the four-digit FoR code level. The two-digit FoRs, therefore, form unique UoEs and may present the RECs with a quite different profile from the constituent four-digit FoRs. For example, a two-digit UoE may contain a mix of material which has been evaluated at the four-digit level and material which has not.

In instances where an institution does not meet the low volume threshold in the FoR, the UoE will be publicly reported as ‘not assessed’. This means that data submitted on research outputs, research income, applied measures and esteem measures for the relevant two-digit or four-digit FoR for that institution will be collected but not evaluated under ERA. However, the data submitted will still contribute to the construction of the ERA benchmarks and all ERA data will aggregate for national-level reporting irrespective of whether any FoRs within a specific institution meet the low volume threshold.

2.4.2 Low volume and national benchmarksFor the purposes of generating FoR-specific national benchmarks (referred to as Australian Higher Education Provider (HEP) benchmarks in ERA), the ARC will aggregate outputs within each of the two- and four-digit FoR code levels nationally. HEP benchmarks are used to profile an institution’s performance against other Australian HEPs. Therefore, these benchmarks will include information submitted to a particular FoR from all institutions, including data from the ‘not assessed’ UoEs.

2.5 Interdisciplinary and multidisciplinary researchAs ERA is a discipline-based research evaluation exercise, interdisciplinary and multidisciplinary research is disaggregated based on its discipline components. However, RECs will have access to information which shows the nature and extent of inter/multidisciplinary research for each UoE. Each research output can be assigned to a maximum of three four-digit FoRs. For each UoE RECs are able to view a ‘Discipline Profile’ showing the extent to which the research outputs of a UoE have also been assigned to other four-digit FoRs. This will provide additional information for the purposes of assigning UoEs to REC members, and is also contextual/discipline information for REC members to consider when undertaking their evaluation.

Where multi/interdisciplinary work is being considered, REC members may be assigned between RECs as required to bring appropriate expertise to bear on the evaluation. At the final REC evaluation


meeting, all RECs will meet concurrently which also allows for cross-REC expertise to contribute to finalising evaluations.

2.5.1 Institutional codingInstitutions may add institutional reporting codes that link components of their submission to particular institutional units such as research centres or departments. Following completion of the ERA evaluation, institutions will then be able to use these codes to compile information about, for example, an institutional unit in ‘climate change research’ that had its research outputs submitted for evaluation under a variety of Fields of Research (e.g. environmental science and management, atmospheric sciences, law, soil sciences and demography).

Institutional coding is for institutional use and not for the purposes of ERA evaluation.

2.6 Reference PeriodThe collection of data for ERA 2015 is based on several reference periods as detailed in Table 1 below.

Table 1: ERA 2015 reference periods

Data Type Reference Period Years

Research Outputs 1 January 2008 to 31 December 2013 6

Research Income 1 January 2011 to 31 December 2013 3

Applied Measures 1 January 2011 to 31 December 2013 3

Esteem Measures 1 January 2011 to 31 December 2013 3

Data regarding eligible researchers is not collected for a reference period but based on a single staff census date of 31 March 2014.

2.7 ERA Submission Journal ListThe ERA 2015 Submission Journal List includes 24 028 scholarly journals. An article must be published in a journal included in the list in order to be submitted as a journal article in ERA.

The ERA 2015 Submission Journal List includes journals that meet the following criteria:

were active during the ERA 2015 reference period for research outputs (1 January 2008 to 31 December 2013)

are scholarly

have peer or editorial review policies acceptable to the discipline

have an ISSN.

Each journal on the list is assigned up to three FoR codes. The FoRs assigned to a journal are not listed in any order of relevance or importance.

A journal may be assigned either two-digit FoRs or four-digit FoRs. Where the subject matter of a journal is sufficiently broad to cover more than three four-digit FoR codes, the journal has been assigned one or more two-digit FoR codes; where the subject matter is sufficiently broad to cover more than three two-digit FoR codes, the journal has been assigned as Multidisciplinary (MD).


2.8 ERA Indicator DevelopmentDuring 2008, the ARC convened an Indicator Development Group (IDG), comprising experts in research metrics and statistics to consider, test and recommend appropriate discipline-specific indicators, including measures of quality, applied research and research activity. To test the appropriateness of the proposed indicators for each discipline, the ARC held discipline cluster workshops with discipline experts. The ARC has also further consulted with the sector regarding the refinement of the indicators following the ERA 2010 and ERA 2012 evaluations. The indicator development process has been informed by analytical testing to verify the validity of the indicators. Where an indicator has not been clearly demonstrated to be a valid and robust measure of research quality for a discipline, it has not been included in ERA. The ERA Indicator Principles are included in Section 5: The ERA Indicators—Background, and the details of each indicator are discussed in Section 6: The ERA Indicators—Detail, of this Handbook.

2.9 Development of arrangements for ERA 2015The ARC has consulted broadly in the development of arrangements for ERA 2015. In addition to the feedback on ERA 2012 processes provided by the sector and REC members, the ARC issued a sector-wide consultation paper on a range of issues, as well as draft ERA 2015 documentation. The ERA 2015 Submission Guidelines and ERA 2015 Discipline Matrix are informed by the outcomes of these consultations.

For a list of submission-related changes for ERA 2015, see page 7 of the ERA 2015 Submission Guidelines. The changes relevant to the evaluation process include the addition of a new category of non-traditional research outputs for all disciplines—Research Report for an External Body, which consists of four subcategories of reports. The ARC has also provided further clarification of the requirements for the selection of research outputs for peer review within a UoE.


3 ERA Roles and Responsibilities

3.1 Expert ReviewExpert review informed by discipline-specific indicators is central to ERA evaluations. ERA evaluations are conducted by the members who comprise the RECs. Each four-digit UoE will be assigned to three REC members. The same REC members will automatically be assigned to the two-digit UoEs based on the four-digit assignments. In cases where only the two-digit UoE is evaluated, typically due to the low volume threshold, at least three REC members will be assigned.

Evaluations are informed by the range of indicators identified in the ERA 2015 Discipline Matrix at Appendix 6, with particular focus placed on those that relate most closely to the quality of research outputs—such as citation metrics and peer review.

3.2 Peer ReviewREC members have access to a pool of peer reviewers who have been recruited for ERA 2015. Peer reviewers are assigned by the principal reviewer, a nominated REC member, for each UoE in which peer review is used as an indicator, as identified in the ERA 2015 Discipline Matrix. In each case, the principal reviewer is expected to assign at least two peer reviewers to each UoE.

External peer reviewers report on, but do not rate, the sample of peer review outputs which they have reviewed. Their report informs the evaluations by the REC members. Peer reviewers do not have access to any of the ERA indicators or data presented to REC members, only the sample of outputs nominated by each institution for peer review.

3.3 Responsibilities of the Research Evaluation Committee (REC)

The responsibilities of a REC are to:

assign an agreed rating for all UoEs under each four-digit and two-digit FoR code where there is sufficient volume for an evaluation

work with the other RECs to ensure consistent application across the exercise of the overall quality standards and common assessment procedures

provide feedback and advice as requested by the ARC on any aspects of the assessment process

report the results to the ARC.


3.4 Responsibilities of a REC memberThe responsibilities of a REC member are to:

participate fully in the evaluation process within their REC

abide by confidentiality and Conflict of Interest (COI) requirements as detailed in Section 3.10

maintain confidentiality of both the deliberations and decisions of the REC

identify all instances where they may have a COI or other sensitivity and raise these with the ARC prior to the conflict occurring

ensure they adequately prepare for meetings to avoid unnecessary additional administrative costs and inconvenience to other committee members

be diligent in completing tasks allocated to them by the REC Chair

assign external peer reviewers where required

evaluate assigned material and allocate preliminary ratings to each UoE

contribute fully, constructively and dispassionately to all REC processes and, within the capacity of their expertise, take ownership of the collective decisions of the REC

exercise due skill and care in the performance of their responsibilities.

3.5 Responsibilities of a REC ChairThe responsibilities of a REC Chair are to:

ensure that the REC operates within the policies, guidelines and procedures established by the ARC

abide by confidentiality and COI requirements

ensure that confidentiality is maintained for the deliberations and decisions of the REC

identify instances where there may be COI or other sensitivity and raise these with the ARC prior to conflict occurring

contribute fully, constructively and dispassionately to all REC processes and take ownership of the collective decisions of the REC

assign material to REC members for evaluation

evaluate their own assigned material and give preliminary ratings

ensure that evaluations are completed within agreed timeframes

chair the REC meeting to review preliminary ratings, and guide the REC to provide final ratings for quality separately for each UoE

ensure that REC members have an opportunity to contribute fully to the process and REC activities

ensure that REC decisions are documented

report on the results to the ARC

participate in a review at the conclusion of the REC meeting and report to the ARC on the evaluation processes undertaken by the REC.

In the event that a REC Chair is unable to perform some or all of these responsibilities the ARC will appoint an Acting Chair from within the REC with responsibilities, determined by the ARC, for all or part of the responsibilities of a REC Chair. This will most commonly occur, for example, where the


Chair has identified a COI and the ARC appoints an Acting Chair for the purposes of assigning material for evaluation.

3.6 Responsibilities of a Peer ReviewerThe responsibilities of a peer reviewer are to:

evaluate assigned material and provide a report using the peer review template

be diligent in completing tasks allocated to them

exercise due skill and care in the performance of their responsibilities

identify instances where they may have a COI or other sensitivities, raise these with the ARC prior to conflict occurring and comply with the directions of the ARC relating to the management of COI

abide by confidentiality requirements.

3.7 Review of ERA processes and feedbackThroughout their engagement for the purposes of ERA, REC members are invited and encouraged to comment on and provide feedback about all ERA processes. One of the outcomes of the evaluation meeting is that RECs will make recommendations for consideration by the ARC about future improvements for ERA processes. The ARC will also convene a meeting of REC Chairs at the conclusion of the evaluation phase for a range of purposes, including an overarching review of evaluation processes.

3.8 ERA Scrutiny CommitteeThe ARC will appoint a Scrutiny Committee for ERA 2015 to:

scrutinise the processes followed by the RECs in assessing the ‘home’ UoE of each REC member. A REC member’s ‘home’ UoE would be the UoE associated with their institution and their primary four-digit FoR of expertise

scrutinise the outcome for each ‘home’ UoE with the benefit of relevant benchmark information from the ERA 2015 evaluations

provide a report to the ARC Chief Executive Officer (CEO) advising of any issues in relation to the evaluation outcomes.

3.9 ConfidentialityREC members and peer reviewers are required to sign a confidentiality agreement with the ARC prior to their participation in ERA. The agreement covers all aspects of their work with ERA, and the agreement survives the conclusion of their engagement for the purposes of ERA.

REC members and peer reviewers may not contact researchers and/or institutions under any circumstances in relation to material that has been submitted for evaluation in ERA, or seek additional information from any sources. REC members and peer reviewers must not reveal details about any evaluation, deliberations or conclusions, at any time.

3.10 Conflict of interest (COI)A COI is any situation where a REC member or peer reviewer has an interest which conflicts, might conflict, or may be perceived to conflict with the interests of the implementation of ERA. Examples of COI include:

being employed by, or holding an adjunct or honorary appointment at, the institution that has made the submission which is being assigned


having a close personal relationship with someone whose work is significantly incorporated in the UoE task being assigned for evaluation. This could include a partner, spouse, family member or close friend. Included in this category is enmity

being a close collaborator with someone whose work is significantly incorporated in the UoE task that is being assigned for evaluation. For example, where a REC member is a close collaborator with authors for 10% or more of the total outputs of a UoE, that would constitute a potential COI

other conflicts that a REC member will need to raise and have clarified, including financial interests (for example holding a company directorship, stock ownership or options, patents, royalties, consultancy or grant) which could lead to financial gain to a REC member in circumstances where they have access to information or are able to influence decision-making.

While most COIs will be determined before the assignment of evaluation tasks occurs, REC members and peer reviewers may encounter material with which they have a potential COI during evaluation and are required to declare any potential or actual COI as soon as practicable after it has been identified. In such circumstances, the ARC will address each instance on a case by case basis, usually by reassigning the material to another reviewer.

A REC member or a peer reviewer will never be involved in considerations about UoEs in any discipline from their own institution, or any institution with which they have a declared COI.

3.11 Research Integrity and Research MisconductAs specified within the ARC Research Integrity and Research Misconduct Policy, anyone engaged on ARC business, such as ARC College of Experts members, Research Evaluation Committee members, Selection Advisory Committee members, external assessors and contractors, are required to report alleged breaches of research integrity or research misconduct issues identified in relation to ARC funded business to the ARC Research Integrity Officer.

The policy and contact details for the Research Integrity Officer are available on the ARC website.

Should you identify an alleged breach of research integrity or a research misconduct issue as part of your evaluation please notify the ARC Research Integrity Officer. A Notification Form for an Allegation of Research Integrity Breach or Misconduct (Attachment A of the policy) can be used to report the allegation.

The Research Integrity Officer will refer the allegation to the relevant institution for investigation in accordance with the requirements of the Australian Code for the Responsible Code of Research. Sufficient information should be provided to enable the institution to progress an investigation into the allegation (if required).

3.12 Other sensitivitiesTo be eligible for ERA, all research outputs must either be published or made publicly available in the ERA reference period. However, if any research material causes offence or serious sensitivity to a REC members or peer reviewers, they are asked to raise their concern with the ARC as soon as practicable. In this case the UoE would normally be reassigned.

3.12.1 Commercially Sensitive research outputs A research output that includes commercially sensitive information may be included as part of a submission provided the necessary permissions have been obtained. This will be flagged to RECs and peer reviewers.


http://www.arc.gov.au/codes-and-guidelines#code1

http://www.arc.gov.au/research-integrity

3.12.2 Culturally Sensitive research outputs A research output that is culturally sensitive may be included as part of a submission provided that the ARC is appropriately advised of the sensitivities. This will be flagged to RECs and peer reviewers.

3.12.3 Australian Government Security Classified research outputs A research output that includes information classified in line with the Australian Government Protective Security Manual as either ‘In-Confidence’ or greater, or ‘Restricted’ or greater, cannot be included in a submission (this also includes outputs subsequently classified as ‘Sensitive’, ‘For Official Use Only’, or greater under the Australian Government Security Classification System).

3.13 Assignment outside area of expertiseOne of the REC members will be assigned as the principal reviewer for a UoE. The principal reviewer will take the lead role in the discussion of that UoE at the REC meeting.

There will also be a number of cross-REC assignments where REC Chairs will be able to draw on expertise from members outside their own REC. On such occasions, REC members may be asked to evaluate UoEs that do not appear to correspond directly with their area of expertise. REC members’ scholarly judgement and views are extremely valuable in the evaluation and moderation of these UoEs.

3.14 CopyrightERA REC members and peer reviewers have access to, and use of, relevant research outputs to conduct ERA peer review. Acting under section 183(1) of the Copyright Act 1968 (Cth), the Commonwealth of Australia, as represented by the ARC, has authorised each ERA REC member and peer reviewer, to do acts comprised in the copyright of relevant material for the purposes of ERA. As a result, authorised REC members and peer reviewers may make all uses of relevant material that are necessary or convenient to enable their participation in ERA. The authorisation is strictly limited to their participation in ERA and will not extend to uses for any purpose unrelated to participation in ERA.

Access to research outputs is provided strictly for the purposes of conducting evaluation for ERA. REC members and peer reviewers are not permitted to reproduce or distribute the outputs for any purpose other than participation in ERA. To ensure appropriate protection of copyright material in ERA submissions, REC members and peer reviewers must at all times comply with the authorisation.


4 The ERA Evaluation Process

4.1 ERA phasesERA 2015 consists of a number of phases, including Submission, Assignment, Evaluation and Reporting. Each of these phases is composed of a number of stages or activities. Table 2 below outlines the ERA 2015 phases and evaluation schedule.

Table 2: ERA phases and evaluation schedule

PHASE ACTIVITY

Submission Submission of data by eligible institutions to the ARC

AssignmentREC Chairs assign UoEs to REC members

REC members (principal reviewers) assign UoEs to peer reviewers

Evaluation

Stage 1

Preliminary individual evaluation of UoEs by REC members at the four-digit level, including peer review (where peer review is an identified indicator) of research outputs; evaluation of all assigned UoEs by peer reviewers

9 June to 27 July 2015

Stage 2A

REC members’ moderation of four-digit evaluations and preliminary independent evaluation of UoEs at the two-digit level

29 July to 8 September 2015

Stage 2BREC members’ moderation of two-digit evaluations

10 September to 29 September 2015

Stage 2C

REC members’ review of moderated four-digit and two-digit evaluations in preparation for the Stage 3 meeting

1 October to 8 October 2015

Stage 3

Meeting of all RECs to finalise recommended evaluation outcomes

12 October to 16 October 2015

ReportingState of Australian University Research 2015 -2016: Volume 1 ERA National Report published


The various stages of the ERA 2015 Evaluation process are outlined in Figure 1 below.

Figure 1: ERA stages and activity


4.1.1 SubmissionInstitutions will be given access to the ERA IT system, the System to Evaluate the Excellence of Research (SEER), to upload their ERA data. The data will be verified and validated to ensure that they meet the ERA requirements (see the ERA 2015 Submission Guidelines). The submitted data are used to construct UoEs for each four-digit and two-digit FoR code which includes all relevant indicators for evaluation as well as the relevant national and international benchmarks.

4.1.2 Assignment At the conclusion of the submission phase, UoEs will be assigned to REC members by the REC Chair for evaluation, except in particular instances of identified COI, in which case an Acting Chair will be appointed by the ARC for the purposes of assignment.

Each four-digit UoE will be assigned to three REC members. REC members will automatically be assigned to two-digit UoEs based on their four-digit assignments. There will also be a number of cross-REC assignments where REC Chairs will be able to draw on expertise from members outside their own REC.

Each UoE will have a REC member appointed as principal reviewer who will take a lead role in discussion of the UoE at the Stage 3 Evaluation Meeting. Where peer review is identified as an indicator, external peer reviewers will be assigned for the purposes of constructing the peer review indicator.

REC Chairs and REC members should take account of identified COIs and workload when assigning UoEs for review or evaluation.

The appointed principal reviewer for a UoE will assign peer reviewers for that UoE. Assignment is based on peer reviewer expertise at the two- and four-digit FoR code level. Principal reviewers may also need to consider the expertise of peer reviewers at the six-digit FoR code level to ensure that evaluation is carried out by those with the appropriate expertise. This may be particularly relevant for Indigenous research. The ANZSRC provides alternative groupings to aid the understanding of research from different cultural perspectives which are unique to Australia and New Zealand. Appendix 8 provides a list of six-digit codes relating to Aboriginal and Torres Strait Islander Studies with the related four-digit codes and discipline grouping.

4.1.3 Evaluation and moderationEvaluation in ERA is essentially conducted online to access the relevant data, indicators and peer review outputs (where peer review is an indicator) for each assigned UoE. REC members review the range of relevant indicators to reach a preliminary view (a rating with reference to the ERA rating scale and supporting text) about each UoE, and to record that view in SEER prior to the REC meeting. Peer review similarly is conducted through SEER, and peer reviewers have access through SEER to nominated outputs for peer review.

In the first instance, preliminary evaluations at the four-digit and two-digit levels are conducted independently by REC members. Evaluation is split across several stages as illustrated in Figure 1. In Stage 1, REC members undertake their initial evaluations of four-digit UoEs, independently from each other. In Stage 2A REC members have access to the evaluations of other REC members that are co-assigned to the same UoEs to allow them an opportunity to reflect on their preliminary evaluations, and to provide opportunity for moderation between REC members’ preliminary ratings.

Moderation is an integral process in ERA—it ensures that each evaluation is conducted as an exchange of views between experts in a discipline and their colleagues in other disciplines. This


process promotes the standard application of the ERA methodology across disciplines. In Stages 1—2C, moderation is conducted independently in SEER with individual REC members considering their own evaluations in light of the posted ratings and comments of other reviewers of the same UoE. It does not involve direct communication with other reviewers.

At the conclusion of the online evaluation stages the RECs will convene to consider all of the preliminary evaluations and agree to final evaluation outcomes for each UoE. The final ratings are the decision of the entire REC and every UoE will be discussed by the REC as a committee, except where REC members are excluded due to an identified COI.

The ratings agreed by the RECs are final. The RECs will deliver their agreed final ratings to the ARC.

4.1.4 ReportingThe ERA National Report will be produced by the ARC. The National Report will present a comprehensive assessment by discipline of the quality of research activity conducted in Australia’s higher education institutions. This report will provide information on the discipline-specific research activity of each eligible Australian higher education institution and the contribution of each discipline to the national landscape. In addition, the ARC will provide a range of information to individual institutions following the completion of the ERA 2015 evaluations, to assist further with their understanding of the ERA results.


5 The ERA Indicators: Background

5.1 Introduction to the ERA Indicator SuiteERA is based on the principle of expert review informed by indicators. Quantitative and qualitative indicators present significant amounts of data in a readily accessible format. Many of the tabular indicator presentations are complemented by graphical presentations, which display the same data in a different format.

The indicator profiles in ERA serve several functions:

to summarise data within a UoE

to provide a mechanism for REC members to review subsets of data through drilldown menus

to understand how a UoE performs relative to other Australian institutions

to understand how a UoE performs relative to the world.

The ERA indicator suite has been developed to align with the research behaviours of each discipline. For this reason, there are differences in the selection of indicators. For example, some disciplines use citation analysis, while others use peer review of research outputs—peer review and citation analysis are not used in combination.

Figure 2 shows ERA 2015 indicators at a glance. Detailed information on which FoR codes use which indicators is available in the ERA 2015 Discipline Matrix (see Appendix 6).


Figure 2: ERA Indicators at a glance


5.2 The ERA Indicator PrinciplesThe eight ERA indicator principles listed below have guided the development of the indicator suite. In addition, and at all times throughout the ERA development process, the ARC has been cognisant of the burden of data collection placed on submitting institutions. Each of the ERA indicators is designed with regard to the following criteria:

Quantitative—objective measures that meet a defined methodology that will reliably produce the same result, regardless of when and by whom the principles are applied.

Internationally recognised—while not all indicators will allow for direct international comparability, the indicators must be internationally-recognised measures of research quality. Indicators must be sensitive to a range of research types, including research relevant to different audiences (e.g. practitioner focused, internationally relevant, nationally- and regionally-focused research). ERA will include research published in non-English language publications.

Comparable to indicators used for other disciplines—while ERA evaluation processes will not make direct comparisons across disciplines, indicators must be capable of identifying comparable levels of research quality across disciplines.

Able to be used to identify excellence—indicators must be capable of assessing the quality of research, and where necessary, focused to identify excellence.

Research relevant—indicators must be relevant to the research component of any discipline.

Repeatable and verifiable—indicators must be repeatable and based on transparent and publicly available methodologies. This should allow institutions to reproduce the methodology in-house. All data submitted to ERA must be auditable and reconcilable.

Time-bound—indicators must be specific to a particular period of time as defined by the reference period. Research activity outside of the reference period will not be assessed under ERA other than to the extent it results in the triggering of an indicator during the reference period.

Behavioural impact—indicators should drive responses in a desirable direction and not result in perverse unintended consequences. They should also limit the scope for special interest groups or individuals to manipulate the system to their advantage.


5.3 ERA Rating ScaleERA utilises a five-point rating scale. The rating scale is broadly consistent with the approach taken in research evaluation processes in other countries to allow for international comparison.

Table 3: ERA Rating Scale and Descriptor

Rating Descriptor

5 The Unit of Evaluation profile is characterised by evidence of outstanding performance well above world standard presented by the suite of indicators used for evaluation.

4 The Unit of Evaluation profile is characterised by evidence of performance above world standard presented by the suite of indicators used for evaluation.

3 The Unit of Evaluation profile is characterised by evidence of average performance at world standard presented by the suite of indicators used for evaluation.

2 The Unit of Evaluation profile is characterised by evidence of performance below world standard presented by the suite of indicators used for evaluation.

1 The Unit of Evaluation profile is characterised by evidence of performance well below world standard presented by the suite of indicators used for evaluation.

NA Not assessed due to low volume. The number of research outputs does not meet the volume threshold standard for evaluation in ERA.

5.3.1 Notes on the Rating Scale ‘World Standard’ refers to a quality standard. It does not refer to the nature or geographical

scope of particular subjects, or to the locus of research nor its place of dissemination.

Each point within the rating scale represents a quality ‘band’. For example, one UoE might be rated highly within the ‘4’ band and another rated lower within the same band, but the rating for both will be a ‘4’. REC members may only give whole ratings (not 4.2, 4.5 etc.).

The ‘banding’ of quality ratings assists REC members in determining a final rating. If, for example, a UoE has a preliminary rating at the top margin of the ‘4’ band based on the assessment of the quality of the research outputs, other indicators (e.g. income or esteem measures) may be sufficient to raise the rating into the ‘5’ band. The lack of such indicators will not, however, be used to lower a rating.

The ERA evaluation measures research quality, not scale or productivity. Volume information is presented to the RECs for the purposes of providing context to the research.

The methodology and rating scale allow for UoEs with different volumes of output to achieve the same rating. So, for example, a UoE with a small number of outputs can achieve a rating of ‘5’ where the UoE meets the standard for that rating point, similar to a UoE with a large number of outputs.

Each UoE is assessed against the absolute standards of the rating scale, not against other UoEs. One of the key objectives of ERA is to identify excellence across the full spectrum of research performance.

REC members exercise their knowledge, judgment and expertise to reach a single rating for each UoE. In reaching a rating, REC members take account of all of the supporting evidence which is


submitted for the UoE. REC members do not make comment about the contributions of individual researchers.

The rating for each UoE reflects the REC members’ expert and informed view of the characteristics of the UoE as a whole. In all cases the quality judgments relate to all of the evidence, including the entire indicator suite, and the ERA Rating Scale. In order to achieve a rating at a particular point on the scale, the majority of the output from the UoE will normally be expected to meet the standard for that rating point. Experience has demonstrated that there is normally a variety of quality within a UoE.

5.4 A Dashboard of IndicatorsERA is an evaluation of research quality, and is a holistic evaluation. The ERA indicator suite for each FoR is presented to REC members as a ‘dashboard of indicators’. The ‘dashboard’ presents a range of information to the REC member, and the full range of indicators presented on the ‘dashboard’ are relevant to the evaluation.

5.5 DrilldownsREC members are able to view the underlying data behind each indicator. Through the ERA evaluation interface (SEER), REC members are able to drilldown into the underlying data of an indicator at various points. Drilldown menus are generally not available where information would allow the viewer to identify or track individual researchers.

Drilldowns enable REC members to view the unit record data which comprises the indicator. Some of the information displayed relates to other indicators, allowing REC members to enrich their view of the UoE. For example the journal field of the publishing profile will show both a list of all journal articles published in that journal and citation counts for these articles. This may reveal additional information such as a trend of low citation performance explained by a particular sub-discipline focus. In this manner, REC members can begin to build a richer picture of the UoE they are looking at and conduct evaluations informed by summary metrics, the underlying information, contextual information and their expert knowledge of the discipline.

5.6 Explanatory StatementsExplanatory Statements are an integral part of the ERA evaluations and are viewed by REC members alongside the indicators. Institutions have an opportunity to provide an Explanatory Statement for each two-digit FoR code. Explanatory Statements inform REC members of the context in which a two- or four-digit UoE is presented, and may guide REC members’ attention to a particular aspect of the submission or particular focus of the research such as an emerging discipline. Where the indicator profile looks unusual, the Explanatory Statement may assist REC members to understand apparent anomalies.

5.7 Volume and Activity vs. QualityA Volume and Activity indicator is provided, and is intended to provide contextual information regarding the UoE, such as focussing REC members’ attention to the main output type for a UoE.

There are no assumptions in ERA about the relationship between quality and quantity. ERA assesses research quality, and recognises that a small UoE can be rated at the same level as a large UoE.

5.8 Assignment of FoRs to Research OutputsThe ERA methodology has been designed to allow submitting institutions flexibility to assign research outputs to the most appropriate FoR code.


Institutions may assign research outputs to up to three four-digit FoR codes relevant to the output. With the exception of journal articles and conference papers, there is no restriction on the FoR codes institutions can assign to research outputs.

Institutions may assign research outputs published in journals to any of the FoR codes listed for that journal in the ERA 2015 Submission Journal List. There is no requirement for institutions to assign a journal article to all of the listed codes for each journal, only the relevant codes.

In the case of articles published in journals with two-digit codes in the ERA 2015 Submission Journal List, institutions may assign to the article any four-digit codes associated with the two-digit codes identified for that journal in the list.

In the case of articles in journals marked as multidisciplinary (MD) in the ERA 2015 Submission Journal List, the institution may select any relevant four-digit FoRs to assign to the article.

In addition, the reassignment exception rule allows a journal article which has significant content (66% or greater) that could best be described by a particular FoR code, to be assigned by the institution to that FoR code, even if the ERA 2015 Submission Journal List does not assign that code to the journal in which the article was published.

Where a research output is assigned more than one FoR code, submitting institutions are required to apportion the item across the FoR codes to account for the whole output. Each of the FoR codes assigned must account for at least 20% of the output (and in the case of the reassignment exception apportionment to a FoR not shown on the journal list must account for at least 66%). The total of percentages apportioned to each research output must equal 100%.

5.9 FTE and HeadcountInstitutions submit the fractional FTE (full-time equivalent) value of each eligible researcher as well as the FoR codes relevant to the researcher. Up to three four-digit FoR codes, totalling 100% can be assigned to each eligible researcher. Not all researchers require a FTE value to be eligible, for example affiliates and Emeritus Professors. The identity of individual researchers is protected in the staffing profile.

5.10 Research Income and Research Commercialisation IncomeInstitutions are required to assign the relevant FoR codes to Research Income and Research Commercialisation Income. There is no restriction on the number of FoR codes that can be assigned to Research Income and Research Commercialisation Income. The total of percentages apportioned to Research Income and Research Commercialisation Income must equal 100% (the minimum apportionment to any FoR code is 0.01%).

5.11 Applied Measures (excluding Research Commercialisation Income)

Each Applied Measure, with the exception of Research Commercialisation Income, may be assigned to up to three relevant FoR codes. Where more than one FoR code is assigned to an Applied Measure, submitting institutions are required to apportion the FoR codes so that the total of the percentages apportioned equals 100% (the minimum apportionment to any FoR code is 20%).

5.12 Esteem MeasuresEach Esteem Measure may be assigned to up to three relevant FoR codes. Where more than one FoR code is attributed to an Esteem Measure, submitting institutions are required to apportion the Esteem Measure across the FoR codes totalling 100% (the minimum apportionment to any FoR code is 20%). The identity of individual researchers is protected in the esteem profile.


5.13 SEER warningsThe SEER system has been developed to ensure that all indicators presented are valid. REC members can be confident that the indicators presented are accurate, and have passed validation and all automated and human checks during the submission phase.

The indicator profiles in Section 6: The ERA Indicators—Detail, provide information on the warnings relevant to each indicator. SEER will assign warnings based on a set of pre-defined rules. Warnings do not disqualify data, but flag outliers and issues that should be borne in mind while interpreting the data. Warnings may guide REC members to focus on particular indicators, or may highlight data outliers which may affect the indicator profile.

When warnings are presented for a UoE, REC members should take additional care to ensure that they are aware of all aspects of the UoE, including outliers in the underlying data (details of which can be viewed in the drilldowns).


6 The ERA Indicators: Detail This section of the Handbook describes in detail the indicators that will be shown during evaluation.

Indicator contextual information will be shown on the first SEER screen for each UoE.

The remainder of this section provides information for each indicator used in the ERA evaluation process including:

The indicator—description and purpose

FoR code specific issues—information about the applicability of the indicator to particular discipline groupings or UoEs

Indicator tables and interpretation—how the indicator is shown in SEER

Benchmarks and comparators—description of any relevant benchmarks or the comparative information provided for the indicator

Relationship with other indicators—including whether the indicator should be considered in conjunction with other indicators

Relevant warnings—any warnings that will show in SEER regarding the integrity of the data, and an explanation of what each warning means

Drilldowns—drilldowns allow REC members to click on an aggregated indicator profile and view the details of individual items.

6.1 Indicator contextual informationEach UoE will be prefaced by contextual data to assist REC members to form an overall picture of the size of the UoE, the predominant output types and the extent of any interdisciplinary research.

The UoE Profile presents an Explanatory Statement submitted by the institution (see Section 5.6) together with the interdisciplinary profile.

6.1.1 Interdisciplinary profileFor four-digit UoEs RECs are provided with an interdisciplinary profile of the UoE. ERA allows up to three four-digit FoR codes to be apportioned to each research output and so REC members will have information about key areas of cross-over between the UoE being assessed and other FoRs from the same institution. The interdisciplinary profile should be viewed alongside information provided in the corresponding Explanatory Statement, which may, for example, highlight that the UoE is an integral part of broader research activity with significant volumes of research in other FoR codes.

Table 4 shows the interdisciplinary profile for a UoE. The first FoR code shown is the FoR of the UoE being assessed (in this case, 0901). The profile then displays a list of other FoR codes apportioned to outputs from this UoE.


Only FoR codes that account for at least 20% of the outputs are shown in the interdisciplinary profile. Twenty per cent of outputs shared across two or more FoR codes represents a significant interdisciplinary profile. This means, however, that some interdisciplinary research which represents less than 20% within the UoE will not be shown in the profile.

Table 4: Interdisciplinary profile table

FoR Name Apportioned count Whole Count %

0901 Aerospace Engineering 83.5 169 49%

0909 Geomatic Engineering 39.4 90 23%

Figure 3: Interdisciplinary profile bar graph

0901 09090%

10%

20%

30%

40%

50%

60%

49%

23%

Uni X 0901 Interdisciplinary Profile

Table 4 is a profile for a UoE in 0901 (Aerospace Engineering) where 169 whole research outputs have been submitted. The proportion of these whole outputs that are apportioned to 0901 is equal to 83.5 outputs, or 49%. A proportion equal to 39.4 outputs (23% of the 169 research outputs) were also assigned to 0909 Geomatic Engineering. No other FoRs are shown in the interdisciplinary profile for this UoE because no other FoRs account for more than 20% of apportioned outputs submitted to the UoE. This is presented graphically in Figure 3.

6.1.2 Intradisciplinary profileFor two-digit UoEs, RECs are provided with an intradisciplinary profile that indicates which of the constituent four-digit FoR codes are prominent in the two-digit UoE. This may indicate a particular sub-discipline focus that needs to be accounted for in evaluation.

The intradisciplinary profile also indicates which of the constituent four-digit FoR codes will be evaluated as separate UoEs (i.e. which four-digit FoRs for this institution met the relevant low volume threshold). The blue bars represent four-digit FoR codes that will be evaluated as individual UoEs because the low volume threshold was met. The red bars show four-digit FoR codes where the low volume threshold was not met.


Figure 4: Two-digit Intradisciplinary profile

Figure 4 indicates which of the constituent four-digit FoR codes are prominent in the two-digit UoE. It shows the percentage contributed by each four-digit FoR code to the total apportioned research outputs for the two-digit UoE. It also demonstrates how different the four-digit and two-digit profiles are: that is, the two-digit UoE is not just an average of the four-digit performance, but includes a range of outputs that may not have been evaluated at the four-digit level (as in the example above).

6.2 UoE Indicator SummaryThe first item shown in the view indicators section for each UoE is the Indicator Summary (Table 5). This summary outlines at a glance the research output volume information (for relevant output types), staffing profile, outputs nominated for peer review (where applicable), total research income for each category and applied and esteem information. It is intended as a quick reference for the information that is contained in the indicators, not as a measure of quality.


Table 5: UoE Indicator Summary

Volume and Activity

Books 10.0Book Chapters

51.7Journal Articles

64.4Conference Publications

2.2Original Creative Works

0.0

Live Performance

0.0

Recorded/ Rendered Works

0.0 Curated Works

0.0 Portfolios 0.0

Total headcount

24.9 Total FTE 20.1

Peer Review Items Flagged 39

Research Income Category 1 $473,764 Category

2$11,971 Category 3 $14,909 Category 4 $0

Applied Patents: 0Commercialisation Income

$0 Registered Designs

2.3Plant Breeder’s Rights

0 NHMRC Guidelines

0

Esteem Work of Reference

0 Learned Academy

1.0 Cat 1 Fellowships

2.4 Statutory Committee

0 Australia Council

0.1

An orange-coloured box on this screen indicates that there is a warning associated with the profile (in this case for Category 1 income in the Research Income profile). The warning will be detailed in the specific indicator profile.

6.3 Volume and ActivityREC members have access to a range of Volume and Activity measures which provide an indication of the level of activity for each UoE. The Volume and Activity indicator is not a proxy for research quality. The quality of a small UoE will be evaluated according to the same criteria as a large UoE. Three Volume and Activity profiles are shown: Research Outputs, FTE Profile by Academic Level, and Research Output by Year.

The volume and activity indicator provides contextual information regarding the UoE. For example, it will show REC members the relative proportions of different types of research outputs within the UoE which may contribute to an understanding of the type of research being performed e.g. a UoE comprising mostly creative works will have different expected patterns of behaviours from one which comprises mostly of journal articles, and so the focus of the evaluation will be informed by this.

6.3.1 Research OutputsThis indicator provides an overview of the types and volume of research outputs, including the contribution of the institution to the total output of Australian research within the FoR.

FoR code specific issues

Traditional research output types apply to all disciplines. Non-traditional research outputs (NTROs) only apply to some disciplines. The exception is the NTRO category ‘Research Reports for an External Body’ which applies to all disciplines.

Depending on the applicability of indicators, each UoE will have either a ‘Traditional Output Table’, as shown in Table 6 or a ‘Traditional and Non-Traditional Output Table’ as shown in Table 7.

A pie chart showing the distribution of research output types (Figure 5) will be available for all UoEs.


Please refer to the ERA 2015 Discipline Matrix at Appendix 6 for detailed information regarding the applicability of indicators.

Indicator tables and interpretationThis indicator is presented both in tabular and graphical formats, as shown in Table 6, Figure 5 and Table 7. The indicator shows:

the apportioned number of outputs by type for the UoE

the percentage of outputs by type for the UoE

the percentage of the UoE’s contribution to the Australian HEP apportioned total for the FoR code

for UoEs subject to Peer Review, the outputs nominated for Peer Review are shown in the ‘Peer Review (whole count)’ column, as shown in Table 7.

Information regarding eligible output types is provided in Section 5.4.2 of the ERA 2015 Submission Guidelines.

Table 6: Traditional output table

Output Type No. of outputs % of outputs % of contribution to Australian HEP FoR total

Books 0.0 0% 0%

Book Chapters 3.4 2% 23%

Journal Articles 159.7 97% 21%

Conference Publications 2.0 1% 80%

Research Reports for External Bodies 0.0 0% 0%

Total 165.1 100% 21%

Note, percentages can total more than 100% because of rounding of fractions.


Figure 5: Distribution of research output pie chart

Figure 5 displays the research output proportions from Table 6 graphically. ‘Journal Articles’ make up the bulk of research outputs contributing to the UoE, with the other traditional output types comprising 3% of outputs submitted to the UoE. In this case the citation data, if an identified indicator, will be an influential evaluation indicator as it covers the significant majority of the outputs.

Table 7: Traditional and non-traditional output table

Output Type No. of outputs

% of outputs

% of Contribution to Australian HEP

FoR total

Peer Review (whole count)

Books 2.0 1% 2% 1

Book Chapters 5.2 2% 1% 2

Journal Articles 7.0 3% 1% 5

Conference Publications 12.7 4% 3% 0

Original Creative Works 93.5 30% 8% 45Live Performance of Creative Works 126.0 40% 17% 22Recorded/Rendered Creative Works 7.0 2% 2% 6Curated or Produced Substantial Public Exhibitions and Events 59.8 19% 54% 14Research Reports for an External Body 0.0 0% 0% 0Portfolios of Non Traditional Research Outputs 0.0 0% 0% 0

Total 313.2 100% 7% 95Note, percentages can total more than 100% because of the rounding of fractions.

Table 7 shows that there were a total of 313.2 apportioned outputs submitted for this UoE. ‘Live-Performance of Creative Works’ make up the highest proportion at 40% of the total apportioned outputs for this UoE, followed by ‘Original Creative Works’ at 30%. A total of 95 outputs have been nominated for Peer Review. REC members can drilldown into the Volume and Activity profile to examine the bibliographical detail of the outputs.


Benchmarks and ComparatorsBenchmarks are not applied to this indicator, however, the percentage of total contribution to Australian HEP total for the FoR code is shown.

The percentage contribution to the Australian total is shown as a guide to the role of a particular UoE in shaping the Australian benchmarks for other indicators. An institution that contributes a high proportion of outputs to the FoR will obviously heavily influence Australian benchmarks.

Relationship with other indicatorsNil

Relevant warningsNil

DrilldownsExample drilldowns for this indicator are available at Appendix 1—Research Output Drilldowns.

6.3.2 FTE Profile by Academic Level Staffing data provides contextual information to REC members regarding the academic profile of each UoE. Institutions are required to report academic classification levels of each eligible researcher as used in the Higher Education Staff Data Collection (HESDC). An ‘Other’ category is provided to allow the inclusion of eligible researchers who cannot be assigned to one of the Level A–E classifications. An example would be an administrative (rather than teaching or research) staff member who has produced an eligible research output. Further information regarding eligible researcher criteria is provided in Section 5.3.1 of the ERA 2015 Submission Guidelines. Institutions also assign relevant four-digit FoR codes to eligible researchers. A researcher may be assigned up to three four-digit FoR codes.

Both headcount and FTE are shown in this indicator. Headcount is shown alongside FTE because non-salaried staff (e.g. Emeritus and Adjunct staff) may contribute to the UoE but have an FTE of 0. Therefore, viewing both headcount and FTE provides REC members with a more complete picture of eligible researchers.

As with volume data, staffing data is provided as contextual information and cannot be used to draw conclusions about the quality of the research outputs within a UoE. A quick reference guide to researcher eligibility is presented in Table 8.


Table 8: Quick reference guide to researcher eligibility

Is a ‘Member of Staff’ at the census date (31 March 2014)

Nature of appointment with institution

Nature of ‘Function’

Minimum number of research outputs 1

Must have a research output with a demonstrable publication association

Submit ‘Member of Staff’ researcher data

Research outputs to submit

No – – – – No Nil

Yes

FTE-based

RO or T&R 0 No Yes AllRO or T&R <0.4 FTE2 1 Yes Yes All

Other 1 No Yes All

All others3 Any 1 Yes Yes

Only those with demonstrable

publication association 4

1. ‘Research outputs’ are those outputs that meet the requirements outlined in the ERA 2015 Submission Guidelines.

2. See section 5.3.1.4 of the ERA 2015 Submission Guidelines for eligibility criteria for staff employed at less than 0.4 FTE.

3. ‘All others’ includes visiting, exchange, seconded, temporary (conjoint, clinical, adjunct), unpaid, and casual.

4. A ‘demonstrable publication association’ is one that meets the criteria outlined in the ERA 2015 Submission Guidelines.

LEGENDFunction: RO = Research Only; T&R = Teaching and Research

FoR code specific issuesThis indicator applies to all FoR codes.

Indicator tables and interpretationAs ERA does not evaluate individual researchers there are no drilldowns to individual researchers provided for the FTE profile.

When viewing the FTE staffing profile, REC members should be aware that the work standards relating to each classification level may vary from institution to institution. These variations may result from factors such as different institutional classifications or differences in employment law between states and territories. The classification data is presented as context which may be further explained in the institutional Explanatory Statement.

Table 9 presents the indicator in tabular format. The indicator includes:

the number of apportioned FTEs by HESDC levels

the percentage of FTEs by HESDC levels

apportioned headcount by HESDC levels

headcount percentage by HESDC levels.


Table 9: FTE Profile by Academic Level

HESDC Level

FTE (apportioned) % of FTEs

Headcount (apportioned) % Headcount

Level E 14.5 19% 15.5 17%

Level D 14.2 19% 14.2 16%

Level C 14.9 20% 16.2 18%

Level B 19.7 26% 21.8 24%

Level A 9.9 13% 10.5 12%

Other 2.8 4% 12.0 13%

Total 75.9 100% 90.1 100%Note, percentages can total more than 100% because of the rounding of fractions.

Table 9 shows that the UoE employed a total of 75.9 FTEs during the reference period. The largest proportion of employed staff is ‘Level B’ at 26% followed by ‘Level C’ at 20%.

The UoE’s headcount is 90.1. Note that up to three FoR codes can be assigned to researchers, thereby making it possible to have decimals in the ‘Headcount’ column. For example, someone employed as 0.9 FTE at Level E, and apportioned 30% in FoR 0201 and 70% in FoR 0203 will contribute as follows:

0.27 FTE (0.9 x 0.3) and 0.3 Headcount (1 x 0.3) for ‘Level E’ in 0201

0.63 FTE (0.9 x 0.7) and 0.7 Headcount (1 x 0.7) for ‘Level E’ in 0203.

Benchmarks and ComparatorsNil

Relationship with other indicatorsTotal FTE (all levels including ‘Other’) and total academic FTE (levels A–E only) are used as denominators in the Research Income and Research Commercialisation Income indicators for the purposes of developing a comparison.


DrilldownsNil

6.3.3 Research Output by YearThis indicator provides an overview of the types and volume of research outputs by year, including the total output for each year.

FoR code specific issuesThis indicator applies to all FoR codes.


Indicator tables and interpretationThe indicator is presented in tabular format as shown in Table 10. The indicator includes:

the number of apportioned outputs by type

the number of apportioned outputs by year of publication.

Table 10: Research output types

Output Type 2008 2009 2010 2011 2012 2013

Books 0.0 0.0 0.0 0.0 0.0 0.0

Book Chapters 0.0 0.0 0.0 0.0 0.0 0.0

Journal Articles 33.2 31.0 35.2 38.2 42.5 39.8

Conference Publications 0.0 0.0 7.0 2.0 4.0 0.0

Original Creative WorksLive Performance of Creative Works

0.0 0.0 0.0 0.0 0.0 0.0

Recorded/Rendered Creative Works

0.0 0.0 0.0 0.0 0.0 0.0

Curated or Produced Substantial Public Exhibitions and Events

0.0 0.0 0.0 0.0 0.0 0.0

Research Reports for an External Body

1.0 0.0 3.0 5.0 7.0 5.0

Portfolios of Non Traditional Research Outputs

0.0 0.0 0.0 0.0 0.0 0.0

Total 35.2 31.0 45.2 45.2 53.5 44.8

Table 10 shows that the focus of publication for the UoE is through Journal Articles. The table shows a consistent level of publication over the reference period.




DrilldownsNil

6.4 Publishing profileThe publishing profile indicator enables RECs to identify the depth and breadth of publishing behaviours within a UoE. For each UoE, each research output type will be displayed as a separate table, showing the profiles for the traditional research output types of journal articles, books, book chapters, and conference publications. Non-traditional research outputs will not be shown.

The publishing profile indicator will inform expert judgments regarding the relevance of the outlets to the research being published, e.g. ‘Is this an appropriate journal for this research?’. It also allows, for example, RECs to take into account any regional or applied focus of research in a UoE through the outlets that are represented.

The research output tables are sorted by descending frequency with the outlet title in which the UoE most frequently publishes appearing first. REC members are able to view every outlet title in which the UoE has published. Please note that it is not possible to sort in this indicator, as the ‘Cumulative


% of outlet title’ column is static. REC members are able to search for a particular outlet title using keywords. It is also possible to click on outlet titles in each table and drilldown into the research output details. REC members should not make their judgments solely on the basis of titles or frequency counts.

The reassignment exception rule, as detailed in Section 5.4.3.1 of the ERA 2015 Submission Guidelines, gives institutions the ability to assign a journal article to the most appropriate FoR code for that research output. This means that REC members may encounter journals in the Publishing Profile that are not typically published by researchers for that FoR code. Where this occurs, REC members are able to drilldown into the details of the research output and view the journal article title, authors and citation or peer review information where available.

REC members should generally accept the information which is presented for evaluation as having been appropriately constructed and validated in submission. Institutions were only able to submit articles published in journals included in the ERA 2015 Submission Journal List. It is worth noting that the ARC consulted the sector extensively to develop the Journal List. If an article is published in a journal that is not included on the ERA 2015 Submission Journal List, it can still be submitted to ERA as a NTRO where that is an available output type for the discipline and where it meets the other criteria for submission. Where there is significant doubt in the expert opinion of a REC Member, this should be reported to the ARC for further investigation. REC members must not undertake independent investigations.

Examples of each of the four outlet frequency tables are shown in Table 11, Table 12, Table 13 and Table 14.

FoR code specific issuesThis indicator applies to all FoR codes:

Some four-digit FoR codes may not have any journals in the ERA 2015 Submission Journal List, however, there may be outputs published in two-digit FoR codes or multidisciplinary journals that an institution has assigned to these four-digit FoR codes. There may also be journal articles an institution has assigned to these four-digit FoR codes using the reassignment exception.

Indicator tables and interpretationThe indicator shows:

number of apportioned research outputs per outlet title

percentage of research outputs per outlet title

cumulative percentage of research outputs per outlet title.


Table 11: Publishing profile indicator—Books

Publisher name No. of books (apportioned) % of books Cumulative %

of books

University of Canterbury 16.7 12.60% 13%

Cambridge Scholars Publishing 13.9 10.49% 23%

Brill Academic Publishers 12.6 9.51% 33%

Tauris Academic Studies 10.5 7.92% 41%

Sdu Uitgevers 7.8 5.89% 46%

Toyo Keizai Shimpo Sha 6.9 5.21% 52%

Metropolis-Verlag 6.6 4.98% 57%

Singapore University Press and World Scientific Publishing Co Pty Ltd 6.2 4.68% 61%

National Institute Press 4.3 3.25% 65%

Gulf Research Center Books 3.2 2.42% 67%

Network Books 2.5 1.89% 69%

National Museum of Ethnology Japan 2.1 1.58% 70%

United Nations Publishers 2.1 1.58% 72%

Blackwell Publishing Ltd 2.1 1.58% 74%

Naval War College Press 1.9 1.43% 75%

Anamaya Publishers 1.4 1.06% 76%

University of Pittsburgh Press 1.3 0.98% 77%

Mino y Davila 1.2 0.91% 78%

Global Oriental 1.0 0.75% 79%

Cornell University Southeast Program 1.0 0.75% 79%

Only 20 of the most frequent publishers shown only in this example. REC members are able to view the remainder of the publishers in SEER.


Table 12: Publishing profile indicator—Book Chapters

Publisher nameNo. of book

chapters (apportioned

)

% of book chapters

Cumulative % of book chapters

Routledge, Taylor & Francis Group 31.9 8.29% 8%

Oxford University Press 25.5 6.34% 15%

Palgrave Macmillan 25.0 6.34% 21%

Wiley 20.5 5.12% 26%

Cambridge University Press 18.5 4.88% 31%

Institute of Southeast Asian Studies 17.0 4.15% 35%

Ashgate Publishing Ltd 16.6 4.39% 40%

Prentice Hall 14.0 4.15% 44%

Manchester University Press 11.0 2.68% 46%

Allen and Unwin 10.0 2.44% 49%

Institute of Samoan Studies 9.0 2.20% 51%

Springer 8.5 2.44% 53%

Routledge 8.0 1.95% 55%

Edward Elgar Publishing 6.5 1.71% 57%

Lynne Rienner Publishers Inc 6.0 1.46% 59%

M E Sharpe Inc 6.0 1.46% 60%

I B Tauris & Co Ltd 5.0 1.22% 61%

API Network 5.0 1.22% 62%

Rowman & Littlefield Publishers Inc. 4.0 0.98% 63%

Only 20 of the most frequent publishers shown only in this example. REC members are able to view the remainder of the publishers in SEER.


Table 13: Publishing profile indicator—Journal articles

Journal Title

No. of journal articles

(apportioned)

% of journal articles

Cumulative % of journal articles

International Energy Journal 33.9 13.56% 14%International Journal of Adaptive Control and Signal Processing 22.1 8.84% 22%

International Journal of Electrical Engineering 20.3 8.12% 31%

Signal Processing: Image Communication 15.5 6.20% 37%

Annals of Telecommunications 14.7 5.88% 43%

IEEE Journal of Microelectromechanical Systems 13.8 5.52% 48%

IEEE-ASME Transactions on Mechatronics 12.3 4.92% 53%Turkish Journal of Electrical Engineering and Computer Sciences 11.6 4.64% 58%

Electronics and Telecommunications Research Institute (ETRI) Journal 11.5 4.60% 62%

IEEE Communications Magazine 9.8 3.92% 66%

IEEE Transactions on Semiconductor Manufacturing 8.6 3.44% 70%

Electric Power Systems Research 8.1 3.24% 73%IEEE Circuits and Devices: the magazine of electronic and photonic systems 7.6 3.04% 76%

IEEE Antennas and Propagation Magazine 6.4 2.56% 78%

Journal of Communications Technology and Electronics 6.3 2.52% 81%International Journal of Microwave Science and Technology 3.8 1.52% 83%

International Journal of Innovations in Energy Systems and Power 3.6 1.44% 84%

Denki Kako Gakkaishi 3.5 1.40% 85%

Fujitsu Scientific and Technical Journal 2.5 1.00% 86%

Elektromagnitnye Yavleniya 2.3 0.92% 87%

Only 20 of the most frequent journal titles shown only in this example. REC members are able to view the remainder of the journal titles in SEER.


Table 14: Publishing profile indicator—Conference publications

Conference name

No. of conference

publications (apportioned

)

% of conference

publications

Cumulative % of conference

publications

ISCA Tutorial and Research Workshop Automatic Speech Recognition 20.1 10.79% 11%

International Conference on the Principles of Knowledge Representation and Reasoning 19.1 10.25% 21%

IEEE Symposium on Computational Intelligence for Image Processing 16.8 9.02% 30%

IEEE International Conference on Information and Automation 16.5 8.86% 39%

International Meeting on DNA Computing and Molecular Programming 15.4 8.27% 47%

Computer Animation, Information Visualisation, and Digital Effects 13.3 7.14% 54%

German Conference on Artificial Intelligence 13.1 7.03% 61%IEEE International Conference on Intelligent Computer Communication and Processing 9.2 4.94% 66%

Deutsche Arbeitsgemeinschaft für Mustererkennung DAGM e.V 9.1 4.88% 71%

Australasian Speech Science and Technology 8.6 4.62% 76%

Pacific Asian Conference on Expert Systems 7.9 4.24% 80%International Conference on Intelligent Tutoring Systems 5.6 3.01% 83%

Intelligent Multimedia, Video and Speech Processing 4.6 2.47% 86%International Conference on Artificial Intelligence 4.5 2.42% 88%ACM SIGGRAPH/Eurographics Symposium on Computer Animation 3.8 2.04% 90%

International Conference on Artificial Intelligence and Soft Computing 3.2 1.72% 92%

Annual International Workshop on Presence 2.7 1.45% 93%

Program Visualization Workshop 2.3 1.23% 94%International Conference on User Modelling (now UMAP) 2.1 1.13% 95%

Ambient Intelligence Developments 1.9 1.02% 97%

Only 20 of the most frequent conference titles shown only in this example. REC members are able to view the remainder of the conference titles in SEER.


Relationship with other indicatorsThis indicator should be considered in the context of all other indicators.


DrilldownsExample drilldowns for this indicator are available at Appendix 1: Research Output Drilldowns.


6.5 Citation AnalysisERA uses a number of bibliometric tools for the citation analysis indicators. Two broad types of citation analysis are used in ERA: relative citation impact (RCI) and the distribution of publications based on comparisons with field-specific benchmarks. The former is presented as an average, while the latter profiles the distribution of citations across the set of publications being evaluated.

ERA includes three types of bibliometric profiles to evaluate research publication quality. These are:

1. Relative Citation Impact (RCI), calculated against Australian institution and world benchmarks

2. Distribution of papers based on world centile threshold and Australian HEP average (centile analysis)

3. Distribution of papers against RCI classes.

The three profiles are designed to be complementary and must be considered as a set.

Citation analysis is applicable only to eligible journal articles indexed by Scopus and where the UoE meets the low volume threshold for citation analysis. It is important that at least 50 apportioned and indexed articles are included in this indicator to ensure a robust statistical base. The FoR codes that utilise citation analysis are shown in the ERA 2015 Discipline Matrix in Appendix 6.

6.5.1 Relative Citation Impact (RCI) ProfileAn RCI is calculated for each paper against year-specific benchmarks. An average of all the institution’s individual papers’ RCIs is then derived. World and Australian HEP benchmarks are used in the calculation of the RCI profile.

FoR code specific issuesPlease refer to the ERA 2015 Discipline Matrix at Appendix 6 for information regarding the applicability of indicators.


the apportioned count of indexed papers for the UoE

average UoE RCI against world benchmark

average UoE RCI against Australian HEP benchmark

percentage of papers indexed by Scopus

percentage of contribution to the Australian HEP FoR total for papers

percentage of contribution to the Australian HEP FoR total for citations.


Table 15: UoE RCI against world and Australian HEP benchmark

Total Publications(Apportioned)

UoE RCI against:% Papers Indexed

World Benchmark Aust. Benchmark

133 1.2 1.0 81%

Table 15 shows that 133 papers in this UoE are eligible for citation analysis. The UoE’s average RCI against the world is 1.2; which means that this UoE is performing at 1.2 times the world average. The UoE has a high percentage of papers indexed by Scopus (81%), contributing to the RCI performance for the UoE. The percentage of papers indexed provides important contextual information about the validity of this indicator for the UoE.

It is important to note that the RCI profile is an average of all papers’ RCIs against the relevant benchmark. It does not reveal information about groups of highly cited papers or groups of uncited papers. For this reason, this profile must be interpreted in conjunction with Distribution of Papers by RCI Classes Profile.

Table 16: Proportion of UoE contribution to Australian HEP FoR Total papers and citations

% contribution to Australian HEP FoR Total

Papers Citations

4% 4%

Table 16 shows the UoE’s contribution to the Australian HEP FoR Total papers and citations. In this example, the UoE published 4% of total papers for the FoR code and received 4% of the citations for the FoR.

Benchmarks and ComparatorsAs per the benchmarks shown in Distribution of Papers by RCI Classes Profile.

Relationship with other indicatorsThis indicator must be interpreted in conjunction with Distribution of Papers by RCI Classes Profile.

Relevant warnings

If one or more indexed journal articles has an RCI greater than or equal to 8.0, this warning is shown: “This UoE contains “x” articles with very high citations (RCI ≥ 8) which may skew the RCI profile. You can view the article details using the RCI class distribution profile drilldowns. The centile and RCI class distribution profiles may be more reliable profiles”

Where a UoE has less than 75 indexed apportioned articles, this warning is shown: “There are less than 75 indexed apportioned articles in the UoE, treat RCI profile with care—place more relevance on the centile and RCI class distribution profiles”

In the drilldowns, any article with an RCI of greater than or equal to 8.0 will also be highlighted.


The drilldown may, for example, reveal that there is a particular highly cited paper which is leading to an overall very high RCI profile. REC members may wish to account for this in how they interpret this indicator.


6.5.2 Centile Analysis ProfileREC members will have access to a centile analysis profile as a tool to be used in conjunction with the RCI profile described above and the distribution of papers by RCI class described below. Centile Analysis profiles allow the examination of the distribution of papers relative to world centile thresholds.

The Centile Analysis profile also shows the median number and percentage of papers at the 50th world centile for a UoE. This shows an institution’s performance above and below the median.


Indicator tables and interpretationThe indicator shows at the 1, 5, 10, 25 and 50 centiles:

the cumulative number of UoE papers in each world centile band

the cumulative percentage of UoE papers in each world centile band

the Australian HEP cumulative percentage of papers for the FoR in each world centile band

the UoE’s contribution to the Australian HEP total for each world centile band

the percentage of journal articles indexed by Scopus for the UoE

the number of uncited papers.

Table 17: UoE Centile analysis

World centileUoE Aust. HEP

FoR average % of papers (cumulative)

% Contribution to Aust. HEP

FoR total

% papers indexedNo. of papers

(cumulative)% of papers (cumulative)

1 1.0 1% 2% 5%

5 4.7 7% 7% 6%

10 18.4 27% 16% 10%

25 49.8 73% 44% 10%

50 (median) 63.3 92% 76% 8%

Total* 68.6 100% 100% 81%Uncited 2.3

* This total is a sum of apportioned indexed journal articles for the unit of evaluation.

Table 17 shows that this UoE had 1.0 (1%) papers in the top 1% of cited papers in the world. This is compared against the Australian HEP percentage of papers which had 2% in this centile band. In the top 5% of cited papers the UoE had 4.7 papers or 7% of its total papers. The Australian HEP percentage for the FoR code was 7% of papers. In the top 10% of cited papers, or the 90th percentile, the UoE had 18.4 papers or 27% of its papers. The Australian HEP percentage for the FoR code had 16% of papers in the 90th percentile. This suggests that the UoE, although performing below the Australian HEP average in the 1st centile band and at average in the 5th centile band, is performing above the HEP average at the 10th centile band. At the 50th percentile, or the median, the UoE had 63.3 papers or 92% of papers. This is more than the Australian HEP average of 76% of papers at the median.


Figure 6: Centile analysis graph

Figure 6 shows the UoE’s centile profile graphically. The light blue shading is the world centile bands of 1, 5, 10, 25 and 50. Where the UoE’s performance (in green) exceeds the light blue shading, the UoE is performing above world average in that centile band. The purple bar is the Australian HEP performance for the FoR code.

This UoE contributes a small percentage of papers in each of the centile bands to the Australian HEP total. The ‘% Papers Indexed’ also provides important contextual information about the validity of this profile. In Table 17, 81% of journal articles submitted to ERA for this UoE are indexed by Scopus.

Benchmarks and Comparators

1. World centile thresholds: the citation provider derives the number of citations required to be in the top 1%, 5%, 10%, 25% and 50% of the world for a FoR code for each year of the reference period.

2. Australian HEP average for each centile: the ARC will derive the average cumulative percentage of papers for a FoR code meeting the threshold for the various world centile bands. This allows comparison of an institution’s performance against its peers.


3. Relationship with other indicatorsThis indicator should be interpreted in conjunction with RCI profile.

Relevant warnings

If one of the centile bands has a lower threshold at zero cites, this warning will be shown: “The centile band X% includes uncited articles”. For details please refer to Appendix 5.


6.5.3 Distribution of papers by RCI ClassesA Relative Citation Impact (RCI) is calculated for each paper against year-specific benchmarks. World and Australian institution benchmarks are used in the calculation of the RCI profile. The papers will be profiled against seven classes of RCI:

Class 0 Output with no citations (RCI=0)

Class I Output with RCI ranging from 0.01 to 0.79

Class II Output with RCI ranging from 0.80 to 1.19

Class III Output with RCI ranging from 1.20 to 1.99

Class IV Output with RCI ranging from 2.00 to 3.99

Class V Output with RCI ranging from 4.00 to 7.99

Class VI Output with RCI above >8.00.

FoR code specific issuesPlease refer to the ERA 2015 Discipline Matrix in Appendix 6 for information regarding the applicability of indicators.


number of UoE papers by RCI Classes (against world benchmark)

proportion of UoE papers by RCI Classes (against world benchmark)

Australian HEP average proportion of papers by RCI Classes (against world benchmark)

percentage of UoE contribution to Australian HEP FoR total by RCI Classes

number of UoE papers in Classes 0 and I (against world benchmark)

number of UoE papers in Classes IV, V and VI (against world benchmark)

ratio of number of UoE papers in Classes IV, V and VI against number of UoE papers in Classes 0 and I.

Citation analysis benchmarks are calculated for each year of the reference period. For each year of the reference period, for each FoR code eligible for citation analysis, a world and Australian institution benchmark will be derived. Papers published in a specific year will be assessed against the discipline-specific benchmark for that year.

This takes into account the differences in the time a paper has had in which to attract citations. That is, papers published in 2008 would (typically) have higher citations than a paper published in 2013 because the 2008 paper has had over six years to attract citations, whereas the 2013 paper has had fewer than two.


Additionally, some institutions will have a concentration of outputs in the more recent years of the reference period, others in earlier years, while some will have equal distribution across each year of the reference period. For this reason, ERA uses year-specific citation benchmarks and not benchmarks based on averages across the entire period. This ensures that any heterogeneity in publication patterns across the reference period is taken into account.

Table 18: Uni X, FoR Y: number of papers across RCI Classes (assessed against the world benchmark)

Class RCI Range No. of papers(apportioned) % of papers Aust. HEP

FoR Average% Contribution to

Aust HEP FoR Total

0 0 2.3 3% 14% 1%I 0.01-0.79 9.5 14% 32% 3%II 0.80-1.19 8 12% 11% 7%III 1.20-1.99 23.9 35% 22% 10%IV 2.00 -3.99 21.2 31% 15% 13%V 4.00-7.99 3.7 5% 5% 7%VI >=8.00 0 0% 2% 0%Total* 57.8 100% 100%

* This total includes journal articles where an RCI can be calculated, not the total indexed journal articles.

Table 18 shows that 3% (or 2.3 apportioned) of papers are uncited, and 17% below the world average. Most papers for this UoE are above the world average (71%) and 36% are cited at 2.00 or more times the world average.

The HEP average allows REC members to compare the UoE against the performance of Australia as a whole. This is shown graphically in Figure 7.

The UoE’s total contribution to the Australian HEP FoR total for each of the RCI Classes is also available in Table 18.

Figure 7: UoE RCI Class distribution against FoR average

Class 0 Class I Class II Class III Class IV Class V Class VI0%

5%

10%

15%

20%

25%

30%

35%

40%

University X, FoR Y, RCI Class Distribution

Uni XHEP FoR Average


REC members are also shown the proportion of high and low RCI Classes in Table 19. The ‘Low Classes’ constitute Class 0 and Class I, while the ‘High Classes’ constitute Class IV, Class V and Class VI. The UoE, as shown in Table 19, has a high to low ratio of 2.11, which confirms the evidence in Table 18 that the UoE has a relatively high number of highly cited papers.

Table 19: UoE papers by low and high RCI Classes

Low RCI Class Count (Class 0–I) High RCI Class Count (Class IV–VI) Proportion of High to Low

11.8 24.9 2.11

Figure 8: UoE papers by RCI Class distribution (blue = low class, darker greens = high class)

03%

I14% II

12%

III35%

IV31%

V5%

Uni A, FoR Y, Citation Class Distribution

014%

I32%

II11%

III22%

IV15%

V5%

Class VI2%

FoR Y, HEP Citation Class Distribution

Figure 8, as well as showing graphically the breakdown by RCI Classes of the UoE compared against the Australian HEP FoR average, also shows the proportion of high to low RCI Class distribution through the colour coding. Class 0 and Class I (i.e. the low RCI Classes), are shown in shades of blue, while Classes IV, V and VI are shown in various shades of dark green. Class II and Class III are shown in pale green.

Benchmarks and ComparatorsTwo benchmarks are used in this profile:

1. World benchmark—calculated using the Scopus ERA 2015 world dataset for each FoR code and for each year of the reference period

2. Australian benchmark—calculated using the institutionally submitted ERA 2015 data for each FoR code and for each year of the reference period.

Relationship with other indicatorsThis indicator should be interpreted in conjunction with RCI Profile.

Relevant warningsIn the drilldowns, any article with an RCI of greater than or equal to 8.0 will be highlighted.



6.6 Peer ReviewFor FoR codes that use peer review as an indicator, institutions are required to nominate 30% of the outputs in the FoR code for peer review. Institutions select the 30% sample of research outputs to make available for peer review. The 30% is calculated based on apportioned counts of research outputs. For example, a UoE contains 100 apportioned outputs, and must, therefore, identify 30 whole outputs for peer review. Institutions have been requested to provide a profile sample which is representative of both the range of outputs types, and the range of eligible researchers for the FoR within the institution. Peer review occurs at the four-digit and two-digit level, for each assessable UoE which meets the low-volume threshold. REC members and selected peer reviewers review outputs nominated for peer review to inform the rating for a UoE. There is no separate rating for individual outputs or for the nominated peer review sample.

Each assessable UoE is assigned to multiple REC members and ERA peer reviewers. Peer reviewers in ERA will be assigned in all cases at the four-digit level, and in some cases also at the two-digit level (for example, where there are substantial new outputs included that were not evaluated at the four-digit level). In all cases ERA peer reviewers will be assigned to multiple UoEs. This ensures that they are able to include a degree of comparison in their evaluations. This does not mean that they are required to rank outputs or UoEs against each other. Reviewing across multiple UoEs will also assist peer reviewers develop a deeper familiarity with the ERA peer review criteria.

The research output types available for peer review include the standard range of academic outputs including books, book chapters, journal articles and conference publications. As well, ERA includes a range of Non-Traditional Research Output (NTRO) types for some disciplines. This category takes account of research in the creative arts which ranges from the experimental, involving the production of creative works, through to the analytical, involving the study of particular subjects.

The NTRO types include:

Original creative works

Live performance of creative works

Recorded / rendered creative works

Curated or produced substantial public exhibitions and events

Research reports for an external body.

These outputs may be submitted as individual items or, where individual works that are derived from the same underlying research endeavour but do not in themselves constitute research, they may be submitted as a ‘Portfolio’, which in ERA constitutes a single Non-Traditional Research Output.

Up to three FoR codes can be assigned to research outputs. Research outputs can be nominated for peer review in one or all of those codes. An output will only be available for peer review in a specific FoR if the submitting institution has nominated it for peer review in that FoR. It is not automatically available for peer review in all assigned FoRs. For example, a book is coded by the institution to FoR 2103, 1904 and 1901. If the book is nominated for peer review in 2103, but not in 1904 and 1901, it will only be available for peer review in 2103.

For NTROs which are nominated for ERA peer review and for each portfolio, a research statement identifying the research component of the outputs must be provided as part of the submission of an institution. The research statement must be no more than 2000 characters (around 250 words) and address the following categories:

1. Research Background


- Field

- Context

- Research Question

2. Research Contribution

- Innovation

- New Knowledge

3. Research Significance

- Evidence of Excellence.

REC members and ERA peer reviewers will evaluate NTROs selected for ERA peer review in the context of the research component as identified in the research statement.


Indicator tables and interpretationREC members have access to a summary table (Table 20) which lists the number of outputs by output type available for peer review.


Table 20: Available outputs for Peer Review

Output Type No. of outputs % of outputs% of contribution to Aust HEP FoR

total

Peer Review (whole count)

Books 4.1 1% 1% 1

Book Chapters 14.7 2% 1% 4

Journal Articles 39.3 6% 2% 12

Conference Publications 39.8 7% 4% 12

Original Creative Works 246.9 41% 5% 74

Live Performance of Creative Works 182.0 30% 23% 55Recorded/Rendered Creative Works 36.0 6% 5% 11Curated or Produced Substantial Public Exhibitions and Events 12.0 2% 2% 4Portfolios of Non Traditional Research Outputs 31.0 5% 6% 9Research reports for an External Body 0.0 0% 0% 0

Total 605.8 100% 5% 182Note, percentages can total more than 100% because of the rounding of fractions.

Table 20 shows that the largest output type for this UoE is ‘Original Creative Works’ (41%) and this is reflected in the proportions of output types which have been nominated for peer review.

The ‘Peer Review’ tab in SEER lists the outputs which have been nominated for peer review and provides a link (through SEER) to the individual outputs for REC members and peer reviewers.

REC members will also have access to the peer reviewers’ reports. These reports will provide important advice to the RECs from a specialist perspective, which can then be incorporated into the REC members’ evaluation alongside the various other indicators on the dashboard. Peer reviewers base their responses on the pool of outputs available for peer review only, and do not have access to any of the other indicators or data provided on the dashboard. REC members are not required to complete a Peer Review Report.

The Peer Review Report form (reproduced at Appendix 2) asks each peer reviewer to nominate their expertise for each assigned UoE in terms of the discipline (i.e. four-digit code) on a scale of one (low expertise) to five (high expertise).

Reviewer expertise in Area

Low Expertise 1 2 3 4 High Expertise 5

The assumption is that a peer reviewer who rates expertise at ‘5’ is well-qualified in the discipline to comment on the assigned work. This information will assist REC members to incorporate peer reviewer reports into the overall evaluation of the UoE under consideration.

Peer reviewers must indicate each output they read by marking that output as ‘Read’ in SEER. This is a helpful guide for peer reviewers as they work through the allocation of items for review and it is information which the REC members will use both to determine what outputs have contributed to a Peer Review Report and for any additional reading which might be necessary during subsequent stages of evaluation to ensure a broad range of the outputs submitted for peer review have been read.

Types of outputs reviewed?


Articles Books Book Ch NTRO Conf Pub Total number of outputs reviewed

# # # # # #[auto-populated by SEER “read” items]

The types of outputs read for each UoE will be auto-populated and show in the individual Peer Review Reports.

The Peer Review Report includes a section for peer reviewers to describe their sampling strategy.

Sampling Strategy [Please make a statement about the sampling strategy you employed to select outputs for peer review. This may include reference to disciplinary expertise, types of outputs (books, journals articles, etc.), prior familiarity with work etc.]

It is useful for the REC members to have an indication of the range of output types that have been read, the extent to which the peer reviewer was familiar with these outputs prior to the evaluation, and the extent to which these outputs were within the peer reviewers disciplinary expertise. This information will assist REC members in applying the information in the report to their task of evaluating the UoE as a whole.

The Peer Review Report consists of a textual response on the quality of the sample of outputs that REC members will review, against the broad criteria of approach and contribution.

Approach is described as the approach taken in the group of outputs reviewed, potentially including reference to the methodologies, appropriateness of outlets/venues and discipline-specific publishing practices. Contribution is described as the contribution of the group of outputs reviewed to the field and/or practice.

The Peer Review Report form has a separate section for each of the criteria with a text limit of up to a maximum of 10 000 characters for each criterion.

The task of peer review in ERA is to judge the quality of research in the outputs assessed using the criteria of approach and contribution. Peer reviewers and REC members are also asked to report how the quality of work is distributed within a UoE. The scale from Tier 1 (the lowest quality) to Tier 4 (the highest quality) is intended to be a banding rather than a series of fixed points. What that means is that each tier allows for a range of performance. The expectation is that written analysis in the Peer Review Report will align with and reflect the proportions of quality recorded across the quality distribution scale.

Quality Distribution: Percentage (which will sum to 100%) of research outputs read which you judge to be:

Tier 1 - Lowest Quality Tier 2 Tier 3 Tier 4 – Highest quality

##% ##% ##% ##%

The quality distribution in this scale should align with the textual responses given for the criteria of Approach and Contribution.


In each moderation stage, REC members will have access to peer review reports and the UoE reports of co-assigned REC members. REC members will also have access to a ‘Moderation Report’, a summary of the quality distribution.

Figure 9 is an example of the structure of the report screen which will be provided to REC members during the moderation stages. It provides links to the individual reports of co-assigned REC members and the peer reviewers. The ‘Show graph’ button, as shown in Figure 9, will be available at Evaluation Stage 2C. It shows the distribution judgments of quality by all reviewers of the outputs which they have reviewed from lowest to highest quality for each UoE. An additional benchmarking line for the Australian HEP average for that FoR is also shown in the graph. The graph shows that five reviewers have submitted reports and their judgments are that the output for the UoE is of high to very high quality. The difference in judgment, for example, between Reviewer 4 and Reviewer 5 will be explained in the text of their reports.


Figure 9: Moderation Report

Benchmarks and comparatorsIn Stage 2C the quality distribution, as shown at the bottom section of Figure 9, for each four-digit UoE will show the average quality distribution for all reviewers for all assessed UoEs in the FoR (the ‘Australian HEP average’) to give a sense to REC members of how the quality distributions for the UoE align with the FoR average. Nil



DrilldownsExample drilldowns for peer review are available at Appendix 2: Peer Review Drilldowns and Peer Reviewer template.

The drilldown provides access to outputs nominated for peer review and the associated Research Statement for non-traditional research outputs.


6.7 Research IncomeThe research income indicator profiles research income as defined by Higher Education Research Data Collection (HERDC) specifications.

For the purposes of ERA, the following categories of income are profiled:

1. Category 1: Australian competitive grants

2. Category 2: Other public sector research income

3. Category 3: Total Industry and other research income

- 3 (i): Australian

- 3 (ii): International A (competitive, peer reviewed)

- 3 (iii): International B (other international income)

4. Category 4: Cooperative Research Centre (CRC) research income.

Institutions are required to submit information on all research income falling within eligible income category types. In order for research income to be submitted, it must:

be an eligible research income category type

meet the research income reference period requirements (1 January 2011 to 31 December 2013).

Research Commercialisation Income is separate from the above-mentioned Research Income types and is addressed in Applied Measures.

Category 1 income is peer reviewed competitive income. The information presented in the entire income profile may assist RECs in identifying particular types of research (e.g. strong industry collaboration). The different types of income may assist in identifying a particular research focus, for example, this may help RECs identify a particularly applied, multidisciplinary or collaborative focus of the UoE, which may help to interpret other indicators on the dashboard.

Institutions may assign to each item of Research Income as many four-digit FoR codes as are relevant and determine the percentage apportionment of each item of Research Income across the assigned FoR codes totalling 100% (the minimum apportionment to any FoR code is 0.01%).

Further information regarding Research Income can be found in Section 5.5 of the ERA 2015 Submission Guidelines.


FoR code specific issuesThis indicator is applicable to all FoR codes.


total income by each year of the reference period for each category

the UoE’s contribution to the Australian HEP FoR total for each category

the total amount of income received for each category, including a breakdown of Category 3 income by sub-categories.

HERDC Research Income Summary FTE (Levels A–E Only)

the number of grants for Category 1 income only

average dollar per grant for Category 1 income only

average dollars in each funding category per FTE.

‘Benchmark $ per FTE (Levels A–E Only)’—the average dollar per FTE (Levels A–E Only) for all Australian HEPs for the FoR code

ratio of UoE’s ‘Average $ per FTE (Level A–E Only)’ against ‘Benchmark $ per FTE (Level A–E Only)’

total FTE (levels A–E Only).

HERDC Research Income Summary Total FTE

the number of grants for Category 1 income only

average dollar per grant for Category 1 income only

average dollars in each funding category per total FTE

‘Benchmark $ per total FTE’—the average dollar per total FTE for all Australian HEPs for the FoR code

ratio of UoE’s ‘Average $ per total FTE against Benchmark $ per total FTE

total FTE (Levels A–E and Other).


Table 21: HERDC Research Income by year of reference period

HERDC Category

Research Income Type 2011 2012 2013 Total for

period

contribution to

Aust. HEP FoR Total

1Australian competitive grants $ 17,532 $ 23,469 $ 131,142 $ 172,143 8%

2Other public sector research income $ 112,990 $ 0 $ 0 $ 112,990 3%

3

Total industry and other research income $ 0 $ 0 $ 41,303 $ 41,303 1%

3(i) Australian $ 0 $ 0 $ 41,303 $ 41,303 2%

3(ii) International A $ 0 $ 0 $ 0 $ 0 N/A

3(iii) International B $ 0 $ 0 $ 0 $ 0 N/A

4CRC research income $ 119,559 $ 167,740 $ 192,066 $ 479,365 6%

Total income—all types $ 250,081 $ 191,209 $ 364,511 $ 805,801 4%Table 21 shows the UoE’s income by each year of the reference period. This UoE has a general upward trend in the amount of Category 1 and 4 income received. Sub-categories of Category 3 income are also shown in the income profiles. Additionally, the table also shows the percentage of the UoE’s contribution to the Australian HEP FoR total. This UoE contributed a total of 4% to all Australian income for this FoR code.

Table 22: HERDC research income summary with FTE (Level A–E Only)

HERDC Category

Research Income Type

No. of Grants

Total Amount

average $ per grant

average $ per Level A–E FTE

Benchmark $ per Level

A–E FTE

Ratio against

benchmark $ per Level

A–E FTE

1

Nationally competitive grants 1.1

$172,143

$160,133 $ 23,909 $ 11,351 2.11

2

Other public sector research income

$112,990 $ 15,693 $ 21,905 0.72

3

Industry and other research income $ 41,303 $ 5,737 $ 20,877 0.27

4CRC research income

$479,365 $ 66,578 $ 44,046 1.51

Total FTEs (Level A–E Only) 7.2

Table 22 shows the total amount received for each type of Research Income. The UoE received 1.1 Category 1 Nationally Competitive Grants, totalling $172 143. This equates to an average of $160 133 per grant. Table 22 profiles the UoE’s income against its total FTEs for Levels A–E Only. This UoE had a total of 7.2 FTEs and this is used as a denominator for income by type.

For Category 4 CRC Research Income the UoE received an average of $66 578 per FTE (Levels A to E only). This is compared against the Australian HEP FoR average of $44 046, to arrive at a ratio of 1.51. This means that the UoE receives 1.51 times the CRC income per FTE compared against the Australian HEP FoR benchmark.

Table 23: HERDC research income summary with total FTE (Levels A–E and Other)


HERDC Category

Research Income Type

No. of Grant

sTotal

Amountaverage $ per grant

Average $ per FTE

Benchmark $ Per FTE

Ratio against

benchmark $ per FTE

1Nationally competitive grants

1.1 $ 172,143 $ 160,133 $ 19,787 $ 10,983 1.80

2Other public sector research income

$ 112,990 $ 12,987 $ 21,195 0.61

3Industry and other research income

$ 41,303 $ 4,747 $ 20,200 0.24

4 CRC research income $ 479,365 $ 55,099 $ 42,617 1.29

Total FTE (level A–E and Other)

8.7

Table 23 presents the same information as Table 22. The only difference is that the denominator used is the total FTE which includes Levels A–E and the ‘Other’ category. Due to potential inconsistencies in the categorisation of FTE Levels at different institutions, income is profiled against both ‘Total FTE’ and ‘Levels A–E FTE’.

Benchmarks and ComparatorsOne benchmark is available for the comparison of a UoE’s income against the Australian average. The ‘Ratio against Benchmark $ per FTE’ compares the UoE’s performance against the ‘Australian HEP FoR $ per FTE’.

Relationship with other indicatorsThe Research Income indicator uses the FTE calculations from FTE Profile by Academic Level.

Relevant warnings

if the FTE (Level A–E Only), Total FTEs or HERDC Category 1 No. of Grants is less than 1, the ‘Average $ per grant’ and ‘Average $ per FTE’ will not be shown. This warning will be shown: “Average Dollar per Grant or Dollar Per FTE not shown due to FTE or number of Grants being less than 1”.

if FTE is less than or equal to 5.0, this warning will be shown: “FTE is less than 5.0”.

DrilldownsExample drilldowns for Research Income are available at Appendix 3: HERDC Category 1 Research Income Drilldown.

The drilldown for Category 1 income provides a summary of the grant schemes by year. For example, it shows how many and what value of National Health and Medical Research Council (NHMRC) Practitioner Fellowships were awarded in each year of the reference period. This information may be useful in identifying the particular focus of a UoE—for example, where there is a particular focus on Category 1 income awarded for practice-led research that primarily leads to new understandings.

6.8 Applied MeasuresThe Applied Measure indicator category consists of intellectual property and research Commercialisation Income measures.

Where applicable, REC members will have access to the following types of applied measures:

patents


research commercialisation income

registered designs

plant breeder’s rights

NHMRC endorsed guidelines.

The Applied Measures reference period is 1 January 2011 to 31 December 2013. Institutions may assign up to three four-digit FoR codes to these measures, except for Research Commercialisation Income which may have as many four-digit FoR codes assigned to it as are relevant. Similar to the Research Income indicators, institutions have determined the percentage apportionment of each Applied Measure across the assigned FoR codes totalling 100% (the minimum apportionment of any FoR code is 20%).

These indicators point towards particular kinds of application of research which may be expected in particular disciplines and sub-disciplines. In this respect these indicators assist in interpreting other information on the dashboard.

6.8.1 Research Commercialisation IncomeInstitutions may provide information on Research Commercialisation Income, such as income resulting from licences, options and assignments (LOAs), including running royalties, cashed-in equity and other types of income (see below for further detail). Only LOAs negotiated on full commercial terms, granting access to institutional intellectual property (patented or otherwise) in return for royalties or licence fees may be reported. Key terms in this section should be understood in accordance with their meaning in the National Survey of Research Commercialisation, collected by the Department of Industry and Science1. Research Commercialisation Income earned by institution-owned subsidiaries and spin-off companies is eligible for inclusion in ERA provided that the institution can account for this income in its audited financial statements.

Institutions are required to report Research Commercialisation Income at the four-digit FoR code level and it must be assigned to a relevant year. Research Commercialisation Income does not include:

commercial income from other sources such as research contracts and consultancies (which is included under Research Income), commissioned works, student fees, the renting of space at universities or any other source

CRC research income (which is included under Research Income).

LOA income does not include:

Material Transfer Agreements (MTAs)

research funding

patent expense reimbursement

a valuation of equity not cashed-in

trademark licensing royalties from university insignia

income received in support of the cost to make and transfer materials under MTAs.


1 Department of Industry and Science website (www.industry.gov.au) Australian Research Council ERA 2015 Evaluation Handbook Page 62 of 135


the total amount of research commercialisation income received

total research commercialisation income by each year of the reference period

the total percentage contribution of each research income type to Australian HEP FoR.

Research Commercialisation Income by FTE (Levels A–E only)

amount of commercialisation income per FTE (Levels A–E only)

‘Benchmark $ per total FTE (Levels A–E only)’—the average dollar per FTE (Levels A–E only) for the Australian HEP for the FoR code

ratio of UoE’s ‘Average $ per FTE (Levels A–E only)’ against ‘Benchmark $ per FTE (Levels A–E only)’

total FTE (Levels A–E only).

Research Commercialisation Income by Total FTE

amount of research commercialisation income per total FTE

‘Benchmark $ per total FTE’—the average dollar per total FTE for the Australian HEP for the FoR code

ratio of UoE’s ‘Average $ per total FTE’ against ‘Benchmark $ per total FTE’

total FTE (Levels A–E and ‘Other’).


Table 24: Research Commercialisation Income by year of reference period

2011 2012 2013 Total for Period % contribution to HEP FoR total

$ 45,000 $ 3,984 $ 6,500 $ 55,484 16%

Table 24 shows the UoE’s income by each year of the reference period. The UoE received a total of $45 000 in 2011, $3984 in 2012 and $6500 in 2013. Table 24 also shows the percentage of the UoE’s contribution to the Australian HEP FoR total. This UoE contributed a total of 16% to all Australian Commercialisation Income for this FoR code.

Table 25: Research Commercialisation Income profile by FTE (Level A–E only)

Total FTE (Level A–E only) Total Amount $ per FTE (Level A–

E only)Benchmark average $ per FTE (Level A–

E only)

Ratio against benchmark average $ per FTE (Level A–

E only)11.5 $ 1,399,582 $ 121,702 $ 55,039 2.21

Table 25 shows the total amount of Research Commercialisation Income received for this UoE is $1 399 582. This UoE had a total of 11.5 FTEs (Levels A–E only) and this is used as a denominator for income by type to arrive at an average of $121 702 per FTE. This is compared against the Australian HEP FoR average $ per FTE of $55 039, to arrive at a ratio of 2.21. This means that the UoE received 2.21 times the income per FTE for levels A–E compared against the Australian HEP FoR benchmark.

Similar to the Research Income profiles, the Research Commercialisation Income is also profiled against both Levels A–E and the ‘Other’ category; this is shown in Table 26.

Table 26: Research Commercialisation Income profile by FTE

Total FTE Total Amount $ per FTE Benchmark average $ per FTE

Ratio against average $ per FTE

9.85 $ 55,483 $ 5,633 $ 3,567 1.58

Benchmarks and ComparatorsSimilar to the Research Income Indicator, one benchmark is available for the comparison of a UoE’s income against the Australian average. The ‘Ratio against Benchmark Average $ per FTE’ compares the UoE’s performance against the ‘Australian HEP FoR $ per FTE’.

Relationship with other indicatorsThe Research Commercialisation Income indicator uses the FTE calculations from FTE Profile by Academic Level.

Relevant warnings

If the FTE is less than 1, then ‘$ per FTE’ will not be shown. This warning will be shown: “The average(s) and/or ratio(s) are not shown due to FTE or Number of Grants being < 1.0”.

If FTE is less than or equal to 5.0, this warning will be shown: “FTE is less than 5.0”.

DrilldownsNil

6.8.2 PatentsA patent is defined as a right granted for any device, substance, method or process which is new, inventive and useful. It is legally enforceable and gives the owner the exclusive right commercially to exploit the invention for the life of the patent.


For ERA 2015 Applied Measures include Australian standard patents and their international equivalents, but not Australian innovation patents.

Eligible patents are standard patents registered within the following jurisdictions:

Australia (standard patents only)

United States

Europe—European Patent Office (EPO) issued only

Japan

Other International

Triadic patents—a set of patents filed at the EPO, the United States Patent and Trademark Office (USPTO) and the Japan Patent Office (JPO) that share one or more priorities. The triadic patent families cover a homogeneous set of inventions.

Only patents which became enforceable within the Applied Measures reference period(1 January 2011 to 31 December 2013) are eligible. For Australian patents, this means that patents must have been sealed within that period. Where a series of triadic patents is submitted, and if the same patent was issued in different years in different jurisdictions, then it must be submitted against the year in which it was granted provided that the relevant year falls within the Applied Measures reference period.

If the same patent was issued in multiple jurisdictions, the patent is shown separately for each country or type. As well as the total number of patents, the total number of patent families is also shown. This allows REC members to identify the same patents that are issued in multiple jurisdictions. A triadic patent is a recognised type of patent family and counts as a single patent family, but as three patents in the total for the reference period.

Patents may be granted to either institutions or eligible researchers.2



number of apportioned patents sealed by eligible countries

number of patents sealed by eligible countries (whole counts)

total number of patent families.

2 Income generated from patents may be included for ERA 2015 under research commercialisation income. Australian Research Council ERA 2015 Evaluation Handbook Page 65 of 135

Table 27: Patent profile

Country No. of patents sealed (apportioned)

No. of patents sealed (whole counted)

Australia 3.0 3

Japan 0.0 0

United States 1.0 2

Europe 0.0 0

Other international 3.0 3

Triadic 0.0 0Total Patents in Reference Period (Triadic patents count as 3 for total) 7.0 8Total Patent Families in Reference Period 5.0

Table 27 shows that the UoE has sealed a total of 7.0 apportioned patents which is made up of eight whole counts of patents. As the same patent can be sealed in multiple countries, the ‘Total Patent Families’ is also shown. This UoE sealed a total of 5.0 unique patents.



Relevant warnings

Where patent families exist, the warning of “Profile contains ## patent families—see drilldowns” will be shown. Patent family members will be identified in the drilldowns. Patent families are patents that have been sealed in multiple jurisdictions, but are counted as one unique patent in ‘No. of Patents Sealed (whole counted)’ in the profile. Patents that have been sealed in multiple jurisdictions can be identified in the drilldowns by the unique identifier in the ‘Patent Family Name’ field.

The following note will be shown, “Triadic patents count as 3 for total”.

DrilldownsExample drilldowns for this indicator are available at Appendix 4—Applied Measure Drilldowns

6.8.3 Registered DesignsA Registered Design right is granted for new and distinctive designs. Once a registered design has been examined and certified, the owner has an exclusive right to use, license and/or sell the design. In this context, design refers to features which, when applied to a product, render it unique in appearance. This may include shape, pattern or ornamentation. Registered Designs are not automatically included in ERA 2015. However, in those cases where there is a clear link between the Registered Design and the related research (based on the ERA definition of research), an institution can submit the design for inclusion. Only those Registered Designs which were certified in Australia within the applied measures reference period are eligible as ERA Applied Measures.


Registered Designs may be granted to either institutions or eligible researchers. Income generated from Registered Designs, either via licensing or otherwise, is included in ERA 2015 under Research Commercialisation Income, providing the additional requirements pertaining to this measure are met.



number of apportioned Registered Designs

number of Registered Designs (whole counts).

Table 28: Registered design profile

No. of registered designs (apportioned)

No. of registered designs (whole counted)

No. of unique registered designs

1 1 1




DrilldownsExample drilldowns for this indicator are available at Appendix 4: Applied Measure Drilldowns.

6.8.4 Plant Breeder’s RightsFor ERA purposes, Plant Breeder‘s Rights (PBRs) are those granted under the Plant Breeder‘s Rights Act 1994 (Cth) or their international equivalents, as listed in international PBRs equivalents as below:

countries or intergovernmental organisations listed as members of the International Union for the Protection of New Varieties of Plants (UPOV)

the Plant Patent and Utility Patent systems of the United States of America (as far as they apply to plant varieties)

such other countries or intergovernmental organisations as are from time to time assessed by IP Australia as having legislation compliant with the UPOV Convention.

ERA Applied Measures include granted PBRs, but do not include circumstances where varieties are only covered by provisional protection.

To be eligible PBRs must have been granted in the Applied Measures reference period to the institution, an institution-owned subsidiary, a spin-off company that is associated with the institution or eligible researchers.

If the same PBRs were issued in multiple jurisdictions, the PBRs are shown separately for each country or type. PBRs issued in multiple jurisdictions are also identified as being related or of the same family of PBRs.Australian Research Council ERA 2015 Evaluation Handbook Page 67 of 135

Institutions may submit PBRs where the research behind the PBRs is clearly identifiable as meeting the ERA definition of research. Institutions may be required to justify this inclusion on request by the ARC.

FoR code specific issuesPlease refer to the ERA 2015 Discipline Matrix in Appendix 6 for information regarding the applicability of indicators.


number of apportioned PBRs

number of PBRs (whole counts)

total unique PBRs.Table 29: Plant Breeder’s Rights profile

PBRs apportioned PBR whole count Total unique PBRs3.0 3 3

Table 29 shows that the UoE has registered a total of 3.0 apportioned PBRs which is made up of three whole counts of PBRs. Like patents, the same PBR can be registered in multiple countries, therefore the total unique PBRs is also shown. This UoE registered a total of three unique PBRs.






6.8.5 NHMRC Endorsed GuidelinesGuidelines endorsed by the National Health and Medical Research Council (NHMRC) are eligible for inclusion in submissions. NHMRC Endorsed Guidelines include those on population health, clinical practice, and ethics. Such guidelines may be produced by groups external to the NHMRC, or else developed by NHMRC with the assistance of expert working groups.

Externally developed guidelines are approved by the NHMRC only if they meet NHMRC requirements and standards which are set out in legislation and in a series of NHMRC publications on the development, implementation and evaluation of guidelines. These requirements and standards are designed to ensure that the end product is based on the best available scientific evidence and presented in creative, innovative and, most importantly, effective ways.

To be eligible for inclusion in ERA 2015, NHMRC Endorsed Guidelines must:

meet the definition of research (as per Section 3.1 of the ERA 2015 Submission Guidelines)

have been published by the NHMRC within the applied measures reference period

have one or more eligible researchers listed as an author of, and/or contributor to, the guidelines (as per Section 5.3.1 of the ERA 2015 Submission Guidelines).

As with research outputs and Esteem Measures, NHMRC Endorsed Guidelines follow the eligible researcher(s) named on the guidelines if, at the staff census date, they are at a different institution from where they were at the time the guidelines were published by the NHMRC.

Where more than one eligible researcher from the same institution is an author of the same set of guidelines, institutions may claim only one Applied Measure for that set of guidelines. Where staff members from different institutions are authors of the same set of guidelines, each institution may claim that set of guidelines as an Applied Measure.



number of apportioned NHMRC Endorsed Guidelines

number of NHMRC Endorsed Guidelines (whole counts).

Table 30: NHMRC-Endorsed Guidelines profile

No. of NHMRC Endorsed Guidelines (apportioned)

No. of NHMRC Endorsed Guidelines (whole counted)

2.0 3






6.9 Esteem MeasuresERA 2015 includes a number of measures of esteem that constitute recognition of the quality of eligible researchers and indicate that a researcher is held in particularly high regard by peers in their discipline and/or by other well-qualified parties.

Esteem Measures that are eligible for ERA embody a measure of prestige and are recognised by experts within the discipline as a highly desired, highly regarded form of accolade or acknowledgement. Esteem Measures included in ERA must be linked to research quality rather than to teaching or engagement. The Esteem Measures eligible for ERA are:

Editor of a prestigious work of reference

Membership of a Learned Academy or membership of AIATSIS

Recipient of a Nationally-Competitive Research Fellowship (Category 1)

Membership of a Statutory Committee

Recipient of an Australia Council Grant or Australia Council Fellowship.

The Esteem Measures reference period is 1 January 2011 to 31 December 2013.

As with research outputs, Esteem Measures follow the eligible researcher if, at the staff census date, they are at a different institution from the one they were at the time of the relevant membership, fellowship or grant. The only exception to this is nationally-competitive research fellowships which are affiliated with the institution.

Each eligible Esteem Measure can only be claimed once during the reference period. Institutions have assigned each Esteem Measure to up to three four-digit FoR codes and determined the percentage apportionment of each esteem measure across the assigned FoR codes totalling 100%.

Esteem Measures and Research Income are submitted as separate items in SEER. This means that institutions can assign different FoR codes and apportionment to a Category 1 Fellowship under Esteem and different FoR codes and apportionment to the income generated by the Category 1 Fellowship.

For a list of eligible esteem by type, please refer to Section 5.7.2 of the ERA 2015 Submission Guidelines.




number of apportioned esteem counts by esteem type

number of esteem counts by esteem type (whole counts).

Table 31: Esteem Measures ProfileEsteem Type Apportioned Esteem

CountsWhole Esteem

CountsEditor of a Prestigious Work of Reference 0.2 1

Membership of a Learned Academy 5.7 7

Recipient of a Nationally-Competitive Research Fellowship (Category 1)

4.4 6

Membership of a Statutory Committee 0 0

Recipient of an Australia Council Grant or Australia Council Fellowship

0 0

Total Esteem Counts 10.3 14




DrilldownsNil


7 Glossary

Term DescriptionApplied measures Applied measures include PBRs, patents, registered designs, research

commercialisation income, and NHMRC-endorsed guidelines.

Applied research Has the meaning used in the ANZSRC, that is, ‘original work undertaken primarily to acquire new knowledge with a specific application in view. It is undertaken either to determine possible uses for the findings of basic research or to determine new ways of achieving some specific and predetermined objectives’.

Australian Learned Academies

Organisations whose individual or institutional members are devoted to the advancement of learning in one or all of the three broad areas of knowledge: the natural sciences, humanities and social sciences. In Australia, the Learned Academies are:

Australian Academy of the Humanities

Australian Academy of Science

Academy of the Social Sciences Australia

Australian Academy of Technological Sciences and Engineering. Explanatory statement A statement which a submitting institution may choose to provide to

outline relevant contextual information about the research performance and development of disciplines addressed in a submission. Each explanatory statement must be at the two-digit FoR level and no more than 10 000 characters in length.

Bibliometrics As explained in the OECD Frascati Manual (2002), “Bibliometric analysis uses data on numbers and authors of scientific publications and on articles and the citations therein (as well as the citations in patents) to measure the “output” of individuals/research teams, institutions and countries, to identify national and international networks, and to map the development of new (multidisciplinary) fields of science and technology”.

Citation analysis Scrutiny of references contained in journal articles, including analysis of frequency and patterns.

Dashboard (Indicator Dashboard)

Refers to the indicator suite available to REC members through SEER during evaluation.

Discipline For the purposes of ERA, ‘disciplines’ are defined as four- or two-digit FoR codes as identified in the ANZSRC.

Discipline matrix Specification of which ERA indicators will be applied to which disciplines. The ERA 2015 Discipline Matrix is available on the ARC website and at Appendix 6 of this Handbook.

ERA 2015 Submission Journal List

A list of peer reviewed journals that define outlets eligible for submission in ERA 2015. Each journal is assigned to one or more disciplines defined by FoR code(s).

Esteem Particularly high regard in which a researcher is held by peers in their discipline and/or by other well-qualified parties.

Fields of Research (FoR)

A hierarchical classification of fields of research set out in the ANZSRC. The term ‘Fields of Research’ or ‘FoR’ applies to all three ANZSRC levels (two-digit, four-digit and six-digit).


Term DescriptionFour-digit FoR The middle level of the three hierarchical levels within ANZSRC Fields of

Research. An example of a four-digit FoR code is ‘0206—Quantum Physics’. Within the ANZSRC classification, this level is referred to as a ‘Group’.

Higher Education Research Data Collection (HERDC)

The annual research data collection exercise undertaken by the Department of Education and Training.

Higher Education Staff Data Collection (HESDC)

The annual staff data collection exercise undertaken by the Department of Education and Training.

Indexed journal A journal indexed by Scopus. Scopus tracks citations of articles published in such a journal.

Institution Eligible higher education providers.

Journal article To qualify as an eligible research output for ERA purposes, a journal article must meet the criteria set out in ERA 2015 Submission Guidelines.

Licensing As defined in relevant legislation, licensing of rights gives the licensee the right to use (but not own) the rights.

Low volume threshold A low volume threshold exists for each UoE in ERA. For disciplines where citation analysis is used, a low volume threshold refers to fewer than 50 indexed journal articles over the six-year reference period in any four- or two-digit FoR. For disciplines where peer review is used, no evaluation will be conducted for FoRs with an equivalent of fewer than 50 weighted research outputs over the six-year reference period for that UoE.

Multi-Disciplinary journal (MD)

A journal with more than three four-digit or two-digit FoR codes will be classified as multidisciplinary.

Non-Traditional Research Output (NTRO)

Research outputs which do not take the form of published books, book chapters, journal articles or conference publications.

Patent As defined in relevant legislation, a patent is a right granted for any device, substance, method or process which is new, inventive and useful. It is legally enforceable and gives the owner the exclusive right to commercially exploit the invention for the life of the patent. ERA Applied Measures include Australian standard patents (but not Australian innovation patents) and equivalent patents issued overseas.

Peer review For the purpose of ERA, an acceptable peer review process is one that involves an assessment or review, before publication, of the research output in its entirety by independent, qualified experts. Independent in this context means independent of the author. Note that ‘ERA Peer Review’ has a different meaning (see ‘ERA Peer Review’).

Principal reviewer REC member who is appointed to lead discussion of preliminary evaluations of a UoE at the Stage 3 finalisation meeting. Principal Reviewer is also responsible for assigning peer reviewers where peer review is an identified indicator. Each assessable UoE is assigned a Principal Reviewer.

Published Published (in the case of traditional research outputs such as publications) or made publicly available (in the case of non-traditional research outputs).


Term DescriptionReference periods The periods during which research outputs must have been published,

research income reported under HERDC etc.; in order for associated data to be included in ERA submissions. ERA reference periods vary according to the research item.

Research Evaluation Committees (REC)

The discipline grouping-specific committees which undertake ERA evaluations. Each such committee includes internationally-recognised members with expertise in research evaluation and broad discipline expertise.

Research statement For each NTRO or portfolio nominated for ERA peer review, institutions must submit a Research Statement of 250 words identifying the research component of the research output (i.e. how the output meets the definition of ‘research’).

Sector Refers broadly to the higher education community and those individuals and organisations who consider themselves affiliated the higher education community.

Two-digit FoR The highest of the three hierarchical levels within ANZSRC Fields of Research. An example if ‘02 Physical Sciences’. Within the ANZSRC classification, this level is referred to as a ‘Division’.

Unit of Evaluation (UoE)

A discipline for a specific institution. In some contexts, the term refers to the set of associated ERA information (including submission data, indicators and evaluation outcomes). While all ERA data collection will be at the four-digit FoR level for a specific institution, the UoE will be either at the four-digit or two-digit FoR for an institution.


8 Abbreviations

Abbreviation Description

AIATSIS Australian Institute of Aboriginal and Torres Strait Islander Studies

ANZSRC Australian and New Zealand Standard Research Classification

ARC Australian Research Council

CRC Cooperative Research Centre

EPO European Patent Office

ERA Excellence in Research for Australia

FAQs Frequently Asked Questions

FoR Fields of Research (ANZSRC)

FTE Full-Time Equivalent

HEP Higher Education Provider

HERDC Higher Education Research Data Collection

HESDC Higher Education Staff Data Collection

IDG Indicator Development Group

IP Intellectual property

ISSN International Standard Serial Number

JPO Japan Patent Office

LOA Licences, Options and Acquisitions

MTAs Material Transfer Agreements

NHMRC National Health and Medical Research Council

NTRO Non-Traditional Research Outputs

PBRs Plant Breeder’s Rights

RCI Relative Citation Impact

REC Research Evaluation Committee

SEER System to Evaluate the Excellence of Research

UoE Unit of Evaluation

UPOV International Union for the Protection of New Varieties of Plants

USPTO United States Patent and Trademark Office


9 Discipline Clusters

Abbreviation Description

BB Biological and Biotechnological and Sciences

EC Economics and Commerce

EE Engineering and Environmental Sciences

EHS Education and Human Society

HCA Humanities and Creative Arts

MHS Medical and Health Sciences

MIC Mathematical, Information and Computing Sciences

PCE Physical, Chemical and Earth Sciences


Appendix 1: Research Output Drilldowns

Columns with red text will be shown according to the indicator applicability as per the ERA 2015 Discipline Matrix at Appendix 6.

Books Details of Books (Total : 5)Authors Title Edition Publisher Place of

PublicationYear Extent Apportionment Peer Review

Pullman, Fillip The celebrated William Shakespeare: An actor, poet and playwright

1 McGraw Hill London 2009 20 pages 1.00

Black, Jessica Reading Breuer: A Psychoanalytic Perspective

1 Penguin Madrid 2011 44 pages 0.80

Smith, John; Truman, Newell

Land of vision, Australia and the 21st century 25 Osborne

Publishing

Sydney 2012 32 pages 1.00

Miles, Nancy Modernism History.Fiction

2 Penguin New York 2013 945 pages 0.30

Book ChaptersDetails of Book Chapters (Total : 15)Authors Chapter Title Book Title Editor Publisher Place of

PublicationYear Extent Apportionment Peer Review

Cox, Penelope Radiography Introduction

Radiography Masterclass

White, A Wordsworth London 2008 30 pages 0.30

Lee, K Segmented Quantum Modelling

Quantum Modelling

Black, C Oxford University Press

UK 2009 25 pages 0.40

Jane, Smith; Clarke, Lester

Polymerization Principles

Organic Chemistry

Red, P Allen & Unwin Sydney 2010 30 pages 0.60


Journal ArticlesTotal publications (# of papers: 57)

Authors Title Outlet title Issue Volume Year Cites RCI Class

RCI (world)

Centile Extent Place of publication

Apportionment Peer Review

Latour, Celeste Talking Robots

Robotics Australia

1 2 2010 15 VI 8.1 5 8 pages

Australia 0.50

King, Carla Peace and the economic miracle

Political World

67 5 2008 5 IV 3.2 25 5 pages

New York 0.10

Kitagawa, Kyoko Feed the World

Foreign Review

20 9 2010 2 I 0.5 50 2 pages

Istanbul 0.30

Conference Publications Details of Conference Proceedings (# of papers: 2)Authors Title of conference paper Conference Outlet

TitleConference name or series name

Venue Year Extent Apportionment Peer Review

Gates, Will Transition from IPV4 to IPV6

Internet Measurement for the New Digital World

ALM SIGCOMM Sydney, Australia

2008 5 pages

0.50

Joe, Issac; Jones, Dean,

The Geography of software development

Computer Science: 21st International Conference on Software Development

Conference of Software Development

Canberra, Australia

2009 3 pages

1.00


Original Creative WorkDetails of Original Creative Works (Total : 15)Title Creators Place of publication Type Year Extent Apportionment Notes Peer

ReviewUnderwater Sculpture Roberts, Jane School of Art Gallery Visual art

work2008 architectural

installation 8x8x2.5m

0.30

The Jumping Dream Delmer, Valerie Australian National Gallery

Other 2011 200 x 100 cms 0.50

Never Never Band Yinguui, Guthinga Harmon House Textual work 2012 Short story 0.50

Live PerformanceDetails of Live Performances (Total : 4)Title Creators Place of Publication Type Year Extent Apportionment Notes Peer

ReviewThe Importance of Being Ernest

Calwell, S Sydney Opera House Play 2008 110 minutes 0.50

The Glass Menagerie Johnson, P Melbourne Arts Centre Play 2009 134 minutes 0.30

Through the Looking Glass

Ovens, S.; Mormon, F.

Brisbane Community Theatre

Dance 2010 89 minutes 0.50

Recorded WorkDetails of Recorded Works (Total : 12)Title Creators Place of

PublicationType Year Extent Apportionment Notes Peer

ReviewThe Making of The Never Ending Story

Flint, L. Stockholm Film, video 2008 55 minutes 0.50

Electric Boogaloo Zapper, M.C. Berne Inter-arts 2009 4 hours 1.00

Islamic music from around the world

Carter, M. New York Performance 2010 2 hours 0.50

The Blue Zone Martin, Delpon Tokyo Websites/web exhibitions

2010 12 pages 1.00


Curated or Exhibition WorkDetails of Curated or Exhibition Works (Total : 7)Title Creators Place of

PublicationType Year Extent Apportionment Notes Peer Review

Artefacts of War Exhibition Chandler, Nigel Gallery of Brisbane

Web-based exhibition work

2008 Photos 6 x 6 1.00

Memories of Main Street Schneider, Paul Melbourne Arts Centre

Exhibition 2009 12 drawings on paper

0.50

Digg Out Blunt, F; Chan, P

Sydney Festival 2010 50 pages 0.30

Barking Madd Purham, Ishmael Australian National Gallery

Other 2013 20 photos 1.00

Research Reports for an External BodyDetails of Research Reports for an External Body (Total: 3)Title Author Place of

PublicationType Year Extent Apportionment Notes Peer Review

The Real Science Crisis: Bleak Prospects for Young Researchers

Monastersky, V

Australian Association of Young Researchers

Not-For-Profit 2010 0.6

Review of Higher Education Regulation Report

Lee Dow, K and Braithwaite, V

Commonwealth of Australia

Public Sector 2010 0.8

The Australian Academic Profession in Transition

Bexley, E Commonwealth of Australia

Public Sector 2011 0.4


Portfolio of Non-Traditional Research OutputsDetails of Portfolios of Non-Traditional Research Outputs (Total: 7)Portfolio Title Portfolio

NumberNon-traditional output types Included Apportionment Notes Peer Review

Original Creative Work

Live performance

Recorded Works

Curated/ Exhibition

Research Report for an External Body

Flour 1 1 2 50

Works in glass 2 4 3 100

A madder day than this

3 5 50

Konnichiwa 4 2 2 40


Appendix 2: Peer Review Drilldowns and Peer Reviewer template

Authors Title Type Detail Year Apportionment In Repo.

Sensitivity Type Links Sensitivity

NoteResearch Statement Read

Latour, Celeste

Talking Robots Journal Article

Robotics Australia

2009 1.0 -- Link 1Link 2

Link

Delmer, Valerie

The Jumping Dream

Original Creative Work

Australian National Gallery

2012 0.75 -- Link 1 Link

Smith, Jane; Clarke, Lester

Polymerization principles

Book Chapter

Organic chemistry

2013 0.5 -- Link


Peer Reviewer Template for ERA 2015

Reviewer expertise in Area

Low Expertise 1 2 3 4 High Expertise 5

Types of outputs reviewed?

Articles Books Book Ch NTRO Conf Pub Total number of outputs reviewed

# # # # # #[auto-populated by SEER “read” items]

Sampling Strategy [Please make a statement about the sampling strategy you employed to select outputs for peer review. This may include reference to disciplinary expertise, types of outputs (books, journals articles, etc.), prior familiarity with work etc.]

ERA PEER REVIEW CRITERIA

Approach [Please make a general statement about the approach taken in the group of outputs reviewed. This may include reference to methodology, appropriateness of outlet/venue, discipline specific publishing practices etc.]

Contribution [Please make a general statement about the contribution of the group of outputs reviewed to the field and/or practice. This may include reference to timeliness, originality, significance of the research question, subsequent use by others and may include a general statement about its contribution nationally and/or internationally.]

Quality Distribution: Percentage (which will sum to 100%) of research outputs read which you judge to be:

Tier 1—Lowest Quality Tier 2 Tier 3 Tier 4—Highest quality##% ##% ##% ##%


Appendix 3: HERDC Category 1 Research Income Drilldown

2011Scheme Name Number of grants

(apportioned) Amount received

Australian Pork Limited—Research and Development Open Tenders 1.3 $ 25,300 Grains Research and Development Corporation—Grains Industry Senior Fellowships 1.0 $ 235,846

R&D Open Tender—New Product—New Farm Products and Services 2.6 $ 80,002

R&D Open Tender—Practices—Agronomy, Soils and Environment 2.0 $ 150,365

MLA Livestock Production Research and Development Program—Strategic and Applied Research Funding 1.0 $ 12,032

ARC Discovery—Federation Fellowships 0.5 $ 26,000

ARC Discovery—Projects 0.3 $ 365,423

2012Scheme Name Number of grants

(apportioned) Amount received

Australian Pork Ltd—Research and Development Open Tenders 1.1 $ 141,680 R&D Open Tender—Practices—Agronomy, Soils and Environment 0.9 $ 1,320,738

ARC Centres of Excellence 1.2 $ 448,011

ARC Discovery—Australian Laureate Fellowships 1.7 $ 842,044

ARC Discovery—Federation Fellowships 0.9 $ 67,379

ARC Discovery—Future Fellowships 0.4 $ 145,600

ARC Linkage—International 0.3 $ 2,046,369

2013


Scheme Name Number of grants (apportioned)

Amount received

National Health and Medical Research Council—Research Fellowships Scheme 1.4 $ 125,689 Australian Research Council—Super Science Fellowships 1.7 $ 101,112

Australian Research Council—Australian Laureate Fellowships 0.2 $ 150,000

Australian Research Council—ARC Centres of Excellence 0.3 $ 20,003

Department of Sustainability, Environment, Water, Population and Communities—Marine and Tropical Sciences Research Facility (MTSRF)

1.2 $ 605,987


Appendix 4: Applied Measure Drilldowns

Patents SealedDetails of Patents Sealed: All (Total: 8)

Patent Family name

Country Number Name Year Apportionment

P1 Australia 12345AOP990B Automated cat food dispenser 2013 1.00P2 Australia 33444TPP000X Kinetic energy recovery system 2012 0.50

P3 France DFR39098 Quadra inertia system for transport 2011 0.50P3 Japan PPTG938-9099-AAF Quadra inertia transport system 2011 0.40

Registered DesignsDetails of Registered Designs: All (Total: 4)

Family Name Registry ID Name Year Apportionment

Name 1 Australian organisation 123213 Registration Name 2013 1.00

Name 2 Australian Engineering Society 38-0900SSE Bio-ethanol storage regulator 2013 1.00

Name 3 Japan National Aeronautic Office POI-990-AS3R High altitude twin scroll turbine 2012 1.00

Name 4 Japan National Aeronautic Office POI-781-BB4G Brant-Klasnov pressure induced purification 2012 0.40

Name 5 Japan National Aeronautic Office POP-002-WZ8E Isometric differential monitoring system 2012 0.30


Plant Breeder’s Rights Details of Plant Breeder’s Rights: All (Total : 5)

Family Name Country Of Registration Application Number Name Year Apportionment

Name 1 Australia 123213 Rose 2011 0.50

Name 2 Australia 38-0900SSE Broccolini 2011 1.00

Name 3 Japan POI-990-AS3R Potato 2012 0.30

Name 4 USA POI-781-BB4G Broccolini 2012 1.00

Name 5 Japan POP-002-WZ8E Potato 2012 0.20

NHMRC-Endorsed Guidelines Details of NHMRC-Endorsed Guidelines: All (Total : 2)

Name Year Apportionment

NHMRC Guide to Healthy Living 2011 0.50

UN Mother and Baby Handbook 2012 1.00


Appendix 5: Citation Benchmark MethodologyThe ARC has previously commissioned a number of studies to empirically test the citation benchmark methodology to ensure the accuracy of the approach. The benchmark methodology is informed by extensive analytical testing of data, literature review and advice from a range of experts in both bibliometrics and research administration. The methodology has been developed to ensure parity across the range of disciplines that will use citation analysis and has been consistent in its approach across all rounds of ERA.

Citation data providerThe citation data provider for ERA 2015 is Scopus.

Year-specific benchmarksERA uses year-specific benchmarks for each FoR code. This approach overcomes issues such as the likelihood that articles published early in the reference period have more time to accrue citations than articles published towards the end of the reference period. This method also ensures that any heterogeneity in publication patterns across the reference period is taken into account.

For each year of the reference period, for each FoR code, a world and Australian HEP benchmark is derived. Articles published in a specific year are assessed against the discipline specific benchmark for that year.

Field-specific benchmarksThe ARC citation methodology recognises that each discipline has distinctive citing behaviours and publication timelines. For this reason, ERA uses FoR code-specific benchmarks. This means that a discipline is only evaluated against its relative performance within that discipline, which significantly reduces the impact of any field-specific citing behaviours and publication timelines that may exist.

FoR code-specific benchmarks are constructed from data relating to the journals assigned to each FoR code. Journals were assigned particular FoR code(s) during the ERA Journal List development process. This process was designed to ensure that only journals that publish outputs that are relevant to a particular FoR code are assigned to that FoR code. In ERA, journal articles submitted by institutions can be assigned and apportioned up to three four-digit FoR codes. Where a journal is assigned to more than one FoR code, its articles and citations to those articles (where applicable) will be counted once in the benchmark for each FoR code.

Submitting institutions are required to assign articles published in two-digit and multidisciplinary journals to four-digit FoR code(s). All indexed journal articles in ERA 2015 use four-digit FoR code benchmarks. Two-digit benchmarks are not used in ERA 2015.

The compilation of two-digit UoEs involves an aggregation of the four-digit outputs in the four-digit codes beneath. It is therefore possible for an article to which more than one four-digit FoR code is assigned to have different RCI and centile results at the article level due to the different FoR code benchmarks.

Low volume thresholdA low volume threshold exists for each UoE in ERA to ensure that a meaningful level of data is being evaluated.


In fields of research where citation analysis is used, the low volume threshold is 50 apportioned indexed journal articles. This means that, if the number of apportioned indexed journal articles over the six-year research outputs reference period is fewer than 50 in any four-digit or two-digit FoR at an institution, then no evaluation will be conducted for that FoR at that institution.

Journal articles within UoEs that did not reach the ‘low volume threshold’ still contribute to the calculation of both world and Australian HEP benchmarks. For more information refer to the ERA 2015 Submission Guidelines.

Journal article eligibility criteriaCitation analysis benchmarks are derived using journal articles that meet all of the following criteria:

a valid research output for ERA 2015. Please refer to the ERA 2015 Submission Guidelines to determine the eligibility of an article

published by a journal listed in the ERA 2015 Submission Journal List

published during the reference period (2008–2013)

indexed by the citation information provider at the time the article is published3.

have a unique article identifier (an EID from Scopus)

assigned by Scopus with an article type of journal article, conference publication or review article.

Inclusion of outputs published in multidisciplinary and two-digit coded journals in benchmarkingAnalysis of previous ERA submission data shows that while the majority of two-digit and multidisciplinary journals published articles across a broad range of FoR codes, a small number published a significant proportion of articles in particular four-digit FoR codes, i.e., they behaved like discipline-specific journals.

For example, out of the 311 journal articles submitted to ERA 2015 published in Journal of Affective Disorders (FoR coded to ‘11 Medical and Health Sciences’ and ‘17 Psychology and Cognitive Sciences’ in the ERA 2015 Submission Journal List), 39% was assigned by HEPs to ‘1103 Clinical Sciences’, 29% to ‘1701 Psychology’ and 32% spread across other 01, 08, 11, 14, 16 and 17 related four-digit FoR codes.

Conversely, the journal Vaccine (FoR coded to ‘06 – Biological Sciences’, ’07 – Agricultural and Veterinary Sciences’ and ‘11 – Medical and Health Sciences’) is a general journal, publishing across a range of FoR codes. Figure 10 illustrates these two examples.

These findings suggest that while some two-digit FoR and multidisciplinary coded journals publish across a broad range of FoR codes, a large majority of their output was focused on particular four-digit FoR code(s). For this reason, these journals are included in the benchmark journal set for the relevant four-digit FoR code.

The thresholds for including two-digit FoR and multidisciplinary coded journals in the benchmark journal set are: 25% or more of all articles submitted to ERA 2015 published in a two-digit FoR or

multidisciplinary coded journal are assigned to specific four-digit FoR code(s)

3 Some journal titles may become first ‘indexed’ during the reference period. This means some journals may only be partly indexed. For example, if Scopus begins indexing Journal A in 2010, papers published in the reference period prior to 2010 will not be included in citation analysis, while papers published in Journal A from 2010 will be included in citation analysis.


‘25% or more’ threshold constitutes 50 or more apportioned articles.

Figure 10: Example two-digit FoR coded journals where Australian HEPs have apportioned research outputs to certain four-digit FoR codes.

1103

Clinical Sci-ences

(39%)

1701 Psychology (29%)

Other

01, 08, 11, 14, 16, 17

FoR codes

(32%)

ERA 2015 HEP Outputs from the Journal of Affective Disorders (311 outputs)

1117, 22.9%

1107, 17.7%

1103, 12.4%1108, 11.2%

0707, 8.1%

0605, 6.6%

1199, 5.3%

1114, 4.2%

1112, 2.5%

1115, 2.0%

0601, 1.5%

Other, 5.6%

ERA 2015 Outputs from Vaccine (320 outputs)

In the example shown in Figure 10, outputs from the Journal of Affective Disorders would be included in the calculation of ‘1103 Clinical Sciences’ and ‘1701 Psychology’ benchmarks as it behaved in a disciplinary manner for those two particular FoR codes. On the other hand, the journal Vaccine would not be included in the calculation of four-digit benchmarks because it does not behave in a disciplinary manner, i.e. there is no single FoR code which has 25% or more articles assigned to it.

The number of two-digit FoR and multidisciplinary coded journals that behaved in a disciplinary manner for ERA 2015 was small, with 136 remapped to be included in any benchmark. This represents 5% (136 of the 2566) of the two-digit FoR and multidisciplinary coded journals in the ERA 2015 Submission Journal List in citation disciplines.

Calculating the benchmarksERA uses three bibliometric methods to evaluate research:

Relative Citation Impact (RCI) calculated against

- World citations per paper (cpp) benchmarks

- Australian Higher Education Providers (HEP) cpp benchmarks

Distribution of papers based on world centile thresholds

Distribution of papers against RCI classes.

World cpp benchmarksScopus derives the ERA 2015 static citation dataset for all publications in the world dataset published during the period 1 January 2008 to 31 December 2013.

The world benchmarks are derived using bibliometric data of all eligible outputs published in the world in journals included in the ERA 2015 Submission Journal List (including those authored by


eligible staff of Australian HEPs). Only Scopus article types of journal article, conference publication and review article are included in the world benchmark calculations.

Scopus derives the benchmarks using the following calculation:

World benchmarkyear(x) FoR(y) =

Sum of cites for all eligible articles in the world dataset year(x) FoR(y)

Total number of eligible articles in the world dataset year(x) FoR(y)

Australian HEP cpp benchmarksThe Australian HEP benchmarks are compiled using all indexed journal articles submitted to ERA 2015. Journal articles submitted to ERA 2015 can be assigned and apportioned up to three four-digit FoR codes with the maximum FoR code apportionment being 100%. This means that a particular journal article can legitimately be submitted to ERA 2015 by two institutions with different variations of apportionment in FoR codes. An example of this would be the following:

Journal article X, published in the journal Australian Family Physician (FoR coded to ‘1117 Public Health and Health Services’ and ‘1103 Clinical Sciences’ on the ERA 2015 Submission Journal List) has contributing authors from University A and University B. University A apportioned 40% of the article to ‘1117 Public Health and Health Services’ and 60% to ‘1103 Clinical Sciences’, while University B assigned 80% of the article to ‘1117 Public Health and Health Services’ and 20% to ‘1103 Clinical Sciences’.

During the creation of the Australian HEP benchmarks, these unique institution FoR apportionments are accounted for in the de-duplication process undertaken by the ARC. That is, Journal article X is counted as 0.6 articles for ‘1117 Public Health and Health Services’ and 0.4 articles for ‘1103 Clinical Sciences’ in the de-duplicated ERA 2015 Australian HEP benchmark dataset.

A de-duplicated set of the indexed journal articles submitted and apportioned by the institutions are used in the calculation of the ERA 2015 Australian HEP benchmarks.

The Australian HEP benchmarks are derived by year using the following calculation:

Aust HEP benchmark year(x) FoR(y) =

Sum of cites for all eligible articles submitted to ERA year(x) FoR(y)

Total number of eligible articles submitted to ERA year(x) FoR(y)

Where a four-digit FoR code has less than 250 articles submitted to ERA 2015 across all HEPs, REC members are provided warning messages to alert them to the possibility of fluctuating annual Australian benchmarks.


Calculating the citation profiles

Relative Citation Impact (RCI)An example of an RCI as used in ERA is shown in Table 32.

Table 32: RCI against world and Australian HEP cpp benchmarks

Total Papers (Apportioned)

UoE RCI against:

World Benchmark Aust. HEP Benchmark

64.8 1.8 1.5

Two benchmarks are used in the calculation of this profile: World and Australian HEP cpp benchmarks.

An RCI is calculated for each article against the relevant FoR and year-specific benchmark. Once RCIs have been calculated for all articles, an average of the UoE’s RCIs is then derived. A UoE’s RCI against world and Australian HEP benchmarks are constructed individually for each UoE, based on the distribution of publications across the reference period.

Steps for deriving the ‘UoE RCI against World and Australian HEP Benchmarks’

Table 33 shows an example for deriving the Institution RCI for a UoE. The two benchmarks are applied to each article submitted to each FoR code. The methodology for deriving the citations profile is:

1. Calculate both ‘RCI (world)’ and ‘RCI (Aust. HEP.)’ for each article in a UoE, where:

a. RCI (World) = number of citations article (n)

World cpp year(x) FoR(y)

b. RCI (Aust. HEP.) = number of citations article (n)

Aust. HEP. cpp year(x) FoR(y)

2. Apply the apportionment to individual article’s RCI from Step 1, where:

a. Apportioned RCI (World) = RCI (World) * apportionment

b. Apportioned RCI (Aust. HEP) = RCI (Aust. HEP) * apportionment

3. average the RCIs derived in 2a and 2b respectively, where:

a. average RCI (world)= average of all ‘Apportioned RCI (world)’ for a UoE

b. average RCI (Aust. HEP.) = average of all ‘Apportioned RCI (Aust. HEP.)’ for a UoE.

Note:

the denominator for 3a and 3b is the total apportioned count of indexed articles for the UoE. For example, in Table 32, the total apportioned count of indexed articles is 64.8.

where the cpp is zero the RCI for those apportioned papers will not be calculated and the papers will not be included in the RCI classes.


Table 33: Example average RCI calculation against world and Australian HEP cpp benchmarks

Institution YFoR code: FoR X

Publication FoR X Apportionment

Year of Publication Citations

World cpp

benchmark

Aust HEP cpp

benchmark

Apportioned RCI against

world benchmark

Apportioned RCI against

Aust. benchmark

Pub 1 0.8 2008 3 2.3 5.2 1.04 0.46

Pub 2 1.0 2008 2 2.3 5.2 0.87 0.38

Pub 3 0.8 2009 5 2.1 3.5 1.90 1.14

Pub 4 0.5 2011 2 0.9 2.5 1.11 0.40

Pub 5 0.6 2010 0 1.2 3.1 0 0

….Pub 6 etc….Total 64.8 Average RCI 1.83 1.54

Distribution of papers based on world centile threshold

World centile thresholdsThe world centile thresholds are derived using bibliometric data of all eligible articles published in the world (including those authored by eligible staff of Australian HEPs).

Centile thresholds are derived by determining the number of raw citation counts required to be in the top 1, 5, 10, 25, and 50% of the world for all eligible articles in the Scopus dataset (by year and FoR code).

Centile analysis

ERA also uses ‘Centile Analysis’ as a tool in conjunction with ‘Relative Citation Impact’ to evaluate research quality. Centile analysis investigates the distribution of articles based on world centile thresholds. An example of the ‘Centile Analysis’ used in ERA is shown in Table 34.

Two benchmarks are used in this analysis:1. World centile thresholds: the citation information supplier derives the number of citations

required to be in the top 1, 5, 10, 25 and 50% of the world for an FoR code for each year of the reference period. For ERA 2015, these centile thresholds are derived by Scopus using the ERA 2015 world dataset

2. Australian HEP average for each centile: the cumulative percentage of Australia HEP articles at various world centile bands for an FoR code.

The centile profile also shows the number and percentage of articles at the 50th world centile (median) for a UoE.

Note:

Where the centile band threshold is not available for a paper, the paper will not be included in a centile band

Where the centile band lower threshold is zero, uncited papers will be included in the relevant centile band and also display in the ‘Uncited’ category in Table 34.


Table 34: Centile analysis

World centileUoE

Aust. HEP FoR Average % of articles (cumulative)No. of articles (cumulative) % of articles (cumulative)

1 0.0 0% 3%

5 2.5 4% 8%

10 11.5 18% 16%

25 19.8 32% 36%

50 (median) 28.5 46% 41%

Total 62.3 100% 100%

Uncited 2.5

Distribution of papers against RCI classes

RCI classesTo provide further granularity, ERA undertakes an analysis of the number of articles belonging to particular RCI bands (termed RCI Classes). The ARC uses seven classes of RCIs for ERA:

Class 0 Output with no impact (RCI=0)

Class I Output with RCI ranging from >0 to 0.79

Class II Output with RCI ranging from 0.80 to 1.19

Class III Output with RCI ranging from 1.20 to 1.99

Class IV Output with RCI ranging from 2.00 to 3.99

Class V Output with RCI ranging from 4.00 to 7.99

Class VI Output with RCI above >8.00.

Steps for compiling the RCI Class profile1. Calculate the ‘RCI (world)’ for each article submitted by an institution for a UoE, as shown in

Table 33.

2. Assign an RCI Class to each of the articles based on the ‘RCI (world)’ score for each article.

3. Count the number of apportioned articles within each RCI Class.


Table 35: Deriving RCI Classes

Institution YFoR code: FoR X

Publication Apportionment Yr of Pub Citations World cpp

benchmark

Aust HEP cpp

benchmark

RCI (world)

RCI (Aust. HEP.) RCI Class

Pub 1 0.8 2008 3 2.3 5.2 1.3 0.58 Class III

Pub 2 1.0 2008 2 2.3 5.2 0.87 0.38 Class II

Pub 3 0.8 2009 5 2.1 3.5 2.38 1.43 Class IV

Pub 4 0.5 2011 2 0.9 2.5 2.22 0.8 Class IV

Pub 5 0.6 2010 0 1.2 3.1 0 0 Class 0

….Pub 6 etc….

Total indexed articles

64.8

Table 36: Number of articles across RCI Classes (assessed against the world cpp benchmark)

Class RCI Range No. of indexed articles % of indexed articles Aust HEP average

0 0 2.5 4% 18%I 0.01–0.79 15.8 24% 26%II 0.80–1.19 18.6 29% 32%III 1.20–1.99 23.2 36% 12%IV 2.00–3.99 1.9 3% 7%V 4.0–7.99 2.8 4% 3%VI >=8 0 0% 2%Total indexed articles 64.8 100% 100%

Table 36 shows that, for the UoE shown, 2.5 articles are uncited, 15.8 articles are cited below the world average, 18.6 articles are cited around the world average (defined as being cited

around one times the world benchmark), 23.2 articles are cited between 1.20 and 1.99 times the world average, 1.9 articles in this analysis have a RCI of between two and four times the world average, 2.8 articles are cited 4.00 to 7.99 times the world average and no articles are cited at or above eight times the world average.


Appendix 6: ERA 2015 Discipline Matrix by Cluster

Biological and Biotechnological Sciences (BB)

Low Volume Threshold

Journal Article Citation Analysis

Peer Review (30% of outputs to be nominated by output type)

Traditional outputs by

outlet frequency

HERDC Research Income

(Categories 1-4)

Esteem Measures Applied Measures Staff data Assessable output types

Cluster FoR Code FoR Title Books Book Chapters Journal articlesConferencePublications

Non-traditional outputs by type

Editor PrestigiousWorks of Reference

Membership of learned

academy

Category 1 research

fellowships

Membership of statutory

committees

Australia Council

Grants or Fellowships

Patents ** Registered designs**

Plant breeder's rights**

NHMRC endorsed

Guidelines

Research Commercialisation

income

Researchers by level


type


Other NTRO

Research Report for

External BodyOther NTRO

Research Report for External

Body

BB 06 Biological Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes* - Yes Yes Yes - YesBB 0601 Biochemistry and Cell Biology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesBB 0602 Ecology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesBB 0603 Evolutionary Biology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesBB 0604 Genetics 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesBB 0605 Microbiology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesBB 0606 Physiology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesBB 0607 Plant Biology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesBB 0608 Zoology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesBB 0699 Other Biological Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesBB 07 Agricultural and Veterinary Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes* - Yes Yes Yes - YesBB 0701 Agriculture, Land and Farm Management 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesBB 0702 Animal Production 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesBB 0703 Crop and Pasture Production 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesBB 0704 Fisheries Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesBB 0705 Forestry Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesBB 0706 Horticultural Production 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesBB 0707 Veterinary Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesBB 0799 Other Agricultural and Veterinary Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - Yes*** 10 Technology 50IJ/

50WOYes* Yes* Yes* Yes* Yes* - Yes* Yes Yes - Yes Yes - - Yes Yes* Yes* - Yes Yes Yes - Yes

BB 1001 Agricultural Biotechnology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesBB 1002 Environmental Biotechnology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesBB 1003 Industrial Biotechnology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - Yes

*For these two-digit codes, material will be evaluated using the same indicators as used for the relevant material at the four-digit level e.g. in 10 Technology a journal article submitted in 1001 will be evaluated at the two-digit level using citation analysis, not peer review.** Patents, registered designs and Plant Breeder's Rights include those granted to eligible researchers and institutions.*** The two-digit FoR 10 will be assessed jointly across the BB, EE and MHS Clusters.

50IJ = 50 indexed apportioned journal articles. 50WO = 50 apportioned weighted outputs. 50IJ/50WO = UoEs meeting either threshold will be evaluated.


Economics and Commerce (EC)





outlet frequency


(Categories 1-4)






academy

Category 1 research

fellowships


committees

Australia Council




NHMRC endorsed

Guidelines


income



type


Other NTRO

Research Report for



Body

EC 14 Economics 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1401 Economic Theory 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1402 Applied Economics 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1403 Econometrics 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1499 Other Economics 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 15 Commerce, Management, Tourism and Services 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1501 Accounting, Auditing and Accountability 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1502 Banking, Finance and Investment 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1503 Business and Management 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1504 Commercial Services 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1505 Marketing 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1506 Tourism 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1507 Transportation and Freight Services 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEC 1599 Other Commerce, Management, Tourism and

Services50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes Yes

** Patents, registered designs and Plant Breeder's Rights include those granted to eligible researchers and institutions.



Engineering and Environmental Sciences (EE)





outlet frequency


(Categories 1-4)






academy

Category 1 research

fellowships


committees

Australia Council




NHMRC endorsed

Guidelines


income



type


Other NTRO

Research Report for



Body

EE 05 Environmental Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesEE 0501 Ecological Applications 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesEE 0502 Environmental Science and Management 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesEE 0503 Soil Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesEE 0599 Other Environmental Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - Yes - Yes Yes Yes - YesEE 09 Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0901 Aerospace Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0902 Automotive Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0903 Biomedical Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0904 Chemical Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0905 Civil Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0906 Electrical and Electronic Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0907 Environmental Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0908 Food Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0909 Geomatic Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0910 Manufacturing Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0911 Maritime Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0912 Materials Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0913 Mechanical Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0914 Resources Engineering and Extractive Metallurgy 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0915 Interdisciplinary Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesEE 0999 Other Engineering 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - Yes

*** 10 Technology 50IJ/50WO

Yes* Yes* Yes* Yes* Yes* - Yes* Yes Yes - Yes Yes - - Yes Yes* Yes* - Yes Yes Yes - YesEE 1005 Communications Technologies 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - YesEE 1006 Computer Hardware 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - YesEE 1007 Nanotechnology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - YesEE 1099 Other Technology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - Yes




Education and Human Society (EHS)





outlet frequency


(Categories 1-4)






academy

Category 1 research

fellowships


committees

Australia Council




NHMRC endorsed

Guidelines


income



type


Other NTRO

Research Report for



Body

EHS 13 Education 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1301 Education Systems 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1302 Curriculum and Pedagogy 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1303 Specialist Studies in Education 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1399 Other Education 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 16 Studies in Human Society 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1601 Anthropology 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1602 Criminology 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1603 Demography 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1604 Human Geography 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1605 Policy and Administration 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1606 Political Science 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1607 Social Work 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1608 Sociology 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesEHS 1699 Other Studies in Human Society 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes Yes


50IJ = 50 indexed apportioned journal articles. 50WO = 50 apportioned weighted outputs.50IJ/50WO = UoEs meeting either threshold will be evaluated.


Humanities and Creative Arts (HCA)





outlet frequency


(Categories 1-4)






academy

Category 1 research

fellowships


committees

Australia Council




NHMRC endorsed

Guidelines


income



type


Other NTRO

Research Report for



Body

HCA 12 Built Environment and Design 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - Yes Yes - - Yes Yes Yes Yes YesHCA 1201 Architecture 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - Yes Yes - - Yes Yes Yes Yes YesHCA 1202 Building 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - Yes Yes - - Yes Yes Yes Yes YesHCA 1203 Design Practice and Management 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - Yes Yes - - Yes Yes Yes Yes YesHCA 1204 Engineering Design 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - Yes Yes - - Yes Yes Yes Yes YesHCA 1205 Urban and Regional Planning 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - Yes Yes - - Yes Yes Yes Yes YesHCA 1299 Other Built Environment and Design 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - Yes Yes - - Yes Yes Yes Yes YesHCA 18 Law and Legal Studies 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - - Yes Yes Yes YesHCA 1801 Law 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - - Yes Yes Yes YesHCA 1802 Maori Law 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - - Yes Yes Yes YesHCA 1899 Other Law and Legal Studies 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - - Yes Yes Yes YesHCA 19 Studies in Creative Arts and Writing 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - Yes Yes Yes - - Yes Yes Yes Yes YesHCA 1901 Art Theory and Criticism 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - Yes Yes Yes - - Yes Yes Yes Yes YesHCA 1902 Film, Television and Digital Media 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - Yes Yes Yes - - Yes Yes Yes Yes YesHCA 1903 Journalism and Professional Writing 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - Yes Yes Yes - - Yes Yes Yes Yes YesHCA 1904 Performing Arts and Creative Writing 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - Yes Yes Yes - - Yes Yes Yes Yes YesHCA 1905 Visual Arts and Crafts 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - Yes Yes Yes - - Yes Yes Yes Yes YesHCA 1999 Other Studies in Creative Arts and Writing 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - Yes Yes Yes - - Yes Yes Yes Yes YesHCA 20 Language, Communication and Culture 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2001 Communication and Media Studies 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2002 Cultural Studies 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2003 Language Studies 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2004 Linguistics 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2005 Literary Studies 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2099 Other Language, Communication and Culture 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 21 History and Archaeology 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - Yes* - - - Yes Yes Yes Yes YesHCA 2101 Archaeology 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2102 Curatorial and Related Studies 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - Yes - - - Yes Yes Yes Yes YesHCA 2103 Historical Studies 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2199 Other History and Archaeology 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 22 Philosophy and Religious Studies 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2201 Applied Ethics 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2202 History and Philosophy of Specific Fields 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2203 Philosophy 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2204 Religion and Religious Studies 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes YesHCA 2299 Other Philosophy and Religious Studies 50WO - Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes Yes Yes




Medical and Health Sciences (MHS)





outlet frequency


(Categories 1-4)






academy

Category 1 research

fellowships


committees

Australia Council




NHMRC endorsed

Guidelines


income



type


Other NTRO

Research Report for



Body

*** 10 Technology 50IJ/50WO

Yes* Yes* Yes* Yes* Yes* - Yes* Yes Yes - Yes Yes - - Yes Yes* Yes* - Yes Yes Yes - YesMHS 1004 Medical Biotechnology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesMHS 11 Medical and Health Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes Yes* - Yes - - Yes Yes* Yes Yes - YesMHS 1101 Medical Biochemistry and Metabolomics 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1102 Cardiovascular Medicine and Haematology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1103 Clinical Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1104 Complementary and Alternative Medicine 50IJ Yes - - - - - - Yes Yes - Yes Yes Yes - Yes - - Yes - Yes Yes - YesMHS 1105 Dentistry 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1106 Human Movement and Sports Science 50IJ Yes - - - - - - Yes Yes - Yes Yes Yes - Yes - - Yes - Yes Yes - YesMHS 1107 Immunology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1108 Medical Microbiology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1109 Neurosciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1110 Nursing 50IJ Yes - - - - - - Yes Yes - Yes Yes Yes - Yes - - Yes - Yes Yes - YesMHS 1111 Nutrition and Dietetics 50IJ Yes - - - - - - Yes Yes - Yes Yes Yes - Yes - - Yes - Yes Yes - YesMHS 1112 Oncology and Carcinogenesis 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1113 Ophthalmology and Optometry 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1114 Paediatrics and Reproductive Medicine 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1115 Pharmacology and Pharmaceutical Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1116 Medical Physiology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - Yes Yes Yes Yes - YesMHS 1117 Public Health and Health Services 50IJ Yes - - - - - - Yes Yes - Yes Yes Yes - Yes - - Yes - Yes Yes - YesMHS 1199 Other Medical and Health Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes Yes - Yes - - Yes - Yes Yes - YesMHS 17 Psychology and Cognitive Sciences 50IJ Yes - - - - - - Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes - YesMHS 1701 Psychology 50IJ Yes - - - - - - Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes - YesMHS 1702 Cognitive Sciences 50IJ Yes - - - - - - Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes - YesMHS 1799 Other Psychology and Cognitive Science 50IJ Yes - - - - - - Yes Yes Yes Yes Yes - - - - - - Yes Yes Yes - Yes




Mathematical, Information and Computing Sciences (MIC)





outlet frequency


(Categories 1-4)






academy

Category 1 research

fellowships


committees

Australia Council




NHMRC endorsed

Guidelines


income



type


Other NTRO

Research Report for



Body

MIC 01 Mathematical Sciences 50IJ/50WO

Yes* Yes* Yes* Yes* Yes* - Yes* Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesMIC 0101 Pure Mathematics 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesMIC 0102 Applied Mathematics 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesMIC 0103 Numerical and Computational Mathematics 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesMIC 0104 Statistics 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesMIC 0105 Mathematical Physics 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesMIC 0199 Other Mathematical Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesMIC 08 Information and Computing Sciences 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - YesMIC 0801 Artificial Intelligence and Image Processing 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - YesMIC 0802 Computation Theory and Mathematics 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - YesMIC 0803 Computer Software 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - YesMIC 0804 Data Format 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - YesMIC 0805 Distributed Computing 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - YesMIC 0806 Information Systems 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - YesMIC 0807 Library and Information Studies 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - YesMIC 0899 Other Information and Computing Sciences 50WO - Yes Yes Yes Yes - Yes Yes Yes - Yes Yes - - Yes Yes - - Yes Yes Yes - Yes




Physical, Chemical and Earth Sciences (PCE)





outlet frequency


(Categories 1-4)






academy

Category 1 research

fellowships


committees

Australia Council




NHMRC endorsed

Guidelines


income



type


Other NTRO

Research Report for



Body

PCE 02 Physical Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0201 Astronomical and Space Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0202 Atomic, Molecular, Nuclear, Particle and Plasma

Physics50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - Yes

PCE 0203 Classical Physics 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0204 Condensed Matter Physics 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0205 Optical Physics 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0206 Quantum Physics 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0299 Other Physical Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 03 Chemical Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0301 Analytical Chemistry 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0302 Inorganic Chemistry 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0303 Macromolecular and Materials Chemistry 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0304 Medicinal and Biomolecular Chemistry 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0305 Organic Chemistry 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0306 Physical Chemistry (incl. Structural) 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0307 Theoretical and Computational Chemistry 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0399 Other Chemical Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 04 Earth Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0401 Atmospheric Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0402 Geochemistry 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0403 Geology 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0404 Geophysics 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0405 Oceanography 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - YesPCE 0406 Physical Geography and Environmental

Geoscience50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - Yes

PCE 0499 Other Earth Sciences 50IJ Yes - - - - - - Yes Yes - Yes Yes - - Yes - - - Yes Yes Yes - Yes




Appendix 7: Fields of Research code summaryThis section of the Handbook provides an overview of the FoR codes, organised by the two-digit FoR codes. Information about applicable indicators is not included in the two-digit FoR code summaries in this appendix.

1. Two-, four-digit and six-digit FoR code peculiarities include sub-fields which are often hidden at the four-digit and six-digit FoR level. The ANZSRC provides a number of inclusions and exclusions which are provided in this section. The summary pages for each discipline included in this section are designed to provide the important inclusions and exclusions to REC members.

2. The code summaries should be read in conjunction with applicable indicators and differences of applicability within and across discipline groupings. The ERA 2015 Discipline Matrix can be found on the ARC website or at Appendix 6. This shows which indicators are relevant for each four-digit FoR code. This section highlights differences in the use of various indicators at the two-digit level.


01—Mathematical SciencesEnsure you are familiar with the six-digit codes beneath each four-digit classification.

Note general exclusions below.

Please ensure you check the four-digit exclusions.

a) Statistical physics is included in Group 0203 Classical Physics.

b) Statistical mechanics associated with chemical processes is included in 0307 Theoretical and Computational Chemistry.

c) Mathematics associated with computer science is included in Division 08 Information and Computing Sciences.

d) Bioinformatics is included in Group 0601 Biochemistry and Cell Biology.

e) Geodesy is included in Group 0909 Geomatic Engineering.

f) Applications of control theory to engineering are included in Groups 0906 Electrical and Electronic Engineering and 0913 Mechanical Engineering.

g) Applications of statistical techniques are included in the appropriate division, e.g. the statistical analysis of correlations between human health and environmental factors is included in Division 11 Medical and Health Sciences.

h) Mathematics and statistics applied in economics are included in Division 14 Economics.

i) Criminology is included in Group 1602 Criminology.

j) History and philosophy of science is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments

0101 Pure Mathematics Uses Peer Review

0102 Applied Mathematics Contains research outputs from a wide range of disciplines with Applied Mathematics outputs.

0103 Numerical and Computational Mathematics

0104 Statistics Contains research outputs from a wide range of disciplines with Statistics outputs.

0105 Mathematical Physics Large cross over with 02—Physical sciences. Many journals are coded to both 01 and 02 to allow institutions an opportunity to assign to Mathematical Physics where relevant.

0199 Other Mathematical Sciences


02—Physical SciencesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Mathematical aspects of physics are included in Group 0105 Mathematical Physics.

b) Optical properties of materials are included in Group 0303 Macromolecular and Materials Chemistry.

c) Tropospheric and stratospheric physics are included in Group 0401 Atmospheric Sciences.

d) Extra-terrestrial geology is included in Group 0403 Geology.

e) Geophysics is included in Group 0404 Geophysics.

f) Soil physics is included in Group 0503 Soil Sciences.

g) Engineering aspects of the physical sciences are included in Division 09 Engineering.

h) Technological aspects of the physical sciences are included in Division 10 Technology.

i) Human biophysics is included in Group 1116 Medical Physiology.

j) History and philosophy of science is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments0201 Astronomical and Space Sciences Tropospheric and stratospheric physics are included in Group

0401 Atmospheric Sciences

0202 Atomic, Molecular, Nuclear, Particle and Plasma Physics

0203 Classical Physics Includes thermodynamics and acoustics

0204 Condensed Matter Physics Other material sciences are included in 0204 Condensed Matter Physics, 0302 Inorganic Chemistry, 0303 Macromolecular and Materials Chemistry, 0903 Biomedical Engineering, 0912 Materials Engineering, and 0914 Resources Engineering and Extractive Metallurgy.

0205 Optical Physics

0206 Quantum Physics

0299 Other Physical Sciences Includes biological physics and medical physics—other than human biophysics. Includes synchrotron and accelerator techniques.


03—Chemical SciencesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Atmospheric sciences, other than atmospheric chemistry, are included in Group 0401 Atmospheric Sciences.

b) Geochemistry is included in Group 0402 Geochemistry.

c) Mineralogy and crystallography are included in Group 0403 Geology.

d) Soil chemistry is included in Group 0503 Soil Sciences.

e) Pharmacology for animal use is included in Group 0707 Veterinary Sciences.

f) Biochemistry other than biomolecular chemistry or medical biochemistry is included in Group 0601 Biochemistry and Cell Biology.

g) Chemical engineering is included in Group 0904 Chemical Engineering.

h) Food chemistry is included in Group 0908 Food Sciences.

i) Mechanical engineering is included in Group 0913 Mechanical Engineering.

j) Biocatalysis is included in Group 1003 Industrial Biotechnology.

k) Nanoscale characterisation and nanotechnology other than nanochemistry are included in Group 1007 Nanotechnology.

l) Medical biochemistry is included in Group 1101 Medical Biochemistry and Metabolomics.

m) Clinical chemistry is included in Group 1103 Clinical Sciences.

n) Pharmacology for human use and human toxicology is included in Group 1115 Pharmacology and Pharmaceutical Sciences.

o) Criminology is included in Group 1602 Criminology.

p) History and philosophy of science is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments0301 Analytical Chemistry

0302 Inorganic Chemistry Other material sciences are included in 0204 Condensed Matter Physics, 0302 Inorganic Chemistry, 0303 Macromolecular and Materials Chemistry, 0903 Biomedical Engineering, 0912 Materials Engineering, and 0914 Resources Engineering and Extractive Metallurgy.

0303 Macromolecular and Materials Chemistry

Nanoscale characterisation and nanotechnology are in 1007. Chemical engineering is in 0904.

Other material sciences are included in 0204 Condensed Matter Physics, 0302 Inorganic Chemistry, 0303 Macromolecular and Materials Chemistry, 0903 Biomedical Engineering, 0912 Materials Engineering, and 0914 Resources Engineering and Extractive Metallurgy.

0304 Medicinal and Biomolecular Chemistry Biochemistry is in 0601. Animal pharmacology is in 0707. Human pharmacology and toxicology is in 1115.


FoR Description Comments0305 Organic Chemistry Organometallic chemistry is in 0399.0306 Physical Chemistry (incl. Structural) Chemical engineering is in 0904.0307 Theoretical and Computational

Chemistry0399 Other Chemical Sciences Includes organometallic chemistry, environmental chemistry and

forensic chemistry.


04—Earth SciencesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Mesospheric, ionospheric and magnetospheric physics is included in Group 0201 Astronomical and Space Sciences.

b) Solid state chemistry and the chemical aspects of crystallography and are included in Group 0302 Inorganic Chemistry.

c) Environmental and atmospheric chemistry are included in Group 0399 Other Chemical Sciences.

d) Environmental sciences, including environmental monitoring, soil science and carbon sequestration science are included in Division 05 Environmental Sciences.

e) Marine ecology and palaeontology associated with palaeoecological studies is included in Group 0602 Ecology.

f) Agricultural applications of hydrology are included in Group 0799 Other Agricultural and Veterinary Sciences.

g) Water reticulation for household and non-agricultural industry use is included in Groups 0904 Chemical Engineering and 0905 Civil Engineering.

h) Environmental engineering is included in Group 0907 Environmental Engineering.

i) Materials engineering is included in Group 0912 Materials Engineering.

j) Mining, mineral processing and metallurgy are included in Group 0914 Resources Engineering and Extractive Metallurgy.

k) Social aspects of geography are included in Group 1604 Human Geography.

l) History and philosophy of science is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments0401 Atmospheric Sciences Mesospheric, ionospheric and magnetospheric physics is included in

0201 Astronomical and Space Sciences.

0402 Geochemistry Solid state chemistry and the chemical aspects of crystallography are included in 0302 Inorganic Chemistry.

0403 Geology

0404 Geophysics Geodesy is included in 0909 Geomatic Engineering.

0405 Oceanography Marine geoscience is included in 0403 Geology. Marine ecology is included in 0602 Ecology.

0406 Physical Geography and Environmental Geoscience

Climatology is included in 0401 Atmospheric Sciences. Social aspects of geography are included in 1604 Human Geography.

0499 Other Earth Sciences


05—Environmental SciencesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Environmental chemistry is included in Group 0399 Other Chemical Sciences.

b) Atmospheric sciences are included in Group 0401 Atmospheric Sciences.

c) Hydrology and environmental geoscience are included in Group 0406 Physical Geography and Environmental Geoscience.

d) Basic ecological research is included in Group 0602 Ecology.

e) Management of land and soil for agricultural production is included in Group 0701 Agriculture, Land and Farm Management.

f) Management of forests for forestry production is included in Group 0705 Forestry Sciences.

g) Carbon capture engineering is included in Group 0904 Chemical Engineering.

h) Environmental engineering is included in Group 0907 Environmental Engineering.

i) Environmental biotechnology is included in Group 1002 Environmental Biotechnology.

j) Environmental nanotechnology is included in Group 1007 Nanotechnology.

k) Management of land and parks in built environments is included in Group 1205 Urban and Regional Planning.

l) Environment economics are included in Group 1402 Applied Economics.

m) Ecological economics is included in Group 1499 Other Economics.

n) Environment policy is included in Group 1605 Policy and Administration.

o) History and philosophy of science is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments0501 Ecological Applications Includes Ecological Impacts of Climate Change. Basic ecological

research is included in 0602 Ecology.

0502 Environmental Science and Management

Includes conservation and biodiversity; public education on environmental issues; the management and monitoring of natural resources and environments for their environmental value.

0503 Soil Sciences Includes soil biology, soil chemistry and soil physics. Environmental chemistry is included in 0399 Other Chemical Sciences. Management of land and soil for agricultural production is included in 0701 Agriculture, Land and Farm Management.

0599 Other Environmental Sciences


06—Biological SciencesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Biological mathematics is included in Group 0102 Applied Mathematics.

b) Biostatistics is included in Group 0104 Statistics.

c) Biophysics other than human biophysics is included in Group 0299 Other Physical Sciences.

d) Chemistry, including organic and biomolecular chemistry, is included in Division 03 Chemical Sciences.

e) Palaeontology other than that associated with palaeoecological studies is included in Group 0403 Geology.

f) Applications of ecology are included in Group 0501 Ecological Applications.

g) Conservation and biodiversity is included in Group 0502 Environmental Science and Management.

h) Biological or life sciences associated with agricultural production or veterinary sciences are included in Division 07 Agricultural and Veterinary Sciences.

i) Bioinformatics software is included in Group 0803 Computer Software.

j) Technological applications of biology are included in Division 10 Technology.

k) Biological or life sciences associated with human health and medicine are included in Division 11 Medical and Health Sciences.

l) Criminology is included in Group 1602 Criminology.

m) Animal bioethics is included in Group 2201 Applied Ethics.

n) History and philosophy of science is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments0601 Biochemistry and Cell Biology

0602 Ecology Includes limnology and ecological studies of freshwater bodies such as lakes or ponds; palaeoecology. Microbial ecology is included in 0605 Microbiology.

0603 Evolutionary Biology Evolutionary genetics and molecular evolution is included in 0604 Genetics.

0604 Genetics Microbial genetics is included in Group 0605 Microbiology; Animal genetics associated with animal breeding is included in Group 0702 Animal Production. Genetics of agricultural crops (excluding genetic engineering) is included in 0703 Crop and Pasture Production and 0706 Horticultural Production. Genetic engineering of agricultural crops is included in 1001 Agricultural Biotechnology. Genetics associated with human health and medicine is included in 1103 Clinical Sciences and 1112 Oncology and Carcinogenesis.

0605 Microbiology Microbial systematics, taxonomy and phylogeny are included in 0603 Evolutionary Biology; Veterinary microbiology is included in Group 0707 Veterinary Sciences; Medical and clinical microbiology are included in Division 11 Medical and Health Sciences.


FoR Description Comments0606 Physiology Plant physiology is included in 0607 Plant Biology; Animal physiological

ecology is included in 0608 Zoology; Physiology related to specific aspects of animal production or veterinary practice is included in Division 07 Agricultural and Veterinary Sciences. Medical physiology is included in 1116 Medical Physiology.

0607 Plant Biology Includes phycology.

0608 Zoology Includes entomology and the study of terrestrial vertebrates (other than humans); The use of live animals or material from live animals for medical research is included in 1199 Other Medical and Health Sciences.

0699 Other Biological Sciences Includes Forensic Biology and Global Change Biology.


07—Agricultural and Veterinary SciencesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Hydrology other than agricultural hydrology is included in Group 0406 Physical Geography and Environmental Geoscience.

b) Management of parks in natural environments is included in Group 0502 Environmental Science and Management.

c) Soil sciences are included in Group 0503 Soil Sciences.

d) Biological or life sciences not associated with agricultural and veterinary sciences or human health and medicine are included in Division 06 Biological Sciences.

e) Food science, including food processing and packaging, is included in Group 0908 Food Sciences.

f) Agricultural engineering is included in Group 0999 Other Engineering.

g) Agricultural biotechnology is included in Group 1001 Agricultural Biotechnology.

h) Biological control of pests, diseases and exotic species is included in Group 1002 Environmental Biotechnology.

i) Biological or life sciences associated with human health and medicine are included in Division 11 Medical and Health Sciences.

j) Management and planning of land and parks in built environments is included in Group 1205 Urban and Regional Planning.

k) Agricultural economics is included in Group 1402 Applied Economics.

l) Management of non-rural businesses is included in Group 1503 Business and Management.

m) Animal bioethics is included in Group 2201 Applied Ethics.

n) History and philosophy of science is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments0701 Agriculture, Land and Farm

ManagementAgricultural engineering is included in 0999 Other Engineering. Agricultural biotechnology is included in 1001 Agricultural Biotechnology.

0702 Animal Production Includes bees and apiary culture; egg production; animal production for domestic or sporting uses.

0703 Crop and Pasture Production Includes agronomy; genetics and field protection procedures for crop and pasture production; post-harvest treatment transportation of crops and grains; weed science.

0704 Fisheries Sciences

0705 Forestry Sciences

0706 Horticultural Production Includes the propagation and culture of garden or horticultural crops; fruit crops; viticulture and oenology; flower production, ornamental crops and nursery stock; propagating and growing vegetable crops; post-harvest treatment of horticultural crops; lawns for aesthetic or sporting purposes.


FoR Description Comments0707 Veterinary Sciences Includes Veterinary Pharmacology; Veterinary Microbiology and

Veterinary virology.

0799 Other Agricultural and Veterinary Sciences

Includes Agricultural Hydrology (Drainage, Flooding, Irrigation, Quality, etc.); Fertilisers and Agrochemicals (incl. Application).


08—Information and Computing SciencesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Mathematics not associated with computer science is included in Division 01 Mathematical Sciences.

b) Cheminformatics is included in Group 0304 Medicinal and Biomolecular Chemistry.

c) The development of computer software, other than mathematics and bioinformatics software, which has applications to fields other than Division 08 Information and Computing Sciences is included in the appropriate divisions, e.g. computer modelling for atmospheric research is included in Division 04 Earth Sciences; software development for forest management is included in Division 07 Agricultural and Veterinary Sciences.

d) Bioinformatics is included in Group 0601 Biochemistry and Cell Biology.

e) Mechatronics for automotive engineering are included in Group 0902 Automotive Engineering.

f) Signal processing and non-manufacturing robotics are included in Group 0906 Electrical and Electronic Engineering.

g) Geospatial information systems are included in Group 0909 Geomatic Engineering.

h) Manufacturing robotics, mechatronics (excluding automotive applications) and CAD/CAM systems are included in Group 0910 Manufacturing Engineering.

i) Communications technologies are included in Group 1005 Communications Technologies.

j) Development of computer hardware is included in Group 1006 Computer Hardware.

k) Health information systems, including surveillance, are included in Group 1117 Public Health and Health Services.

l) Business records and information management and business information systems are included in Group 1503 Business and Management.

m) Computer perception, memory and attention are included in Group 1702 Cognitive Sciences.

n) Computational linguistics is included in Group 2004 Linguistics.

o) Archival, repository and related studies is included in Group 2102 Curatorial and Related Studies.

p) History and philosophy of science is included in Group 2202 History and Philosophy of Specific Fields.

q) Note: 1005 Communications Technologies; and 1006 Computer Hardware may be relevant to 08 disciplines.

r) Note: 0906 Electrical Engineering may be relevant.

FoR Description Comments0801 Artificial Intelligence and Image Processing

0802 Computation Theory and Mathematics


FoR Description Comments0803 Computer Software

0804 Data Format

0805 Distributed Computing

0806 Information Systems

0807 Library and Information Studies

0899 Other Information and Computing Sciences


09—EngineeringEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Control theory is included in Group 0102 Applied Mathematics.

b) Physics, including space sciences, materials physics, optoelectronics and quantum electronics, is included Division 02 Physical Sciences.

c) Chemistry, including materials chemistry and the theory and design of materials, is included in Division 03 Chemical Sciences.

d) Earth sciences, including geophysics and hydrology, are included in Division 04 Earth Sciences.

e) Environmental science, including carbon sequestration science, is included in Division 05 Environmental Sciences.

f) Agricultural science, including agricultural hydrology and post-harvest packaging, transportation and storage of agricultural products, is included in Division 07 Agricultural and Veterinary Sciences.

g) Information and software engineering are included in Division 08 Information and Computing Sciences.

h) Biotechnology, nanotechnology and the development of computer hardware and communications technologies are included in Division 10 Technology.

i) Materials used in dentistry are included in Group 1105 Dentistry.

j) Human nutrition is included in Group 1111 Nutrition and Dietetics.

k) Architectural acoustics is included in Group 1201 Architecture.

l) Building science, construction management and quantity surveying are included in Group 1202 Building.

m) Engineering design, other than chemical, environmental, materials, satellite, missile and space vehicle is included in Group 1204 Engineering Design.

n) Transport planning is included in Group 1205 Urban and Regional Planning.

o) Technical writing is included in Group 1903 Journalism and Professional Writing.

p) History and philosophy of engineering is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments0901 Aerospace Engineering0902 Automotive Engineering0903 Biomedical Engineering Includes development of implants and prosthetics; development of surgical

equipment and medical instrumentation; development of biomaterials.



0904 Chemical Engineering Note: chemistry codes may be relevant.Includes design; membrane and separation technologies; process control and simulation other than that associated with control engineering; water treatment.

0905 Civil Engineering Includes structural engineering; transport engineering; water and sanitary engineering; construction engineering.

0906 Electrical and Electronic Engineering

Note: 1005 Communications Technologies; and 1006 Computer Hardware may be relevant.

0906 excludes electrical and electronic engineering, associated with computer hardware and communication technologies.

0907 Environmental Engineering0908 Food Sciences Includes food chemistry and engineering, including wine; food processing,

packaging and safety; nutritional content and balance of food.0909 Geomatic Engineering Includes surveying, including hydrographic surveying; remote sensing; Geospatial

information systems; navigation and cartography.0910 Manufacturing Engineering0911 Maritime Engineering0912 Materials Engineering Includes ceramics science and ceramics engineering; polymer and textiles

engineering; composite and hybrid materials; physical metallurgy and alloy materials; functional materials; semiconductor engineering.


0913 Mechanical Engineering Includes acoustics, noise and vibration control; mechanical aspects of automation and control engineering; energy generation, conversion and storage. Note Control theory is included in 0102 Applied Mathematics.

0914 Resources Engineering and Extractive Metallurgy

Includes mining engineering; mineral processing; petroleum and reservoir engineering; geomechanics and geotechnical engineering associated with mining and mineral extraction.


Note: geotechnical engineering associated with civil engineering is included in 0905 Civil Engineering; Geotechnical engineering associated with civil engineering is included in 0905 Civil Engineering; Physical metallurgy is included in 0912 Materials Engineering; Uranium processing and enrichment is included in 0915 Interdisciplinary Engineering.

0915 Interdisciplinary Engineering Includes fluid mechanics and computational fluid dynamics; heat and mass transfer; engineering practice; engineering associated with the development of nuclear power and the nuclear fuel cycle; engineering associated with the mitigation of risk from climate change and other environmental factors; and turbulent flows.

0999 Other Engineering


10—TechnologyEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Mathematics and statistics are included in Division 01 Mathematical Sciences.

b) Photonics, optoelectronics and optical communications are included in Group 0205 Optical Physics.

c) Quantum communication is included in Group 0206 Quantum Physics.

d) Nanochemistry is included in Group 0303 Macromolecular and Materials Chemistry.

e) Environmental science is included in Division 05 Environmental Sciences.

f) Improvement of plants and animals through selective breeding is included in Division 07 Agricultural and Veterinary Sciences.

g) Information technology not directly associated with computer hardware is included in Division 08 Information and Computing Sciences.

h) Engineering, including aerospace, biomedical and environmental engineering and remote sensing, is included in Division 09 Engineering.

i) Assisted reproduction technologies are included in Group 1114 Paediatrics and Reproductive Medicine.

j) Pharmacogenomics is included in Group 1115 Pharmacology and Pharmaceutical Sciences.

k) Ethical use of technology is included in Group 2201 Applied Ethics.

l) History and philosophy of technology is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments1001 Agricultural Biotechnology Includes marine biotechnology; genetic modification of plants and animals for

agricultural production; livestock cloning and transgenesis.1002 Environmental Biotechnology Includes biodiscovery;biological control; bioremediation.

1003 Industrial Biotechnology Includes biocatalysis; bioprocessing and bioproducts; fermentation other than for foodstuffs; biofeedstocks; industrial biotechnology.

1004 Medical Biotechnology

1005 Communications Technologies Includes communications networks and analysis; communication and broadcasting systems; digital systems, optical and photonic systems; antenna technology (including that used in remote sensing and satellites); microwave and millimetrewave technology.

1006 Computer Hardware Includes development of physical components for personal computers, mainframes and computer peripherals; development of circuit boards and hardware assemblies of computing devices; development of multiplexers, computer peripherals and computer accessories.

1007 Nanotechnology Includes molecular and organic electronics; nanobiotechnology; nanomedicine; nanoscale characterisation; health and safety aspects of nanotechnology and nanotoxicology.

1099 Other Technology


11—Medical and Health SciencesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Medical physics, biophysics unrelated to humans and accelerators and other equipment for the production of radioisotopes for nuclear medicine are included in Group 0299 Other Physical Sciences.

b) Medicinal and biomolecular chemistry is included in Group 0304 Medicinal and Biomolecular Chemistry.

c) Biological sciences without application to human health and disease are included in the appropriate groups in Division 06 Biological Sciences.

d) Biological and life sciences associated with agricultural and veterinary studies are included in Division 07 Agricultural and Veterinary Sciences.

e) Health informatics is included in Group 0807 Library and Information Studies.

f) Biomedical engineering is included in Group 0903 Biomedical Engineering.

g) Nutritional content and balance of foods is included in Group 0908 Food Sciences.

h) Medical biotechnology is included in Group 1004 Medical Biotechnology.

i) Nanomedicine is included in Group 1007 Nanotechnology.

j) Ergonomics is included in Group 1203 Design Practice and Management.

k) Health economics is included in Group 1402 Applied Economics.

l) demography is included in Group 1603 Demography.

m) Health policy is included in Group 1605 Policy and Administration.

n) Psychology, including biological psychology and sport and exercise psychology, is included in Group 1701 Psychology.

o) Neurocognitive patterns and neural networks are included in Group 1702 Cognitive Sciences.

p) Music therapy is included in Group 1904 Performing Arts and Creative Writing.

q) Human and animal bioethics and medical ethics are included in Group 2201 Applied Ethics.

r) History and philosophy of medicine is included in Group 2202 History and Philosophy of Specific Fields.


FoR Description Comments1101 Medical Biochemistry and

MetabolomicsNote: medicinal and biomolecular chemistry is included in 0304 Medicinal and Biomolecular Chemistry; Biochemistry of species other than human or non-agricultural plant and biochemistry not related to medicine or health are included in 0601 Biochemistry and Cell Biology; Biochemistry of agricultural plants is included in 0703 Crop and Pasture Production and 0706 Horticultural Production; Clinical chemistry and hormonal control of metabolism is included in 1103 Clinical Sciences; Nutrition and dietetics is included in 1111 Nutrition and Dietetics.

1102 Cardiovascular Medicine and Haematology

1103 Clinical Sciences Note: oral pathology is included in 1105 Dentistry.1104 Complementary and

Alternative Medicine1105 Dentistry1106 Human Movement and

Sports ScienceNote: sports nutrition is included in 1111 Nutrition and Dietetics; Human physiology unrelated to sport and exercise physiology is included in 1116 Medical Physiology; Sport and exercise psychology is included in 1701 Psychology.

1107 Immunology1108 Medical Microbiology Note: microbiology unrelated to human medicine is included in 0605

Microbiology; Microbiology related to veterinary practice is included in 0707 Veterinary Sciences; Clinical microbiology is included in 1103 Clinical Sciences.

1109 Neurosciences Note: psychiatry and psychotherapy are included in 1103 Clinical Sciences; Biological psychology is included in 1701 Psychology; Neurocognitive patterns and neural networks are included in 1702 Cognitive Sciences.Large overlap with Cognitive Sciences in the ERA Submission Journal List.

1110 Nursing Note: public health, including aged, disabled, family and residential client care, is included in 1117 Public Health and Health Services.

1111 Nutrition and Dietetics Note: nutritional content and balance of foods is included in 0908 Food Sciences; Metabolism is included in 1101 Medical Biochemistry and Metabolomics.

1112 Oncology and Carcinogenesis Includes cancer cell biology; cancer diagnosis; cancer therapy.

Note: medical genetics other than cancer genetics is included in 1103 Clinical Sciences; Tumour immunology is included in 1107 Immunology.

1113 Ophthalmology and Optometry

1114 Paediatrics and Reproductive Medicine

Includes assisted reproduction; foetal development and medicine; obstetrics and gynaecology.

Excludes Stem cells and tissue engineering are included in 1004 Medical Biotechnology.

1115 Pharmacology and Pharmaceutical Sciences

Note: medicinal chemistry is included in 0304 Medicinal and Biomolecular Chemistry; Pharmacology for veterinary use is included in 0707 Veterinary Sciences; Dental therapeutics, pharmacology and toxicology are included in 1105 Dentistry.

1116 Medical Physiology Note: basic animal physiology and comparative physiology are included in 0606 Physiology; Physiology related to specific aspects of plant or animal production or veterinary practice is included in the appropriate groups in Division 07 Agricultural and Veterinary Sciences; Exercise physiology is included in 1106 Human Movement and Sports Science; Nutritional physiology is included in 1111 Nutrition and Dietetics.

1117 Public Health and Health Services

1199 Other Medical and Health Sciences


12—Built Environment and DesignEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Management of parks in natural environments is included in Group 0502 Environmental Science and Management.

b) Agricultural land use and planning is included in Group 0701 Agriculture, Land and Farm Management.

c) Satellite, space vehicle and missile design are included in Group 0901 Aerospace Engineering.

d) Chemical engineering design is included in Group 0904 Chemical Engineering.

e) Civil engineering, including construction materials and transport engineering is included in Group 0905 Civil Engineering.

f) Environmental engineering design is included in Group 0907 Environmental Engineering.

g) Surveying is included in Group 0909 Geomatic Engineering.

h) Urban and regional studies other than planning are included in Group 1604 Human Geography.

i) Urban policy is included in Group 1605 Policy and Administration.

j) Fine arts are included in Group 1905 Visual Arts and Crafts.

FoR Description Comments1201 Architecture Note: construction and structural engineering are included in 0905 Civil

Engineering.1202 Building Note: civil engineering, including construction materials and engineering and

transport engineering is included in 0905 Civil Engineering; Surveying is included in 0909 Geomatic Engineering.

1203 Design Practice and Management

Includes design history and theory; ergonomics; industrial design; digital and interaction design; textile and fashion design; visual communication and graphics design.

1204 Engineering Design1205 Urban and Regional Planning Includes community planning; management and development of housing

markets; urban and regional analysis and development; transport planning; urban design.

1299 Other Built Environment and Design


13—EducationEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Economics of education are included in Group 1402 Applied Economics.

b) Education policy is included in Group 1605 Policy and Administration.

c) Sociology of education is included in Group 1608 Sociology.

d) Educational psychology is included in Group 1701 Psychology.

e) Educational linguistics is included in Group 2004 Linguistics.

f) History and philosophy of education is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments1301 Education Systems1302 Curriculum and Pedagogy1303 Specialist Studies in Education Includes educational issues related to specific ethnic groups; education

assessment and evaluation; educational technology; learning sciences; special education; teacher education and professional development of educators.

1399 Other Education


14—EconomicsEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Taxation accounting is included in Group 1501 Accounting, Auditing and Accountability.

b) Financial econometrics is included in Group 1502 Banking, Finance and Investment.

c) Economic geography is included in Group 1604 Human Geography.

d) Economic development policy is included in Group 1605 Policy and Administration.

e) Taxation law is included in Group 1801 Law.

f) History and philosophy of economics is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments1401 Economic Theory1402 Applied Economics1403 Econometrics Includes time-series analysis; cross-sectional analysis; panel data

analysis.1499 Other Economics Includes comparative economics systems; ecological economics;

heterodox economics.


15—Commerce, Management, Tourism and ServicesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Financial mathematics is included in Group 0102 Applied Mathematics.

b) Farm management, rural management and agribusiness are included in Group 0701 Agriculture, Land and Farm Management.

c) Non-business information systems are included in Group 0806 Information Systems.

d) Transport engineering is included in Group 0905 Civil Engineering.

e) Transport planning is included in Group 1205 Urban and Regional Planning.

f) The economics of taxation are included in Group 1402 Applied Economics.

g) Econometrics other than financial econometrics is included in Group 1403 Econometrics.

h) Private policing and security services are included in Group 1602 Criminology.

i) Demography is included in Group 1603 Demography.

j) Taxation law is included in Group 1801 Law.

k) Social impacts of marketing are included in Group 2001 Communication and Media Studies.

l) Cultural impacts of marketing are included in Group 2002 Cultural Studies.

m) Business ethics is included in Group 2201 Applied Ethics.

n) Business and labour history is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments1501 Accounting, Auditing and

AccountabilityNote: the economics of taxation are included in 1402 Applied Economics; Taxation law is included in 1801 Law.

1502 Banking, Finance and Investment

1503 Business and Management Includes business management; industrial relations; business information systems and information management; corporate governance; entrepreneurship; organisation and management theory.

1504 Commercial Services1505 Marketing Includes consumer-oriented product and service development; marketing

communications; marketing research methodology; marketing theory.1506 Tourism1507 Transportation and Freight

Services1599 Other Commerce,

Management, Tourism and Services


16—Studies in Human SocietyEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Forensic statistics is included in Group 0104 Statistics.

b) Forensic chemistry is included in Group 0399 Other Chemical Sciences.

c) Physical geography is included in Group 0406 Physical Geography and Environmental Geoscience.

d) Anthropological genetics is included in Group 0604 Genetics.

e) Forensic biology is included in Group 0699 Other Biological Sciences.

f) Health care administration is included in Group 1117 Public Health and Health Services.

g) Educational administration is included in Group 1303 Specialist Studies in Education.

h) Economics, including urban and regional economics, is included in Division 14 Economics.

i) Actuarial studies are included in Group 1502 Banking, Finance and Investment.

j) Forensic psychology is included in Group 1701 Psychology.

k) Law and society and criminal law are included in Group 1801 Law.

l) Language in society (sociolinguistics) is included in Group 2004 Linguistics.

m) Archaeology is included in Group 2101 Archaeology.

n) History and philosophy of science, technology and the social sciences are included in Group 2202 History and Philosophy of Specific Fields.

o) Social philosophy is included in Group 2203 Philosophy.

p) Religion and society is included in Group 2204 Religion and Religious Studies.

FoR Description Comments1601 Anthropology1602 Criminology1603 Demography1604 Human Geography1605 Policy and Administration1606 Political Science1607 Social Work1608 Sociology Includes social theory and change; race and ethnic relations; urban,

rural and environmental sociology; educational sociology.1699 Other Studies in Human Society Includes gender specific studies; studies of Asian society; studies of

Aboriginal and Torres Strait Islander society; studies of Maori society; studies of Pacific Peoples’ society.


17—Psychology and Cognitive SciencesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Artificial intelligence is included in Group 0801 Artificial Intelligence and Image Processing.

b) The application of psychology to computer-human interactions is included in Group 0806 Information Systems.

c) Psychiatry and psychotherapy is included in Group 1103 Clinical Sciences.

d) Neuroscience is included in Group 1109 Neurosciences.

e) Mental health is included in Group 1117 Public Health and Health Services.

f) Learning sciences are included in Group 1303 Specialist Studies in Education.

g) Criminology is included in Group 1602 Criminology.

h) Linguistics other than linguistic processes is included in Group 2004 Linguistics.

i) History and philosophy of the social sciences are included in Group 2202 History and Philosophy of Specific Fields.

j) Philosophical psychology and philosophy of cognition are included in Group 2203 Philosophy.

FoR Description Comments1701 Psychology1702 Cognitive Sciences A large overlap with Neurosciences in the ERA Submission Journal List.1799 Other Psychology and Cognitive

Sciences


18—Law and Legal StudiesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Criminology, including policing and correctional theory, is included in Group 1602 Criminology.

b) Legal ethics and human rights and justice issues are included in Group 2201 Applied Ethics.

c) History and philosophy of law and justice is included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments1801 Law Includes legal institutions; legal theory and practice; litigation,

adjudication and dispute resolution.1802 Maori Law1899 Other Law and Legal Studies


19—Studies in Creative Arts and WritingEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Computer software is included in Group 0803 Computer Software.

b) Communications technologies, including broadcasting systems, are included in Group 1005 Communications Technologies.

c) Computer hardware is included in Group 1006 Computer Hardware.

d) Design studies are included in Division 12 Built Environment and Design.

e) Communication and media studies are included in Group 2001 Communication and Media Studies.

f) Cultural studies, including screen and media culture, are included in Group 2002 Cultural Studies.

g) Literary studies are included in Group 2005 Literary Studies.

h) Curatorial and related studies are included in Group 2102 Curatorial and Related Studies.

i) History and philosophy of the humanities, other than art history, are included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments1901 Art Theory and Criticism1902 Film, Television and Digital Media1903 Journalism and Professional Writing1904 Performing Arts and Creative Writing Includes music and musicology; dance; creative writing; drama and

theatre studies.1905 Visual Arts and Crafts1999 Other Studies in Creative Arts and

Writing


20—Language, Communication and CultureEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Communications technologies are included in Group 1005 Communications Technologies.

b) Marketing and advertising, other than their social or cultural impacts, are included in Group 1505 Marketing.

c) Linguistic anthropology is included in Group 1601 Anthropology.

d) Linguistic processes are included in Group 1702 Cognitive Sciences.

e) Film, television, digital media, creative writing, professional writing and journalism are included in Division 19 Studies in Creative Arts and Writing.

f) Cultural conservation is included in Group 2102 Curatorial and Related Studies.

g) Biography is included in Group 2103 Historical Studies.

h) History and philosophy of the humanities are included in Group 2202 History and Philosophy of Specific Fields.

i) Philosophy of language is included in Group 2203 Philosophy.

FoR Description Comments2001 Communication and Media

StudiesNote: communications technologies are included in 1005 Communications Technologies; Marketing and advertising, other than their social or cultural impacts, are included in 1505 Marketing; Film, television and digital media are included in 1902 Film, Television and Digital Media; Journalism is included in 1903 Journalism and Professional Writing; Cultural studies, including screen and media studies and the cultural impacts of marketing and advertising, are included in 2002 Cultural Studies.

2002 Cultural Studies Note: marketing and advertising, other than their social or cultural impacts, are included in 1505 Marketing; Film, television and digital media are included in 1902 Film, Television and Digital Media; Intercultural communication and the social impacts of marketing and advertising are included in 2001 Communication and Media Studies; Language in culture is included in 2004 Linguistics; Cultural conservation is included in 2102 Curatorial and Related Studies.

2003 Language Studies Note: linguistics is included in 2004 Linguistics.2004 Linguistics Note: linguistic anthropology is included in 1601 Anthropology; Linguistic

processes are included in 1702 Cognitive Sciences; Language studies are included in 2003 Language Studies; Philosophy of language is included in 2203 Philosophy.

2005 Literary Studies Includes comparative literature studies; literary theory; stylistics and textual analysis.

2099 Other Language, Communication and Culture


21—History and ArchaeologyEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Librarianship is included in Group 0807 Library and Information Studies.

b) History of architecture is included in Group 1201 Architecture.

c) History of design is included in Group 1203 Design Practice and Management.

d) History of the built environment is included in Group 1205 Urban and Regional Planning.

e) Anthropology is included in Group 1601 Anthropology.

f) Art history is included in Group 1901 Art Theory and Criticism.

g) Cultural studies are included in Group 2002 Cultural Studies.

h) History of specific concepts or fields of study which defy geographical classification other than architecture, design, built environment and art are included in Group 2202 History and Philosophy of Specific Fields.

FoR Description Comments2101 Archaeology Note: anthropology is included in 1601 Anthropology.2102 Curatorial and Related Studies Note: librarianship is included in 0807 Library and Information Studies.2103 Historical Studies Note: art history is included in 1901 Art Theory and Criticism; History of

specific concepts or fields of study which defy geographical classification other than architecture, design, built environment and art are included in 2202 History and Philosophy of Specific Fields.

2199 Other History and Archaeology


22—Philosophy and Religious StudiesEnsure you are familiar with the six-digit codes beneath each four-digit classification.



a) Mathematical logic is included in Group 0101 Pure Mathematics.

b) Humane treatment of animals in agriculture, domestic or sporting environments is included in Group 0702 Animal Production.

c) History of architecture is included in Group 1201 Architecture.

d) History of design is included in Group 1203 Design Practice and Management.

e) History of the built environment is included in Group 1205 Urban and Regional Planning.

f) Political philosophy is included in Group 1606 Political Science.

g) Sociology and social studies of science and technology is included in Group 1608 Sociology.

h) Psychology of religion is included in Group 1701 Psychology.

i) Human rights law is included in Group 1801 Law.

j) Art history is included in Group 1901 Art Theory and Criticism.

k) Language studies are included in Group 2003 Language Studies.

l) Historical linguistics is included in Group 2004 Linguistics.

m) History of peoples, nations or geographic areas is included in Group 2103 Historical Studies.

FoR Description Comments2201 Applied Ethics Note: humane treatment of animals in agriculture, domestic or sporting

environments is included in 0702 Animal Production; Human rights law is included in 1801 Law; Ethical theory and environmental philosophy, including environmental ethics, is included in 2203 Philosophy.

2202 History and Philosophy of Specific Fields

Note: history of architecture is included in 1201 Architecture; History of design is included in 1203 Design Practice and Management; History of the built environment is included in 1205 Urban and Regional Planning; Sociology and social studies of science and technology is included in Group 1608 Sociology; Art history is included in 1901 Art Theory and Criticism; Historical linguistics is included in 2004 Linguistics; History of peoples, nations or geographic areas is included in 2103 Historical Studies.

2203 Philosophy Note: history of philosophy and the history and philosophy of specific fields of study are included in 2202 History Philosophy of Specific Fields.

2204 Religion and Religious Studies Note: psychology of religion is included in 1701 Psychology; Language studies are included in 2003 Language Studies; Philosophy of religion is included in 2203 Philosophy.

2299 Other Philosophy and Religious Studies


Appendix 8: Aboriginal and Torres Strait Islander StudiesThe ANZSRC provides alternative groupings to aid the understanding of research from different cultural perspectives which are unique to Australia and New Zealand. Six-digit codes relating to Aboriginal and Torres Strait Islander Studies are provided below together with the related four-digit code and Discipline Grouping.

FoR Description Comments050201 Aboriginal and Torres Strait Islander

Environmental KnowledgeDiscipline Grouping—EE05—Environmental Sciences0502—Environmental Sciences and Management

080601 Aboriginal and Torres Strait Islander Information and Knowledge Systems

Discipline Grouping—MIC08—Information and Computing Sciences0806—Information Systems

080701 Aboriginal and Torres Strait Islander Knowledge Management

Discipline Grouping—MIC08—Information and Computing Sciences0807—Library and Information Studies

110403 Traditional Aboriginal and Torres Strait Islander Medicine and Treatments

Discipline Grouping—MHS11—Medical and Health Sciences1104—Complementary and Alternative Medicine

111701 Aboriginal and Torres Strait Islander Health Discipline Grouping—MHS11—Medical and Health Sciences1117—Public Health and Health Services

130301 Aboriginal and Torres Strait Islander Education Discipline Grouping—EHS13—Education1303—Specialist Studies in Education

160501 Aboriginal and Torres Strait Islander Policy Discipline Grouping—EHS16—Studies in Human Society1605—Policy and Administration

169902 Studies of Aboriginal and Torres Strait Islander Society

Discipline Grouping—EHS16—Studies in Human Society1699—Other Studies in Human Society

180101 Aboriginal and Torres Strait Islander Law Discipline Grouping—HCA18—Law and Legal Studies1801—Law

190401 Aboriginal and Torres Strait Islander Performing Arts

Discipline Grouping—HCA19—Studies in Creative Arts and Writing1904—Performing Arts and Creative Writing

200201 Aboriginal and Torres Strait Islander Cultural Studies

Discipline Grouping—HCA20—Language, Communication and Culture2002—Cultural Studies

200319 Aboriginal and Torres Strait Islander Languages Discipline Grouping—HCA20—Language, Communication and Culture2004—Linguistics

200501 Aboriginal and Torres Strait Islander Literature Discipline Grouping—HCA20—Language, Communication and Culture2005—Literary Studies

210101 Aboriginal and Torres Strait Islander Archaeology

Discipline Grouping—HCA21—History and Archaeology2101—Archaeology

210301 Aboriginal and Torres Strait Islander History Discipline Grouping—HCA21—History and Archaeology2103—Historical Studies


Appendix 9: Eligible ERA InstitutionsInstitution AbbreviationAustralian Catholic University ACU

Batchelor Institute of Indigenous Tertiary Education BAT

Bond University BON

Central Queensland University CQU

Charles Darwin University CDU

Charles Sturt University CSU

Curtin University of Technology CUT

Deakin University DKN

Edith Cowan University ECU

Federation University Australia FED

Flinders University FLN

Griffith University GRF

James Cook University JCU

La Trobe University LTU

Macquarie University MQU

Monash University MON

Murdoch University MUR

Queensland University of Technology QUT

RMIT University RMT

Southern Cross University SCU

Swinburne University of Technology SWN

The Australian National University ANU

The University of Adelaide ADE

The University of Melbourne MEL

The University of New England UNE

The University of New South Wales NSW

The University of Newcastle NEW


Institution AbbreviationThe University of Notre Dame Australia NDA

The University of Queensland QLD

The University of Sydney SYD

The University of the Sunshine Coast USC

The University of Western Australia UWA

University of Canberra CAN

University of Divinity DIV

University of South Australia USA

University of Southern Queensland USQ

University of Tasmania (incorporating Australian Maritime College) TAS

University of Technology, Sydney UTS

University of Western Sydney UWS

University of Wollongong WOL

Victoria University VIC


Documents

archive.arc.gov.auarchive.arc.gov.au › Quantitative · Web viewAustralian Research Council ERA 2015 Evaluation HandbookPage 1 of 1. Australian Research Council . ERA 2015 . Evaluation