Survey Manager Information Forum

Melbourne, Day one28th June, 2012

Survey Manager Information Forum

Dr Noel EdgeExecutive Director

Noel EdgeExecutive Director

Survey Managers’ Information Forum (SMIF) 2012

2012 SMIF Program

Julie-Ann Pegden (Curtin)

2012 SMIF Program (cont’d)

Joanne Tyler (Monash)

Phil Aungles (DIISRTE)

Marian Thakur (TEQSA)

GCA News, Changes, etc, …Release of DIISRTE’s AQHE Report/AGS Review:

• Pivotal development for GCA (much more tomorrow!)• Key provisions:

• New instruments as from 2014 (AGS13 as per normal):• Centralised administration of three instruments:

• UES (revised = current UES + some CEQ?)• GOS (based on current GDS)• Employer Survey (based on GCA’s current GOS?)

• Stratified sample based instruments (but possibly hybrid…)• Online and phone instruments• Wide sector consultation• Earlier delivery of data• Possible longitudinal survey (= BGS ?)• Possible separate international onshore/offshore graduates

instrument• Tender for central administration body – end of 2012

AQHE Instruments Timetable

Jul-Dec 2012 Jan-Jun 2013 Jul-Dec 2013 Jan-Jun 2014 Jul-Dec 2014 Jan-Jun 2015

Instruments

UES Full scale trial deployment Full  survey Full survey

GOS Development Development Full survey Full survey Full survey Full survey

AGS October round April round

Administrators

New central body Establishment Establishment UES/GOS UES/GOS UES/GOS UES/GOS

GCA AGS AGS 

ACER UES    

AGS12AGS13? AGS14 (not proposed at this time, but …)

GCA News, Changes, etc, …Technology:

• New internal servers for increased reliability and data storage capacity/security

• New GCA website (including an integrated START site) – increased emphasis on GCA’s web presence with innovations in social media and web site traffic innovations

• CEQuery software – addressing technical limitations of CEQuery and planning improved functionality and data dictionary extensions

GCA News, Changes, etc, … (cont’d)

BGS – Beyond Graduation Survey

• Follow-up to the AGS conducted three years and five years after course completion

• 34 institutions participated in 2011

• Just completed the first 5 years out pilot survey

• Increased interest in the BGS:

• DIISR (ie before DIISRTE) – 7 and 9 year follow up of PhD graduates

• DFaHCSIA (Office of Women) – gender wage gap research

GCA News, Changes, etc, … (cont’d)

GOS – Graduate Outlook Survey

• Survey of graduate employers

• Addresses recruitment practices, intake numbers, perceptions of candidate quality, etc.

• More than 500 employers responded in 2011

• DIISRTE stole our GOS acronym and name! (see AQHE Report)

GCA News, Changes, etc, … (cont’d)

Austrade talks …

• Shanghai – career fairs:• 15 Australian universities • 45 graduate employers

• GCA introduced to chamber of commerce and alumni groups

• Possible site content sharing between Austrade and GCA

• Useful link for international graduate survey

GCA News, Changes, etc, … (cont’d)

Changing Focus, Priorities and Organisational Structure :

• Increase our engagement level with institutions (institution research, careers services, students, researchers, …)

• Increase our strategic initiatives an emphasis on strategy, policy and consultation

• Work closely with Higher Education decision makers in government (DIISRTE, TEQSA, …), Universities Australia and other university bodies, NAGCAS and employers to explore strategic directions in both GCA’s Research and Graduate Opportunities (GO) operations

• So some changes to our internal organisation structure …

Graduate Careers Australia Ltd

Exec.DirectorNoel E

GCA Board

Policy, Strategy and Stakeholder Relations Advisor

Bruce G

General ManagerGraeme B

CorporateServices

Graeme B (General Mgr)

•Info. Tech.•Acct’g/Legals•Web Strategies•Hum. Resources•Asset Mgt•Office Admin.

•Jo O•Isobel H

ResearchOperations

Darren M (Team Leader)

•Graeme B•David C•Jessica A•Nadine H

•Leena A•Lisa G

•AGS•CEQuery•BGS•GOS•Custom Jobs•Research Dev’t.

GOOperations

Chris M (Sales/Mkt Mgr)

•GO Sales•UGO Sales•Elec. Sales•Career Fairs•Sales Reporting

Advisory Role

Line Management

Co. SecretaryGraeme B

•Communications•Publications•Graphic Design

•Jo K•Hina K

GCACommunications

Tina H (Comms/Pub’n Mgr)

Survey Reference Group

Research Team

GraemeBruce David

Darren

Jessica

Nadine

Prof Joan Cooper – Convenor(University of New South Wales) * Tim Sealey (Universities Australia) Phil Aungles, Sam Pietsch, Chris Sainsbury (DEEWR/DIISRTE) Leone Nurbasari (Australian National University) Helen Jacob (Deakin University) David De Bellis (Flinders University) Prof Phillipa Pattison (University of Melbourne) * Prof Carole Kayrooz (University of Canberra) * Justine Fritsch (University of Southern Queensland) Tanya Tietze (University of the Sunshine Coast) Robert McCormack (University of Western Australia) Dr Noel Edge, Bruce Guthrie (GCA)

GCA’s Survey Reference Group (SRG) Members in 2011...

* UA nominee

More than 400 presentations over three days

Dashboards• IE reporting tool• Best practice

Response rates• Declining response rates to student surveys• All respondents to receive incentive• Personalise as much as possible

Carroll, D. 2011. An analysis of mode effects in the 2010 Course Experience Questionnaire. Journal of Institutional Research, 16 (2), 1–12.

  Abstract  Historically, responses to the Course Experience Questionnaire (CEQ) were required to be

collected by self-administered paper or online questionnaire to be eligible for official analysis. CEQ responses collected by telephone were excluded from the final analysis file to minimise the potential for bias due to mode effects: systematic variation in responses obtained using different data collection methods. For the 2010 CEQ, however, telephone data collection was permitted to maximise response rates, with responses collected in this manner included in the final analysis file for the first time. In all, nearly ten per cent of all valid responses to the 2010 CEQ were collected by telephone, with institutional use of telephone data collection ranging from 18 to 56 per cent of all responses received for that institution. Using regression and matching methods, this paper seeks to identify mode effects in the 2010 CEQ data that cannot be attributed to compositional differences between the telephone and self-administered respondent samples. Implications for survey practice are also discussed.

(cont’d)

Best Paper AAIR Conference 2011

The Careers Group – University of London WHAT LONDON GRADUATES do

The Careers Group – University of London (cont’d)WHAT LONDON GRADUATES do

The Careers Group – University of London (cont’d)WHAT LONDON GRADUATES do

The Careers Group – University of London (cont’d)Destinations Interactive

The Careers Group – University of London (cont’d)Destinations Interactive

Core 2011 AGS reports released (or soon to be):◦ Graduate Destinations◦ Graduate Salaries◦ Graduate Course Experience ◦ Postgraduate Destinations◦ Postgraduate Research Experience◦ AGS Report◦ GradStats and GradFiles

2011 SMIF – Melb

GCA’s centralised data collection service for private providers – 4 institutions

GCA’s telephone data collection service for universities – 4 institutions

AGS 2011 Highlights

Activities of bachelor degree graduates (n=68,205), males (n=26,112) and females (n=42,027), 2011 (%)

2011 Employment Results 1

25

Graduates available for full-time employment (n=44,176), males (n=17,671) and females (n=26,459) bachelor graduates, 2011 (%)

2011 Employment Results 2

26

2011 Graduate Starting Salaries (GSS)◦ All: $50,000 pa◦ Males: $52,000 pa◦ Females: $50,000 pa

2011 Salaries Results 1

27

CEQ mean percentage agreement by sex, 2011

2011 CEQ Results 2

28

2011 BGS Results 3

83.2

86.3

92.2

92.2

93.1

93.4

93.5

93.7

58.9

57.7

81.8

64.8

70.0

74.1

72.0

63.5

0 20 40 60 80 100

Technology

Initiative and enterprise

Learning

Planning and organising

Communication

Teamwork

Problem solving

Self-management

%

2008 2011

Self-rated employability skills, high/very high, bachelor degree graduates in full-time employment, by broad field of education, 2008 and 2011 (%)

29

2011 GOS Results 3

16.4%

26.2%

37.4%

58.9%

75.2%

71.0%

74.3%

93.9%

12.9%

14.7%

19.6%

20.2%

37.4%

57.1%

59.5%

73.6%

0% 20% 40% 60% 80% 100%

Other

Newspaper advertising

Other websites (e.g. Facebook, Linkedin)

Graduate recruitment handbooks

University careers fairs

Employment websites (e.g. SEEK, CareerOne)

University careers services

Your organisation's website

1-500 employees More than 500 employees

Methods used to promote graduate program, by organisation size, 2011 (%)

30

Graduate Opportunity (GO) Directories

31

50,000 copies distributed across 48 campuses –

Australia’s largest distribution

10,000+ students registered with GCA’s GO

at 2012 career fairs

Career Fairs

GCA works closely with University Career

Services staff

So … welcome All

Informal climate and an opportunity to meet other survey managers and GCA staff - swap tips, information, war stories, make suggestions, … and enjoy

2012 SMIF

questions?answerssuggestions…comments!

Cue Cards … coding tips, …