· Web viewby Dr. Bodin Jinda, Chiangmai ... Kirida joined the World Bank Bangkok Office in 1999 and is now a Senior Economist at the East Asia and Pacific Poverty Reduction

CULI’s 2013International Research Seminar

Assessment of English for the Professions:Insights from Research

Friday, November 8, 2013

Conference Room 202, Mahitaladhibesra BuildingChulalongkorn University

Organized by

Chulalongkorn University Language Institutein Collaboration with

TOEFL International Speaker Grant and

Research Affairs, Chulalongkorn UniversityTable of contents

CULI’s International Research Seminar Project 3Seminar program 5The Director’s Report 6The Opening Speech 8Keynote Speaker 9Plenary Speaker 10

Abstracts and Biodata Speakers 11

Abstracts and BiodataPoster presenters 13

Abstracts and BiodataHandouts 16Committee 20

Chulalongkorn University Language Institute

CULI Research Seminar 2013 2

International Research Seminar 2013Assessment of English for the Professions: Insights from Research

Friday, November 8, 2013Mahitaladhibesra Building, Chulalongkorn University

Bangkok, Thailand

1. Background and Rationale

Chulalongkorn University Language Institute (CULI) has long served a variety of important functions in English language education in Thailand. In addition to offering English courses, both general and specific, for undergraduate and graduate students, civil servants, and private organization staff, it works to advance and disseminate knowledge of teaching theory and practices in a variety of areas. English for the professions is one such area now particularly in demand by both full-time students and those already in the workforce. It is also an area that is likely to continue to grow in the future as Thailand approaches the ASEAN Economic Community (AEC) in 2015.

It is an undeniable fact that English language skills are a prerequisite for all graduates to be able to compete with their counterparts in the regional and global job markets. At the same time, business operators, administrators and teachers need some reliable measures informed by research for assessing language competency relevant to job demands in a variety of workplaces so as to strengthen the recruitment process. Last year, CULI’s International Research Seminar featured the theme “Researching English in the Workplace: Meeting the Needs of the ASEAN Economic Community (AEC),” and scholars gathered to discuss and share research information as well as exchange teaching ideas concerning English in the workplace. To build on the theme of last year, this year’s seminar will focus on the assessment of English for the professions. The main objective is to bring together language teachers, researchers, administrators and those working in various workplaces to discuss and share ideas regarding assessment practices and research for the professions.

This year’s seminar entitled “Assessment of English for the Professions: Insights from Research,” is also one of the academic activities to commemorate CULI’s 36 th anniversary and is partially funded by TOEFL International Speaker Grants and Research Affairs, Chulalongkorn University.

Objectives


1. To promote and disseminate research regarding English language assessment for different professions

2. To provide the opportunity for all participants to discuss and share ideas and experiences in assessment practices and research

3. To provide the opportunity for all participants to gain hands-on experience in how to assess English language for specific professions

4. To encourage networking among members of various interest groups

2. Participants1. ELT instructors, researchers and administrators from local and overseas institutions2. Postgraduate and Ph.D. students in ELT and related fields

The expected number of participants is 200.

4. Responsible organization Research Coordination and Dissemination Unit Research Department, Chulalongkorn University Language Institute

5. DateFriday, November 8, 2013, 8.00-16.00 hours

6. VenueMahitaladhibesra Building, Chulalongkorn University

7. Expected outcomes The participants will have the opportunity to:

1. broaden their views in language assessment for the professions.2. gain hands-on experience in how to assess English language for specific professions.3. share ideas and experiences in assessment practices and research.4. network with members of various interest groups.

Chulalongkorn University Language Institute


International Research Seminar 2013

Assessment of English for the Professions: Insights from Research

Friday, November 8, 2013Mahitaladhibesra Building, Chulalongkorn University

Bangkok, Thailand

Seminar Program

Friday, November 8, 20138.00-8.45 Registration8.45-9.00 Opening ceremony by Prof. Dr. Pirom Kamolratanakul, the President of Chulalongkorn University9.00-9.45 Keynote Speech: "Importance of Education and English in a Competitive World"

by Dr. Kirida Bhaopichitr, Senior Economist at the East Asia and Pacific Poverty Reduction and Economic Management Unit of the World Bank

9.45-10.45 Lecture 1: Designing Tests in ESP: From Needs to Assessment by Professor Dr. Dan Douglas, English Department, Iowa State

University, USA10.45-11.00 Break11.00-12.00 Lecture 2: Nobody seems to speak English here today: Authenticity in the context of Aviation English by Professor Dr. Dan Douglas12.00-13.30 Lunch 13.30-14.30 Lecture 3: Performance-based assessment for non-native English speaking nurses by Dr. Kornwipa Poonpon, Faculty of Humanities and Social Sciences, Khon Kaen University14.30- 14.45 Break14.45- 15.45 Lecture 4 : Multi-roles of language teachers in language assessment by Dr. Bodin Jinda, Chiangmai University

The seminar also features poster presentations.

The Director’s Report


At CULI’s Research Seminar onAssessment of English for the Professions: Insights from Research

Friday, November 8, 2013at

Mahitaladhibesra Building, Chulalongkorn UniversityBangkok, Thailand

_________________________________

President of Chulalongkorn University

Distinguished Guests

Colleagues and Participants

On behalf of Chulalongkorn University Language Institute, I am delighted to welcome you all to our 2013 Research Seminar on ‘Assessment of English for the Professions: Insights from Research.’

It has been officially announced that the ASEAN Economic Community or “AEC” will go into

effect in 2015. This competitive economic association will require professionals with excellent

English communication skills, creative and critical thinking, and a good understanding of how

language is used in different workplaces and professions by people of different cultures.

This situation makes it necessary for us as teachers and researchers to prepare our students with

the English skills necessary for various real-world professional settings. As a part of providing

them with high-level language and communication skills for the workplace, it is also important

that we rethink and re-evaluate our current teaching practices, including assessment of English

for the Professions.

Assessment involves identifying, gathering and interpreting information about students' learning

with the central purpose of providing feedback on student achievement and progress and to help

set the direction for ongoing teaching and learning.

The major goals of this seminar are, therefore, to promote and disseminate research regarding

assessment of English for the Professions, and to provide a forum for researchers and teachers to

discuss and share their research information experience and expertise in this area.


We are fortunate to have both Thai and international professionals and specialists to share with

us their knowledge, experience and research expertise. We feel confident that this event will be

of value for all of those participating as well as contribute to your own professional development

in English language teaching and research.

May I now invite Prof. Dr. Pirom Kamolratanakul, the President of Chulalongkorn University, to

declare the seminar open.

Thank you.

The Opening Speech

At CULI’s Research Seminar onAssessment of English for the Professions: Insights from Research


Friday, November 8, 2013At

Mahitaladhibesra Building, Chulalongkorn UniversityBangkok, Thailand

Madam Director

Distinguished Guests

Ladies and Gentlemen

It is my honor to be invited here today to open the Chulalongkorn University Language

Institute’s International Research Seminar 2013, entitled ‘Assessment of English for the

Professions: Insights from Research’.

We all know that the influence of English on the global stage has been increasing dramatically

for some time, but now it is becoming even more of a practical necessity as English will become

the working language of the ASEAN Economic Community. As a result, steps are now being

taken in Thailand to rethink and re-evaluate not only our current education policy and teaching

practices, but also our assessment of English skills.

Consequently, research on assessment of English for the professions needs to be supported and

developed to help prepare our young people for the future, and this seminar is one step we can

take to help. Here we can exchange ideas and experience on how to establish the understanding

necessary to ensure that consistency in assessment in English for professions can occur across all

key learning areas.

I hope this seminar will succeed in its goals and that all participants will obtain insights and

inspiration on the areas of assessment in English for the professions. And now, it’s my privilege

to declare this seminar open.

Keynote Speaker


Name: Kirida Bhaopichitr (Ms.)

Title: Senior Economist

Phone number: 02-686-8332

E-mail address: [email protected]

Biodata:Kirida joined the World Bank Bangkok Office in 1999 and is now a Senior Economist at the East Asia and Pacific Poverty Reduction and Economic Management Unit of the World Bank. She is the World Bank Country Economist for Thailand and is based in the World Bank Bangkok Office. Kirida spent 2010 at the World Bank Headquarters in Washington DC in which she worked on regional issues in East Asia as well as authored a paper on estimating the remittance trends in South Asia.

Kirida’s work on Thailand includes monitoring and assessing Thailand’s economic developments, the investment climate, competitiveness, and the reforms in the public sector. Kirida has been the main author of the World Bank’s bi-annual Thailand Economic Monitor (2003-present) and is now authoring a report on Services for Development in Thailand: Professional Services of Engineers and Architects. Kirida was also the main author of the macroeconomic impact assessment of the 2011 floods which is in the Ministry of Finance-World Bank’s Rapid Needs Assessments of the 2011 Floods in Thailand. Kirida also contributes to the East Asia Update, which is the World Bank’s bi-annual regional report on East Asia. In addition to Thailand, she has worked on Lao, Cambodia, and South Asia.

Kirida has been invited to speak at various high-level forums organized by both public and private organizations in Thailand and abroad. She has also taught at the Economics Department at Thammasat University. Kirida appears regularly in the Thai and English media, speaking on current economic issues in Thailand and the East Asia region, and is a recognized voice in the economic and business circles in Thailand.

Kirida earns her Ph.D. in Economics from Cornell University with a scholarship from the Anandhamahidol Foundation which is under the patronage of His Majesty the King of Thailand after finishing her bachelor degree in Economics with first class honors from Thammasat University. She has also received in 2010 the Rising Star Economist Award from the Thammasat Economics Alumni Association which is awarded to one economist each year.

Plenary Speaker

-----------------------------------------------------------------------------------------Professor Dr. Dan Douglas


Dan Douglas, Professor Emeritus at Iowa State University, has been working in applied linguistics and language assessment for some 35 years. His publications include Assessing Languages for Specific Purposes (Cambridge, 2000) and Understanding Language Testing (Routledge, 2010). He is currently President of the International Language Testing Association.--------------------------------------------------------------------------------------- This speaker is sponsored by TOEFL International Speaker Grants.

Lecture 1: Designing Tests in ESP: From Needs to Assessment

Abstract:

In this lecture, I will introduce the audience to the fundamentals of testing English for specific purposes, including What is ESP? What is a context? and Needs analysis. We will consider a practical example in the context of English for airline flight attendants.

Lecture 2: Nobody seems to speak English here today: Authenticity in the context of aviation English.

Abstract:

In this lecture, I will emphasize the quality of authenticity in specific purpose language tests and exemplify problems with authenticity with an extended example from the field of English for international civil aviation.

Speaker

--------------------------------------------------------------------------------------


Dr. Kornwipa Poonpon

Dr. Kornwipa Poonpon is a lecturer of English at Faculty of Humanities and Social Sciences, Khon Kaen University. She has been interested in doing research in second language assessment, teaching speaking and writing, corpus linguistics, and discourse analysis. Her recent publications include the ETS research report “Developing Analytic Rating Guides for TOEFL iBT® Integrated Speaking Tasks,” (co-authored with Jamieson in 2013) and the articles related to language complexity published in TESOL Quarterly (co-authored with Biber and Gray in 2011 and 2013).

--------------------------------------------------------------------------------------

Lecture 3: Performance-based assessment for non-native English speaking nurses

Abstract

Due to a strong need of communicative English language for medical purposes in

the Northeast of Thailand, a number of English training courses are designed and

provided to Thai medical staff to enhance their English communicative skills. However,

how effective these trained staff can use English to communicate in real-world situations

is still in doubt. To address this concern, a performance-based assessment is needed. This

presentation focuses on how to develop a performance-based assessment to assess

performances of Thai nurses, at a medical center in the Northeast of Thailand, when they

used English to communicate with foreign patients in patient-preparation situations. To

begin with, the presenter explains how to conduct a needs assessment to examine relevant

stakeholders’ needs about using English for medical purposes in the medical center. Then

three types of performance-based assessment—authentic speaking tests (with a rating

scale), an observation and a self-reflection—and how to develop them were illustrated.

How to validate the tests and measure test reliability is also described. Limitations of the

performance-based assessment will be discussed.

Speaker

-------------------------------------------------------------------------------------------


Dr. Bodin Jinda

Bordin Chinda is a lecturer at the English Department, Faculty of Humanities, Chiang Mai University. He obtained a PhD in language testing and assessment from the University of Nottingham, UK. His research interests include performance-based language assessment, innovations in language education, washback/ impact studies, professional development, qualitative research methodology, and action research.

Lecture 3: Multiple Roles of Teachers in Language Assessment

Abstract:

This paper reports the findings from different studies carried out in the

past 5 years at Chiang Mai University. These studies aimed to investigate the

changes of teachers’ reactions, including attitudes toward and practice in the

innovations in language assessment. From qualitative data, the findings indicate

that English language teachers at the University did not have adequate knowledge

in language testing and assessment resulting in some misconceptions, especially,

on their roles in performance-based assessment. However, with a professional

development programme, in which teachers were included in an assessment

development process, aiming to equip the teachers with basic understanding of

language testing and assessment, the practices in language testing and assessment

at the University were improved. The paper, therefore, proposes that in order to

improve the quality of the assessment, teachers should get involved in the

development process of the assessment as an in-service teacher development

programme.

Poster presenters

Dr Kantatip Sinhaneti


Dr Kantatip Sinhaneti won the Fulbright Open Competition to pursue an MA in TESOL at Michigan State University and received her PHD at U of Texas at Austin. Her experience includes teaching at CULI, SASIN and working with the international organization “SEAMEO”. Currently she serves as Adjunct professor in the Master of Education in Teaching English as an International Language program at SIU International University.

Digby Watson

Digby Watson is currently studying towards his Master’s in Education (Teaching English as an International Language) at Shinawatra International University in Bangkok, Thailand.

Research title: Demographics in authorship of articles published in a Thai journal

Abstract:

Journals are effective platforms for the exchange of ideas. In Thailand, English language teaching (ELT) journals have an important role to play in getting local research published and in introducing international ideas to a Thai audience. ELT research is an area that receives a lot of attention but, to date, there has never been an examination of the topics published in Thailand. This study aims to identify any changes in topics by examining all researched articles which had articles published in PASAA, Thailand’s oldest professional ELT journal, over three decades. By comparing the three decades, this study aims to determine if there had been any changes in the topics of the research that had been conducted. This study identified definite variations in the topics of articles researched reflecting the transformation of the ELT discipline over the past three decades. These results provide insights into a little explored aspect of academic research and can be used to determine trends in the topics of future research.

Poster presenter

-----------------------------------------------------------------------------------------


Assistant Professor Walaipun Puengpipattrakul

Walaipun Puengpipattrakul is currently an assistant professor of English at Chulalongkorn University Language Institute. The areas of her interest cover language learner literacy, learning motivation, second/foreign language acquisition, grammatical acquisition, and writing pedagogy.

Research title:

Authentic Writing Assessment as Academic and Professional Development

Abstract:

In Thailand’s higher education, authentic forms of writing assessment have not

been utilized much to measure L2 learners’ writing skills in classroom-based

writing pedagogy as expected. In this study, an authentic form of writing

assessment—journal entries—was employed. The study was designed to provide

L2 learners opportunities to reflect on their L2 learning by writing in English and

to develop their English-language writing skills, particularly in fluency of written

content and ideas. The results from the journal entries showed L2 learners some

learning strategies and those from the interview revealed their views on the use of

such authentic form. It is crucial for the English language teaching community to

take authentic forms of writing assessment into consideration as a practical tool to

encourage their professional development and motivate L2 learners’ academic

development.

Poster presenter

Mr. Phachara Saiphet


Mr. Phachara Saiphet got a B.Ed. degree in Secondary Education, English major from Chulalongkorn University. He finished his M.A. degree in English as an International Language (EIL) from Chulalongkorn University where he has gained knowledge of Language Assessment and Evaluation, Sociolinguistics and Language Instruction that are beneficial for his study.

Research title:

An Analysis of Item Bias in the English Ordinary National Educational Test (O-NET) for Grade 12 in the Academic Years 2008-2010

Abstract:

This research is a descriptive study which aims to analyze the item bias in the

twelfth-grade English O-NET in the Academic Years 2008-2010 classified by

genders. Four hundred subjects classified by genders who answered each item

correctly were randomly collected by the National Institute of Educational Testing

Service (NIETS). The level of item difficulty was calculated from the subjects. It

was discovered that four patterns of item bias appeared in the twelfth-grade

English O-NET in the Academic Years 2008-2010. Those patterns include the

items that appear to be preferable to women together with equally difficult, easy

and moderate for both men and women. However, it shows that gender bias

happens mostly in the twelfth-grade English O-NET, years 2009 and 2010

because most of the items in the twelfth-grade English O-NET, years 2009 and

2010 are more advantageous to women than men. Also, some items in the twelfth-

grade English O-NET, years 2009 and 2010 show that some items are difficult for

both genders. Nevertheless, the twelfth-grade English O-NET, year 2008 does not

indicate any bias because no item shows that neither men nor women perform

better. On the contrary, the twelfth-grade English O-NET, year 2008 shows that it

contains various types of item including not only the difficult and easy items but

the moderate items for both genders.


Handouts

Lecture 1 (9:45-10:45)

Designing Tests in ESP: From Needs to Assessment


Dan DouglasIowa State University

• What is ESP?– English taught/learned in a social / situational context, usually educational,

vocational, or professional• What is a context?

– SPPCTLNG! • Needs Analysis

– Sources of data• Domain experts• Documents• Learners• Applied Linguists/Language Teachers

– Methods of data collection• Interview• Questionnaire• Language Audit• Observations• Text Analysis• Ethnographic study• Journals/Logs

Example: Flight Attendants EnglishSettingParticipantsPurposeContentToneLanguageNormsGenre

Lecture 2 (11:00-12:00)


Nobody seems to speak English here today: Authenticity in the context of aviation English

Dan DouglasIowa State University

What is Authenticity?

o A property of the response language users make to spoken and written texts

Genuine - Authentic o A spoken or written text produced in a communicative context is both genuine

and authentico A text removed from its original context is still genuine but not authentic

Contextual features that promote authenticityo Settingo Participantso Purposeo Contento Toneo Languageo Normso Genreo

Phraseology and Plain Languageo Phraseology: Standardized language forms used in routine pilot/controller

communicationo Plain Language: Departure from Phraseology, usually in non-routine situations

International Civil Aviation Organization (ICAO)

o …radiotelephony communications shall be conducted either in the language of the station on the ground or in English, and… English shall be made available when pilots are unable to use the language of the station on the ground

ICAO Rating Scale


Chuck Yeager Syndromeo Preference for plain language over prescribed phraseologyo Lack of accommodation for L2 speakers of English

ICAO tests only non-native English speaking pilots and ATCOs

This reduces authenticityo Features of Authenticity

Participants: including English L1 speakers Tone: Speakers’ attitudes Norms of Interaction: Behavioral expectations

Aviation English as a Lingua Francao Any lingual medium of communication between people of different mother

tongues, for whom it is a second languageo What is critical is not so much mastery of the English language...but also

interactional competence

Interactional Competenceo Ability to tolerate and comprehend different varieties of English o Ability to negotiate meaningo Ability to use (or adjust) phonological features crucial for intelligibilityo Awareness of appropriate pragmaticso Ability to accommodateo Ability to notice and repair breakdowns in communicationo Ability to use background knowledge in communication


Advisory Committee

Kulaporn Hiranburana DirectorJaroon Gainey Deputy Director for Administration and

PlanningChalatip Chanchairerk Deputy Director for Academic AffairsSatita Watanapokakul Deputy Director for International Affairs Ong-orn Thananart Deputy Director for Academic Services and

Professional DevelopmentSupanee Chinnawongs

Organizing Committee

Prakaikaew Opanon-Amata ChairWorawanna Petchkij Deputy Chair Walaipun Puengpipattrakul MemberPramarn Subphadoongchone MemberKandaporn Jaroenkitboworn MemberMattanee Palungtepin MemberJirada Wudthayagorn MemberChutchada Twichatwitayakul Member and SecretaryTanapan Panthong Member and Assistant Secretary

Sub-Committee

Parima Kampookaew Welcoming, Master of Ceremonyand Public Relations

Worawanna Petchkij Conference DocumentsChutchada Twichatwitayakul Registration & CateringWichian Koedphum Conference VenueKomson Eiamjamrus Audio – VisualsMontri Pukcharoen Graphic ArtNapaswan Thongprasan Photography
