Embed Size (px)
Citation preview
Academic Corpora to Enhance the Revision Process: The Google Alternative
Randall SadlerUlugbek Nurmukhamedov
For those who can’t stand the suspense!
Introductions (us) Intro of the study Definition Lit Review
– Error Correction– Corpus studies– Technology & Feedback
Participants Methodology
– Data Collection– Tools
Data Analysis Results Problems & Future Research
Introduction to the Research
Students making heavy use of Google in research……maybe too heavy?
Also heavy electronic and paper dictionary use
Using MS Word Spell Czech Also using Grammar Check—great for avoiding the
horrors of the passive sentences. …..so why don’t they all have perfect
grammar???
Definitions: Google Wildcard Search
GWS refers to the use of an * in a Google search Original term: The results are high significant GWS modified search: "The results are *
significant.” First 20 resulting hits:1. The results are statistically significant (13)2. The results are highly significant (3)3. The results are clinically significant (3)4. The results are marginally significant (1)5. The results are not statistically significant (1)
Participants
Large Midwestern U. Taking Graduate ESL Writing Course (level 2 of 4 possible)
Focus on “the use of academic writing conventions” Placement in course via TOEFL, EPT, and Diagnostic
Essay Variety of majors
– Mostly science, computers, etc.
2 Courses Parallel Curriculum & Assignments
– Control: 16– Experimental: 13
In lab at least once/week Last paper of the semester: Persuasive Essay on a topic
from their field of study
Methodology
1. Electronic versions of papers collected from each student.
2. Samples examined to determine most common error types.
3. All papers coded for error type by color.4. Researchers cross-checked coding, any differences
discussed and resolved.
Nouns Verbs Articles Prepositions
Adjectives Pronouns Adverbs General
Procedure: Control Group Intro to the Study/Human Subjects Forms (3 minutes) Discussion of the papers and markings (10 minutes)
– What do the colors mean? Sample paper & Key Handout Explanation of sections and subsections
Intro to the Online Resources (15 minutes)– Take ss. to online resources page: http://randallsadler.googlepages.com– Show them the various sections, and explain how they can use it with
samples.– Have students explore the Tools (10 minutes)
Practice (15 minutes)– Handout: What does the marking mean? (GIVE HANDOUT)– What to do when revising– Let’s work on the sample together
Demo CamStudio (10 minutes) Setup (10 minutes)---(GIVE HANDOUT “WHAT TO DO NOW”)
– Save a new draft of your paper on the desktop– Start Camstudio– Open your paper
Treatment (45 minutes)
Procedure: Experimental Group Intro to the Study/Human Subjects Forms (3 minutes) Discussion of the papers and markings (10 minutes)
– What do the colors mean? Sample paper Key Handout Explanation of sections and subsections
Intro to the Google Wildcard Searches (15 minutes)– Show sample Google Wildcard Searches– Explain How to use it. Give some sample phrases with errors– Have students explore the Tools (10 minutes)
Practice (15 minutes)– Handout: What does the marking mean? (GIVE HANDOUT)– What to do when revising– Let’s work on the sample together
Demo CamStudio (10 minutes) Setup (10 minutes)---(GIVE HANDOUT “WHAT TO DO NOW”)
– Save a new draft of your paper on the desktop– Start Camstudio– Open your paper
Treatment (45 minutes)
Data Analysis
Data Sources Pre-revision papers Post-revision papers Researcher observation of revision
process Movies of desktop showing revision
process Survey
Post-Treatment, items (original errors) coded:
+ or – change – was there some change made to the identified error
segment? + or – effective
– Was there an effective change (result in a grammatically correct item)?
+ or – expected– Was it an expected change?
Results
Control 16 students Total Sample: 7874 492 words per student
Error Total: 522Errors per student: 32.6
Experimental 13 students Total Sample: 6789 522 words per student
Error Total: 394 Errors per student: 30.3
Pre-Treatment Errors by Category
Adjective
s
Adverb
s
Articles
General
Nouns
Preposit
ions
Pronouns
Verbs
20
6
114
59
116
48
28
131
25
13
104
34
95
34
7
82
0
20
40
60
80
100
120
140
Experimental Control
Error Results by Percentage
31
25
64
99
911
2125
2422
2622
0 5 10 15 20 25 30
Adverbs
Pronouns
Adjectives
Prepositions
General
Verbs
Nouns
Articles
Experimental Control
Post-Treatment Changes
Control 91.9% of errors
changed (480/522) 380 out of 480 items
that WERE changed were effective 79.2%
Experimental 76.2% of errors
changed (275/361) 86.9% of changed
items were effective (239/275)
Changes by Category (%)
Adverbs
Pronouns
Adjectives
Prepositions
General
Verbs
Nouns
Articles
0 10 20 30 40 50 60 70 80 90 100
54
71
84
79
59
73
87
76
83
93
80
94
91
91
90
98
Control Experimental
% of changed and effective items
Adverbs
Pronouns
Adjectives
Prepositions
General
Verbs
Nouns
Articles
0 10 20 30 40 50 60 70 80 90 100
86
40
95
89
85
83
85
93
60
92
75
73
57
73
88
88
Control Experimental
