2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

Embed Size (px)

Citation preview

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    1/25

    Online Assessmenttaming the Virtual Wild West

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    2/25

    Do your students cheat?Yup.

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    3/25

    Can you stop it?Nope.

    But you can do things to make it moredifficult for them.

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    4/25

    How bad is it?

    100%

    75%25%

    Less than 25%

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    5/25

    Cheating Trends

    Cheating increases with the age of thestudent at least through age 25

    -Cizek, 1999

    People who feel more "distant" cheatmore

    -George and Carlson, 1999; Burgoon et al, 2003

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    6/25

    Why Cheat?

    Competition and pressures for good grades

    Instructional situations that are perceived as unfair orexcessively demanding

    Faculty who are perceived as uncaring or indifferent to

    their own teaching or to their students' learning Lax attitudes on the part of faculty toward academic

    dishonesty

    Peer pressure to support a friend

    A diminishing sense of academic integrity and ethicalvalues among students.

    -Davis B.G., 1993

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    7/25

    3 Tiers of Defense

    Deterrence

    Detection

    Discipline

    http://images.google.com/imgres?imgurl=http://www.nasa.gov/images/content/52993main_radar.jpg&imgrefurl=http://www.nasa.gov/audience/forkids/home/F_Flying_Like_Ants.html&h=209&w=287&sz=79&tbnid=034outEobPsJ:&tbnh=80&tbnw=110&start=5&prev=/images%3Fq%3Dradar%2Bairplane%26hl%3Den%26lr%3D%26rls%3DRNWE,RNWE:2004-34,RNWE:en
  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    8/25

    Deterrence

    Define scholastic dishonesty upfront

    Institutional Honor Code

    Agreement not to cheat Proctored Exams

    Be aware of what students have access to

    Neat WebCT Tricks

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    9/25

    Scholastic Dishonesty Defined

    Scholastic dishonesty includes but is notlimited to cheating, plagiarism, collusion,the submission for credit of any work or

    materials that are attributable in whole orin part to another person, taking anexamination for another person, any actdesigned to give unfair advantage to a

    student or attempt to commit such acts.-Regents Rules and Regulations, Part One, Chapter VI, Section 3,Subsection 3.2, subdivision 3.22

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    10/25

    Institutional Honor Code

    Center for Academic Integrity

    http://www.academicintegrity.org/index.asphttp://www.academicintegrity.org/index.asphttp://www.academicintegrity.org/index.asp
  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    11/25

    Agreement Not to Cheat

    UT Permian Basin

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    12/25

    Proctored Exams

    Proctored Exam Information Page

    Proctored Exam Request Form

    Secure Exam Delivery System

    http://som.utdallas.edu/globalmba/gmba_proc_exam_info.htmhttp://som.utdallas.edu/globalmba/ExamForm.pdfhttp://conferencevideo/proctoreddatabase.rmhttp://conferencevideo/proctoreddatabase.rmhttp://som.utdallas.edu/globalmba/ExamForm.pdfhttp://som.utdallas.edu/globalmba/gmba_proc_exam_info.htm
  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    13/25

    Be Aware Of Whats Out There

    List of 225 Paper-mills from CostalCarolina University:

    http://www.coastal.edu/library/presentations/mills2.html

    http://www.coastal.edu/library/presentations/mills2.htmlhttp://www.coastal.edu/library/presentations/mills2.html
  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    14/25

    WebCT Tricks

    Test Banks

    Randomizing Questions

    Randomizing Answers

    Making the Test Unprintable One Question at a Time

    Time Limits

    Availability Password

    Controlled Release of Test Information

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    15/25

    WebCT Tricks

    Setting up a test

    Student view

    http://conferencevideo/test.rmhttp://conferencevideo/studentview.rmhttp://conferencevideo/studentview.rmhttp://conferencevideo/test.rm
  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    16/25

    Detection

    High-TechPlagiarism identifying programs

    -turnitin.com

    -Google

    Statistical tests?-Scrutiny!

    -Dr. Wesolowskis Software

    Compare answer patterns in WebCTHow long did the student take to complete the

    test?

    http://www.turnitin.com/http://www.google.com/http://www.assess.com/Software/scrutiny.htmhttp://www.business.mcmaster.ca/msis/profs/wesolo/wesolo.htmhttp://www.business.mcmaster.ca/msis/profs/wesolo/wesolo.htmhttp://www.assess.com/Software/scrutiny.htmhttp://www.google.com/http://www.turnitin.com/
  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    17/25

    Detection

    Low-Tech

    -Writing Sample

    -Oral quiz on material

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    18/25

    Discipline

    Be Consistent

    Follow established procedures onreporting the incident

    BE CAREFUL!

    http://www.utdallas.edu/student/slife/discipline.htmlhttp://www.utdallas.edu/student/slife/discipline.htmlhttp://www.utdallas.edu/student/slife/discipline.htmlhttp://www.utdallas.edu/student/slife/discipline.html
  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    19/25

    Scenarios

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    20/25

    What Can You Do?

    Problem: You suspect someone other thanthe student might take the test.

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    21/25

    What Can You Do?

    Problem: You suspect someone has a copyof the test.

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    22/25

    What Can You Do?

    Problem: The student has taken the test,but for some unbeknownst reason, youdid not receive it hmmm.

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    23/25

    Summary

    Cheating is widespread

    Combat Cheating with Deterrence,Detection, and Discipline

    Be vigilant!

  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    24/25

    References

    Burgoon, J., Stoner, G., Bonito, J., & Dunbar, N. (2003). Trust anddeception in mediated communication. Proc. 36th Hawaii Intl. Conf.on System Sciences, Honolulu, HI, 44-54.

    Cizek, G. J. (1999). Cheating on tests: how to do it, detect it, andprevent it. Mahwah, NJ: Lawrence Erlbaum.

    Davis, B.G, (1993). Tools for TeachingJossey-Bass Publishers: SanFrancisco

    Dick, M., Sheard, J., Bareiss, C., Carter, J., Joyce, D., Harding, T., &Laxer, C. (2003). Addressing student cheating: definitions andsolutions. ACM SIGCSE Bulletin, 35(2), 172-184

    George, J., & Carlson, J. (1999, January). Group support systemsand deceptive communication. 32nd Hawaii Intl. Conf. on SystemsSciences, 1038.

    McCabe, D.L. (1999). Center For Academic Integrity Study.Retrieved February 2, 2005 fromhttp://www.academicintegrity.org/cai_research.asp

    http://www.academicintegrity.org/cai_research.asphttp://www.academicintegrity.org/cai_research.asphttp://www.academicintegrity.org/cai_research.asp
  • 8/3/2019 2005 TXDLA Online Assessment ...Taming the Virtual Wild West Presentation)

    25/25

    Unprintable Quiz Codecopy and paste this as the upper text block of the quiz page

    BODY {display:none}

    var message="Function Disabled!";function clickIE() {if (document.all) {(message);return false;}}function clickNS(e) {if(document.layers||(document.getElementById&&!document.all)) {if (e.which==1||e.which==2||e.which==3) {(message);return false;}}}if (document.layers){document.captureEvents(Event.MOUSEDOWN);document.onmousedown=clickNS;}else{document.onmouseup=clickNS;document.oncontextmenu=clickIE;}document.oncontextmenu=new Function("return false")

    function disableselect(e){return false

    }function reEnable(){return true}document.onselectstart=new Function ("return false")if (window.sidebar){document.onmousedown=disableselectdocument.onclick=reEnable}