Dr. Terence Etchellst.a.etchells@ljmu.ac.uk

Computing and Mathematical Sciences

Liverpool John Moores University, UK.

Generating Online Assessment Questionswith

Derive and Perception

Important (Videos)

• In order that you can view the videos in this presentation you will need the TechSmith Video Codec that can be found at:

http://download.techsmith.com/tscc/tscc.exe

Alternately, you can find the tscc.exe on this CD. Simply

run the exe file from the CD or the internet download.

Where LJMU is!

Where LJMU is!

Where LJMU is!

Liverpool John Moores University

Liverpool John Moores University

My office

What is Perception?

• A Package for Delivering Assessments over the internet.

• Assessments can take many forms.

• e.g. multiple choice, text matching, numerical values.

What is Perception?

• A Package for Delivering Assessments over the internet.

• Assessments can take many forms.

• e.g. multiple choice, text matching, numerical values.

What is Perception?

• A Package for Delivering Assessments over the internet.

• Assessments can take many forms.

• e.g. multiple choice, text matching, numerical values.

What is Perception?

• A Package for Delivering Assessments over the internet.

• Assessments can take many forms.

• e.g. multiple choice, text matching, numerical values.

What is Perception?

• 4 Main parts to Perception

– Authoring the Questions– Constructing Assessments

• Selecting groups of questions

– Setting Schedules• dates, how many attempts, who?

– Reporting• What scores did they get.

What is Perception?

• 4 Main parts to Perception

– Authoring the Questions– Constructing Assessments

• Selecting groups of questions

– Setting Schedules• dates, how many attempts, who?

– Reporting• What scores did they get.

What is Perception?

• 4 Main parts to Perception

– Authoring the Questions– Constructing Assessments

• Selecting groups of questions

– Setting Schedules• dates, how many attempts, who?

– Reporting• What scores did they get.

What is Perception?

• 4 Main parts to Perception

– Authoring the Questions– Constructing Assessments

• Selecting groups of questions

– Setting Schedules• dates, how many attempts, who?

– Reporting• What scores did they get.

What is Perception?

• 4 Main parts to Perception

– Authoring the Questions– Constructing Assessments

• Selecting groups of questions

– Setting Schedules• dates, how many attempts, who?

– Reporting• What scores did students get.

What is Perception?

• The software is well developed and used all over the world in Education and Business.

• It is very secure.

• Detailed info on Perception can be found at http://www.questionmark.com

What is Perception?

• The software is well developed and used all over the world in Education and Business.

• It is very secure.

• Detailed info on Perception can be found at http://www.questionmark.com

What is Perception?

• The software is well developed and used all over the world in Education and Business.

• It is very secure.

• Detailed info on Perception can be found at http://www.questionmark.com

Why Use Perception?

• Large Classes, NO MARKING!

• Students can do assessments in their own rooms/home.

• Students can do assessments in their own time.

Why Use Perception?

• Large Classes, NO MARKING!

• Students can do assessments in their own rooms/home.

• Students can do assessments in their own time.

Why Use Perception?

• Large Classes, NO MARKING!

• Students can do assessments in their own rooms/home.

• Students can do assessments in their own time.

Why Use Perception?

• Large Classes, NO MARKING!

• Students can do assessments in their own rooms/home.

• Students can do assessments in their own time.

What are the pitfalls?

• Authoring the questions is VERY time consuming.

• Perception has Wizards for constructing the questions, but only one at a time.

• There are large databases to manage.

What are the pitfalls?

• Authoring the questions is VERY time consuming.

• Perception has Wizards for constructing the questions, but only one at a time.

• There are large databases to manage.

What are the pitfalls?

• Authoring the questions is VERY time consuming.

• Perception has Wizards for constructing the questions, but only one at a time.

• There are large databases to manage.

What are the pitfalls?

• Authoring the questions is VERY time consuming.

• Perception has Wizards for constructing the questions, but only one at a time.

• There are large databases to manage.

What are the pitfalls?

• There are many aspects of the software that need to be mastered.

• A steep learning curve.

• Servers can go down! No support at Midnight!

What are the pitfalls?

• There are many aspects of the software that need to be mastered.

• A steep learning curve.

• Servers can go down! No support at Midnight!

What are the pitfalls?

• There are many aspects of the software that need to be mastered.

• A steep learning curve.

• Servers can go down! No support at Midnight!

Overall

• Positives out way the Negatives.

• Students like the instant non judgemental (by a human) feedback.

• Students know their scores and can see their grades for all assessments attempted.

Overall

• Positives out way the Negatives.

• Students like the instant non judgemental (by a human) feedback.

• Students know their scores and can see their grades for all assessments attempted.

Overall

• Positives out way the Negatives.

• Students like the instant non judgemental (by a human) feedback.

• Students know their scores and can see their grades for all assessments attempted.

Overall

• Positives out way the Negatives.

• Students like the instant non Judgemental (by a human) feedback.

• Students know their scores and can see their grades for all assessments attempted.

What has this to do with Derive?

• For large classes there must be many different questions.

• Students network solutions if there are only a few questions.

• Must generate many copies of template questions with different values and solutions.

What has this to do with Derive?

• For large classes there must be many different questions.

• Students network solutions if there are only a few questions.

• Must generate many copies of template questions with different values and solutions.

What has this to do with Derive?

• For large classes there must be many different questions.

• Students network solutions if there are only a few questions.

• Must generate many copies of template questions with different values and solutions.

What has this to do with Derive?

• For large classes there must be many different questions.

• Students network solutions if there are only a few questions.

• Must generate many copies of template questions with different values and solutions.

What has this to do with Derive?

• It is possible with Derive that we can generate many different questions and solutions from a set template.

• However, interfacing Derive with Perception is not trivial .

• We must be inventive .

What has this to do with Derive?

• It is possible with Derive that we can generate many different questions and solutions from a set template.

• However, interfacing Derive with Perception is not trivial .

• We must be inventive .

What has this to do with Derive?

• It is possible with Derive that we can generate many different questions and solutions from a set template.

• However, interfacing Derive with Perception is not trivial .

• We must be inventive .

How Do We Connect?

• Perception Questions are written in a mark-up language, QML, which is text.

• Perception has wizards for producing questions in QML.

• QML can be imported in Perception Question Databases.

How Do We Connect?

• Perception Questions are written in a mark-up language, QML, which is text.

• Perception has wizards for producing questions in QML.

• QML can be imported in Perception Question Databases.

How Do We Connect?

• Perception Questions are written in a mark-up language, QML, which is text.

• Perception has wizards for producing questions in QML.

• QML can be imported in Perception Question Databases.

How Do We Connect?

• Perception Questions are written in a mark-up language, QML, which is text.

• Perception has wizards for producing questions in QML.

• QML can be imported in Perception Question Databases.

So what do we do?

• Create a Template Question with the Perception Wizard.

• Extract the QML text and place in a WORD document.

• Get Derive to generate random values and the solution for the question.

So what do we do?

• Create a Template Question with the Perception Wizard.

• Extract the QML text and place in a WORD document.

• Get Derive to generate random values and the solution for the question.

So what do we do?

• Create a Template Question with the Perception Wizard.

• Extract the QML text and place in a WORD document.

• Get Derive to generate random values and the solution for the question.

So what do we do?

• Create a Template Question with the Perception Wizard.

• Extract the QML text and place in a WORD document.

• Get Derive to generate random values and the solution for the question.

So what do we do?

• Use Word’s mail merge facility to merge the values into the template making hundreds of different versions of the same question.

• We must Program Derive to produce the values and the solutions.

• It is not possible to save our values and solution in a form that Word’s mail merge can work with.

So what do we do?

• Use Word’s mail merge facility to merge the values into the template making hundreds of different versions of the same question.

• We must Program Derive to produce the values and the solutions.

• It is not possible to save our values and solution in a form that Word’s mail merge can work with.

So what do we do?

• Use Word’s mail merge facility to merge the values into the template making hundreds of different versions of the same question.

• We must Program Derive to produce the values and the solutions.

• It is not possible to save our values and solution in a form that Word’s mail merge can work with.

A Simple Example

Expand the expression

(2x+1)(x+2)

What is the co-efficient of x?

Question Manager

• Perception has a program called Question Manager.

• We use this program to Author our questions.

• We will now Author our simple Question.

Question Manager

• Perception has a program called Question Manager.

• We use this program to Author our questions.

• We will now Author our simple Question.

Question Manager

• Perception has a program called Question Manager.

• We use this program to Author our questions.

• We will now Author our simple Question.

Question Manager

• Perception has a program called Question Manager.

• We use this program to Author our questions.

• We will now Author our simple Question.

Generating Parameters and Solutions

• We now have a template with the parameters a, b, c and d and an answer of 9999.

• We now turn to Derive to generate many instances of the parameters and their answer.

• A little programming is needed .

Generating Parameters and Solutions

• We now have a template with the parameters a, b, c and d and an answer of 9999.

• We now turn to Derive to generate many instances of the parameters and their answer.

• A little programming is needed .

Generating Parameters and Solutions

• We now have a template with the parameters a, b, c and d and an answer of 9999.

• We now turn to Derive to generate many instances of the parameters and their answer.

• A little programming is needed .

Generating Parameters and Solutions

• We now have a template with the parameters a, b, c and d and an answer of 9999.

• We now turn to Derive to generate many instances of the parameters and their answer.

• A little programming is needed .

Q1(n,counter,list,a,b,c,d,ans):=PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ))

Define the function

Q1(n,counter,list,a,b,c,d,ans):=PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ))

Open a PROG()

Q1(n,counter,list,a,b,c,d,ans):=PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ))

Define an empty list

Q1(n,counter,list,a,b,c,d,ans):=PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ))

Set a counter to 1

Q1(n,counter,list,a,b,c,d,ans):=PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ))

Open a LOOP()

Q1(n,counter,list,a,b,c,d,ans):=PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ))

Escape when done

Q1(n,counter,list,a,b,c,d,ans):=PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ))

Randomise the parameters

Q1(n,counter,list,a,b,c,d,ans):=PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ))

Determine the answer

Q1(n,counter,list,a,b,c,d,ans):=PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ))

Add the parameters and answer to the list

Q1(n,counter,list,a,b,c,d,ans):=PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 )) Progress the counter

by 1

Expand Example

• We will run the Derive program.

• Bring the results into Word + NotePad to Format and save the Merge File.

Expand Example

• We will run the Derive program.

• Bring the results into Word + NotePad to Format and save the Merge File.

Expand Example

• Merge the File with the QML template.

• Import the merged file into Perception.

• Test a question at random.

Expand Example

• Merge the File with the QML template.

• Import the merged file into Perception.

• Test a question at random.

Expand Example

• Merge the File with the QML template.

• Import the merged file into Perception.

• Test a question at random.

A more demanding Example

Approximate the integral

7

2

2 1

3 2

xdx

x

Correct to 5 decimal places.

A More Demanding Example

• Text will not adequately render mathematical expressions of this type.

• MathML is the Internet Mark Up language fro Mathematics.

• We can use MathType to create MathML.

A More Demanding Example

• Text will not adequately render mathematical expressions of this type.

• MathML is the Internet Mark Up language fro Mathematics.

• We can use MathType to create MathML.

A More Demanding Example

• Text will not adequately render mathematical expressions of this type.

• MathML is the Internet Mark Up language fro Mathematics.

• We can use MathType to create MathML.

A More Demanding Example

• Create the basic template

• Construct the MathML.

• Insert into Question Template

A More Demanding Example

• Create the basic template

• Construct the MathML.

• Insert into Question Template.

A More Demanding Example

• Create the basic template

• Construct the MathML.

• Insert into Question Template.

A More Demanding Example

• Now we program Derive to produce the parameters and the answers.

Round(x,n,ndec,n1dec,n1digit):=PROG( ndec:=FLOOR(10^n x), n1dec:=FLOOR(10^(n+1) x), n1digit:=n1dec-10 *ndec, IF(n1digit<5, ndec/10^n, (ndec+1)/10^n ))

Q2(n,counter,list,a,b,c,d,e,f,prec,ans):=PROG( counter:=1, list:=[ ], LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, e:=RANDOM(15)+3, f:=e+RANDOM(15)+3, prec:=random(5)+3, ans:=(a·d - b·c)·LN(c·e + d)/c^2 + (b·c - a·d)·LN(c·f + d)/c^2 + a·(f - e)/c, ans:=Round(ans,prec), list:=adjoin([counter,a,b,c,d,e,f,prec,ans],list), counter:+1 ))

A More Demanding Example

• Create Merge table as before.

• Merge into Template

A More Demanding Example

• Create Merge table as before.

• Merge into Template.

Perception Live

• For the next few weeks or so you can try some of the questions I have developed.

• http://perception.cms.livjm.ac.uk/q/open.dll

• Name: Guest

• Group: DES-TIME

Thank You

For Tony Peacock, former Principal North Bolton Sixth Form College, UK, died July 2006

Any ideas what this is???