Proposal in Detail – Part 2

Project Aim, Objectives, Evaluation Criteria, Deliverables, Technical and Non-Technical Resources Required

Project Aim

Reminder

Project Aim

This is the “thesis” of the project Consider using Bloom’s Taxonomy

Verbs in stating your aim. e.g. “This research will measure how

Web 2.0 tools can improve collaboration and knowledge sharing”

Bloom’s Taxonomy

Bloom, B.S. (Ed.) (1956) Taxonomy of educational objectives

Bloom, B.S. (Ed.) (1956) Taxonomy of educational objectives

Bloom’s Taxonomy

•Evaluation: appraise, argue, assess, attach, choose, compare, defend, estimate, judge, predict, rate, score, select, support, value

•Synthesis: arrange, assemble, collect, compose, construct, create, design, develop, formulate, manage, organize, plan, prepare

•Analysis: analyze, appraise, calculate, categorize, compare, contrast, criticize, differentiate, discriminate, distinguish, examine

•Application: apply, choose, demonstrate, dramatize, employ, illustrate, interpret, operate, practice, schedule, sketch, solve, use

•Comprehension: classify, describe, discuss, explain, express, identify, indicate, locate, recognize, report, restate, review

•Knowledge: arrange, define, duplicate, label, list, memorize, name, order, recognize, relate, recall, repeat, reproduce state

Project Aim

Project Aim

Complete the following sentences:

“The aim of this project is to ...”

“This will be done by ...”

“It will be evaluated by ...”

Project Objectives

Reminder

Project Objectives

Typically between 4 and 7 objectives The objectives are the milestones in

reaching your project aim.

Project Objectives

Suggested objectives Review appropriate research Identify interesting approaches Identify a range of opinions Design the experiment Execute the experiment Analyze the results

Project Objectives

Project Objectives

These are generic objectives, create ones that are specific to your project: Review appropriate research Identify interesting approaches Identify a range of opinions Design the experiment Execute the experiment Analyze the results

Evaluation Criteria

Reminder

Evaluation Criteria

About half a page for this section

How you intend to implement and evaluate your research?

What methods are you going to use, both quantitative and qualitative?

Evaluation Criteria

How have other researchers who have done similar projects in the past evaluated their projects?

Is there a standard model, framework, or instrument to be used?

Evaluation Criteria

Can you find a formal framework for assessing the outcome the a previous project has already used?

Use standards? IEEE 829 Standard for Software Test

Documentation. ISO 9126 and ISO 14598 (which are

standards on software evaluation)

Evaluation Criteria

Suggested criteria The suitability of the design The suitability of the experiment The suitability of the evaluation

Evaluation Criteria

How do you evaluate the project? How effective were the methods?

Did the combination of quantitative and qualitative techniques match the research?

How effective were the tools you used? Did the tools prove to be suitable?

How effective were they at measuring your research question? Did the tools accurately model the research

question?

Evaluation Criteria

Evaluation Criteria

If you haven’t checked yet, explore the literature, and find out how these type of projects are evaluated. Google and GoogleScholar things like: “Project topic” evaluation “Project topic” metrics “Project topic” standards “Project topic” ISO “Project topic” framework

Evaluation Criteria

Write down two criteria under each of the following headings: The suitability of the design The suitability of the experiment The suitability of the evaluation

Also, remember that measurements like: Area under the Curve Misclassification Error Confusion Matrix N-fold Cross Validation ROC Graph Log-Loss and Hinge-Loss

Evaluation Criteria

...are good for evaluating the analysis, so they are good for checking how good the model is based on the dataset, and are definitely part of the evaluation, but if you want to discuss the findings with respect to the real-world (and to the research question) you must do the following:

Test predictions using the real-world

Evaluation Criteria

Deliverables

Reminder

Deliverables

Generic deliverables: Literature Review Dissertation Document Software Survey results on CD etc.

Deliverables

Deliverables

These are generic deliverables, create ones that are specific to your project Literature Review Dissertation Document Software Survey results on CD etc.

Technical and Non-Technical Resources Required

Reminder

Technical and Non-Technical Resources Required

Access to people

PC / Laptop / PDA / etc.

Software Libraries

Technical and Non-Technical Resources Required

Technical and Non-Technical Resources Required

Over to you...

Access to people

PC / Laptop / PDA / etc.

Software Libraries