DI Score Room Appraiser Training 2015

Your Name Here

Score Room Masters

Useful email addressesYour Email Here

Cell Phone NumbersYour Cell Phones Here

Important Websites

Destination Imagination http://www.destinationimagination.org/

Your Region Destination Imagination http://your.region.org

Score Site http://discoring.texasdi.org

DI Appraiser Basics

http://www.diuniversity.org

Overview of the Training

2015 Challenges

Score Room Mission

Paperwork Flow

Scoring Considerations

Individual Jobs for Score Room

Handling Problems

Final Thoughts

2015 Challenges

Technical Challenge:Creature Feature

Scientific Challenge:Making Waves

Fine Arts Challenge:Feary Tales

Improvisational Challenge:The Improv Games

Structural Challenge:Lose to Win

Early Learning Challenge:Animal Mish Mash

Service Learning Challenge:Brandaid

Example Challenges & Colors

• A: Creature Feature (Creature) Orange/Salmon• B: Making Waves (Waves) Yellow• C: Feary Tales (Feary)   Blue• D: The Improve Games (Improv) Pink/Red• E: Lose to Win (L2Win) Green• PO: BrandAid (Brand) Grey• IC     Purple• Score room   Black• Animal Mish Mash (Animal)   White

We like to color code everything for easy sorting. Consult your RD/AD for their choice of colors!

General Procedures When? Report to Score Room by 9:00

Leave time for Breakfast and Sign in before this We’ll be working until about 5:30 (we hope!)

Access to the room is limited Not a place for visiting or hanging out

All paperwork is logged in and out of the room

Refer anything unusual to the room leaders This allows everyone else to continue processing

the “normal” scores, keeping the flow going

Add to the bottom, take from the top This keeps paperwork flowing in time order

Primary Mission The primary Mission of a DI Score Room is to provide the

announcer at the conclusion of a tournament with an accurate list of place finishes for the teams that competed at that tournament.

Help keep the tournament running smoothly

Get everyone home at a reasonable hour Goal: All scores Complete 1 hr before the award ceremony

Accuracy

Efficiency

Timeliness

Score Room Mission Accuracy is foremost.

Procedures result in all scoring operations being done twice by independent people.

These two people must agree on the resulting computation.

If in doubt ask your CM or send back to appraiser to correct

Never erase a score Initial ALL changes

Score Room Mission

Efficiency is defined as computing the final scores by the time that the Tournament Director expects them to be done.

Typically final scores are available about an hour or less after the last team performance.

• Efficiency is secondary to Accuracy.

Score Room Mission

• Timeliness Process paperwork ASAP Don’t Hold on to Packets! Process Packets in order (first

in first out) Process and move on to the

next step, then file! Have everything completed

well before the scheduled awards ceremony

Individual Responsibilities

Appraiser – Site, not score room personnel

Appraisal Team Organizer- Site

Score checkers

Computer operators

Score runner

Gate keeper

Paperwork Manager

Score Room Challenge Masters

Paperwork Flow - Central

AppraisersAppraisers

AppraisersAppraisers

Appraisers

Appraisal Team

Organizer

Gate Keeper

Head Appraiser

Team Manager

Checker (optional)

Paper Work Manager File Manager

Challenge Sites

Score Room

Data Entry 1 Data Entry 2

Results TM, HA

Logs allTime(s) In

Time(s) Out

Final Score

storage area

Runner

Paperwork Flow - HybridAppraisers

AppraisersAppraisers

AppraisersAppraisers

Appraisal Team

Organizer

Checker (optional)

Gate Keeper

Head Appraiser

Team Manager

Checker (optional)

Paper Work Manager File Manager

Challenge Sites

Score Room

Data Entry 1

Data Entry 2

Runner

HA & TM Copy

Logs allTime(s) In

Time(s) Out

Final Score

storage area

Network or USB Flash Drive electronic check

Central Score Room Sample Layout

Gate KeeperScore Room

Data Entry 1 Data Entry 2

Final Score

storage area

Check In

Checker

(optional)

Data Entry 1 Data Entry 2

Data Entry 1 Data Entry 2

Tournament Master

Printer / Copier

Paper Flow

Check and Backup

Backup

Scoring Guidelines Objective - Non-averaged

scores 0, 5, 10, 15 all appraisers agree

Subjective - Averaged scores USS Appraiser ranges 1-30 will vary between

appraisers Rounding – Score program

does this for us 2 digits to right of decimal

.666 > .67 and .333 > .33

Zero Score if element is not present all appraisers scoring that element

must agree it was not there

Deductions all appraisers must agree % of the points earned reason(s) must be noted Deduction Worksheet with

highlighted entry

Appraiser

Complete the Appraiser Score Sheet

Must complete all assigned items and no more!

Must be legible

Must agree on all deductions, zero scores or non averaged scores (0, 5, 10, 15)

Appraisal Team Organizer

Collect Appraiser forms, envelope and all paperwork from the team.

Check for legibility and any missing items

Place all paperwork in envelope, give to runner to deliver to checker & Computer Operator

Receive Head Appraiser and Team copies from computer operator - log times in for Head Appraiser.

Log times when team has received their copy

Making up the Score Packet

Team label on the upper left corner of envelope Please put the papers in this order

Deductions worksheet if there is a Deduction Weigh-in (Check In) sheet (Challenge E Only) Appraisers sheets

In Order (Alpha or Numeric)

Prep area sheet Everything else last Small Envelope with Award Certificates

Team manager Copy of scores also goes in when complete

Stickies on the special stickies sheet stay at the appraisal site to give back to Team manager with team scores

ONLY positive comments! Trash inappropriate ones…

LabelStatus Dots

Score Checkers Check incoming score sheets for completeness &

legibility

Check Weight held calculation (Challenge E) Not needed for 2015!

Write initials next to calculation

Check order of paperwork Deduction Work sheet

Weigh-in Sheet (Challenge E)

Appraiser sheets (in order)

Prep Area sheet

extra material last

Pass to Computer Operators.

Score Checker

Ensure Legibility

Common Errors

Subjective vs Objective Objective all must agree

Range

Deductions

Checking Scores

Never have two team’s paperwork out in your work area at once! If your Head Appraiser needs you to look at

something, put the current team’s paper away!

After checking, please put the score sheets in the order that they appear on the printed Appraiser Assignment sheet form before sending to score room.

Score Runners

Very Important Job!

Introduce yourself to Head Appraiser, Appraisal Team Organizer and Gate Keeper

Pick up completed score packets from competition sites Team challenges

Instant challenges

Deliver score packets to score room check-in

Make scheduled runs

Computer Operators - Central Will use provided Computers & Printers

Computer Proficiency very helpful! Importance of accuracy in typing numbers 1st Entry Operators

Enter scores from appraiser sheets Place all remaining paperwork in team envelope

and pass to 2nd entry computer operator 2nd Entry Operators

Re-enter scores from appraiser sheets Check is automatically done when saved

Occasionally enter bad data to verify check

Print 1 Team, 1 Head Appraiser and 1 Score Room Copy

Score Room Copy into envelope Team and HA copies get returned to site in folder

Can download program and be familiar with it http://discoring.texasdi.org/

Computer Operators - Site Will use provided Computers & Printers Computer Proficiency very helpful! Importance of accuracy in typing numbers 1st Entry Operators

Enter scores from appraiser sheets Place all remaining paperwork in Large envelope Print 1 Team, 1 Head Appraiser and 1 Score Room

Copy Score Room Copy into Large envelope Team and HA copies go in small envelope for HA

Send Large Envelope to Score room for 2nd entry computer operator

2nd Entry Operators Re-enter scores from appraiser sheets Check is automatically done when saved

Occasionally enter bad data to verify check Print Score Room Copy – Put in Envelope

Can download program and be familiar with it http://discoring.texasdi.org/

Gate Keeper / Check In

Accept all incoming packets Using Check In Computers and Program

Log in and out times on IC/TC

Log out paperwork leaving score room for questions

Do not let unauthorized individuals in score room

Paperwork Manager

Pick up incoming folders from gatekeeper and transfer to the correct computer operator

Pick up completed folders from Computer Operators

Deliver HA and Team score printouts to return folder

File folders in appropriate boxes by challenge and update checklist

If scores are pulled after filing, hand walk the returned envelope to computer operators and identify actions needed

Score Room Challenge Master

Knowledge of

the challenges

scoring program

how calculations are done

all score room jobs

Recruit and train

appraisal team organizers

score room personnel

There to help with any questions or issues

How to Handle Issues

Talk with your score room leader

Mark team with an Issue in the program Enter explanation in Modify Team dialog box

Print Appraiser Feedback form or use “yellow sticky” to describe issue

Put all paperwork in the package

Put on a red sticker

Log team red in the Check-In program

Return to team challenge room for correction

Processing Issues (cont.)

When a red sticker packet comes back in Log it in Goes to head of the queue for the first

computer It is an older packet than those we’re processing

Could be from A change we requested

A change the Head Appraiser is requesting Partially cover green sticker with red

Sticker Management

Good packet after 1st entry – put a green sticker on packet

MJAGood packet after 2nd entry and check –

initial green sticker – Send to File

Bad packet during 2nd entry – add red sticker – return for problem resolution

Problem resolved and re-run through 1st entry – add a green sticker

Good packet after 2nd entry and check – initial green sticker – Send to fileMJA

Bad packet during 1st entry – put a red sticker on packet – return for problem resolution

Practice

Some people will not be doing data entry

Everyone should be familiar with the scoring program

In case of illness, etc.

If you haven’t used it before, please download it and practice

http://discoring.texasdi.org

Scoring Goals Ensure that every team gets the full credit they

deserve for their challenge solution

And only the credit they deserve

Turn scores around promptly

Allows team managers to review them

Maintain the confidentiality of the scores

Never leave your paperwork unattended

Let everyone get home at a reasonable hour

Have fun in the process

QUESTIONS!

Ask and we’ll see if we can answer.

Computer Entry Demo

Tournament Summary Window

Scoreboard for the tournament number of teams number whose

scores are incomplete

when they should finish

when the scores were printed

Drill down to a challenge level

Drilling Down to Enter Scores

List of teams in a challenge level performance

time status

being scored?

TC done? IC Done?

Entering Scores

Data entry of all appraisers’ scores

Computer verifies ranges

Verifies appraiser agreement for objective scores

Computer calculates it all

Computer scales the final results and prints them

Error Checking

Entering Item-Specific Deductions

Click on “OK” to close the deduction dialog box

• Click on the square checkbox to the left of the item’s title

• Fill in the deduction value and the reason

• Note that deductions can be a percent of the awarded score (not the max score!)

Entering “Other” Deductions

Deductions are not normally editable as a safety measure.

To enable:

Right click in the score area

Select “Modify Deductions”

Or, “Alt-D” for you keyboard types

All deductions MUST have a reason

Entered in the second computer

All Challenge Level Window a VERY useful tool!

Use with Quick Search!

Issues Form (Modify Team dialog)

… for your time.

… for your service.

… for your generosity.

… for all you do.