Thoughts on Conducting a Senior On-Hill Evaluation

Senior OET Evaluation Group

• Evaluation Team
  
  • Consists of 3 evaluators per group, one acting as a Lead Evaluator
  • All Evaluators must be current OET TE’s or Certified & Calibrated TEs in Ski/Ride or Toboggan.  Same should be true for Advocates & Proficient Toboggan Handlers
  •  Evaluators are positioned  to view candidates from different vantages (approach, passing, and moving away)
  • A shadow evaluator may be assigned – allow them the opportunity to comment and provide input but their score should not be considered in the final evaluation scoring.
• Lead Evaluator:
  
  • Manages the OET Evaluation Group and solves problems with IOR, QA & staff
  • Give clear and explicit instructions
  • Responds to any and all concerns from the Evaluation team, Candidates or QA.
• Advocates/Hill Captain
  
  • Interacts with the senior candidates and evaluation team
  • Hill Captain:  an Advocate at the top of the hill to maintain order, ensure safety and communicate with the evaluation team

• Communicate a plan: places to meet at the beginning of the day, at the end of each run, and in case you get separated.

• All tasks being evaluated (tobogganing, skiing, snowboarding) need to begin with good demos at the senior level.
• Demo should be redone if not presented at the senior level or if conditions change during the evaluation.
• Be sure that the candidates understand that the demo is the baseline. Performance at or above the demo is acceptable; below is not.

• Terrain must be appropriate to the task.
• Candidates should be comfortable with the terrain.
• This is a senior level evaluation and the terrain should not be too easy nor should it be too hard for the given task.
• Test day snow conditions and weather may influence terrain selection.
• Metrics are established and published for senior level tobogganing terrain.

• Ensure you are using the most current Scorecards found on CD webpage.
• Allow sufficient time to complete scoring for each line item in a section and make comments for feedback
• A score of 4 is at Senior Level with 5 & 6 above, and 1, 2, or 3 is below senior level.
• The candidate must achieve a passing score in each section of the scorecard to be successful. 
• If a candidate is unsuccessful in one section, they are permitted to retest in that section.  If a candidate is unsuccessful in more than one section, they are not permitted to retest those sections.
• At the conclusion of the evaluation, the evaluator totles the scores from each section.  There is a minimum score to pass for each section.  When determining the final score, a consensus score is determined for each section.  If two evaluators say a candidate passes and one fails, the result is a pass for that section.  The candidate must pass all sections of the score card to be successful in the evaluation.
• The candidate must be given a Composite Score Card with a composite score and actionable feedback to help the Senior Candidate grow regardless of results.

• Do not allow other individuals to tag along with the candidate or evaluation teams.
• Above all, integrity of the entire team must be maintained It is not appropriate to sell out your lead or fellow evaluators once the cards are turned in. Work out any differences before cards are turned in
• Be considerate of the other evaluation teams (terrain, toboggans, etc.).
• Be flexible and be able to adapt.
• Every member of the Evaluation Team is responsible for the safety of the candidates, staff and public.  Please be proactive in correcting possible issues before they occur.