合格Instructor Guide

Plan your student peer assessments

As with any learning activity, how these assignments are introduced, designed, and integrated in courses impacts the student experience with ComPAIR. UBC internal studies so far have surfaced a few recommendations to consider in your planning.

• Clearly explain the learning objective(s): Students who understand what underlying skills they are practicing in the application feel they learn more from the assignments. It is important to explain the end goal of using ComPAIR—how comparing will concretely help learning—not only how the process works. As a starting point, download the modifiabletemplate for introducing ComPAIR to studentsthat UBC instructors have created.
• Build on ComPAIR assignments：当作为更大进程的一部分呈现时，Compair的作业对学生更有益。在更大的课程目标的背景下使用对同行评审的合格（例如，准备撰写后期纸张，评估早期项目草案），而不是独立任务或“繁忙的工作”。
• Provide a low-stakes training round: Students feel more confident when no- or low-stakes practice with comparing answer pairs happens prior to graded assignments in ComPAIR, especially when the practice includes review of how they've done the comparisons.
• Use multiple, detailed criteria for comparisons：学生提供更多指导说他们从比较中了解更多信息，特别是当作业更复杂时。在比较期间，在比较期间，在比较和/或提前提供的详细外部标准中的多个描述性标准来解释 - 可能导致更强大的学习和可能更丰富的反馈。
• 每个分配需要3+比较: Despite low reported confidence giving peer feedback, many students report they learn simply from practicing this skill with answer pairs. A minimum of three comparisons per student (i.e., each student reviews six peer works) is suggested to give students repeated practice to learn from.
• Assess the quality of peer feedback: Adding weight of some kind to the peer feedback students write has helped instructors increase the quality of feedback given. Assigning marks creates additional accountability for students and increases their buy-in to the process.

Develop your student peer assessment criteria

In ComPAIR, one or more custom criteria can be used to guide students' comparison of the answer pairs. Each criterion must pose a question answered by choosing between the answers (e.g., Which is better?).

To develop criteria, start with the course learning outcomes and think about how seeing other work will help students get there—what can students learn from each other? Keep in mind how experienced students in the course will be, and use criteria at a difficulty level the majority will be able to understand. UBC instructors generally stick with between 1-6 total criteria, and some advise using an odd number to discourage students from selecting a “tie” between answers.

Consider also if the goal is more summative (critically looking at final work) or formative (constructively looking at drafted work). Harder, more complex, and longer criteria may be better for summative uses. Softer, more straightforward, and shorter criteria may be better for formative uses.

Decide on the timing of your assignment phases

You will need to decide how many ComPAIR assignments you will give in the course as well as the timing for each phase of the assignment: answering, comparing, and (optionally) self-evaluating. By default, comparing begins after answering ends, though these may be designed to overlap. However, keeping the phases separate allows students to complete their evaluations without delays (which can happen if answering and comparing overlap and there aren't enough answers available for students to compare).

合格assignments can be given during and after group projects as well. When you use a group assignment, one answer will be requested from each group (which any member can submit), but each group member must complete the required comparisons and self-evaluation (if enabled) individually.

Choose how outcomes will influence grades

If ComPAIR assignments will influence grades, you should communicate to students in the beginning how exactly the assessment marks will be counted, so students are not caught off-guard.

通常，教师年级学生的组合两个方面：

• 他们参与该过程（即回答，比较和/或自我评估）。创建关联赋值时，您将能够分配完成赋值的每个阶段的权重。
• The quality of the work students do through ComPAIR, which may mean any of the following: reviewing the answers students initially submit, seeing how peer feedback informs a revised or later work they submit, or looking at the thoroughness and thoughtfulness of their peer feedback (this has the added benefit of increasing students’ sense of accountability in providing quality constructive criticism).

关于CompAir排名的注释

合格’s main pedagogical focus is to help students effectively review peer work and write insightful feedback using the power of comparison. However, some instructors have considered using合格’s optional scoring/ranking of answersfor grading as well, primarily by chunking the answers into rough top, middle, and bottom groups and assigning a grade to each.

Conduct your own validation, if you intend to factor ComPAIR’s outcomes into the marks you assign. Internal research so far indicates that ComPAIR’s scoring may not reliably map to traditional expert grading, as it ultimately relies on the skills and training of novices (students) to provide accurate, well-informed rankings of their peers’ answers.

Set up a ComPAIR course

您最容易在画布上使用Compair开始。通过画布，您可以设置一个将自动使用类列表自动填充的Compair课程。如果您想与Canvas成绩簿同步Compair参与等级，则指令差异。

Understand the ComPAIR workflow

使用Compair进行同行评审是一个简单的过程。

1. You create an assignment：为每个分配设置五个结构元素（分配详细信息，阶段，比较标准，比较标准，比较和参与等级的数量和参与等级），该过程可以在十分钟内完成。
2. Students answer the assignment: Students can answer using a rich text editor, a file attachment, or both. For a group assignment, only one student from each group needs to answer.
3. Students compare and comment on pairs of peer answers: Students select a preferred answer from the pair for each criterion you set (e.g., "Which is better?), then write feedback to the author of each answer, following instructions that you can customize. This phase is done individually, whether or not it is a group assignment.
4. 学生完成自我评估（可选）: If you enable self-evaluation, students reflect and comment on their own answer at the end of the process, following instructions that you can customize. This phase is done individually, whether or not it is a group assignment.
5. Everyone views results: Once the phases of a peer review assignment complete, students can access the peer feedback given to their (or their group’s) answer, as well as all answers submitted by peers. You and your teaching team can read and comment privately or publicly on student answers, access a participation table to view activity and participation grades, mark "top" answers, and view each student’s comparison choices, peer feedback, and self-evaluation.

To find out more about each step, visit theCompAir支持网站的工作流页面。

Create a basic ComPAIR assignment

1. Log in to ComPAIR, and click yourcourse name。If you don't have a course, you can follow the earlier steps to set one up.
2. ClickAdd Assignment那which will take you to a page for filling in information about the assignment:
   • Under "Assignment Details", set the short name of the assignment, enable/disable self-evaluation and group functionality, and add any assignment instructions.
   • Under "Schedule", set the timelines for when students can answer, compare answers and, optionally, evaluate their own answer.
   • Under "Prompts", set the criteria that students will use to compare the answer pairs. One or more criteria can be used and each must pose a question answered by choosing between the answers. Instructions for peer feedback and self-evaluation can also be customized.
   • Under "Comparison Settings", set the number of comparisons required from each student and how the pairs will be selected by the application—at random or adaptively based on how students have ranked answers so far. You can also add a practice answer pair for students to start with and enable replies.
   • 在“参与等级”下，设置完成任务的每个部分的重量，该重量用于计算总参与等级。
3. Save那作业。

在画布中设置级别同步

Once you have set up a ComPAIR course and assignment, you can sync grades directly from ComPAIR to Canvas. To sync properly, you will need to set up individual links in Canvas to each ComPAIR assignment. Each student must click the link of each Canvas assignment to establish a connection between their Canvas gradebook entries and their work in ComPAIR.

1. 要在Canvas中创建分配链接，请先从CompAir复制必要的信息：
   • Log in to ComPAIR, and click yourcourse title。
   • 滚动到您要同步等级的CompAir分配，然后单击编辑underneath the assignment title.
   • ClickCopy?at the top right of the edit assignment page. This will copy the information you need to enter in Canvas.
2. 登录您的Canvas课程，然后单击Assignmentsin the Course Navigation.
3. Click the+ Assignment blue buttonin the upper right side of the screen.
4. 输入指定名称，因为您希望学生看到它。
5. Scroll down to submission type and selectExternal Toolfrom the drop-down menu.
6. 甚至if you know the URL, clickFind。（直接进入URL不会与画布正确同步。）
7. 从列表中，选择合格and click选择。
8. At the end of the "External Tool URL" field, type a question mark (?), then paste the value you copied from ComPAIR.
   • The "External Tool URL" will ultimately something look like this:
     compair.elearning.ubc.ca./api/lti/auth?assignment=*******
9. CheckLoad This Tool In A New Tab。这允许等级与画布正确同步。
10. Save & Publish那作业。(Students can only access published assignments.)