[TOS] peer evaluations

[Clif Kussmaul]

I've had the same experience. :-)

However, I get very different responses when I ask each person to allocate
$10,000 in bonuses.
A few give everyone equal amounts, but most are more selective,
and I very rarely have teams where everyone gives themselves the biggest
bonus.

A similar approach would be to change the peer rating to be something like:
	-2: far below, -1: below, 0: average, 1: above, 2: far above
and require ratings to sum to 0 (or use a tool to normalize responses)

I also think it helps to make the peer evaluation more specific, maybe even
as a rubric,
so it asks about specific things and gives examples of below/average/above
responses.

I've include text from my form below.

Clif


Name of Evaluator (you): _____
Name of Team Member being Evaluated (include yourself): _____

Peer Ratings (1=Never, 2=Rarely, 3=Sometimes, 4=Usually, 5=Always)
- Do they prepare for meetings and attend regularly?	
- Do they complete assigned work on time and in good condition?	
- Do they participate actively in the team, and contribute regularly?	
- Do they seek help within the group when necessary?	
- Do they cooperate with the group, listening and compromising when
necessary?	

If you could assign bonuses to each team member, how much would they get?
 (team total = $2000 * # of team members, e.g. $6000 for 3, $8000 for 4)

Specific Areas of STRENGTH
(1+ sentences - what did they do well, and how did that help the team?)

Specific Areas for IMPROVEMENT
(1+ sentences - what could they do to improve, and how would it help?)

---
Clif Kussmaul  clif at kussmaul.org  http://kussmaul.org  +1-484-893-0255
EDT=GMT-5  (he/him)

-----Original Message-----
Date: Mon, 15 Apr 2019 10:28:13 -0400
From: Joanna Klukowska <joannakl at cs.nyu.edu>
To: tos at teachingopensource.org
Subject: [TOS] peer evaluations
Message-ID: <c7abb5e2-4893-93ac-505a-b505fb9067f7 at cs.nyu.edu>
Content-Type: text/plain; charset="utf-8"; Format="flowed"

Hi,

I am teaching a class that focuses on student contributions to open source
projects.
I want to ask students to complete peer evaluations for the members of their
teams. 
But last time I did it, they all rated each other as excellent (even though
I know there were glitches).
Does anybody have a template of a peer evaluation that they used
successfully?

I am attaching a copy of my form for reference.

Thanks,
Joanna