drop the top 25% and bottom 25% or report ALL the data and few ways to look at it.
is it tied to remuneration? or just for discussion? Maybe a little more discussion on the apps intent will help. >> block cheaters? are they cheating really? What's the nature of the work? Is there a reason why their managers are disconnected from their performance? Are there other performance metrics available? Are they being used? Is this a "learning organization"? ie steady flow of learning? Eric -----Original Message----- From: Dave Francis [mailto:[EMAIL PROTECTED] Sent: June 1, 2005 10:32 PM To: CF-Talk Subject: RE: Dealing with users It's been a while, but I seem to remember something about using median (or maybe its mode?) rather than mean to reduce the impact of very low/high entries? -----Original Message----- From: Thane Sherrington [mailto:[EMAIL PROTECTED] Sent: Wednesday, June 01, 2005 9:03 PM To: CF-Talk Subject: Dealing with users Here's a a problem I'm wrestling with. I have a company doing on-line performance reviews. Each employee rates a set of other employees on a survey which has six categories with between 3 and 7 questions in each category. The problem is that there are a couple bad apples who blow through the surveys rating someone either all 1s or all 5s, throwing off that person's ratings and effectively ruining the value of the performance review. My first attempt to stop this was to time the surveys. People who finished them in less than five minutes (the cheaters generally take two minutes) got a message telling them to go back and think about their answers and try again. That didn't work because it turned out that several non-cheaters print out the review and do it on paper, and then login to enter the answers - since they were working from paper, they finished the review in under five minutes. Then I tried checking each category - if all the answers in a specific category were the same, I rejected the review and told them to do it again. No soap - occasionally there are legitimate reviews where one category has all the same answers. So then I switched to checking the entire survey. If all the answers are same, the survey gets rejected. It took the cheaters slightly under a quarter of a second to figure that one out, as you can imagine. The surveys are all anonymous, so I can't simply go to the person entering the survey and tell him/her to stop cheating. Can anyone think of a way to monitor and block the cheaters? T ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Logware (www.logware.us): a new and convenient web-based time tracking application. Start tracking and documenting hours spent on a project or with a client with Logware today. Try it for free with a 15 day trial account. http://www.houseoffusion.com/banners/view.cfm?bannerid=67 Message: http://www.houseoffusion.com/lists.cfm/link=i:4:208324 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4 Donations & Support: http://www.houseoffusion.com/tiny.cfm/54
