Great idea unless someone does really well on the one real review filed and everyone else cheats below 3.
Then you've got someone who's really getting screwed because the math just doesn't work. I kind of like reporting all the data and several views of it. But I still favor a personalized report... I have to create an account. My name and employee number are linked to the data, but the application keeps the data private. Each survey I fill out is registered under me and my averages are shown... average scores given per category, high/low scores given per category... I KNOW that this data can be seen and after cheating on 4 of them I see that my average, high, and low are all 4... and I start to worry. I'm given one chance by the system to fix each survey, and as the system watches me fill them out it can email me to say "It's obvious you're not taking this seriously. A copy of this email has been sent to your supervisor, and you have 24 hours to redo these surveys: link, link, link. Non-compliance is grounds for severance (our choice of limbs), termination (and no, you won't be back), firing (would you like a last cigarrette?), and a good, old-fashioned ass-kicking in front of (or, more likely... BY...) the senior management staff." Each survey filled out about me is viewable by me (except the names of those filling them out).. along with all my averages, highs, lows, blah blah blah. This screams THIS IS IMPORTANT, TAKE IT SERIOUSLY. Otherwise... it's pointless... statistical analysis notwithstanding. Laterz, J NOTE: This is free advice. It is important to remember that often one gets what one pays for. On 6/1/05, Eric Dawson <[EMAIL PROTECTED]> wrote: > > drop the top 25% and bottom 25% > or report ALL the data and few ways to look at it. > > is it tied to remuneration? or just for discussion? > > Maybe a little more discussion on the apps intent will help. > > >> block cheaters? > are they cheating really? > > What's the nature of the work? > Is there a reason why their managers are disconnected from their > performance? Are there other performance metrics available? Are they being > used? > > Is this a "learning organization"? ie steady flow of learning? > > Eric > > -----Original Message----- > From: Dave Francis [mailto:[EMAIL PROTECTED] > Sent: June 1, 2005 10:32 PM > To: CF-Talk > Subject: RE: Dealing with users > > It's been a while, but I seem to remember something about using median (or > maybe its mode?) rather than mean to reduce the impact of very low/high > entries? > > > -----Original Message----- > From: Thane Sherrington [mailto:[EMAIL PROTECTED] > Sent: Wednesday, June 01, 2005 9:03 PM > To: CF-Talk > Subject: Dealing with users > > > Here's a a problem I'm wrestling with. I have a company doing on-line > performance reviews. Each employee rates a set of other employees on a > survey which has six categories with between 3 and 7 questions in each > category. > > The problem is that there are a couple bad apples who blow through the > surveys rating someone either all 1s or all 5s, throwing off that person's > ratings and effectively ruining the value of the performance review. > > My first attempt to stop this was to time the surveys. People who finished > them in less than five minutes (the cheaters generally take two minutes) > got a message telling them to go back and think about their answers and > try > again. That didn't work because it turned out that several non-cheaters > print out the review and do it on paper, and then login to enter the > answers - since they were working from paper, they finished the review in > under five minutes. > > Then I tried checking each category - if all the answers in a specific > category were the same, I rejected the review and told them to do it > again. No soap - occasionally there are legitimate reviews where one > category has all the same answers. > > So then I switched to checking the entire survey. If all the answers are > same, the survey gets rejected. It took the cheaters slightly under a > quarter of a second to figure that one out, as you can imagine. > > The surveys are all anonymous, so I can't simply go to the person entering > the survey and tell him/her to stop cheating. > > Can anyone think of a way to monitor and block the cheaters? > > T > -- --------------- ------------------------------------- Buy SQLSurveyor! http://www.web-relevant.com/sqlsurveyor Never make your developers open Enterprise Manager again. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Find out how CFTicket can increase your company's customer support efficiency by 100% http://www.houseoffusion.com/banners/view.cfm?bannerid=49 Message: http://www.houseoffusion.com/lists.cfm/link=i:4:208331 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4 Donations & Support: http://www.houseoffusion.com/tiny.cfm/54
