Instead of working with mad statistics, which gives even math majors headaches...
Is this something where there's an HR manager who is permitted to see all the data... i.e. someone who could be labeled a "Program Administrator"? If so (and I actually did this once... successfully) I'd lobby to force the person filling out the survey to supply an employee number and name. Make a big deal out of it, with a great big red Flash checkbox at the end that says something ominous like "I hereby solemnly swear that these answers were truthful and if not I may be legitimately being feed to the Ravenous Bugblatter Beast of Omicron V... if even he can stomach my putrescent self." Then, when someone cheats, let loose the Corporate Hounds to chew their asses. I mean, frankly, if management isn't taking this seriously enough to "have a talk" with those doing the cheating, then the project is pretty well defeated before it starts. This would also be a good way to judge management's commitment to and understanding of the importance of the project as a whole. Laterz, J On 6/1/05, Thane Sherrington <[EMAIL PROTECTED]> wrote: > > Here's a a problem I'm wrestling with. I have a company doing on-line > performance reviews. Each employee rates a set of other employees on a > survey which has six categories with between 3 and 7 questions in each > category. > > The problem is that there are a couple bad apples who blow through the > surveys rating someone either all 1s or all 5s, throwing off that person's > ratings and effectively ruining the value of the performance review. > > My first attempt to stop this was to time the surveys. People who finished > them in less than five minutes (the cheaters generally take two minutes) > got a message telling them to go back and think about their answers and > try > again. That didn't work because it turned out that several non-cheaters > print out the review and do it on paper, and then login to enter the > answers - since they were working from paper, they finished the review in > under five minutes. > > Then I tried checking each category - if all the answers in a specific > category were the same, I rejected the review and told them to do it > again. No soap - occasionally there are legitimate reviews where one > category has all the same answers. > > So then I switched to checking the entire survey. If all the answers are > same, the survey gets rejected. It took the cheaters slightly under a > quarter of a second to figure that one out, as you can imagine. > > The surveys are all anonymous, so I can't simply go to the person entering > the survey and tell him/her to stop cheating. > > Can anyone think of a way to monitor and block the cheaters? > > T > -- --------------- ------------------------------------- Buy SQLSurveyor! http://www.web-relevant.com/sqlsurveyor Never make your developers open Enterprise Manager again. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Discover CFTicket - The leading ColdFusion Help Desk and Trouble Ticket application http://www.houseoffusion.com/banners/view.cfm?bannerid=48 Message: http://www.houseoffusion.com/lists.cfm/link=i:4:208330 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4 Donations & Support: http://www.houseoffusion.com/tiny.cfm/54
