Re: [IxDA Discuss] Your favorite rating interface
I think the author just wants to find new ways for users to give quick feedback. I personally like the rating system on ign and gamespot and there are a couple of other interesting rating systems I quite can't remember. One was an interesting wordpress plugin. I can't quite remember the names of either On Dec 19, 2:17 am, Esteban Barahona [EMAIL PROTECTED] wrote: For reviewing content it's preferable to have reviews than ratings... if the point is to improve it. And after using an account on wikipedia, it's preferable being able to change directly the content. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Posted from the new ixda.orghttp://gamma.ixda.org/discuss?post=23493 *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today:http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help ..http://www.ixda.org/help *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
Thanks everyone for excellent examples and good discussion. We're definitely thinking about requiring reviews with ratings, but I'm a little concerned that we won't get the quantity of ratings that we would get if we just had ratings. Granted, the QUALITY of the ratings might be higher, so it's a trade off of sorts. I think we may go with a slider of some sort since it gives a bigger range of numbers and is just as easy (if not easier) to use and understand as the ubiquitous stars. Thanks, Kim *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
For reviewing content it's preferable to have reviews than ratings... if the point is to improve it. And after using an account on wikipedia, it's preferable being able to change directly the content. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Posted from the new ixda.org http://gamma.ixda.org/discuss?post=23493 *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
Pandora has good rating system. However there is no way to change song rating from Thumbs Up to No Digit rating. Since the rating affects the frequency of the song being played, (for the upcoming year) I wish Santa has added the neutral rating: I don't mind this song, but I do not want it to be played too frequently. Oleh On Dec 16, 2007 1:23 PM, Michael Micheletti [EMAIL PROTECTED] wrote: There's another scheme in work on Pandora (http://www.pandora.com). It seems to work pretty well for tuning a station (music stream). There are two basic rating icons/choices, plus three other related actions associated with the rating system and station. The choices are identified by the (icon) images listed below. Ratings: (Thumb Up) I really like this song - play more like it! (Thumb Down) I don't like this song - it's not what this station should play. Related: (zzz) I'm tired of this song - don't play it for a month. (?) Why is this song playing? (+) I want to add more kinds of music to this station. Pandora is one of the rare websites/web services that all the demographics in our house love. I think that's partly because it's so easy to rate content. Thumb's up or thumb's down. Michael Micheletti On Dec 16, 2007 10:16 AM, Bryan Minihan [EMAIL PROTECTED] wrote: What would be really nice is if they captured the relationship of different songs to each other. I tend to listen to iTunes in sessions, so when I sit down for a few hours to work, I play work songs. *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help -- Oleh Kovalchuke Interaction Design is the Design of Time http://www.tangospring.com/IxDtopicWhatIsInteractionDesign.htm *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
On Dec 15, 2007, at 11:56 PM, Murli Nagasundaram wrote: The other problem is the implicit criteria used in a star rating as both Jonathan and Jim point out. What's an alternative though, that is simple and quick, as well as reliable? :-C:-(:-|:-):-D ;-) -- Jonathan Koren [EMAIL PROTECTED] http://www.soe.ucsc.edu/~jonathan/ *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
I have a problem with ratings in iTunes, as well. I've grown a couple hundred songs in my library over time, but about 98% of my library is either not rated or 5. I wouldn't really have any 1s in iTunes, or it wouldn't be there, so that rules out one whole point in the scale. What would be really nice is if they captured the relationship of different songs to each other. I tend to listen to iTunes in sessions, so when I sit down for a few hours to work, I play work songs. I have a work playlist, but it's incomplete, and I just don't have time to keep moving new songs into it. I also want different types of music depending on what kind of work I'm doing, and can't think of obvious names for different lists. If iTunes could somehow pay attention to what songs I play multiple times, and which songs I skip, in a given session, then let me play that as a playlist, I wouldn't have to manually rate them or move them over to a list myself. Over time iTunes would have compilations based on different moods and could grow them by recognizing when I'm playing songs out of a particular list. Wishful thinking, I know =] Bryan http://www.bryanminihan.com -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Jonathan Koren Sent: Saturday, December 15, 2007 11:37 PM Cc: ixd-discussion Subject: Re: [IxDA Discuss] Your favorite rating interface Even a Likert scale doesn't mean the same thing to users. There's plenty of users that rank everything 5 stars, others that rank items only 1 star or 5 stars. Even in my own experience a Likert scale can be problematic. I decided to rate all my songs on iTunes. I decided I'd try to bell curve it with: 1: absolute crap, or non music track 2: don't like it 3: perfectly acceptable 4: like it 5: sublime This worked for a while, until I started to realized that there would be two songs that I liked, but weren't sublime, but I preferred one to the other. I couldn't capture that relationship. In a sense, a 7 point scale would have been better here, but I suspect I would have ended up with wanting a 9 point scale. -- Jonathan Koren [EMAIL PROTECTED] http://www.soe.ucsc.edu/~jonathan/ *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
There's another scheme in work on Pandora (http://www.pandora.com). It seems to work pretty well for tuning a station (music stream). There are two basic rating icons/choices, plus three other related actions associated with the rating system and station. The choices are identified by the (icon) images listed below. Ratings: (Thumb Up) I really like this song - play more like it! (Thumb Down) I don't like this song - it's not what this station should play. Related: (zzz) I'm tired of this song - don't play it for a month. (?) Why is this song playing? (+) I want to add more kinds of music to this station. Pandora is one of the rare websites/web services that all the demographics in our house love. I think that's partly because it's so easy to rate content. Thumb's up or thumb's down. Michael Micheletti On Dec 16, 2007 10:16 AM, Bryan Minihan [EMAIL PROTECTED] wrote: What would be really nice is if they captured the relationship of different songs to each other. I tend to listen to iTunes in sessions, so when I sit down for a few hours to work, I play work songs. *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
On Dec 14, 2007, at 2:00 PM, Jeffrey D. Gimzek wrote: A number of systems have gone to a 7-star system: […] Even then, it may do a good job of capturing levels of dislike which may be valuable in some settings -- movies, for example. For that, an 8- star system is probably better: -3 -2 -1 0 1 2 3 (and unrated). […] OK, but is that instantly understandable ? that is the deal with the stars - ubiquitous = understandable Ubiquitous != understandable. Just because something is everywhere, doesn't mean everyone understands it in the same way. As stated, that's the exact problem with a 5-star system. Everyone probably understands what 5 stars means, but all the rest are up for grabs. many many people dont really understand negative numbers to see an example of a rating that is almost totally useless, see jobvent.com what's a 1303? what's a - 43? i dont know. i have to figure it out, and by then i dont care. I can't disagree with you; a (presumably) rolled-up value which doesn't obviously relate to the original rating spread is obscure at best, maybe unuseful. One which does relate -- average 3.4 rating (19 ratings) on a scale of -4 to +4 -- is better. If negative numbers are deemed too confusing -- where're your personas, huh?! grin -- maybe a letter grade of A through F with + and - in the mix. Americans at least should have a decent grasp that if the grade relates to percentages, then an F is covering roughly the entire bottom half of the spectrum, everything from completely unacceptable down to putrid and beyond. -- Jim Drew [EMAIL PROTECTED] http://www.soundskinky.com/blog/ *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
Thanks a ton for these, Jeffrey. I'm building ratings into our site, as well, and one of my challenges is coming up with different ratings for different kinds of people. We have three sets of users on our site - coaches, athletes and fans, and I want to differentiate ratings from coaches and fans (because one may have more weight than others in helping an athlete get recruited), so I might use some of your ideas to do this. Another rating interface I like (tho I've only looked at it a little bit) is RottenTomatoes.com. Thanka =] Bryan http://www.bryanminihan.com -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Jeffrey D. Gimzek Sent: Friday, December 14, 2007 2:03 AM To: IXDA list Subject: Re: [IxDA Discuss] Your favorite rating interface Kim Asked: Anyone seen any interesting rating interfaces lately? I'm especially interested in rating of CONTENT on a site (more than an ITEM you might buy or have bought). The one currently in use on Amazon product pages is actually pretty nice. It breaks down the ratings with bar charts so you can se how many people rated something a 5, 4, etc. It adds more meaning to the rating. I am working on a rating site now and let me tell you this is a tough nut to crack ! 1 - 5 stars are ubiquitous for a reason. One scale i really liked was a branded one: this site http://www.mtbr.com/reviews/Saddle/product_22653.shtml used chili peppers. I have seen less... socially acceptable scale icons in certain magazines run by Hugh Hefner. Ebay has a nice rating interface on their buyer/seller feedback that allows them to use different Likert scales http://en.wikipedia.org/ wiki/Likert_scale with the same graphic 1 - 5 star graphic. ie: Like - Dislike on one scale, Satisified to Unsatisfied on another. the quality and quantity of the data is important - if you rate 5 things from 1-5, is the overall rating a 4 or a 4.5 or a 4.2 or even 4.25 ? how important is that accuracy to your users? Another aspect of rating is helpful/unhelpful where 27 helpful vs. 3 unhelpful basically rate a post... thumbs up/dn is also used this way. Sites such as Yelp and thefunded.com use this as an addition to rating. We wound with a sort of LCD/LED meter like you see on equalizers, but horizontal. that way we can change the scale: 1 - 5 1.0 - 5.0 1 - 10 0 -100% without really changing the graphic... what that meant however is that we needed a real number next that gives you actual data: 3, 2.5, 7 of 10 etc. sort of like this:|| || || || | (4.5) Again, this is a great place to brand your rating to make it unique. hope that all helps you get started ! jd -- Jeff Gimzek | Senior User Experience Designer [EMAIL PROTECTED] | www.glassdoor.com *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
On Dec 13, 2007, at 11:03 PM, Jeffrey D. Gimzek ([EMAIL PROTECTED]) wrote: I am working on a rating site now and let me tell you this is a tough nut to crack ! 1 - 5 stars are ubiquitous for a reason. The only reason 1-5 stars is ubiquitous is because it's ubiquitous. Anyone remember when hotels and such only went to 4 stars? And now I've seen ones touted as 7 stars. Sounds like starflation to me: when everyone is a 4-star, you have to go to a 5-star system just to differentiate yourself from the crowd. But why is everyone a 4-star? Answer: not because they are all top of the line, but because no one wants to be below the top. (And doubly so when Motel 6 and its peers show up as 2-star, leaving the question of what fleabag is only a 1- star? Eew? The problem of a 1-5 star system is that there is typically no definition of what the various ratings mean. Is 3-star average? (What is average?) Is 1-star avoid even if they pay you to stay there and it's the middle of a blizzard and there is no other place at all within 100 miles? Does no stars mean hasn't been rated or less than 1 star; does it mean both? A number of systems have gone to a 7-star system: 5 stars, no stars, and don't like. (Adobe Bridge, Rhapsody, many others.) Even then, it may do a good job of capturing levels of dislike which may be valuable in some settings -- movies, for example. For that, an 8-star system is probably better: -3 -2 -1 0 1 2 3 (and unrated). Then you could decide that (picking two movies I saw from the Rotten Tomatoes worst list from last year) than while DaVinci Code and Eragon were both bad, that Eragon was a -2 (Tivo it and maybe remember to watch it later, or not) but DaVinci was only a -1 (might be worth Netflixing some day), while Dreamgirls was a +2 (might be worth buying a copy for your personal library). (Such a positive/negative balance also makes rolling up group averages more accurate.) -- Jim Drew [EMAIL PROTECTED] http://www.soundskinky.com/blog/ *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
On Dec 14, 2007, at 1:16 PM, Jim Drew wrote: On Dec 13, 2007, at 11:03 PM, Jeffrey D. Gimzek ([EMAIL PROTECTED]) wrote: I am working on a rating site now and let me tell you this is a tough nut to crack ! 1 - 5 stars are ubiquitous for a reason. The only reason 1-5 stars is ubiquitous is because it's ubiquitous. Anyone remember when hotels and such only went to 4 stars? And now I've seen ones touted as 7 stars. Sounds like starflation to me: when everyone is a 4-star, you have to go to a 5-star system just to differentiate yourself from the crowd. But why is everyone a 4-star? Answer: not because they are all top of the line, but because no one wants to be below the top. (And doubly so when Motel 6 and its peers show up as 2-star, leaving the question of what fleabag is only a 1- star? Eew? The problem of a 1-5 star system is that there is typically no definition of what the various ratings mean. Is 3-star average? (What is average?) Is 1-star avoid even if they pay you to stay there and it's the middle of a blizzard and there is no other place at all within 100 miles? Does no stars mean hasn't been rated or less than 1 star; does it mean both? A number of systems have gone to a 7-star system: 5 stars, no stars, and don't like. (Adobe Bridge, Rhapsody, ma ny others.) Even then, it may do a good job of capturing levels of dislike which may be valuable in some settings -- movies, for example. For that, an 8-star system is probably better: -3 -2 -1 0 1 2 3 (and unrated). Then you could decide that (picking two movies I saw from the Rotten Tomatoes worst list from last year) than while DaVinci Code and Eragon were both bad, that Eragon was a -2 (Tivo it and maybe remember to watch it later, or not) but DaVinci was only a -1 (might be worth Netflixing some day), while Dreamgirls was a +2 (might be worth buying a copy for your personal library). (Such a positive/negative balance also makes rolling up group averages more accurate.) OK, but is that instantly understandable ? that is the deal with the stars - ubiquitous = understandable many many people dont really understand negative numbers to see an example of a rating that is almost totally useless, see jobvent.com what's a 1303? what's a - 43? i dont know. i have to figure it out, and by then i dont care. jd - - Jeffrey D. Gimzek | Senior User Experience Designer http://www.glassdoor.com *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
Clearly, the Michelin guide's ratings system is superior, since they only have 3 stars. g Of course, 99.99% of restaurants are beneath their notice and receive no star, so they're only providing ratings from excellent to superlative. Which is actually a good way of controlling your ratings. If I'm being asked to give ratings, I tend to prefer a system that's spelled out. For example: 1 -- I'll never shop here again, you suck 2 -- It would take a major sale to convince me to shop here again 3 -- I will probably shop here again 4 -- I'll definitely shop here again, and recommend you to friends 5 -- Please, take all my money, I love you so much I think spelling out the ratings prevents me from having to think too hard about it (hmm, is it a 6 or a 7?). You might also shame people into not giving you such a lousy rating by using over-the-top humor. Movie/book ratings are always hard because you can either rate all movies against each other or you can rate within genre. So, Eragon might get a 1/10 compared to movies overall, but a 4/10 compared to other fantasy movies. I've also noticed that I tend to rate movies higher if I had low expectations and lower if I had high expectations. One might get better results if you asked people to rate movies compared to other movies. That way you can control whether they're within genre, for example. -- Kim + + + + + + + + + + + + + + + + + + Kim Bieler Graphic Design www.kbgd.com 240-476-3129 + + + + + + + + + + + + + + + + + + *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
Re: [IxDA Discuss] Your favorite rating interface
Kim Asked: Anyone seen any interesting rating interfaces lately? I'm especially interested in rating of CONTENT on a site (more than an ITEM you might buy or have bought). The one currently in use on Amazon product pages is actually pretty nice. It breaks down the ratings with bar charts so you can se how many people rated something a 5, 4, etc. It adds more meaning to the rating. I am working on a rating site now and let me tell you this is a tough nut to crack ! 1 - 5 stars are ubiquitous for a reason. One scale i really liked was a branded one: this site http://www.mtbr.com/reviews/Saddle/product_22653.shtml used chili peppers. I have seen less... socially acceptable scale icons in certain magazines run by Hugh Hefner. Ebay has a nice rating interface on their buyer/seller feedback that allows them to use different Likert scales http://en.wikipedia.org/ wiki/Likert_scale with the same graphic 1 - 5 star graphic. ie: Like - Dislike on one scale, Satisified to Unsatisfied on another. the quality and quantity of the data is important - if you rate 5 things from 1-5, is the overall rating a 4 or a 4.5 or a 4.2 or even 4.25 ? how important is that accuracy to your users? Another aspect of rating is helpful/unhelpful where 27 helpful vs. 3 unhelpful basically rate a post... thumbs up/dn is also used this way. Sites such as Yelp and thefunded.com use this as an addition to rating. We wound with a sort of LCD/LED meter like you see on equalizers, but horizontal. that way we can change the scale: 1 - 5 1.0 - 5.0 1 - 10 0 -100% without really changing the graphic... what that meant however is that we needed a real number next that gives you actual data: 3, 2.5, 7 of 10 etc. sort of like this:|| || || || | (4.5) Again, this is a great place to brand your rating to make it unique. hope that all helps you get started ! jd -- Jeff Gimzek | Senior User Experience Designer [EMAIL PROTECTED] | www.glassdoor.com *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ Welcome to the Interaction Design Association (IxDA)! To post to this list ... [EMAIL PROTECTED] Unsubscribe http://www.ixda.org/unsubscribe List Guidelines http://www.ixda.org/guidelines List Help .. http://www.ixda.org/help
