I think David makes a lot of good points here; coming down to my own point, which is, we all are probably rating different things in our own minds when we look at rating.
I had one of my own apps receive a down rating from a user who got an error, because word had an error on his pc, and it caused an error on my app. He couldn't reproduce it, but he wrote me that he down rated the app. I've been asking GW for over a year now to allow us to remove comments, because a comment I once made for a previous version of an app, no longer applies to the current version. They haven't done anything about it, so I just added a comment which says my previous comment doesn't apply; awkward I know, but it points out the short-comings of ratings, comments, and categories. To give GW credit, I did write yesterday to mention I thought the I-Tunes app didn't belong in the "general" category, but in the "program enhancements" category instead. I received an immediate reply that it had been moved. So, David's right: ratings without comments are meaningless, and comments without indicating version numbers are misleading (at least, when mentioning issues or problems). If you want to encourage users to use the ratings and comments features, here's an idea: keep track in the .ini file of how many times they have run your app, and once it hits some number you believe should give them adequate experience, pop up a one-time message box which encourages them to use ratings and comments on App Central or appGet for this app. Hth, Chip -----Original Message----- From: David [mailto:[email protected]] Sent: Monday, February 17, 2014 6:39 PM To: [email protected] Subject: Re: Meaningless app ratings Have to admit, I have never rated anything on App Central. No, it has got nothing to do with the quality of the apps. I am using many an app, and some of them have become no less than essential for my computer activity. As such, I guess, I should have been generous with both the fours and fives. :) Yet, I agree, the concept of rating is more of a curosity, than a real help. The low number of raters, is one thing. Even if one or two persons leave a rating on my app, it does not really tell much about the app. As one pointed out, what is the great thing for me, may not be just as great for you. And, if an app happens to perform just what I expected, should that mean a five-star, even if the app actually is performing a poor or rather meaningless activity? If an app pops up some kind of jokey message every time I turn on the computer, or whenever the Notepad is opened - does that qualify for five ratings, simply just because that app never fails to perform its simplistic activity faultlessly? Should my rating reflect the usability, the stability, the complexity, or simply just my personal feeling and opinion about the actual project? It was likened with things like EBay, from one of the users here. Well, one thing that makes EBay ratings slightly more usable, is the fact that you cannot rate a seller or product, until you actually have bought the offered product. Well, don't know if that ever could be implemented in a functional way on App Central, specially with free apps. People may download the app, run it once, experience some unexpected behavior, and leave you the worst rating. Next user will see the low rating, and forget about your project. Although I haven't tried, I wonder if App Central even lets me rate an app, that I do not even have installed on my computer. If my suspecion is correct, it actually could open for users simply to low-rate any project they just happened to disagree in. I don't like the whole idea of a jaws-key app, I don't install it, but just low-rate it to discourage anyone from trying it. Hmm, then what benefit or real meaning would the rating have? First speaking of ratings on App Central, you guys have already mentioned that a rating with no comment is rather useless. Tell you what! A rating that has been commented, is no more use, long as the comment is not valid. One of my apps, received a mid-class rate, and a comment about some lacking of functionality. My next update fixed the commented issue, but since I cannot delete the comment, nor affect the rating, the commented rating sticks. Fact is, that many a user may skip the app, if they read this comment, since it somehow makes a bad story of my project. The comment was usable and correct enough when it was left, and maybe we could name the rating proper based on that. But since the app has had two updates after that, the issue commented on been fixed long time ago, the whole comment and rating only serves to confuse and discourage potential users. Even I go to App Central and leave a comment, telling that the previous comment is no longer valid, what do I get from that? When you open the website of the app, the oldest comment will be shown first, and once people have read that, they may conclude the app has a serious lack, and leave the stuff alone. Comments should at least, be displayed newest first. Now, all of that said, even if apps got a thousands of ratings, this would tell little and nothing as to whether the app will fix what I am hoping for. We have - for instance - two different apps for add/Removing software on your computer. There is two different apps for having an hourly read-out of the current time automated. There is two different apps - InstallPackage and AppGet - to retrieve apps from app central. And, there is even two different apps dealing with Notepad. OK, any of these apps receive ten thousand three hundred and fiftyseven ratings. What good does it tell me? That a bunch of people had some fun in throwing stars... :) It does tell me nothing as to whether any of these apps are going to help me with my actual problem. And there may be reasons why one app will be better equipped to carry out my stuff, than the other. Yet, the other app, may have been a better go, for misses Carlson. She rated that app five stars, but the app that really would have solved my problem, was downloaded by mister Clinton, and he simply did not like the whole idea - and rated it one star. If I was to go by the app with the highest rating in this scenario, it would have resulted in me installing an app, that only partially did what I wanted - and maybe lead to me not leaving good ratings. Shows us some of the weaknesses in a rating-system, on material that really is all that individual in its structure and functionality as is the case with tiny pieces of software. Another weakness is, if an app happens to be very popular for a period of time. Say an app has been developed to fix a certain issue in the screen reader performance. The app really is good, well-constructed and smoothly functioning on a daily basis. Everyone rates it four and five stars, leaving the project several hundred scores. After a while, GW changes some stuff in their core, or the third-party software the app was designed for does. Now, downloading and running this app will mess up the screen reader, causing loads of frustrations. Yet, the app had received loads of good ratings, so new users discern it must be the real good go, ending up with big frustrations. What then could we do about the rating system? OK, one easy answer would be: Simply Remove The Whole Thing! Still, maybe there is good reasons for having a rating capability in the system. It just need a far more intermediate function. First of all, ratings should be locked to a given version of the app. Just because version 1 works well and performs perfectly, that doesn't say anything as to the functionality of version 2 or 3. Hence a rating that tells something about one version, should not be taken into consideration in the next version of the app. Or, if we really want it advanced, you should at least see a rating list like this: Version 1: 4Stars, Version 1.1: 3Stars, Version 1.2: 3Stars, All Over Rating: 3.3Stars. This is being done on certain websites. Useful enough for some funny statistics, but whether it will increase the download rate of the app, I don't know. :) Secondly, we may want to do a similar thing to the comments, and even give the app developer a chance of rectify comments that are no longer valid. And, at least, give any person the chance of removing his comments, when he realizes his comment is not any longer valid. Furthermore, any comments should be listed with the newest one first, to give the most updated facts the highest priority. If we really want the rating system, and we want it to mean anything, I also believe we may want to present the ratings more directly to potential users. Many users now aday, will be using things like AppGet. When you scroll down the tree of available apps, you are not informed of any ratings. You will have to tab around on the screen, for each app individually, to know anything about the rating of the app. There should have been a setting in the View menu of the AppGet, determining if the user wants the rating of the apps displayed. Then, with this setting turned on, he would see a list like this: Hourly Chime, 3Stars; InstallPackage, 5Stars; Extended Dictionary, 1Star; Time N Date, 0Stars. Turning off the rating-display, the tree would read only the app names - like it does already. Now, the user could browse the available apps, and know the ratings in a quicker way. Again, if the feature would affect anything on the amount of downloads, I am not really sure. Give my three-year-old grand-child a toy car, and he will rate it fifty-nine stars - since it will give him hours of fun. Give the same toy car to his sister, she will rate it ninety-two stars because she loves the color. Give me the toy car, and I may rate it 2 stars, since it solved my problem of what to give as a gift for my grand-children next Sunday. Well, you see how little it all would tell about the actual shape, functionality and durability of the toy. And, it never could reflect much about how hard the developer and manufacturer had worked on getting the thing as good as possible. As a result, the whole rating could at best be amusing; at the worse end, be misleading and unfair. ----- Original Message ----- From: "Mike Pietruk" <[email protected]> To: <[email protected]> Sent: Monday, February 17, 2014 4:39 PM Subject: Re: Meaningless app ratings > Rod > > While the rating concept is theoretically good, in practice, it often > proves meaningless. > For one thing, the process is easily riggable; for another, a rating is > only valuable, particcularly when few votes are cast, if we know something > about who cast the vote. > For one person, an ap may be valuable; for another is ok. To me, as an > example, a "5" is only warranted is something is truly outstanding; a good > ap should probably get a 4. > That illustrates the whole problem with the system as about the only > vbalue most of these rating approaches have is to provide ego rubs for the > ap creators if they draw high numbers which you can help insure by telling > folks you trust or your "friends" to vote for it. > And, you would have never complained if the single vote was a 5 (or > perhaps even a 4) as that is what you wanted to see. > I am not an ap creator -- I couldn't create one if my life depended on it > -- but if I drew low numbers -- especially from a good number of people -- > I'd try to figure out where the complaint lies. > What might seem flawless and perfect to you or me might not be that for > someone else. > > Some rating systems -- such as Amazon, Newegg and bay -- seem to function > better given larger user bases and what is at stake. > The way I look at a free ap is I get what I pay for it. Hopefully, it > will do for me what I hope it can do; but, on the other hand, > the developer probably, in most instances, created it for what they wanted > to do and if it benefits me, so be it. > And, oh yes, an ap or programm fails for me not because there is something > wrong with it but the problem is on my end. > > > > > > I will not trust in riches but in him who richly provides. > Andy Stanley, pastor, from his new book "How to Be Rich: It' Not > What You Have. It's What You Do With What You Have." > > >
