2009/10/28 Hironori Bono (坊野 博典) <[email protected]>: > Even though this is still a random thought, I would personally like to > use chromium to evaluate the new dictionaries: i.e. uploading the new > dictionaries to our dictionary server, changing the chromium code to > use the updated ones, asking users to compare the new dictionaries > with the old ones and give us their feedbacks (*1). If users like the > new dictionaries, we would like to release the new ones. Otherwise we > will keep the old ones.
In the web search world when we made changes like these, we'd try to measure it without users giving explicit feedback. For example: give some users the new dictionary, and others the old one. Log which entry index from the dictionary suggestion list people are frequently choosing, then compare the aggregate counts between the two sets of users. (Maybe call the "Add to Dictionary" menu option -1.) For a better dictionary, I'd expect people to use the earlier entries from the suggestion list more frequently, and the "Add to Dictionary" option less frequently. This can be done with our existing histogram framework and I believe Jim wrote a framework within that for doing these sorts of experiments. It still might be worth soliciting feedback from users directly. For example, if the new dictionary is missing a common word the above measure would get a high count of "Add to Dictionary", and maybe users could tell us about this. But in general, you get higher quality data when you involve more users, and a spreadsheet will be limited to people who understand the English instructions. --~--~---------~--~----~------------~-------~--~----~ Chromium Developers mailing list: [email protected] View archives, change email options, or unsubscribe: http://groups.google.com/group/chromium-dev -~----------~----~----~----~------~----~------~--~---
