Thanks a lot Xav for this very interesting feedback. I attach some complementary rough data that i gathered this morning.
After reading your mail, the 3 first and big points (not taking into account small improvements here and there) that i would remember are : * continue testing some other type of missions (geocaching, video feed, arcade mini-games, etc) to compare the success of these missions (fact that the player stays in the game) with the google seach based mission we mostly tested in this first version * continue searching alternatives to reading too much on the chat (3D, files, etc), to see if players leave less easily at the very beginning * one of the main point for me is retention. Through story telling hooks, levelling, more game content and any other way, make the player want to come back come play a little every day, at least for a few days.
Am I distorting the players' feedback or do you see things the same way ? On 21/02/2011 15:44, Xavier Antoviaque wrote:
Hi,
Today with David we spent time looking at the logs of what players did
in the game since we released the version in mid-January. We have noted
where the players stopped playing and why, and noted our impressions.
First, the comments about the game submitted at the end of the mission
(thanks Vlad, the reports really helped here):
* That was fun.
* Cute.
* Fix the browser
* it was good
* fun.
* it was good
* cool
* I think it was fun to do the task.
* the internet searches were a bit easy
* very interesting
* fine
* easy!
* cool
* I thoroughly enjoyed it. I do not enjoy the way the handler makes
typoes and undoes them.
* The spelling mistakes in this window are a bit strange. The
hacking mini game needs improvement, but otherwise very interesting
* Very interesting, the hacking mini game isn't great. But I am
intrigued, I want to see what the rest of this game is like.
* was nice
* fun, not too scripted but a good tutorial
* fun
* Hacking was kind of difficult to control
* Ok
* boring
* I like your AI. Don't like the Hack-It game with the boxes
* thrilling
* pretty interesting
* Intriuging
* Interesting.
* alright
* good
* yay
* it's ok
* good
* easy
* ok
* the hacking mini-game need to be improved
* It's fun to use internet to resolve problems ! Good game.
* it was fun
* why didnt you look it up?
* Unexpectedly identical to the last such mission; I expected
different circumstances, not the same lost agent.
* Not bad, but I'd like more opportunity to apply my technical
skills to hacking a potentially unaware adversary, rather than
quick reactions against a hostile one.
* stressfull
* It's a nice game, looks real, especially with the real browsw
* of course
* Good
* ok
* no complaints
* thank you
* Great! I want more!
* Interesting
* great
* Good balance of difficulty. Hated all the clicking back and forth,
would have prefered typing.
* good
* fun
* curious
* it was not easy and quite confusing.
* Twas fun!
* it was really cool task. i liked it. Kudos
* Freaking great game! really innovative and different! Never had
this kind of experience before!
* Yes, really nice to work like this,iam really interested on this
kind of work.
* awesome
* could not understand what we were trying to achieve here
* it was cool
* je jf^spdiojfdsjf
* it was very interesting and fun
However those are only the comments of those who completed the mission.
Here is a graph showing where the players stopped playing the most (in
red) and how many were remaining (in blue) in the sessions I've seen:
(to complete with David's data, showing 9097 => 9248)
Aside from the bounce (which is surprisingly low at 40%), the three main
blockers seem to be:
* Typing something in the chat (the laziness to type mentioned by case?)
* Searching an answer on Google (the concept of those missions)
* Clicking on the "hack" or "submit" buttons (issues with: finding the
button, finding the right page for both hack and submit, also
performance/interest for minigame?).
Feedback written while reading the logs:
* Those who really try to play usually succeed at finding
painter+painting+pushkin. Giving help when the player types the wrong
answer works well with those who really play the game
http://humanityprojectonline.com/admin/sessions/session?id=6a3fd899e082886ec0b8fc6dc9f236f9
* Really need to have more emails from players, to recontact them afterwards
* Lots of improvements to make for detecting answers (cf tool from
Vlad), especially variations of "yes" (+handle swearing => propose an
alternate activity to the frustrated player)
* List URLs from Planet Watch mission + results
* Lots of funny answers - players like to play with the understanding of
the agent => need to find a way to play with that
* Players usually click or do something, even if they don't reply in the
chat - the desktop interface seems to be intriguing for them
* Very few players go past the first mission, even when they
successfully completed the first one => find way to draw them back to
the game.
** Seen quite a few who start the second mission but immediately quit
the game. Maybe also need to find an interest, a tension, something they
would want to check again. (make fun? progression? unlocking new stuff?
...?)
* Maybe asking "are you ready" twice at the beginning is too much -
since players usually test the bot on the first answer, they get a lot
of repeats from the first question - maybe it makes it look like "yes"
is still not good enough.
* Wondering if some of the sites entered by players in "Planet Watch"
mission didn't scare off some players - cf
http://humanityprojectonline.com/admin/sessions/session?id=572b5498c92b0c4392decea784ebdb1c
=> seemed really enthusiat about the game, but then dropped when he was
asked to confirm its first site
Examples of interesting sessions:
* Give good answers, but stuck by button
http://humanityprojectonline.com/admin/sessions/session?id=4edbe4c41e98d82ba3b1485aed4f0294
* Issues with the LinkedIn page - quite a few players ended up on a
different page than the one intended for the mission (maybe they clicked
in the window?) cf
http://humanityprojectonline.com/admin/sessions/session?id=ca8eea26e0afffa69386b7c6c461137a
* Pb with concept of searching google "Not interested"
http://humanityprojectonline.com/admin/sessions/session?id=5dcfdf834aaa0cc64c5279ea1942f779
Ideas for the admin:
* Generate KPIs on conversion & funnels
* Add URLs in reports
* Need to improve the readbility of the sessions log
** Separate answers and questions
** Make it clearer on which page the player is at any moment (what's all
those "go to site => Home" ?). Not sure we see the current one atm - cf
last action in
http://humanityprojectonline.com/admin/sessions/session?id=572b5498c92b0c4392decea784ebdb1c
=> should show the URL of the site displayed to the player, here it's
the URL before that is shown
** Only show the new answers from EagleOne, not the history
** Remove repetitions (probably comes from the fact that one action can
call several php pages) => especially at begginning of session, hard to
know what the player did
** Improve coverage of actions outside of the chat - hard to know what
the player is doing exactly
* Attach PHP & game log for each session
* Stats on hack success/failure and nb of tries
* Link to sessions: those who completed, who stopped at a given step, etc.
* Elements sur la frequence de jeu dans le temps / qui revient ?
* Display time to load game
Xavier.
_______________________________________________
Farsides mailing list - [email protected]
Wiki: http://farsides.com/
List: http://farsides.com/ml/
Forum: http://farsides.com/forum/
Ideas: http://farsides.com/ideas/
Chat: http://farsides.com/chat/
logs hpo feb 21.ods
Description: application/vnd.oasis.opendocument.spreadsheet
_______________________________________________ Farsides mailing list - [email protected] Wiki: http://farsides.com/ List: http://farsides.com/ml/ Forum: http://farsides.com/forum/ Ideas: http://farsides.com/ideas/ Chat: http://farsides.com/chat/
