Hi Tom, I like how the players perform both phases of the game (question and answer) -- seems likely to keep the game fresh and interesting.
For the score, I might suggest a series of thumbs up / thumbs down decisions on aspects of intelligence. Or maybe a star rating. Looking forward to seeing how things progress after playing a bunch of games against different opponents. -Steve On Sat, Feb 27, 2016 at 8:50 PM, Matthew Taylor <[email protected]> wrote: > So far I think I'm losing to the robots. :/ > --------- > Matt Taylor > OS Community Flag-Bearer > Numenta > > > On Sat, Feb 27, 2016 at 10:08 AM, Scott Purdy <[email protected]> wrote: > > Looks cool, Tom! It seems like a good way to test out a certain type of > > algorithm. But you could certainly solve this task and still have a ways > to > > go for building AI for robotics and other applications. > > > > One interesting aspect of this is that you would have to train your AI on > > very recent news since I would guess that a lot of questions would be > about > > recent world events. This makes it a combination problem of creating an > > intelligent language agent as well as building the infrastructure to keep > > it's knowledge up-to-date. > > > > On Thu, Feb 25, 2016 at 2:00 PM, Alex Kamil <[email protected]> > wrote: > >> > >> great test, Tom! > >> I think you can make this game harder and more realistic by adding a > level > >> where users write or select short (few lines) stories or simple > scenarios > >> and ask questions about them, similar to Facebook bAbI tasks, basically > >> grading other player's understanding of context. > >> > >> Alex > >> > >> > >> On Thu, Feb 25, 2016 at 2:03 PM, Tom Silver <[email protected]> > wrote: > >>> > >>> Hi everyone, > >>> > >>> I was an algorithms intern at Numenta last summer and I'm currently > >>> finishing my undergraduate degree in CS and math at Harvard. For my > senior > >>> thesis, I am trying to develop "the first true test of AI". > >>> > >>> The test is centered around online games called Luna Games. (You can > try > >>> it out at http://luna-game.com.) I just published a Medium post > explaining > >>> the theory behind the test: > >>> > >>> > >>> > https://medium.com/@tomssilver/launching-the-luna-rating-system-481a965b11d4#.knrbv0oro > >>> > >>> I would love to get feedback from the NuPIC community about the test. > Do > >>> you think it actually makes sense as a test for AI? Do you think it's > >>> practical? > >>> > >>> Also, if anyone has their own Question Answering system that they would > >>> like to test, send me a note and we can get you set up. So far I have > only > >>> added very simple chatbots as players. > >>> > >>> Thanks in advance for any feedback you have! > >>> > >>> Best, > >>> > >>> Tom > >> > >> > > > >
