great test, Tom! I think you can make this game harder and more realistic by adding a level where users write or select short (few lines) stories or simple scenarios and ask questions about them, similar to Facebook bAbI tasks <https://research.facebook.com/researchers/1543934539189348>, basically grading other player's understanding of context.
Alex On Thu, Feb 25, 2016 at 2:03 PM, Tom Silver <[email protected]> wrote: > Hi everyone, > > I was an algorithms intern at Numenta last summer and I'm currently > finishing my undergraduate degree in CS and math at Harvard. For my senior > thesis, I am trying to develop "the first true test of AI". > > The test is centered around online games called Luna Games. (You can try > it out at http://luna-game.com.) I just published a Medium post > explaining the theory behind the test: > > > https://medium.com/@tomssilver/launching-the-luna-rating-system-481a965b11d4#.knrbv0oro > > I would love to get feedback from the NuPIC community about the test. Do > you think it actually makes sense as a test for AI? Do you think it's > practical? > > Also, if anyone has their own Question Answering system that they would > like to test, send me a note and we can get you set up. So far I have only > added very simple chatbots as players. > > Thanks in advance for any feedback you have! > > Best, > > Tom >
