No, because in my problem formulation, there is an agenda, with prioritized goalsso not all the options (slot machines) are ranked equally. Moreover at every time step / choice point we want to take the best action that addresses the most urgent or highest priority goal at the time. This is akin to knowing which slot machine to play next. So we already have an ordering on the slot machines. The problem is after we've pulled a lever and there is no payout, how often to go back and re-pull a lever. So I would consider it more of a dynamic planning problem. http://en.wikipedia.org/wiki/Reactive_planning And therein may lie the answer. We don't worry about how many tries at all. So I suppose the answer is, just keep trying until there's something better (more interesting or more urgent) to do. Perhaps. Now to define "more interesting and more urgent"... ~PM > Date: Sun, 28 Sep 2014 21:13:47 +0900 > From: [email protected] > To: [email protected] > Subject: Re: [agi] How many tries? > > Is your problem related to the multi-armed bandit problem? > http://en.wikipedia.org/wiki/Multi-armed_bandit > > (Sorry if someone has mentioned it---I didn't find it...) > > -NA > > ----- Original Message ----- > >From: "Piaget Modeler via AGI" <[email protected]> > >To: "AGI" <[email protected]> > >Subject: RE: [agi] How many tries? > >Date: Wed, 24 Sep 2014 20:11:52 -0700 > > > >How many solutions should we attempt before throwing in the towel? > > > >How many tries should you, a child, or an AGI give to an intention before get > ting frustrated and giving up? > >Given that one could choose to focus on an intention or ignore it, at what po > int does failure on an intention turn the focus to avoidance, and ultimately a > bandonment of the intention? > >And yes I know it depends on what else is going on, so suppose context is hel > d constant andwe were only focusing on one intention of many in our agenda (in > tention set). > >Kindly advise. > >~PM > > > > ------------------------------------------- > AGI > Archives: https://www.listbox.com/member/archive/303/=now > RSS Feed: https://www.listbox.com/member/archive/rss/303/19999924-4a978ccc > Modify Your Subscription: https://www.listbox.com/member/?&; > Powered by Listbox: http://www.listbox.com
------------------------------------------- AGI Archives: https://www.listbox.com/member/archive/303/=now RSS Feed: https://www.listbox.com/member/archive/rss/303/21088071-f452e424 Modify Your Subscription: https://www.listbox.com/member/?member_id=21088071&id_secret=21088071-58d57657 Powered by Listbox: http://www.listbox.com
