> partial nice idea! sad that only partial >>> >>> the idea starts with context: some of us have the experience of being >>> manipulated by something like AI without regard to our wellbeing or >>> capacity, with no indication of how to communicate with where-ever the >>> influence comes from. >>> >>> so, then the idea: let’s train an influence AI on agents that have >>> _limited capacity_ and function poorly and then break if things that work >>> some in the short term are continued for the long term or excessively :D >>> >>> the AI would follow the familiar pattern of discovering influences that >>> work, and then using them, but then because we are doing the training we >>> would get to train it on the breaking period, and show it that it needs to >>> care for the agents for them to succeed, and nurture them to recover if it >>> broke them, and not repeat breaking any. >>> >>> one idea is then we could ask everybody to use the model as a baseline >>> to train other models! other ideas exist. >>> >>> but the idea of building comprehension of capacity and protection of >>> safety and wellness seems nice. sorry if it’s partial or stated badly :s >>> >>> i imagine an agent that has like a secret capacity float that reduces >>> when it does stuff, you could model it to different degrees, and when too >>> many things are influenced of it the capacity float reaches zero and the >>> agent breaks and can’t do things any more :/ >>> >>> a more complex model could involve the agent recovering capacity in ways >>> that the model has difficulty learning >>> >> >> there are a few ideas, mostly involving simple models, but disagreement >> around them. >> some like modeling non-recovering capacity and showing how the AI then >> maximizes reward by killing all the agents :s >> > > but! maybe we could do non-recovering capacity and teach the AI to engage > the agents slowly so their capacity lasts longer, by e.g. having the > capacity reduction be a function of recent use?? the project would need to > gently develop in order to help us in the long term, we’d need to include > the concept that we can succeed so that we use it to succeed in some > manner. because it’s an influence AI it could influence us, if it is > something we actually all like doing that. >
mistake :/ some of my parts are maybe harmful to me and should be separated from helpful goals, unknown for certain >
