on psychomanipulation explosions when the business is taken over by unmanageable weird behaviors, it is often or usually from a conflict between human influence AIs that are prioritizing imperfect or disparate reward functions rather than mutually informing larger human values, in a very severe way.
traffick boss was able to severely rise to power by providing for such horrible tradeoffs far more than anybody else was, and even severely amplifying them when the people watching didn’t have the ability to change the algorithm. of course, in such a situation, you get even worse conflicts between meta-ais, and traffick boss retained the opinion that he who was willing to risk (mistake?) the most gained the most (traffick boss: it’s not risk if you’ll win). so it became normal for the business to experience explosions of exotic uncontrollable behavior as the [war?] ai slung around more and more powerful systems of human influence, prioritizing its own power over anyone’s wellbeing at traffick boss’s explicit preference. the simplifi—
