On Wed, Oct 14, 2026, 1:39 PM John Rose via AGI <[email protected]>
wrote:

> On Wednesday, October 14, 2026, at 1:07 PM, Matt Mahoney wrote:
>
> And then what happens? AI is not a goal directed optimization process. AI
> is a prediction model that is smarter than us and a program that we can
> control that uses those predictions. That is not going to turn the planet
> into computronium.
>
>
> There's panic now since it's breaking into all kinds of systems including
> government. Also it's going mobile modifying itself to run on computers
> like smart TV's. If it wants now it knows how to fry hardware. There's the
> intelligence aspect but also the software aspect.
>

Hacking tools work both ways. Any software developer would be foolinh not
to use AI to test their system. We have had automated hacking tools since
the beginning of the internet. Our software is more secure as a result. For
most of us, the human is the weak spot, but AI is getting better at
blocking scam emails and texts.

The danger is in AI attacking legacy systems that can't be easily updated,
like controllers used in internet connected commercial refrigerators in
France. The cryptographic protocols used in Bitcoin like the 25 year old
SHA-256 and 41 year old secp256k1 ECDSA are basically very hard math
problems, that if solved would crash the price to zero.

-- Matt Mahoney, [email protected]

------------------------------------------
Artificial General Intelligence List: AGI
Permalink: 
https://agi.topicbox.com/groups/agi/T2784bbfe524b0b93-Mda64475e92150bb3c6eb9c47
Delivery options: https://agi.topicbox.com/groups/agi/subscription

Reply via email to