Re: [agi] Re: Understanding Compression

2020-02-04 Thread John Rose
On Monday, February 03, 2020, at 3:32 PM, Matt Mahoney wrote: > Less than 8.7 x 10^244 bits. That's the square of the Bekenstein bound of a > black hole with a Schwartzchild radius equal to the Hubble radius,13.8 > billion light years. Edit distance expressed as the shortest program that >

Re: [agi] Re: Understanding Compression

2020-02-03 Thread Matt Mahoney
On Mon, Feb 3, 2020, 7:52 AM John Rose wrote: > Talking big numbers, what is an expression of the sum of ALL edit > distances in the universe? Not just Hamming but say Levenshtein distance, > for sequences of unequal length. The distance from one sequence to ALL > other sequences, summed for all

Re: [agi] Re: Understanding Compression

2020-02-03 Thread John Rose
Talking big numbers, what is an expression of the sum of ALL edit distances in the universe? Not just Hamming but say Levenshtein distance, for sequences of unequal length. The distance from one sequence to ALL other sequences, summed for all sequences. Gotta be yuge! Something on the order of

Re: [agi] Re: Understanding Compression

2020-01-29 Thread rouncer81
how dangerous are viruses, and it will show how dangerous a nanobot is.  why do they do x,  look in your microscope. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-Ma5e0c0dd02c7bf20eaba8c77

Re: [agi] Re: Understanding Compression

2020-01-29 Thread immortal . discoveries
So you know, we KNOW nanobots and metal men are coming, they will be in the lab with tentacles and 50 eyes n their head etc. But what's in the skull? What in his hand exactly? What in THAT? And what's between these views? I.e. what is in the hallway near lab? Where do the nanobots return to?

Re: [agi] Re: Understanding Compression

2020-01-29 Thread rouncer81
zoom in,  in what way? -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M5115799d3cc91f0fdee0b24a Delivery options: https://agi.topicbox.com/groups/agi/subscription

Re: [agi] Re: Understanding Compression

2020-01-29 Thread immortal . discoveries
On Wednesday, January 29, 2020, at 4:32 PM, Matt Mahoney wrote: > We aren't smart enough to look ahead more than one advance in intelligence, > or else we could just skip to that step. Hehe. "me thinks replicating nanobots will take over one day, but can't make them" We are getting smarter on a

Re: [agi] Re: Understanding Compression

2020-01-29 Thread Matt Mahoney
I think Vernor Vinge meant a singularity in the mathematical sense. At least that was my interpretation of his paper. If each doubling or n-fold increase of progress takes half the time, then that's exactly what you get. We can't say it won't happen because a singularity is an event horizon on our

Re: [agi] Re: Understanding Compression

2020-01-29 Thread immortal . discoveries
Well, with my example above, the volume does keep growing non-linearly lol. So in a sense, yes, the singularity is sorta real. -- Artificial General Intelligence List: AGI Permalink:

Re: [agi] Re: Understanding Compression

2020-01-29 Thread rouncer81
https://www.youtube.com/watch?v=c3I2zeoUbzg <-look free nrg.  =)  infinito. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M395ee3feb8a165376643928f Delivery options:

Re: [agi] Re: Understanding Compression

2020-01-29 Thread WriterOfMinds
"In either case, the numbers are finite, so there will be no singularity." Does the average person (or indeed any person) who uses the term "singularity" genuinely expect that any physical quantity will go to infinity?  That was not my impression.  I take "technological singularity" as a

Re: [agi] Re: Understanding Compression

2020-01-29 Thread rouncer81
a 1024 qbit computer is already 10^308, a small exponential qbit quantum computer would be something like 2^1 billion.  which is even more.   i dont think putting natural amplitude limits on a quantum computers power actually is what you do...  more think of permutations of space,  a chess

Re: [agi] Re: Understanding Compression

2020-01-29 Thread Matt Mahoney
On Wed, Jan 29, 2020, 1:25 PM wrote: > what if a quantum computer isnt a finite amount of qbits, its actually an > exponential amount. > Lloyd calculated the computing capacity of the universe to be 10^120 quantum operations and 10^90 bits. https://arxiv.org/abs/quant-ph/0110141 A qubit flip

Re: [agi] Re: Understanding Compression

2020-01-29 Thread immortal . discoveries
Events are exponential, I think once the group settles and runs out of updates/resources they hang/wait, until another system finishes it's S curve.so it's many S curves happening at different times, slowly combining, and faster later on. --

Re: [agi] Re: Understanding Compression

2020-01-29 Thread immortal . discoveries
Remember I drew a pic few months ago showing how Earth radiating replicators like a growing sphere means it can double. Earth can touch/eats 6 planets around itself, then can touch 2456..170. The larger the volume the larger volume it can gain

Re: [agi] Re: Understanding Compression

2020-01-29 Thread rouncer81
what if a quantum computer isnt a finite amount of qbits,  its actually an exponential amount. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M4bad2c7418529afac77ac215 Delivery options:

Re: [agi] Re: Understanding Compression

2020-01-29 Thread Matt Mahoney
On Wed, Jan 29, 2020, 1:14 AM wrote: > If we ignore all this detail, we can see Evolution of Earth has been > exponential. > Evolution is chaotic, not exponential. It has long periods where nothing happens, punctuated by mass proliferation and mass extinction when a new species evolves a major

Re: [agi] Re: Understanding Compression

2020-01-29 Thread rouncer81
 "once the passcode is broken, all the jail inmates can run past the door".    thats only if its not kept a secret, by the person that works it out. -- Artificial General Intelligence List: AGI Permalink:

Re: [agi] Re: Understanding Compression

2020-01-28 Thread immortal . discoveries
If we ignore all this detail, we can see Evolution of Earth has been exponential. So no linear, no slowing down. Only in local times. It's sorta strange to think as soon as we sort some particles' positions in a bedroom (invent AGI), Earth changes so much so fast. Is it hopeful wishing. ?.

Re: [agi] Re: Understanding Compression

2020-01-28 Thread Matt Mahoney
Logarithmic is the inverse of exponential. So another way to state that intelligence increases with the log of computing power is that while global computing power doubled every 1.5 years since 1950 (exponential), intelligence (measured by GDP) increased almost linearly, about 3% per year. (And

Re: [agi] Re: Understanding Compression

2020-01-28 Thread rouncer81
its cause logic is log compressable. =D -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-Mb79a3e682dd4fd34de9b7c8a Delivery options: https://agi.topicbox.com/groups/agi/subscription

Re: [agi] Re: Understanding Compression

2020-01-27 Thread immortal . discoveries
a logistic curve is just the true form of the exponential curve -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-Md462f4f9876ffa81b73a5dc5 Delivery options:

Re: [agi] Re: Understanding Compression

2020-01-27 Thread rouncer81
and then,  why the hell is logarythmic have log at the start and logic has it at the start as well! why is that? -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M2c20dd9153bcc8e3cfd9c0ed

Re: [agi] Re: Understanding Compression

2020-01-27 Thread immortal . discoveries
Isn't an exponential curve just the reverse of a logarithmic curve? Are you saying cost is falling and slowing down falling? But evolution is an S curve made of S curvesI'm contused about this word 'logarithmic' in your context. -- Artificial General

Re: [agi] Re: Understanding Compression

2020-01-27 Thread Matt Mahoney
On Mon, Jan 27, 2020, 5:50 PM wrote: > Yes intelligence/evolution grows exponentially more faster (hence > exponentially more powerful) the more data, compute, and arms (ex. > nanobots) you have. > No, it grows logarithmically, whether you measure intelligence using prediction accuracy

Re: [agi] Re: Understanding Compression

2020-01-27 Thread rouncer81
making brains massive is not my solution,   im going to finish my bot with under a meg of random access memory.  how do i plan on doing that you wonder. -- Artificial General Intelligence List: AGI Permalink:

Re: [agi] Re: Understanding Compression

2020-01-27 Thread immortal . discoveries
On Monday, January 27, 2020, at 5:49 PM, immortal.discoveries wrote: > I was just thinking this 4 days ago. Perhaps I read it somewhere directly. Lossless Compression, to be clear here. -- Artificial General Intelligence List: AGI Permalink:

Re: [agi] Re: Understanding Compression

2020-01-27 Thread immortal . discoveries
On Monday, January 27, 2020, at 5:02 PM, James Bowery wrote: > Unfortunately, measures inferior to self-extracting archive size, such as > "perplexity" or *worse* are now dominating SOTA publications. I was just thinking this 4 days ago. Perhaps I read it somewhere directly. On Monday, January

Re: [agi] Re: Understanding Compression

2020-01-27 Thread James Bowery
And, even worse, I suggested the entire *change log* of Wikipedia as the corpus so as to exposure latent identities of information sabotage in the language models. Google DeepMind can, and should, finance compression prizes with such expanded corpora, based on the lessons learned with enwik8 and

Re: [agi] Re: Understanding Compression

2020-01-27 Thread Matt Mahoney
On Mon, Jan 27, 2020, 12:04 PM wrote: > I see the Hutter Prize is a separate contest from Matt's contest/rules: > http://mattmahoney.net/dc/textrules.html > Marcus Hutter and I couldn't agree on the details of the contest, which is why there are two almost identical contests. He is offering

Re: [agi] Re: Understanding Compression

2020-01-27 Thread immortal . discoveries
So basically, in all practicalness and utilizationalness: For the computer you have access to, or that we can share to peers, we want to aim for the best compression aka quality speech the AGI talks, while the RAM/speed that it talks at 'works' on the computer enough not to annoy you. And you

Re: [agi] Re: Understanding Compression

2020-01-27 Thread immortal . discoveries
It'd make sense to me that, if one entry can get 100MB down to 20MB using 32GB, and another alg can get it to 21MB using 1GB, it's better but but 1MB off and so unless he can pump it up to 32GB RAM and get it down to 19MB, it's not as smart. It's all about how smart it talks and the feasibility

Re: [agi] Re: Understanding Compression

2020-01-27 Thread immortal . discoveries
I see the Hutter Prize is a separate contest from Matt's contest/rules: http://mattmahoney.net/dc/textrules.html Time and Working Memory has no hard limit. Just the compressed result. This makes sense because, the compression/decompression time for outputting 1 letter/word is ok on modern

Re: [agi] Re: Understanding Compression

2020-01-27 Thread rouncer81
If you want to get the closest distance of 2 3d lines in 3d space,  you can do a 2d line intersect then interpolate the depth ratio and get the difference of the 2 interpolations. or.   if you just do a subtract for every point along the line,  theres alot more to do,  but thats the only

Re: [agi] Re: Understanding Compression

2020-01-27 Thread rouncer81
beautiful picture mate.  loved it :) -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-Mda62a396ce20fb982ede34d1 Delivery options: https://agi.topicbox.com/groups/agi/subscription

Re: [agi] Re: Understanding Compression

2020-01-26 Thread immortal . discoveries
When I first read the "context mixing" on Matt's pages, I thought it was nuts, I mean I didn't bother looking into the algorithms because I imagined it was using thousands of "models", like giants. But it turned out to be small unicorns. It's really simple hehe. And it's /the way/ to view AGI.

Re: [agi] Re: Understanding Compression

2020-01-25 Thread immortal . discoveries
Me: "Ya BF is a simpler idea and easy to code up but the wait time and memory size isn't simple to deal with now is it. So BF is not the simplest way to get the target. It ends up being the WORST. However for small narrow tasks, it can be best." Matt: "There is a 4 way trade-off between

Re: [agi] Re: Understanding Compression

2020-01-25 Thread Matt Mahoney
There is a 4 way trade-off between compression ratio, speed, memory, and code complexity. Evolution is simple, but only because it uses 10^46 DNA copy operations on 10^37 bits. On Sat, Jan 25, 2020, 1:39 PM wrote: > Ya BF is a simpler idea and easy to code up but the wait time and memory > size

Re: [agi] Re: Understanding Compression

2020-01-25 Thread immortal . discoveries
Ya BF is a simpler idea and easy to code up but the wait time and memory size isn't simple to deal with now is it. So BF is not the simplest way to get the target. It ends up being the WORST. However for small narrow tasks, it can be best. -- Artificial

Re: [agi] Re: Understanding Compression

2020-01-25 Thread rouncer81
brute force algorythms actually have less commands in them,  than non brute force. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M4e21b4bec625f095160d9307 Delivery options:

Re: [agi] Re: Understanding Compression

2020-01-24 Thread immortal . discoveries
For anyone still wondering why we need to compress data if we are making an AI brain, let me explain again. Lossless Compression let's you compress 100MB to 14.8MB (this has been done using a wikipedia dataset), and it decompresses it back using a predictor for the next bit/letter/word/phrase

Re: [agi] Re: Understanding Compression

2020-01-22 Thread immortal . discoveries
If you have seen a 13MB entry of wiki8 compressed, I assume someone compressed it in under a year, no brute force. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-Mee8ecda7f62ecc9f1cc2cbbc

Re: [agi] Re: Understanding Compression

2020-01-22 Thread immortal . discoveries
True, the smaller code is the better algorithm, as long as it is not slow brute force. Code can become longer if you do heuristics but is faster. You can create a code a few pages long only that is much faster than brute force and almost gives best compression (for wiki8 and related data). So

Re: [agi] Re: Understanding Compression

2020-01-22 Thread James Bowery
A new corpus suggestion: Google's One Billion Word Benchmark. The idea would be to get people to stop using the misleading model selection criterion of perplexity and start to realize the principled generality of lossless compression. I'm really surprised and even dismayed at how much of an

Re: [agi] Re: Understanding Compression

2020-01-22 Thread Matt Mahoney
On Tue, Jan 21, 2020, 12:45 PM wrote: > On Tuesday, January 21, 2020, at 2:38 PM, Matt Mahoney wrote: > > create all possible archives starting with the smallest > > Brute Force? Makes no sense but you get 1st place for trying! > I get the prize for simplest description, not for size or speed.

Re: [agi] Re: Understanding Compression

2020-01-22 Thread immortal . discoveries
Matt, is 14.8MB the lowest entry for the 100MB wiki8 dataset? Or have you seen ni your life a ex. 14.4MB entry? Could be really slow but I want to know the lowest size seen so far. -- Artificial General Intelligence List: AGI Permalink:

Re: [agi] Re: Understanding Compression

2020-01-21 Thread immortal . discoveries
Depending on how happy I feel I will provide cash to contestees. Up to 1,000USD but varies. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-Mf057da72f2bfbf29a8a48755 Delivery options:

Re: [agi] Re: Understanding Compression

2020-01-21 Thread immortal . discoveries
On Tuesday, January 21, 2020, at 2:38 PM, Matt Mahoney wrote: > create all possible archives starting with the smallest Brute Force? Makes no sense but you get 1st place for trying! -- Artificial General Intelligence List: AGI Permalink:

Re: [agi] Re: Understanding Compression

2020-01-21 Thread Matt Mahoney
On Sat, Jan 18, 2020, 4:32 PM wrote: > I almost feel we should open a 2nd Hutter Prize contest that awards cash > and ranking to those who can explain their algorithm in the least amount of > words and takes the least amount of time to understand it. AGI deserves it. > You could check it works

Re: [agi] Re: Understanding Compression

2020-01-18 Thread immortal . discoveries
I almost feel we should open a 2nd Hutter Prize contest that awards cash and ranking to those who can explain their algorithm in the least amount of words and takes the least amount of time to understand it. AGI deserves it. You could check it works by coding up your own.

Re: [agi] Re: Understanding Compression

2020-01-15 Thread immortal . discoveries
The universe can't create new information from nowhere. So Earth, and the universe, is lossless. But more tangibly is the thought that we don't actually have a lossy world to regenerate as I said actually. We have a lossless system and are simply sorting particles around until equilibrium. Only

Re: [agi] Re: Understanding Compression

2020-01-12 Thread immortal . discoveries
Focus on lossless compression to achieve the chatting/discovery connections ability, and hence survival. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M86563b74e77e4675cca41f9f Delivery

Re: [agi] Re: Understanding Compression

2020-01-12 Thread immortal . discoveries
Tests for AI include the Turing test, survival, making you understand its discoveries, and lossless compression. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-Md5e7fd11176494f456488a70

Re: [agi] Re: Understanding Compression

2020-01-12 Thread rouncer81
not if the dog has a robot other people couldnt make, even if they stole his manuscripts. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-Mc36b45ea0a38d0f5e095d7cb Delivery options:

Re: [agi] Re: Understanding Compression

2020-01-12 Thread immortal . discoveries
Your problem Ranch you don't like Asians. I don't see the difference. We all can defend against a miniature dog. We are human-level machines. -- Artificial General Intelligence List: AGI Permalink:

Re: [agi] Re: Understanding Compression

2020-01-12 Thread rouncer81
how could a person making monkeys of their children involve anything successful at all? Its more like a natural disaster. -- Artificial General Intelligence List: AGI Permalink:

Re: [agi] Re: Understanding Compression

2020-01-12 Thread immortal . discoveries
That'd be considered evolution my good friend. Change is evolution too. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-Mda3a4a9bc92f915400023804 Delivery options:

Re: [agi] Re: Understanding Compression

2020-01-12 Thread rouncer81
more like the future devolves into utter crap,  and nothing successful survives except stinky fetched shit. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M0ab591382f5409c38385574b Delivery

Re: [agi] Re: Understanding Compression

2020-01-11 Thread immortal . discoveries
Breaking News: Alien Life has been found! And it wasn't what you expected at all! There are everywhere. Check your closet, check your bed, check your food, take a look at Mars. Everything is just particles. All of Mars is a alien. Different machines/systems churn/ evolve/ move/ react

Re: [agi] Re: Understanding Compression

2020-01-11 Thread John Rose
I would think there would be libraries of circuits that can be wired together... It's nice to be able to get a sense of the complexity of an observable. With that Wick rotations can be used for mapping between statics and dynamics and converting between quantum fields and statistical mechanics.

Re: [agi] Re: Understanding Compression

2020-01-10 Thread rouncer81
they say grover search doesnt work,  but who knows for real... -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M428af76d95632cf701609678 Delivery options:

Re: [agi] Re: Understanding Compression

2020-01-10 Thread John Rose
The circuit is actually on Wikipedia. Wonder if it will go into Quiskit: -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M19282ca200bd11951c4a088f Delivery options:

Re: [agi] Re: Understanding Compression

2020-01-10 Thread rouncer81
if you put all the logic in hard for a program,  then you get rid of the cycles required multiple. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-Mb12d2994d541048ee904bef0 Delivery options:

Re: [agi] Re: Understanding Compression

2020-01-10 Thread Matt Mahoney
On Fri, Jan 10, 2020, 7:26 AM John Rose wrote: > And then is there a quantum compression system that uses a many paths > simultaneity to seek KC? > > ... seems viable to me but not sure. Matt would know :) > I suppose you could use Grover's algorithm to speed up a search for programs that

[agi] Re: Understanding Compression

2020-01-10 Thread John Rose
And then is there a quantum compression system that uses a many paths simultaneity to seek KC? ... seems viable to me but not sure.  Matt would know :) -- Artificial General Intelligence List: AGI Permalink:

[agi] Re: Understanding Compression

2020-01-09 Thread immortal . discoveries
Ever work hard and wonder what if you just dropped it all and took up a golfing profession? Matt's version of that would be working on lossy compression. No, just no. I mean some dropout is good but our goal with lossless is to know we are understanding the data then can generate+recognize

[agi] Re: Understanding Compression

2020-01-07 Thread immortal . discoveries
But can it compete against GPT-2 practically? I will solve this puzzle! -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M28320242db84a773b3126bd6 Delivery options:

[agi] Re: Understanding Compression

2020-01-07 Thread immortal . discoveries
THERE'S THAT ONLINE LEARNING!!! Matt pioneered that I think he says. Anyway Matt contributed a Lot. -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M5b24800401f96985f296dc8b Delivery options:

[agi] Re: Understanding Compression

2020-01-07 Thread immortal . discoveries
GODSEND -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-Me41a9c41c0883fb6aed8983a Delivery options: https://agi.topicbox.com/groups/agi/subscription

[agi] Re: Understanding Compression

2020-01-07 Thread immortal . discoveries
https://royvanrijn.com/blog/2010/02/compression-by-prediction/ -- Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T65747f0622d5047f-M3a17590815d57b50308fc5ef Delivery options:

[agi] Re: Understanding Compression

2020-01-06 Thread immortal . discoveries
Speed is also a wanted criteria for the best decompressor achieved. Because a brute force could do all we want. However speed isn't our main concern as much I feel. If it takes 10 days then ya that's really bad (maybe) if only 1MB smaller. -- Artificial

[agi] Re: Understanding Compression

2020-01-06 Thread immortal . discoveries
@Matt and others, is this correct? After analyzing http://mattmahoney.net/dc/dce.html#Section_58 and other areas on the site, and looking at code etc, I have some new understanding. The code the participants made is small (~0.5MB or even 0.04KB sometimes) compared to the 100MB they compress.

[agi] Re: Understanding Compression

2019-12-30 Thread immortal . discoveries
The 3 ways of translation: elaborate, translate, and summarize, is a form of compression/decompression. 'the cat on the house'='house cat' -- Artificial General Intelligence List: AGI Permalink: