--- On Mon, 11/3/08, John G. Rose <[EMAIL PROTECTED]> wrote:

> This study - 
> http://www.cogsci.rpi.edu/CSJarchive/1986v10/i04/p0477p0493/MAIN.PDF
> 
> is just throwing a dart at the wall. You'd need
> something more real life
> instead of word and picture recall calculations to arrive
> at a number even close to actual.

It is the best estimate we have today. However you are right that there is more 
to memory than words and pictures. How do you measure the memory that we used 
to learn to see and to walk?

Anyway, thanks for the link. I had not been able to find it online.

> > Just looking at the speed/memory/accuracy tradeoffs of
> various models
> > at http://cs.fit.edu/~mmahoney/compression/text.html
> (the 2 graphs
> > below the main table), it seems that memory is more of
> a limitation
> > than CPU speed. A "real time" language model
> would be allowed 10-20
> > years.
> > 
> 
> I'm sorry, what are those 2 graphs indicating? To get a
> smaller compressed
> size more running memory is needed? That y-axis is a
> compressor runtime
> memory limit specified by a command line switch or is it
> just what the
> compressor consumes for the data to be compressed?

The compressed size vs. memory chart shows how much memory the compressor 
requires. In theory, a model with 10^9 bits could be represented in 128 MB of 
memory. But in practice we need much more to achieve any kind of efficiency, at 
least 4 GB it seems. The graph doesn't show any hint of leveling off.

Both graphs show only the compressors on the Pareto frontier, which means no 
better compressor uses less memory or is faster. For each compressor, I tested 
only using the options for maximum compression. Many compressors allow other 
options for greater speed or less memory, so it could result in additional data 
points. However these points tend to trend along the same line as the overall 
graph.

-- Matt Mahoney, [EMAIL PROTECTED]



-------------------------------------------
agi
Archives: https://www.listbox.com/member/archive/303/=now
RSS Feed: https://www.listbox.com/member/archive/rss/303/
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=8660244&id_secret=117534816-b15a34
Powered by Listbox: http://www.listbox.com

Reply via email to