I'm not thinking of hot cell caching. I'm talking about going the whole way and putting all the data in-memory. So yes, store file contents would be loaded into memory, though not the memcache, because that would get really complicated, I think. InMemoryStoreFile would really be what I was going for, I'd guess. The table wouldn't be read-only. Writes would go through to disk but reads would come straight from memory.

On Mar 31, 2008, at 8:42 PM, stack wrote:

A Reference-cache of hot cells would take a day at the outside I'd guess. The bulk of the work is done.

If you're talking about something else, lets discuss. What would it look like? Store MapFiles would be floated in memory or copied to MemCache? We'd need a special In-Memory MapFile? We'd do a bulk memcopy from HDFS up into mem and then you'd serve from there? Would the table have to be read-only?

St.Ack


Bryan Duxbury wrote:
Quick poll for us devs - if you had to guess, how long do you think it would take for the in-memory option of HBase to actually be implemented to work reliably?

-Bryan


Reply via email to