Seref, Sounds excellent and a good fit for HBase. Within a couple months, I expect us to have made significant progress with internal caching. This would potentially alleviate you from having to even think about doing any additional cache layers.
Best of luck. JG > -----Original Message----- > From: Seref Arikan [mailto:[EMAIL PROTECTED] > Sent: Tuesday, December 09, 2008 8:27 AM > To: [email protected] > Subject: Re: How can I running HBase on PHP > > Thanks Jonathan, > I am working on a quite complex domain layer with persistence waiting > as a > todo item. At the moment rdmbs solutions provide persistence, but a > production system will very likely go up to terabyte levels in terms of > storage, and hybrid approaches where data ends up in a scaleable > solution is > very attractive to me at the moment. > I'll be getting back with questions in a couple of months, given the > current > pace of my work, and I'm sure your experience and others' will be of > great > value. > > Kind regards > Seref > > On Tue, Dec 9, 2008 at 12:01 AM, Jonathan Gray <[EMAIL PROTECTED]> > wrote: > > > Also, 0.19 and 0.20 releases bring new mechanisms for caching data > > internally/automatically without the need for something like > Memcached on > > top. > > > > 0.19 (current trunk) already has block-caching which caches blocks > fetched > > from HDFS in an LRU-style queue. > > > > 0.20 will add a column cache which will store read cells into memory > in an > > LRU-style queue. This is very similar to how you might use Memcached > > externally. > > > > There are also plans for in-memory tables, hopefully in 0.20, and a > > time-based cache which would do something like "keep past 24 hours of > data > > in memory". These are still early in development but stay tuned to > the > > list > > over the next month or two to follow progress. > > > > Until then, it's increasingly common to put a Memcached-like key/val > on top > > of HBase to help with random reading performance. Memcached is in- > memory > > and typically based on TTLs, if you want to cache more data than can > fit in > > memory or you want real invalidations rather than expiration, you > might > > also > > look at BerkeleyDB or Tokyo Cabinet which are disk-based key/val > stores. > > If > > you have any more questions, there are a number of us on the list who > have > > done things like this and can help. > > > > JG > > > > > -----Original Message----- > > > From: Seref Arikan [mailto:[EMAIL PROTECTED] > > > Sent: Monday, December 08, 2008 2:30 PM > > > To: [email protected] > > > Subject: Re: How can I running HBase on PHP > > > > > > Thanks for your response. > > > > > > Best, > > > Seref > > > > > > On Mon, Dec 8, 2008 at 9:50 PM, Dan Zinngrabe <[EMAIL PROTECTED]> > > > wrote: > > > > > > > Not that I know of, though it's not difficult at all. There are > > > plenty of > > > > articles about memcached in general, and plenty about using it > with a > > > > database as well. It's very easy to apply those to using it with > > > HBase > > > > since > > > > memcached is a networked, in memory key-value store. > > > > > > > > On Mon, Dec 8, 2008 at 12:49 PM, Seref Arikan < > > > > [EMAIL PROTECTED]> wrote: > > > > > > > > > Ah, very nice news indeed. My schema is probably very fit for > > > HBase, a > > > > > plain > > > > > structure with only some node-value pairs. Any documents about > > > memcached > > > > > use > > > > > with HBase? > > > > > > > > > > Thanks > > > > > Seref > > > > > > > > > > > > > > > On Mon, Dec 8, 2008 at 8:46 PM, Krzysztof Szlapinski < > > > > > [EMAIL PROTECTED]> wrote: > > > > > > > > > > > Seref Arikan pisze: > > > > > > > > > > > >> Hi there, > > > > > >> Based on the response, can I assume that people use HBase as > a > > > backend > > > > > for > > > > > >> PHP? I've asked a question about real time use of HBase > before, > > > and > > > > the > > > > > >> general consensus seemed to be not yet, but in case PHP > based > > > web apps > > > > > are > > > > > >> using it as a backend, I'd love to hear about that. > > > > > >> > > > > > >> > > > > > > Yes, we are using hbase for our PHP web app with success (we > will > > > > release > > > > > > it the next two months). We use java bridge and though we had > to > > > > overcome > > > > > > some technical issues it works fine now. We had to develop a > > > middle > > > > tier > > > > > in > > > > > > java so it was easy for us to talk to hbase. Part of it > became a > > > > project > > > > > > called pigi (http://www.pigi-project.org/). > > > > > > > > > > > > krzysiek > > > > > > > > > > > > > > > > > > > > > > > > >
