I was looking for a way to replace mysql with hbase so I could serve data on websites. HADOOP-2171 solves that problem seams. I have not tested it much but latest patch (v02) seams to be working correctly. I thank I can get the hadoop-Streaming to work for what I need but it seams if I want to take full advantage of hadoop map/reduce I am going to have to learn java :)
Thanks for the help and patches. Keep up the good work and we will have a production version released before you know it. Billy "stack" <[EMAIL PROTECTED]> wrote in message news:[EMAIL PROTECTED] >I tried using streaming to dump into a hbase table. As things are >currently written, it unfortunately won't work. Streaming would seem to >presume keys and values of type Text whereas the TableOutputFormat takes a >key of type Text but the value is expected to be MapWritable (where the >keys are column names). Even if you could do types other than Text in >Streaming, an MW type is awkward for php/python, etc., to conpose. > > Regards your question as to how php might access hbase, at the moment your > options are few: > > + There is the Edward Yoon patch that you've already tripped over, > hadoop-2171. It puts up an IPC server that fields HQL strings. The > server does the HQL parse and forwards the interpreted request to the > hbase cluster. Included is a first cut at php code that is capable of > making the basic method call against the remote java IPC server. > + If traffic is light and your requests are read-only, there is the HQL > page in the master's webui. > > If hbase had a REST interface, hadoop-2068, would that work for you? > > St.Ack > > > Billy wrote: >> Can you show me an example on how that would be down with the command >> line? >> >> >> "Michael Stack" <[EMAIL PROTECTED]> wrote in >> message news:[EMAIL PROTECTED] >> >>> Billy wrote: >>> >>>> .. >>>> >>>> What I am looking to do is get and store the input and output from/in >>>> hbase. >>>> >>>> >>> I haven't tried it but it looks like you can specify input and output >>> classes for streaming with -inputformat and -outputformat options. >>> >>> Try setting these to TableInputFormat [1] and TableOutputFormat [2] >>> respectively. >>> >>> Usual caveats apply: These hbase classes need to be either bundled into >>> your job jar -- awkward in this case since you are using the streaming >>> job jar -- or they need to be on the cluster CLASSPATH (Add the >>> hadoop*hbase.jar to lib directory across the cluster is probably easiest >>> thing to do). >>> >>> St.Ack >>> >>> 1. >>> http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/javadoc/org/apache/hadoop/hbase/mapred/TableInputFormat.html >>> 2. >>> http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/javadoc/org/apache/hadoop/hbase/mapred/TableOutputFormat.html >>> >>> >> >> >> >> > >
