Ch, you may consider using flume as it already has a flume sink that can sink to hdfs. What I did is to set up a flume listening on an Avro sink, and then sink to hdfs. Then in my application, i just send my data to avro socket. Chen
On Thu, Feb 20, 2014 at 5:07 PM, ch huang <[email protected]> wrote: > hi,maillist: > is there any optimize for large of write into hdfs in same time > ? thanks >
