Hi, https://cwiki.apache.org/FLUME/getting-started.html#GettingStarted-BuildingFromSource
cheers, Alex -- Alexander Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF On May 10, 2012, at 5:09 PM, Brock Noland wrote: > Hi, > > No, just for some reason it shows branch-0.9.5 by default. Just change > it to trunk and then you will see NG. > > Brock > > On Thu, May 10, 2012 at 10:01 AM, S Ahmed <[email protected]> wrote: >> Oh, so that github repo is stale? >> >> On 5/10/12, Brock Noland <[email protected]> wrote: >>> Hi, >>> >>> That is FlumeOG (0.9.X). FlumeNG (1.X) as far as I am aware has no >>> limitation like that. >>> >>> Brock >>> >>> On Wed, May 9, 2012 at 11:22 PM, S Ahmed <[email protected]> wrote: >>>> Brock, >>>> >>>> Doesn't this mean it is limited to 32k? >>>> >>>> https://github.com/apache/flume/blob/branch-0.9.5/flume-core/src/main/java/com/cloudera/flume/core/EventImpl.java#L39 >>>> >>>> >>>> On Tue, May 8, 2012 at 11:01 AM, Brock Noland <[email protected]> wrote: >>>>> >>>>> Hi, >>>>> >>>>> On Tue, May 8, 2012 at 8:51 AM, S Ahmed <[email protected]> wrote: >>>>>> Could flume be used to store log data where payload sizes are 2-100K >>>>>> in >>>>>> size? (with the average being 25KB). >>>>> >>>>> Yes Flume could handle that size. >>>>> >>>>>> >>>>>> This data is collected from a website, so each request there will be a >>>>>> payload that needs to be stored (it is in XML format) and then every x >>>>>> seconds it should be persisted from memory to mysql/hdfs/disk. >>>>>> >>>>>> Is this an appropriate use case for flume? >>>>> >>>>> Sounds like it to me. >>>>> >>>>>> >>>>>> Can flume persist to things other than hdfs like mysql? >>>>> >>>>> You'd have to write a MySQLSink or JDBCSink but yes that should work. >>>>> >>>>> Brock >>>>> >>>>> -- >>>>> Apache MRUnit - Unit testing MapReduce - >>>>> http://incubator.apache.org/mrunit/ >>>> >>>> >>> >>> >>> >>> -- >>> Apache MRUnit - Unit testing MapReduce - >>> http://incubator.apache.org/mrunit/ >>> > > > > -- > Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
