[jira] [Commented] (FLUME-2373) Enable configuration to switch thrift source serialization protocol

2014-12-01 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14230649#comment-14230649 ] Hari Shreedharan commented on FLUME-2373: - Hi Stefan, This generally looks

[jira] [Created] (FLUME-2565) HDFS Sink under-replication check does not work on encrypted HDFS

2014-12-01 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created FLUME-2565: --- Summary: HDFS Sink under-replication check does not work on encrypted HDFS Key: FLUME-2565 URL: https://issues.apache.org/jira/browse/FLUME-2565 Project: Flume

[jira] [Assigned] (FLUME-2565) HDFS Sink under-replication check does not work on encrypted HDFS

2014-12-01 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan reassigned FLUME-2565: --- Assignee: Hari Shreedharan > HDFS Sink under-replication check does not work

[jira] [Commented] (FLUME-2562) Metrics for Flafka components

2014-11-21 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221305#comment-14221305 ] Hari Shreedharan commented on FLUME-2562: - Extending is fine. In fact, I thin

[jira] [Created] (FLUME-2561) Add metrics to Kafka Channel

2014-11-20 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created FLUME-2561: --- Summary: Add metrics to Kafka Channel Key: FLUME-2561 URL: https://issues.apache.org/jira/browse/FLUME-2561 Project: Flume Issue Type: Bug

[jira] [Commented] (FLUME-2560) Kafka channel entries missing for output jar generation

2014-11-20 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220294#comment-14220294 ] Hari Shreedharan commented on FLUME-2560: - Looks good. Running tests

[jira] [Commented] (FLUME-2555) TestKafkaChannel tests intermittently fails on JDK8

2014-11-18 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217401#comment-14217401 ] Hari Shreedharan commented on FLUME-2555: - This slows down the build a lot

[jira] [Commented] (FLUME-2488) TestElasticSearchRestClient fails on Oracle JDK 8

2014-11-18 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217378#comment-14217378 ] Hari Shreedharan commented on FLUME-2488: - I took a look at this. I think t

[ANNOUNCE] Apache Flume 1.5.2 released

2014-11-18 Thread Hari Shreedharan
The Apache Flume team is pleased to announce the release of Flume version 1.5.2. Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. This release can be downloaded from the Flume download page at: http://flume.apac

Re: [VOTE] Apache Flume 1.5.2 RC1

2014-11-17 Thread Hari Shreedharan
This vote is now closed.  The vote passes with: +1 (4 binding, 2 non-binding):  Johny Rufus (Non-binding) Ashish Paliwal (Non-binding) Jarcec (Binding) Roshan Naik (Binding) Arvind Prabhakar (Binding) Hari Shreedharan (Binding) +0: None -1 : None As a result of this vote

Re: [VOTE] Apache Flume 1.5.2 RC1

2014-11-14 Thread Hari Shreedharan
; +1 >> >> * Verified checksums and signature files >> * Verified that each jar in binary tarball is in the license >> * Checked top level files (NOTICE, ...) >> * Run tests >> >> (pretty much the same email I’ve sent for 1.5.1 :)) >> >> Jarcec >

[jira] [Commented] (FLUME-2553) Error while saving data to hbase java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.Increment.setWriteToWAL(Z)Lorg/apache/hadoop/hbase/client/Increment;

2014-11-14 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14212620#comment-14212620 ] Hari Shreedharan commented on FLUME-2553: - You need to build Flume against h

[jira] [Commented] (FLUME-2553) Error while saving data to hbase java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.Increment.setWriteToWAL(Z)Lorg/apache/hadoop/hbase/client/Increment;

2014-11-14 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14212545#comment-14212545 ] Hari Shreedharan commented on FLUME-2553: - What version of HBase are you u

[jira] [Commented] (FLUME-2538) TestResettableFileInputStream fails on JDK 8

2014-11-13 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14211249#comment-14211249 ] Hari Shreedharan commented on FLUME-2538: - This looks good. Can you link

Re: [VOTE] Apache Flume 1.5.2 RC1

2014-11-12 Thread Hari Shreedharan
>> If you find something out of place, let me know - we can spin another RC. >> >> >> Thanks, >> Hari >> >> On Wed, Nov 12, 2014 at 1:15 PM, Hari Shreedharan >> wrote: >> >> > This is the eighth release for Apache Flume as a top-level project, >

Re: [VOTE] Apache Flume 1.5.2 RC1

2014-11-12 Thread Hari Shreedharan
1:15 PM, Hari Shreedharan wrote: > This is the eighth release for Apache Flume as a top-level project, > version 1.5.2. We are voting on release candidate RC1. > This release fixes an incompatibility with Java 6 based clients found > in Apache Flume 1.5.1 Release. > It fixe

[jira] [Commented] (FLUME-2538) TestResettableFileInputStream fails on JDK 8

2014-11-12 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208848#comment-14208848 ] Hari Shreedharan commented on FLUME-2538: - I like the patch, but I'd

[VOTE] Apache Flume 1.5.2 RC1

2014-11-12 Thread Hari Shreedharan
This is the eighth release for Apache Flume as a top-level project, version 1.5.2. We are voting on release candidate RC1. This release fixes an incompatibility with Java 6 based clients found in Apache Flume 1.5.1 Release. It fixes the following issues:https://git-wip-us.apache.org/repos/asf?p=f

[jira] [Updated] (FLUME-2551) Add dev-support to src tarball

2014-11-12 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2551: Issue Type: Improvement (was: Bug) > Add dev-support to src tarb

[jira] [Updated] (FLUME-2547) Removing SSLv2Hello causes Java 6 clients to break

2014-11-12 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2547: Fix Version/s: v1.5.2 > Removing SSLv2Hello causes Java 6 clients to br

[jira] [Updated] (FLUME-2549) Enable SSLv2Hello for HttpSource

2014-11-12 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2549: Fix Version/s: v1.5.2 > Enable SSLv2Hello for HttpSou

[jira] [Updated] (FLUME-2548) Enable SSLv2Hello for Avro Source and NettyAvroRpcClient

2014-11-12 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2548: Fix Version/s: v1.5.2 > Enable SSLv2Hello for Avro Source and NettyAvroRpcCli

[jira] [Resolved] (FLUME-2551) Add dev-support to src tarball

2014-11-12 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan resolved FLUME-2551. - Resolution: Fixed Committed. > Add dev-support to src tarb

[jira] [Created] (FLUME-2551) Add dev-support to src tarball

2014-11-12 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created FLUME-2551: --- Summary: Add dev-support to src tarball Key: FLUME-2551 URL: https://issues.apache.org/jira/browse/FLUME-2551 Project: Flume Issue Type: Bug

Re: SSLv2Hello is required on Java 6

2014-11-12 Thread Hari Shreedharan
>> On Nov 11, 2014, at 2:03 PM, Hari Shreedharan >> wrote: >> >> Hi, >> >> >> Right after we pushed 1.5.1 out (I have not even sent the announce email), >> we discovered that Java 6 requires SSLv2Hello on the server side for >> negotiat

Re: Using CodaHale metrics for monitoring

2014-11-11 Thread Hari Shreedharan
o figure > out how managing the Reporter part. Let me try to put a patch > together. > On Wed, Nov 12, 2014 at 9:29 AM, Hari Shreedharan > wrote: >> Currently the metrics exposed via Sources/sinks/channels are hardcoded. We >> could add a method to add custom m

[jira] [Comment Edited] (FLUME-2307) Remove Log writetimeout

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207651#comment-14207651 ] Hari Shreedharan edited comment on FLUME-2307 at 11/12/14 4:1

[jira] [Commented] (FLUME-2307) Remove Log writetimeout

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207651#comment-14207651 ] Hari Shreedharan commented on FLUME-2307: - >From the logs you have here,

[jira] [Commented] (FLUME-2307) Remove Log writetimeout

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207645#comment-14207645 ] Hari Shreedharan commented on FLUME-2307: - >From your logs, I don&#x

Re: Using CodaHale metrics for monitoring

2014-11-11 Thread Hari Shreedharan
ters/Meters and > be available to have those Metrics available via the framework. I > think CounterGroup was created for the same purpose. > Let me create a JIRA for this and work on it. > thanks > ashish > On Wed, Nov 12, 2014 at 1:11 AM, Hari Shreedharan > wrote: >>

[jira] [Commented] (FLUME-2307) Remove Log writetimeout

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207640#comment-14207640 ] Hari Shreedharan commented on FLUME-2307: - This does not seem like it is du

[jira] [Updated] (FLUME-2549) Enable SSLv2Hello for HttpSource

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2549: Attachment: FLUME-2549.patch > Enable SSLv2Hello for HttpSou

[jira] [Updated] (FLUME-2548) Enable SSLv2Hello for Avro Source and NettyAvroRpcClient

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2548: Attachment: FLUME-2549.patch > Enable SSLv2Hello for Avro Source and NettyAvroRpcCli

[jira] [Updated] (FLUME-2548) Enable SSLv2Hello for Avro Source and NettyAvroRpcClient

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2548: Attachment: (was: FLUME-2549.patch) > Enable SSLv2Hello for Avro Source

[jira] [Updated] (FLUME-2548) Enable SSLv2Hello for Avro Source and NettyAvroRpcClient

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2548: Attachment: FLUME-2548.patch > Enable SSLv2Hello for Avro Source and NettyAvroRpcCli

[jira] [Created] (FLUME-2548) Enable SSLv2 for Avro Source and NettyAvroRpcClient

2014-11-11 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created FLUME-2548: --- Summary: Enable SSLv2 for Avro Source and NettyAvroRpcClient Key: FLUME-2548 URL: https://issues.apache.org/jira/browse/FLUME-2548 Project: Flume

[jira] [Created] (FLUME-2549) Enable SSLv2Hello for HttpSource

2014-11-11 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created FLUME-2549: --- Summary: Enable SSLv2Hello for HttpSource Key: FLUME-2549 URL: https://issues.apache.org/jira/browse/FLUME-2549 Project: Flume Issue Type: Sub-task

[jira] [Updated] (FLUME-2547) Removing SSLv2Hello causes Java 6 clients to break

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2547: Attachment: (was: FLUME-2547.patch) > Removing SSLv2Hello causes Java 6 clients

[jira] [Updated] (FLUME-2548) Enable SSLv2Hello for Avro Source and NettyAvroRpcClient

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2548: Summary: Enable SSLv2Hello for Avro Source and NettyAvroRpcClient (was: Enable SSLv2 for

[jira] [Updated] (FLUME-2547) Removing SSLv2Hello causes Java 6 clients to break

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2547: Attachment: FLUME-2547.patch > Removing SSLv2Hello causes Java 6 clients to br

[jira] [Commented] (FLUME-2546) HTTP Source docs should not that neither SSLv2Hello nor SSLv3 are supported

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207231#comment-14207231 ] Hari Shreedharan commented on FLUME-2546: - Holding off on this one till F

SSLv2Hello is required on Java 6

2014-11-11 Thread Hari Shreedharan
Hi, Right after we pushed 1.5.1 out (I have not even sent the announce email), we discovered that Java 6 requires SSLv2Hello on the server side for negotiation even if TLS is used (unless the client code is also changed to disable SSLv2Hello). So: - For HTTP Source, any clients running on Ja

[jira] [Created] (FLUME-2547) Removing SSLv2Hello causes Java 6 clients to break

2014-11-11 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created FLUME-2547: --- Summary: Removing SSLv2Hello causes Java 6 clients to break Key: FLUME-2547 URL: https://issues.apache.org/jira/browse/FLUME-2547 Project: Flume Issue

[jira] [Updated] (FLUME-2546) HTTP Source docs should not that neither SSLv2Hello nor SSLv3 are supported

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2546: Attachment: FLUME-2546.patch I am applying this patch to the 1.5.1 docs and uploading to

[jira] [Created] (FLUME-2546) HTTP Source docs should not that neither SSLv2Hello nor SSLv3 are supported

2014-11-11 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created FLUME-2546: --- Summary: HTTP Source docs should not that neither SSLv2Hello nor SSLv3 are supported Key: FLUME-2546 URL: https://issues.apache.org/jira/browse/FLUME-2546

[jira] [Commented] (FLUME-2441) Unit test TestHTTPSource.java failed with IBM JDK 1.7

2014-11-11 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206932#comment-14206932 ] Hari Shreedharan commented on FLUME-2441: - It went into 1.5.1 > Un

Re: Using CodaHale metrics for monitoring

2014-11-11 Thread Hari Shreedharan
> As of now we have to hide it within MonitoredCounterGroup and its > sub-classes, that's what I did for running it. It was running parallel > to existing system. Let me work more on it and see if I can simplify > the same. > On Tue, Nov 11, 2014 at 4:50 AM, Hari Shreedharan

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
This vote is now closed.  This vote has passed with 4 +1 binding votes: - Arvind Prabhakar - Roshan Naik - Hari Shreedharan - Jarcec Non-binding +1 votes: - Ashish Paliwal No +0 or -1 votes were received. As a result, this RC has passed and will be promoted to the Apache Flume

[jira] [Commented] (FLUME-2385) Flume spans log file with "Spooling Directory Source runner has shutdown" messages at INFO level

2014-11-10 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205980#comment-14205980 ] Hari Shreedharan commented on FLUME-2385: - +1. Running tests and commit

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
> On Mon, Nov 10, 2014 at 2:56 PM, Hari Shreedharan > wrote: >> The HTTP Source does not have any config parameter in the user guide. Only >> for the Avro Source, is there configuration mentioned in the user guide >> (though for now, it is possible to use SSLv3, but w

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
gt; If the intent is to add the configurable option to HTTPS in a later >> > release, then please drop the setting from the doc too. We can track the >> > pending work for HTTPS on another jira. >> > -roshan >> > On Mon, Nov 10, 2014 at 11:15 AM, Hari Shreedharan &l

Re: Using CodaHale metrics for monitoring

2014-11-10 Thread Hari Shreedharan
Is it easier to use than the current one and/or does it give better performance? You’d need to support the current metrics API (MonitoredCounterGroup, SourceCounter, SinkCounter, ChannelCounter etc). Thanks, Hari On Sat, Nov 8, 2014 at 8:21 PM, Ashish wrote: > Hi, > Have hacked a bit into ou

Re: Kafka Channel vs Kafka Sink?

2014-11-10 Thread Hari Shreedharan
Yes, you can. I came up with 2 use-cases where the Kafka channel is useful (in addition to the HA aspect of the channel). 1. Receive data from various sources (even Kafka itself) - and modify it using interceptors and write out to Kafka. This would be lower latency than using a channel + sin

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
ink its good to keep the same > strategy for both Avro and HTTPS. > If the intent is to add the configurable option to HTTPS in a later > release, then please drop the setting from the doc too. We can track the > pending work for HTTPS on another jira. > -roshan > On Mon, Nov 10, 2

[jira] [Commented] (FLUME-2307) Remove Log writetimeout

2014-11-10 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205230#comment-14205230 ] Hari Shreedharan commented on FLUME-2307: - Sorry - my mistake. That is in mi

[jira] [Commented] (FLUME-2307) Remove Log writetimeout

2014-11-10 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205225#comment-14205225 ] Hari Shreedharan commented on FLUME-2307: - Your checkpoint interval is set t

[jira] [Commented] (FLUME-2307) Remove Log writetimeout

2014-11-10 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205212#comment-14205212 ] Hari Shreedharan commented on FLUME-2307: - Which version of Flume? OS details

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
among other things will allow people to build on Mac OS without > running into the JDK7+Snappy 1.0.4 problem where tests because native > library does not load. > Regards, > Arvind > On Thu, Nov 6, 2014 at 3:17 PM, Hari Shreedharan > wrote: >> This is the seventh release for

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
le to build on Mac OS without > running into the JDK7+Snappy 1.0.4 problem where tests because native > library does not load. > Regards, > Arvind > On Thu, Nov 6, 2014 at 3:17 PM, Hari Shreedharan > wrote: >> This is the seventh release for Apache Flume as a top-level pro

[jira] [Commented] (FLUME-2543) Add support for Parquet datasets to the DatasetSink

2014-11-06 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201348#comment-14201348 ] Hari Shreedharan commented on FLUME-2543: - I will leave that upto you

[jira] [Commented] (FLUME-2543) Add support for Parquet datasets to the DatasetSink

2014-11-06 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201288#comment-14201288 ] Hari Shreedharan commented on FLUME-2543: - If Parquet is used, roll is base

[VOTE] Release Apache Flume 1.5.1 RC1

2014-11-06 Thread Hari Shreedharan
This is the seventh release for Apache Flume as a top-level project, version 1.5.1. We are voting on release candidate RC1. It fixes the following issues: https://git-wip-us.apache.org/repos/asf?p=flume.git;a=blob_plain;f=CHANGELOG;hb=c74804226bcee59823c0cbc09cdf803a3d9e6920 *** Please cast you

[jira] [Commented] (FLUME-2451) HDFS Sink Cannot Reconnect After NameNode Restart

2014-11-06 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201145#comment-14201145 ] Hari Shreedharan commented on FLUME-2451: - I was not suggesting an alterna

[jira] [Resolved] (FLUME-2522) SSL tests for HTTP Source fails on some platforms

2014-11-06 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan resolved FLUME-2522. - Resolution: Duplicate > SSL tests for HTTP Source fails on some platfo

Flume 1.5.1 Release

2014-11-06 Thread Hari Shreedharan
As some of you may have noticed, I have been pushing some commits to trunk, 1.5 and 1.6 branches. This is primarily meant for a 1.5.1 maintenance release that includes the following patches: FLUME-2520: HTTP Source should be able to block a prefixed set of protocols. FLUME-2511. Allow configu

[jira] [Updated] (FLUME-2533) HTTPS tests fail on Java 6

2014-11-06 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2533: Fix Version/s: (was: v1.6.0) v1.5.1 > HTTPS tests fail on Jav

[jira] [Updated] (FLUME-2441) Unit test TestHTTPSource.java failed with IBM JDK 1.7

2014-11-06 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2441: Fix Version/s: (was: v1.6.0) (was: v1.5.0.1

[jira] [Updated] (FLUME-2511) Allow configuration of enabled protocols in Avro source and Rpc client

2014-11-06 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2511: Fix Version/s: v1.5.1 > Allow configuration of enabled protocols in Avro source and

[jira] [Updated] (FLUME-2520) HTTP Source should be able to block a prefixed set of protocols.

2014-11-06 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2520: Fix Version/s: (was: v1.6.0) v1.5.1 > HTTP Source should be able

[jira] [Commented] (FLUME-2538) TestResettableFileInputStream fails on JDK 8

2014-11-05 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199529#comment-14199529 ] Hari Shreedharan commented on FLUME-2538: - Wondering why that was not docume

[jira] [Commented] (FLUME-2525) flume should handle a zero byte .flumespool-main.meta file for the spooldir source

2014-11-05 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199504#comment-14199504 ] Hari Shreedharan commented on FLUME-2525: - +1. I made a couple of format

[jira] [Resolved] (FLUME-2539) Append HDFS files from multiple FLUME instances

2014-11-05 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan resolved FLUME-2539. - Resolution: Invalid Unfortunately, that is not possible - as the HDFS API allocates a

[jira] [Commented] (FLUME-2534) Windows : TestFlumeEventQueue,TestCheckpoint & TestCheckpointRebuilder failures

2014-11-04 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14197097#comment-14197097 ] Hari Shreedharan commented on FLUME-2534: - Hey Roshan, Do you mind creatin

Re: [ANNOUNCE] New Flume PMC Member - Roshan Naik

2014-11-04 Thread Hari Shreedharan
Congrats Roshan! Thanks, Hari On Tue, Nov 4, 2014 at 2:12 PM, Arvind Prabhakar wrote: > On behalf of Apache Flume PMC, it is my pleasure to announce that Roshan > Naik has been elected to the Flume Project Management Committee. Roshan has > been active with the project for many years and has b

Re: Flume 0.X JIRA's

2014-11-03 Thread Hari Shreedharan
+1.  Thanks, Hari On Mon, Nov 3, 2014 at 1:45 AM, Ashish wrote: > Folks, > Whats the plan for pre-FlumeNG jira's? To me the branch seems dead. > IMHO, we can mark the ticket's as Won't Fix and clean up JIRA. > wdyt? > thanks > ashish

[jira] [Updated] (FLUME-2533) HTTPS tests fail on Java 6

2014-11-03 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2533: Attachment: FLUME-2533.patch > HTTPS tests fail on Jav

[jira] [Created] (FLUME-2533) HTTPS tests fail on Java 6

2014-11-03 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created FLUME-2533: --- Summary: HTTPS tests fail on Java 6 Key: FLUME-2533 URL: https://issues.apache.org/jira/browse/FLUME-2533 Project: Flume Issue Type: Bug

[jira] [Commented] (FLUME-2215) ResettableFileInputStream can't support ucs-4 character

2014-11-03 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195325#comment-14195325 ] Hari Shreedharan commented on FLUME-2215: - This seems to do a lot of renames

[jira] [Commented] (FLUME-2215) ResettableFileInputStream can't support ucs-4 character

2014-11-03 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195296#comment-14195296 ] Hari Shreedharan commented on FLUME-2215: - [~smolav] - I don't see the p

[jira] [Commented] (FLUME-2525) flume should handle a zero byte .flumespool-main.meta file for the spooldir source

2014-11-03 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195289#comment-14195289 ] Hari Shreedharan commented on FLUME-2525: - Couple of comments: - Do you re

[jira] [Commented] (FLUME-2523) Document Kafka channel

2014-10-31 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14192521#comment-14192521 ] Hari Shreedharan commented on FLUME-2523: - +1. There were a couple of format

[jira] [Commented] (FLUME-2521) Ability to manually recover data from corrupted file channel

2014-10-31 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14192155#comment-14192155 ] Hari Shreedharan commented on FLUME-2521: - FLUME-2519 was not really a cor

[jira] [Commented] (FLUME-2523) Document Kafka channel

2014-10-30 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191375#comment-14191375 ] Hari Shreedharan commented on FLUME-2523: - Thanks for writing these docs! A

[jira] [Commented] (FLUME-1051) Configuration System

2014-10-29 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14189578#comment-14189578 ] Hari Shreedharan commented on FLUME-1051: - Yes, I think the ones still

[jira] [Resolved] (FLUME-967) HTTP based monitoring for flume Agents

2014-10-29 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan resolved FLUME-967. Resolution: Fixed Assignee: Hari Shreedharan Was resolved long ago > HTTP ba

[jira] [Commented] (FLUME-2529) Kafka Source test fails: testBatchTime

2014-10-29 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188873#comment-14188873 ] Hari Shreedharan commented on FLUME-2529: - Did this fail on Apache Jenkin

[jira] [Resolved] (FLUME-1065) netcat source configuration

2014-10-29 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan resolved FLUME-1065. - Resolution: Won't Fix > netcat source confi

[jira] [Resolved] (FLUME-1051) Configuration System

2014-10-29 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan resolved FLUME-1051. - Resolution: Incomplete We never completed this. So I am closing this off > Configurat

Re: Java 8 experience?

2014-10-28 Thread Hari Shreedharan
No, I don’t believe we used any APIs that have been removed from Java 8. There should really be no reason for such a concern Thanks, Hari On Tue, Oct 28, 2014 at 12:51 PM, Edward Sargisson wrote: > Hi all, > Are we aware of anything specific that would prevent a Java 8 build? > It's looking l

[jira] [Updated] (FLUME-2500) Add a channel that uses Kafka

2014-10-28 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2500: Attachment: FLUME-2500-2.patch Final patch from RB > Add a channel that uses Ka

Re: Review Request 26820: FLUME-2500. Kafka Channel

2014-10-28 Thread Hari Shreedharan
: https://reviews.apache.org/r/26820/diff/ Testing --- Added tests that simulate a Kafka cluster. Thanks, Hari Shreedharan

Re: Review Request 26820: FLUME-2500. Kafka Channel

2014-10-28 Thread Hari Shreedharan
: https://reviews.apache.org/r/26820/diff/ Testing --- Added tests that simulate a Kafka cluster. Thanks, Hari Shreedharan

[jira] [Commented] (FLUME-2522) SSL tests for HTTP Sink fails on some platforms

2014-10-28 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187193#comment-14187193 ] Hari Shreedharan commented on FLUME-2522: - Sorry...I was probably tired. I m

[jira] [Updated] (FLUME-2522) SSL tests for HTTP Source fails on some platforms

2014-10-28 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-2522: Summary: SSL tests for HTTP Source fails on some platforms (was: SSL tests for HTTP Sink

[jira] [Created] (FLUME-2522) SSL tests for HTTP Sink fails on some platforms

2014-10-27 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created FLUME-2522: --- Summary: SSL tests for HTTP Sink fails on some platforms Key: FLUME-2522 URL: https://issues.apache.org/jira/browse/FLUME-2522 Project: Flume Issue

[jira] [Commented] (FLUME-2517) Performance issue: SimpleDateFormat constructor takes 30% of HDFSEventSink.process()

2014-10-27 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186158#comment-14186158 ] Hari Shreedharan commented on FLUME-2517: - I don;t have much experience with

[jira] [Commented] (FLUME-2517) Performance issue: SimpleDateFormat constructor takes 30% of HDFSEventSink.process()

2014-10-27 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185606#comment-14185606 ] Hari Shreedharan commented on FLUME-2517: - +1. This looks good to me. Let me

[jira] [Commented] (FLUME-2519) Avro source closes connection when unable to process an event batch

2014-10-24 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183822#comment-14183822 ] Hari Shreedharan commented on FLUME-2519: - Please file a jira. If ther

[jira] [Commented] (FLUME-2519) Avro source closes connection when unable to process an event batch

2014-10-24 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183805#comment-14183805 ] Hari Shreedharan commented on FLUME-2519: - You could add an interceptor

[jira] [Resolved] (FLUME-2519) Avro source closes connection when unable to process an event batch

2014-10-24 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan resolved FLUME-2519. - Resolution: Not a Problem > Avro source closes connection when unable to process an ev

<    1   2   3   4   5   6   7   8   9   10   >