[GitHub] flume pull request #146: FLUME-3128: Fix TestHDFSEventSinkOnMiniCluster.java...

2017-07-20 Thread mcsanady
Github user mcsanady closed the pull request at:

https://github.com/apache/flume/pull/146


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] flume pull request #146: FLUME-3128: Fix TestHDFSEventSinkOnMiniCluster.java...

2017-07-19 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/146

FLUME-3128: Fix TestHDFSEventSinkOnMiniCluster.java due to incompatib…

…le changes in hadoop-hdfs lib.

Our test in 
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java
Uses the getLeaseByPath(String src) method of Lease class which is to be 
replaced by getLeaseForPath(Namenode n, String src) method.

This change is to make Flume compatible after the hadoop change is made 
effective.

See https://issues.apache.org/jira/browse/HDFS-6757

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3128

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/146.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #146


commit 20ec70a896f2e869a78ade8db2023c4c3bb96c32
Author: Denes Arvay <de...@cloudera.com>
Date:   2017-05-02T13:05:23Z

FLUME-3128: Fix TestHDFSEventSinkOnMiniCluster.java due to incompatible 
changes in hadoop-hdfs lib.

Our test in 
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java
Uses the getLeaseByPath(String src) method of Lease class which is to be 
replaced by getLeaseForPath(Namenode n, String src) method.

This change is to make Flume compatible after the hadoop change is made 
effective.

See https://issues.apache.org/jira/browse/HDFS-6757




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] flume pull request #132: FLUME-3093: Groundwork for version changes in root ...

2017-06-29 Thread mcsanady
Github user mcsanady closed the pull request at:

https://github.com/apache/flume/pull/132


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] flume pull request #132: FLUME-3093: Groundwork for version changes in root ...

2017-06-29 Thread mcsanady
GitHub user mcsanady reopened a pull request:

https://github.com/apache/flume/pull/132

FLUME-3093: Groundwork for version changes in root pom

Extracted hard-coded version numbers to root pom.xml

No version number changed in this step. The old used versions are named 
with -old suffix.
 guava-old.version
 httpclient-old.version
 mvn-surefire-plugin-old.version
 mvn-surefire-plugin-old-morphline.version

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3093

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/132.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #132


commit a7239a96b144aa4299c5381cb8c97d35fa57822c
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-05-17T06:52:09Z

FLUME-3093: Groundwork for version changes in root pom

Extracted hard-coded version numbers to root pom.xml

No version number changed in this step. The old used versions are named 
with -old suffix.
 guava-old.version
 httpclient-old.version
 mvn-surefire-plugin-old.version
 mvn-surefire-plugin-old-morphline.version

commit 1330e1cee450fc878fafc4e8a78de46454f0dd1c
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-06-26T09:33:01Z

FLUME-3093: removing flume.version variable

commit 3355a438d55edddb5e4518449cacb90f416e9668
Author: mcsanady <miklos.csan...@cloudera.com>
Date:   2017-06-26T09:42:33Z

Merge branch 'trunk' into FLUME-3093

commit 24aa825f582582b9c0d52b4d405fb621196436ab
Author: mcsanady <miklos.csan...@cloudera.com>
Date:   2017-06-29T10:38:50Z

Small whitespace change to trigger check




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] flume pull request #149: FLUME-3141 Small typo found in RegexHbaseEventSeria...

2017-08-08 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/149

FLUME-3141 Small typo found in RegexHbaseEventSerializer.java



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume smalltypo

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/149.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #149


commit a9d69d6381dbd0d2395fdef6708e51c0717b7b10
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-08-08T14:44:38Z

Small typo found in RegexHbaseEventSerializer.java




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] flume pull request #132: FLUME-3093: Groundwork for version changes in root ...

2017-05-18 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/132

FLUME-3093: Groundwork for version changes in root pom

Extracted hard-coded version numbers to root pom.xml

No version number changed in this step. The old used versions are named 
with -old suffix.
 guava-old.version
 httpclient-old.version
 mvn-surefire-plugin-old.version
 mvn-surefire-plugin-old-morphline.version

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3093

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/132.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #132


commit a7239a96b144aa4299c5381cb8c97d35fa57822c
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-05-17T06:52:09Z

FLUME-3093: Groundwork for version changes in root pom

Extracted hard-coded version numbers to root pom.xml

No version number changed in this step. The old used versions are named 
with -old suffix.
 guava-old.version
 httpclient-old.version
 mvn-surefire-plugin-old.version
 mvn-surefire-plugin-old-morphline.version




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] flume pull request #169: FLUME-3173: Upgrade joda-time

2017-09-12 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/169

FLUME-3173: Upgrade joda-time

Unit tests are passing.
Found no suspicious change in [joda-time release 
doc.](http://www.joda.org/joda-time/changes-report.html)


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3173

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/169.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #169


commit 68a3aae762ea26ec3d751ee50691604b72b5fc2b
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-09-12T07:47:39Z

FLUME-3173: Upgrade joda-time




---


[GitHub] flume pull request #160: FLUME-3154: Add HBase client version check to Async...

2017-08-28 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/160

FLUME-3154: Add HBase client version check to AsyncHBaseSink and HBas…

The current AsyncHBase and HBase sink should run only with HBase < 2
If it finds an incompatible HBase client on the classpath it should fail 
with some meaningful error message

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3154

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/160.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #160


commit 58c61f3366aad4cd01bcc46f119cbff2711fa969
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-08-28T09:15:12Z

FLUME-3154: Add HBase client version check to AsyncHBaseSink and HBaseSink




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] flume pull request #161: FLUME-3155: Use batch mode in mvn to fix Travis CI ...

2017-08-28 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/161

FLUME-3155: Use batch mode in mvn to fix Travis CI error

Reduce log verbosity with mvn batch mode to avoid this error:
The log length has exceeded the limit of 4 MB (this usually means that the 
test suite is raising the same exception over and over).
The job has been terminated

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3155

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/161.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #161


commit 5c7f5a9111f492226bc8d4315a0a0dc66e616d5e
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-08-28T11:46:49Z

FLUME-3155: Use batch mode in mvn to fix Travis CI error




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] flume pull request #178: FLUME-3186: Make asyncHbaseClient configuration par...

2017-10-18 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/178

FLUME-3186: Make asyncHbaseClient configuration parameters available …

In 1.7 version AsyncHbaseClient it is possible to pass all configuration to 
the constructor.
This makes it possible to pass all the parameters to this library with a 
specific prefix.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3186

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/178.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #178


commit 322444a1e1826fa81c403659c39866ab3170b699
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-10-18T11:22:26Z

FLUME-3186: Make asyncHbaseClient configuration parameters available from 
flume config




---


[GitHub] flume pull request #184: FLUME-3194 upgrade derby to the latest version

2017-11-28 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/184

FLUME-3194 upgrade derby to the latest version

FLUME-3194
upgrade derby to the latest (1.14.1.0) version

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3194-10.14.1.0

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/184.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #184


commit 0054943e87d0e281fc00f35a5865e01c6bed1166
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-11-21T09:49:31Z

derby 10.14.1.0




---


[GitHub] flume pull request #186: FLUME-3199 Update netty to latest 3.x version

2017-11-30 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/186

FLUME-3199 Update netty to latest 3.x version

With this change I would upgrade netty to latest 3.x version.

The netty-all 4.x upgrade requires the rewriting of NettyAvroRpcClient 
class which could be next step.
The current version (3.9.4) has known vulnerability:

[CVE-2015-2156](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2015-2156)

Unit tests passed.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3199

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/186.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #186


commit 9eda3ed4f92a1a05cacc355744064655122ce4c1
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-11-29T15:52:52Z

FLUME-3199 Update netty to latest




---


[GitHub] flume pull request #182: FLUME-3158: Upgrade surefire version and config

2017-11-13 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/182

FLUME-3158: Upgrade surefire version and config

Set surefire version to the latest and configure it to rerun failed tests. 
This way the flaky tests will not break the build as often.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3158

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/182.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #182


commit 58809f7c0a5283bd8ba87152ce24097c2ec8c185
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-11-13T15:42:41Z

FLUME-3158: Upgrade surefire version and config




---


[GitHub] flume pull request #180: FLUME-3190: flume shutdown hook issue when both hba...

2017-11-03 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/180

FLUME-3190: flume shutdown hook issue when both hbase and hdfs sink a…

When both hdfs and hbase sink are in use, during shutdown (KILL SIGTERM), 
the hdfs sink won't be able to rename/close the .tmp hdfs file because the 
underlying filesystem could be closed earlier when shutting down the other 
component.

This change registers a new ShutdownHook in the hadoop's 
ShutdownHookManager, which will prevent other hooks to run until Flume stops 
itself.

Tested on a cluster which could reproduce the error before the change, but 
eliminated after.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3190

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/180.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #180


commit f3cff0bcc6112a4067ac606049da7f4bb58c20da
Author: Miklos Csanady <miklos.csan...@cloudera.com>
Date:   2017-11-03T10:21:40Z

FLUME-3190: flume shutdown hook issue when both hbase and hdfs sink are in 
use




---


[GitHub] flume pull request #186: FLUME-3199 Update netty to latest 3.x version

2017-12-06 Thread mcsanady
Github user mcsanady closed the pull request at:

https://github.com/apache/flume/pull/186


---


[GitHub] flume pull request #202: FLUME-3223 Flume HDFS Sink should retry close prior...

2018-03-13 Thread mcsanady
GitHub user mcsanady opened a pull request:

https://github.com/apache/flume/pull/202

FLUME-3223 Flume HDFS Sink should retry close prior to performing a r…

…ecoverLease

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mcsanady/flume FLUME-3223

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/flume/pull/202.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #202


commit a679406c50b387f701739827173a585fa412cfee
Author: Miklos Csanady <miklos.csanady@...>
Date:   2018-03-13T15:41:47Z

FLUME-3223 Flume HDFS Sink should retry close prior to performing a 
recoverLease




---