[GitHub] flume pull request #146: FLUME-3128: Fix TestHDFSEventSinkOnMiniCluster.java...
Github user mcsanady closed the pull request at: https://github.com/apache/flume/pull/146 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] flume pull request #146: FLUME-3128: Fix TestHDFSEventSinkOnMiniCluster.java...
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/146 FLUME-3128: Fix TestHDFSEventSinkOnMiniCluster.java due to incompatib⦠â¦le changes in hadoop-hdfs lib. Our test in flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java Uses the getLeaseByPath(String src) method of Lease class which is to be replaced by getLeaseForPath(Namenode n, String src) method. This change is to make Flume compatible after the hadoop change is made effective. See https://issues.apache.org/jira/browse/HDFS-6757 You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3128 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/146.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #146 commit 20ec70a896f2e869a78ade8db2023c4c3bb96c32 Author: Denes Arvay <de...@cloudera.com> Date: 2017-05-02T13:05:23Z FLUME-3128: Fix TestHDFSEventSinkOnMiniCluster.java due to incompatible changes in hadoop-hdfs lib. Our test in flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java Uses the getLeaseByPath(String src) method of Lease class which is to be replaced by getLeaseForPath(Namenode n, String src) method. This change is to make Flume compatible after the hadoop change is made effective. See https://issues.apache.org/jira/browse/HDFS-6757 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] flume pull request #132: FLUME-3093: Groundwork for version changes in root ...
Github user mcsanady closed the pull request at: https://github.com/apache/flume/pull/132 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] flume pull request #132: FLUME-3093: Groundwork for version changes in root ...
GitHub user mcsanady reopened a pull request: https://github.com/apache/flume/pull/132 FLUME-3093: Groundwork for version changes in root pom Extracted hard-coded version numbers to root pom.xml No version number changed in this step. The old used versions are named with -old suffix. guava-old.version httpclient-old.version mvn-surefire-plugin-old.version mvn-surefire-plugin-old-morphline.version You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3093 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/132.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #132 commit a7239a96b144aa4299c5381cb8c97d35fa57822c Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-05-17T06:52:09Z FLUME-3093: Groundwork for version changes in root pom Extracted hard-coded version numbers to root pom.xml No version number changed in this step. The old used versions are named with -old suffix. guava-old.version httpclient-old.version mvn-surefire-plugin-old.version mvn-surefire-plugin-old-morphline.version commit 1330e1cee450fc878fafc4e8a78de46454f0dd1c Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-06-26T09:33:01Z FLUME-3093: removing flume.version variable commit 3355a438d55edddb5e4518449cacb90f416e9668 Author: mcsanady <miklos.csan...@cloudera.com> Date: 2017-06-26T09:42:33Z Merge branch 'trunk' into FLUME-3093 commit 24aa825f582582b9c0d52b4d405fb621196436ab Author: mcsanady <miklos.csan...@cloudera.com> Date: 2017-06-29T10:38:50Z Small whitespace change to trigger check --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] flume pull request #149: FLUME-3141 Small typo found in RegexHbaseEventSeria...
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/149 FLUME-3141 Small typo found in RegexHbaseEventSerializer.java You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume smalltypo Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/149.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #149 commit a9d69d6381dbd0d2395fdef6708e51c0717b7b10 Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-08-08T14:44:38Z Small typo found in RegexHbaseEventSerializer.java --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] flume pull request #132: FLUME-3093: Groundwork for version changes in root ...
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/132 FLUME-3093: Groundwork for version changes in root pom Extracted hard-coded version numbers to root pom.xml No version number changed in this step. The old used versions are named with -old suffix. guava-old.version httpclient-old.version mvn-surefire-plugin-old.version mvn-surefire-plugin-old-morphline.version You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3093 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/132.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #132 commit a7239a96b144aa4299c5381cb8c97d35fa57822c Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-05-17T06:52:09Z FLUME-3093: Groundwork for version changes in root pom Extracted hard-coded version numbers to root pom.xml No version number changed in this step. The old used versions are named with -old suffix. guava-old.version httpclient-old.version mvn-surefire-plugin-old.version mvn-surefire-plugin-old-morphline.version --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] flume pull request #169: FLUME-3173: Upgrade joda-time
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/169 FLUME-3173: Upgrade joda-time Unit tests are passing. Found no suspicious change in [joda-time release doc.](http://www.joda.org/joda-time/changes-report.html) You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3173 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/169.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #169 commit 68a3aae762ea26ec3d751ee50691604b72b5fc2b Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-09-12T07:47:39Z FLUME-3173: Upgrade joda-time ---
[GitHub] flume pull request #160: FLUME-3154: Add HBase client version check to Async...
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/160 FLUME-3154: Add HBase client version check to AsyncHBaseSink and HBas⦠The current AsyncHBase and HBase sink should run only with HBase < 2 If it finds an incompatible HBase client on the classpath it should fail with some meaningful error message You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3154 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/160.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #160 commit 58c61f3366aad4cd01bcc46f119cbff2711fa969 Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-08-28T09:15:12Z FLUME-3154: Add HBase client version check to AsyncHBaseSink and HBaseSink --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] flume pull request #161: FLUME-3155: Use batch mode in mvn to fix Travis CI ...
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/161 FLUME-3155: Use batch mode in mvn to fix Travis CI error Reduce log verbosity with mvn batch mode to avoid this error: The log length has exceeded the limit of 4 MB (this usually means that the test suite is raising the same exception over and over). The job has been terminated You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3155 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/161.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #161 commit 5c7f5a9111f492226bc8d4315a0a0dc66e616d5e Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-08-28T11:46:49Z FLUME-3155: Use batch mode in mvn to fix Travis CI error --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] flume pull request #178: FLUME-3186: Make asyncHbaseClient configuration par...
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/178 FLUME-3186: Make asyncHbaseClient configuration parameters available ⦠In 1.7 version AsyncHbaseClient it is possible to pass all configuration to the constructor. This makes it possible to pass all the parameters to this library with a specific prefix. You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3186 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/178.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #178 commit 322444a1e1826fa81c403659c39866ab3170b699 Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-10-18T11:22:26Z FLUME-3186: Make asyncHbaseClient configuration parameters available from flume config ---
[GitHub] flume pull request #184: FLUME-3194 upgrade derby to the latest version
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/184 FLUME-3194 upgrade derby to the latest version FLUME-3194 upgrade derby to the latest (1.14.1.0) version You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3194-10.14.1.0 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/184.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #184 commit 0054943e87d0e281fc00f35a5865e01c6bed1166 Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-11-21T09:49:31Z derby 10.14.1.0 ---
[GitHub] flume pull request #186: FLUME-3199 Update netty to latest 3.x version
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/186 FLUME-3199 Update netty to latest 3.x version With this change I would upgrade netty to latest 3.x version. The netty-all 4.x upgrade requires the rewriting of NettyAvroRpcClient class which could be next step. The current version (3.9.4) has known vulnerability: [CVE-2015-2156](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2015-2156) Unit tests passed. You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3199 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/186.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #186 commit 9eda3ed4f92a1a05cacc355744064655122ce4c1 Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-11-29T15:52:52Z FLUME-3199 Update netty to latest ---
[GitHub] flume pull request #182: FLUME-3158: Upgrade surefire version and config
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/182 FLUME-3158: Upgrade surefire version and config Set surefire version to the latest and configure it to rerun failed tests. This way the flaky tests will not break the build as often. You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3158 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/182.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #182 commit 58809f7c0a5283bd8ba87152ce24097c2ec8c185 Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-11-13T15:42:41Z FLUME-3158: Upgrade surefire version and config ---
[GitHub] flume pull request #180: FLUME-3190: flume shutdown hook issue when both hba...
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/180 FLUME-3190: flume shutdown hook issue when both hbase and hdfs sink a⦠When both hdfs and hbase sink are in use, during shutdown (KILL SIGTERM), the hdfs sink won't be able to rename/close the .tmp hdfs file because the underlying filesystem could be closed earlier when shutting down the other component. This change registers a new ShutdownHook in the hadoop's ShutdownHookManager, which will prevent other hooks to run until Flume stops itself. Tested on a cluster which could reproduce the error before the change, but eliminated after. You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3190 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/180.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #180 commit f3cff0bcc6112a4067ac606049da7f4bb58c20da Author: Miklos Csanady <miklos.csan...@cloudera.com> Date: 2017-11-03T10:21:40Z FLUME-3190: flume shutdown hook issue when both hbase and hdfs sink are in use ---
[GitHub] flume pull request #186: FLUME-3199 Update netty to latest 3.x version
Github user mcsanady closed the pull request at: https://github.com/apache/flume/pull/186 ---
[GitHub] flume pull request #202: FLUME-3223 Flume HDFS Sink should retry close prior...
GitHub user mcsanady opened a pull request: https://github.com/apache/flume/pull/202 FLUME-3223 Flume HDFS Sink should retry close prior to performing a r⦠â¦ecoverLease You can merge this pull request into a Git repository by running: $ git pull https://github.com/mcsanady/flume FLUME-3223 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flume/pull/202.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #202 commit a679406c50b387f701739827173a585fa412cfee Author: Miklos Csanady <miklos.csanady@...> Date: 2018-03-13T15:41:47Z FLUME-3223 Flume HDFS Sink should retry close prior to performing a recoverLease ---