GitHub user cjn082030 opened a pull request:

    Flume 1.6

    Use Flume-KafkaSink send messages to Kafka_0.10,Flume-server cpu up to 
99.*%.May be the method process() doesn't get the correct return value?Line 
127,if processedEvents <=0,the return status might should be Status.BACKOFF?

You can merge this pull request into a Git repository by running:

    $ git pull flume-1.7

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #71
commit 1f21df7e11f5fe8a3dcd0bd34116289c02943a64
Author: Hari Shreedharan <>
Date:   2014-03-12T19:35:38Z

    FLUME-2151. Windows: Update TestExecSource to use native commands on Windows
    (Roshan Naik via Hari Shreedharan)

commit f4c6c7025e892ecf0d6fac1b72b5806fe7c9cd8d
Author: Hari Shreedharan <>
Date:   2014-03-13T20:05:29Z

    FLUME-2263. Bump Hadoop 2 version to 2.3.0
    (Gopinathan A via Hari Shreedharan)

commit 1c8b8f5e9185d75c6b1cb06a617dfc08447935c9
Author: Hari Shreedharan <>
Date:   2014-03-13T21:51:03Z

    FLUME-2345. Update to Kite 0.12.0 dependency
    (Ryan Blue via Hari Shreedharan)

commit e12f0a7a46752eff2ff3aaddfa0b93fb606074d7
Author: Hari Shreedharan <>
Date:   2014-03-20T23:16:14Z

    FLUME-2225. Elasticsearch Sink for ES HTTP API
    (Pawel Rog via Edward Sargisson, Hari Shreedharan)

commit 09f0a513602c3b0bb2c9e19903ae6d5e052ab460
Author: Jarek Jarcec Cecho <>
Date:   2014-03-24T19:55:35Z

    FLUME-2347: Add FLUME_JAVA_OPTS which allows users to inject java 
properties from cmd line
    (Brock Noland via Jarek Jarcec Cecho)

commit 61b9bcbb69ae3d19f72276b3aaa78ff3679cecfc
Author: Hari Shreedharan <>
Date:   2014-03-27T19:30:29Z

    FLUME-2309. Spooling directory should not always consume the oldest file 
    (Muhammad Ehsan ul Haque via Hari Shreedharan)

commit 62b383a00c3f678b0f504dc71bf36091ddd4067a
Author: Hari Shreedharan <>
Date:   2014-03-28T22:55:25Z

    FLUME-2350. Consume Order tests need to space out file creation.
    (Muhammad Ehsan ul Haque via Hari Shreedharan)

commit a94594dd2c5cb980bc6f82b1fa606a922986569e
Author: Mike Percy <>
Date:   2014-04-29T00:14:40Z

    FLUME-2357. HDFS sink should retry closing files that previously had close 
    (Hari Shreedharan via Mike Percy)

commit 6115e7d6d611d2b82dc2583b95a13d4c0886a93f
Author: Brock Noland <>
Date:   2014-05-02T14:32:33Z

    FLUME-2181 - Optionally disable File Channel fsyncs (Hari via Brock)

commit 76b359b3fef1fade662388c8356e4a82c227c258
Author: Jarek Jarcec Cecho <>
Date:   2014-05-04T04:43:16Z

    FLUME-2381: Upgrade Hadoop version in Hadoop 2 profile to 2.4.0
    (Hari Shreedharan via Jarek Jarcec Cecho)

commit 31d45f1b377826b8755d1479bda9e2d702206bf9
Author: Hari Shreedharan <>
Date:   2014-05-04T05:23:56Z

    FLUME-2368. Update CHANGELOG for 1.5 release

commit 45abf412c31f85e1b35135df529a36d94aac694c
Author: Hari Shreedharan <>
Date:   2014-05-06T23:28:46Z

    FLUME-2366. Update LICENSE

commit 63bade24bbabbe9eeb887e3294d4d3727cbac25d
Author: Hari Shreedharan <>
Date:   2014-05-06T23:38:20Z

    FLUME-2366. Preparing for Flume 1.5.0 release

commit 73fd7bddeff11ef7af91055db1148416dca9d0b1
Author: Hari Shreedharan <>
Date:   2014-05-07T00:19:22Z

    Adding default version for thrift

commit fd448caa8144ad3ea54a836d4ff6e944f36cfac6
Author: Hari Shreedharan <>
Date:   2014-05-07T00:23:12Z

    FLUME-2368. Update CHANGELOG.

commit f99113042dad2a67d24068e30ed37e4b18e62a72
Author: Hari Shreedharan <>
Date:   2014-05-07T00:29:27Z

    FLUME-2366. Update RELEASE NOTES for Flume 1.5

commit 33cdcf0d4e85e68e6df9e1ca4be729889d480246
Author: Hari Shreedharan <>
Date:   2014-05-15T00:42:09Z

    FLUME-2245. Pre-close flush failure can cause HDFS Sinks to not process 
    (Juhani Connolly, Brock Noland via Hari Shreedharan)

commit 09472ba12278a0d3696b9d2e26d6d1b0d361c830
Author: Juhani Connolly <>
Date:   2014-06-03T02:33:54Z

    FLUME-2273 - Add handling for header substitution in ElasticSearchSink
    Satoshi Iijima via Juhani Connolly

commit 0cba73698dbba6b78d0a2cd7b469f4377723470a
Author: Jarek Jarcec Cecho <>
Date:   2014-06-05T16:28:02Z

    FLUME-2397: HBase-98 compatibility
    (Hari Shreedharan via Jarek Jarcec Cecho)

commit 059795fb9aa890430555f3a4c02a73ec346e7092
Author: Hari Shreedharan <>
Date:   2014-06-10T18:32:37Z

    FLUME-2389. Spillable Memory Channel Example is incorrect
    (Roshan Naik via Hari Shreedharan)

commit 38befa88c0c1004936079f9107a5b8600df5fdbd
Author: Hari Shreedharan <>
Date:   2014-06-10T06:32:34Z

    Updating RELEASE-NOTES for Flume

commit c48c26a358966fdc4dd0ec73002269c13fbaf758
Author: Hari Shreedharan <>
Date:   2014-06-10T18:39:28Z

    FLUME-2399. Update CHANGELOG for Flume

commit 8bfc90c0e4042fd2273d0de23b377fdd69f4c049
Author: Hari Shreedharan <>
Date:   2014-06-10T19:01:16Z

    FLUME-2400. Dataset Sink is not built in hbase-98 profile

commit 3708063ef740803f62e61d52bd3ba6e2a94d7c3e
Author: Hari Shreedharan <>
Date:   2014-06-10T19:10:28Z

    FLUME-2359. Update CHANGELOG to include FLUME-2400

commit 1c318366a630c457afe3b6f26d98bb6df9d973c1
Author: Hari Shreedharan <>
Date:   2014-06-10T21:08:01Z

    FLUME-2399. Minor update to Release notes.

commit f7e240ff3e376bac2dc0fb91e7c7ae32a933f899
Author: Hari Shreedharan <>
Date:   2014-06-13T23:20:47Z

    FLUME-2365. Add DOAP file for Flume.
    (Ashish Paliwal via Hari Shreedharan)

commit b74e35aeb6aea87a29f062f55c79a499c6497abe
Author: Roshan Naik <>
Date:   2014-06-14T02:26:02Z

    FLUME-2024.  Add ExecSource flush timeout to Flume User Guide
    (Ashish Paliwal via Roshan Naik)

commit d0d00c3711c88c4da942dafb34ef3ab8861afdcd
Author: Hari Shreedharan <>
Date:   2014-06-19T06:22:12Z

    FLUME-2408. Remove FLUME-1899 from CHANGELOG.

commit 9940dcbfefbe1248f65aa83f2f84e352ce022041
Author: Jarek Jarcec Cecho <>
Date:   2014-06-27T03:57:31Z

    FLUME-2416: Use CodecPool in compressed stream to prevent leak of direct 
    (Hari Shreedharan via Jarek Jarcec Cecho)

commit f15f20785262ac3cb3e35c2a12e669b7a836d35f
Author: Mike Percy <>
Date:   2014-07-04T22:41:43Z

    FLUME-2404. Make ScribeSource read buffer and max frame size configurable
    Scribe default Thrift service maxReadBufferBytes and frame size varies
    across Thrift versions. In some cases, these values are set to INT_MAX,
    in other cases this is set to 16MB. To avoid OOM in certain cases and
    incompatibilities in other cases, set the default to 16MB and also make
    the parameters configurable.
    (chenshangan and Marimuthu Ponnambalam via Mike Percy)


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

Reply via email to