GitHub user geeag opened a pull request: https://github.com/apache/kafka/pull/2192
MyKafka We suspect that the test suite hangs we have been seeing are due to PermGen exhaustion. It is a common reason for hard JVM lock-ups. Author: Ismael Juma <ism...@juma.me.uk> Reviewers: Jason Gustafson <ja...@confluent.io> Closes #1926 from ijuma/test-jvm-params (cherry picked from commit 67e99d0869dd49358d7ca549ac715b722fda89f5) Signed-off-by: Jason Gustafson <ja...@confluent.io> You can merge this pull request into a Git repository by running: $ git pull https://github.com/geeag/kafka MyKafka Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/2192.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2192 ---- commit 3f930cd84c1a889f0df2bc5057e073e683860171 Author: Jason Gustafson <ja...@confluent.io> Date: 2016-03-25T19:51:54Z KAFKA-3463: change default receive buffer size for consumer to 64K Author: Jason Gustafson <ja...@confluent.io> Reviewers: Gwen Shapira Closes #1140 from hachikuji/KAFKA-3463 (cherry picked from commit d691faf98cb573c4e92748d95d5c8afc492db806) Signed-off-by: Gwen Shapira <csh...@gmail.com> commit 1b1b949b7fbd10fe4b08e97769ab024fad8459fb Author: Andrea Cosentino <anco...@gmail.com> Date: 2016-03-25T22:00:45Z KAFKA-3449: Rename filterOut() to filterNot() to achieve better terminology â¦nology Hi all, This is my first contribution and I hope it will be good. The PR is related to this issue: https://issues.apache.org/jira/browse/KAFKA-3449 Thanks a lot, Andrea Author: Andrea Cosentino <anco...@gmail.com> Reviewers: Yasuhiro Matsuda, Guozhang Wang Closes #1134 from oscerd/KAFKA-3449 (cherry picked from commit c1d8c38345e0a1e04ced143ed07e63fe02ceb8b0) Signed-off-by: Guozhang Wang <wangg...@gmail.com> commit 496bd3fd41c0272b7ef77652b85cbaae748e100e Author: Guozhang Wang <wangg...@gmail.com> Date: 2016-03-25T23:04:58Z KAFKA-3454: add Kafka Streams web docs Author: Guozhang Wang <wangg...@gmail.com> Reviewers: Gwen Shapira Closes #1127 from guozhangwang/KStreamsDocs (cherry picked from commit 23b50093f4100ce7fbff325cdc92ee6cf3c54102) Signed-off-by: Gwen Shapira <csh...@gmail.com> commit 206757eeb18589952291ce1a5578c66de3669f4c Author: Liquan Pei <liquan...@gmail.com> Date: 2016-03-25T23:46:53Z KAFKA-3316: Add REST API for listing connector plugins Author: Liquan Pei <liquan...@gmail.com> Reviewers: Ewen Cheslack-Postava <e...@confluent.io> Closes #1090 from Ishiihara/kafka-3316 (cherry picked from commit 78fa20eb58a948abd9ad4e44acfed606400a47f3) Signed-off-by: Ewen Cheslack-Postava <m...@ewencp.org> commit b45fe77791560a2171e0bbd7df09f648a01b016f Author: Jiangjie Qin <becket....@gmail.com> Date: 2016-03-26T16:22:59Z KAFKA-3388; Fix expiration of batches sitting in the accumulator Author: Jiangjie Qin <becket....@gmail.com> Reviewers: Ismael Juma <ism...@juma.me.uk>, Jun Rao <jun...@gmail.com> Closes #1056 from becketqin/KAFKA-3388 (cherry picked from commit 1fbe445dde71df0023a978c5e54dd229d3d23e1b) Signed-off-by: Jun Rao <jun...@gmail.com> commit f37b550502f6e3429cb3582db7e1c93614e84c58 Author: Ismael Juma <ism...@juma.me.uk> Date: 2016-03-28T16:00:03Z MINOR: Fix typo and tweak wording in `RecordAccumulator` comments This was recently introduced in: https://github.com/apache/kafka/commit/1fbe445dde71df0023a978c5e54dd229d3d23e1b Author: Ismael Juma <ism...@juma.me.uk> Reviewers: Jun Rao <jun...@gmail.com> Closes #1152 from ijuma/fix-typos-in-record-accumulator (cherry picked from commit 4c0660bf3da9879cb405a0f85cf1524511e091e8) Signed-off-by: Jun Rao <jun...@gmail.com> commit afe82512ba5ec3c22ce0e99acfea9ce4d5b2bb2e Author: Ismael Juma <ism...@juma.me.uk> Date: 2016-03-28T21:35:31Z MINOR: Remove a couple of redundant `CoreUtils.rm` methods Also: * Rename remaining `CoreUtils.rm` to `delete` for consistency * Use `try with resources` in `Utils` to simplify code * Silence compiler warning due to exception catch clause in `TestUtils` Author: Ismael Juma <ism...@juma.me.uk> Reviewers: Guozhang Wang <wangg...@gmail.com> Closes #1153 from ijuma/remove-redundant-core-utils-rm (cherry picked from commit 43d5078e981bbb25fd81cdc8ba4c339cd2d3f3d2) Signed-off-by: Guozhang Wang <wangg...@gmail.com> commit 6878df3cc85ac6efc99ae9f723e7664aa919f5d9 Author: Yasuhiro Matsuda <yasuh...@confluent.io> Date: 2016-03-29T20:30:56Z HOTFIX: RocksDBStore must clear dirty flags after flush guozhangwang Without clearing the dirty flags, RocksDBStore will perform flush for every new record. This bug made the store performance painfully slower. Author: Yasuhiro Matsuda <yasuh...@confluent.io> Reviewers: Guozhang Wang <wangg...@gmail.com> Closes #1163 from ymatsuda/clear_dirty_flag (cherry picked from commit 5089f547d5d64a0235e1b4adc327a0cb05eb4ca8) Signed-off-by: Guozhang Wang <wangg...@gmail.com> commit b642284dfef0b77ccd6b0e34ccf40ab19877f008 Author: Jason Gustafson <ja...@confluent.io> Date: 2016-03-29T21:18:57Z KAFKA-3425: add missing upgrade notes Author: Jason Gustafson <ja...@confluent.io> Reviewers: Grant Henke, Ashish Singh, Ismael Juma, Guozhang Wang Closes #1159 from hachikuji/KAFKA-3425 (cherry picked from commit 27583953528138ff3503fb8f300c97971718e48a) Signed-off-by: Guozhang Wang <wangg...@gmail.com> commit 4726adba534cf8d91c24a179d66e135804e216a2 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-03-30T07:50:29Z MINOR: Advance system test ducktape dependency from 0.3.10 to 0.4.0 Previous version of ducktape was found to have a memory leak which caused occasional failures in nightly runs. Author: Geoff Anderson <ge...@confluent.io> Reviewers: Ewen Cheslack-Postava <e...@confluent.io> Closes #1165 from granders/minor-advance-ducktape-to-0.4.0 (cherry picked from commit aaafd23df800d41e4b16fd399015991b2e426dc5) Signed-off-by: Ewen Cheslack-Postava <m...@ewencp.org> commit 9ef243310d6d16a5d508286f8a1c5b5f70d87680 Author: Yasuhiro Matsuda <yasuh...@confluent.io> Date: 2016-03-30T21:26:01Z MINOR: a simple benchmark for Streams guozhangwang miguno Author: Yasuhiro Matsuda <yasuh...@confluent.io> Reviewers: Guozhang Wang <wangg...@gmail.com> Closes #1164 from ymatsuda/perf (cherry picked from commit 2788f2dc73dd62c35c87842d02d23a0ed6a62e97) Signed-off-by: Guozhang Wang <wangg...@gmail.com> commit ef676c15c54840d4b8a8ecb54a879b86b2547ea1 Author: Ismael Juma <ism...@juma.me.uk> Date: 2016-03-31T02:30:34Z KAFKA-3475; Introduce our own `MiniKdc` This also fixes KAFKA-3453 and KAFKA-2866. Author: Ismael Juma <ism...@juma.me.uk> Reviewers: Gwen Shapira Closes #1155 from ijuma/kafka-3475-introduce-our-minikdc (cherry picked from commit 78d91dcd8805d850038df52718380a6f956abad7) Signed-off-by: Gwen Shapira <csh...@gmail.com> commit be822510c63d720dedf286c95588fc0c25a6a49c Author: Ashish Singh <asi...@cloudera.com> Date: 2016-03-31T02:33:37Z KAFKA-3381: Add system test for SimpleConsumerShell Author: Ashish Singh <asi...@cloudera.com> Reviewers: Geoff Anderson Closes #1053 from SinghAsDev/KAFKA-3381 (cherry picked from commit 9f6a6f97134a1d4969c91c4b4e9037b376e03440) Signed-off-by: Gwen Shapira <csh...@gmail.com> commit 36beebc755bc19a48e43d7dd99e9b5eed9b7c419 Author: Grant Henke <granthe...@gmail.com> Date: 2016-03-31T17:07:54Z KAFKA-3451: Add basic HTML coverage report generation to gradle Author: Grant Henke <granthe...@gmail.com> Reviewers: Gwen Shapira, Ismael Juma, Ewen Cheslack-Postava Closes #1121 from granthenke/coverage (cherry picked from commit 623ab1e7c6497c000bc9c9978637f20542a3191c) Signed-off-by: Gwen Shapira <csh...@gmail.com> commit 6badd89ad3ef86111d99df3d345b7fff06b294c9 Author: Rajini Sivaram <rajinisiva...@googlemail.com> Date: 2016-04-01T17:52:26Z KAFKA-2910: Close Zookeeper clients in unit tests Zookeeper clients that are not closed after the server is shutdown keep trying to reconnect, reloading JAAS configuration. This impacts subsequent tests which rely on JAAS config to be reset. Author: Rajini Sivaram <rajinisiva...@googlemail.com> Reviewers: Flavio Junqueira <f...@apache.org>, Ewen Cheslack-Postava <e...@confluent.io> Closes #1171 from rajinisivaram/KAFKA-2910 (cherry picked from commit 77142f6baeb35e6de9608a7372113f72ea330936) Signed-off-by: Ewen Cheslack-Postava <m...@ewencp.org> commit fd07af3fda837a79c5c754575edb7ad25c36666d Author: Guozhang Wang <wangg...@gmail.com> Date: 2016-04-01T20:14:47Z MINOR: add null check for aggregate and reduce operators Author: Guozhang Wang <wangg...@gmail.com> Reviewers: Yasuhiro Matsuda, Gwen Shapira Closes #1175 from guozhangwang/KSNullPointerException (cherry picked from commit ae939467e8aec38f47e2474e74e7ab7ea29c2840) Signed-off-by: Gwen Shapira <csh...@gmail.com> commit e32aeec97b472dfa7c5e089407b778225d65cdf7 Author: Grant Henke <granthe...@gmail.com> Date: 2016-04-01T20:56:11Z MINOR: Fix BNF output for protocol arrays conataining primitives in docs Before this patch arrays containing primitive types were not output: ``` Metadata Request (Version: 0) => [topics] ``` After this patch the type is listed: ``` Metadata Request (Version: 0) => [topics] topics => STRING ``` Author: Grant Henke <granthe...@gmail.com> Reviewers: Ashish Singh, Gwen Shapira Closes #1174 from granthenke/protocol-arrays (cherry picked from commit b865413cd8b71f905ad4ee695f193dcf91ee0595) Signed-off-by: Gwen Shapira <csh...@gmail.com> commit ed60ecffae0d34c90984ee8ec3c147012b3ecb26 Author: Jason Gustafson <ja...@confluent.io> Date: 2016-04-03T06:02:19Z KAFKA-3486: fix autocommit when partitions assigned manually Author: Jason Gustafson <ja...@confluent.io> Reviewers: Ewen Cheslack-Postava <e...@confluent.io> Closes #1169 from hachikuji/KAFKA-3486 (cherry picked from commit dd5480a47eb0f45214c179b7f14ffaf493164222) Signed-off-by: Ewen Cheslack-Postava <m...@ewencp.org> commit 6d2d9f6702861f0c575b0b58e233c80907ada700 Author: Paul Cavallaro <paulcavall...@gmail.com> Date: 2016-04-04T01:14:53Z MINOR: Fix small typo in design section Sentence was missing "as", minor grammar clean up. Author: Paul Cavallaro <paulcavall...@gmail.com> Reviewers: Ewen Cheslack-Postava <e...@confluent.io> Closes #1151 from paulcavallaro/docs-fix (cherry picked from commit 3a20ba305517ace78ea5f54554bd3b333f0b7d3d) Signed-off-by: Ewen Cheslack-Postava <m...@ewencp.org> commit 99ab50ddb2bc52d3278955046617bd918db2463c Author: Liquan Pei <liquan...@gmail.com> Date: 2016-04-04T02:04:48Z MINOR: Clean up of SourceTaskOffsetCommiter Author: Liquan Pei <liquan...@gmail.com> Reviewers: Ewen Cheslack-Postava <e...@confluent.io> Closes #1170 from Ishiihara/minor-cleanup (cherry picked from commit 83cf38545be4614bd1f6b1759ada851fb38d63b0) Signed-off-by: Ewen Cheslack-Postava <m...@ewencp.org> commit e0ac36f05fb5dfecf69f5746b8bd8680ca251f50 Author: Grant Henke <granthe...@gmail.com> Date: 2016-04-04T03:04:36Z KAFKA-3483: Restructure ducktape tests to simplify running subsets of tests ⦠tests Author: Grant Henke <granthe...@gmail.com> Reviewers: Geoff Anderson <ge...@confluent.io>, Ewen Cheslack-Postava <e...@confluent.io> Closes #1162 from granthenke/ducktape-structure (cherry picked from commit 45c585b4f7e3d5e5dd5297b4d121badbd2052922) Signed-off-by: Ewen Cheslack-Postava <m...@ewencp.org> commit 050bf60a4725b239db76732d0f7d7f1c7c41ab06 Author: Gwen Shapira <csh...@gmail.com> Date: 2016-03-21T16:48:02Z Changing version to 0.10.0.0 commit bc47e2306d9558a0f0976b15a554fc2d84ade5fc Author: Gwen Shapira <csh...@gmail.com> Date: 2016-03-21T16:53:17Z Changing version to 0.10.1.0-SNAPSHOT commit 9c5af253b170e2570ba2e17b4155520cea474e81 Author: Gwen Shapira <csh...@gmail.com> Date: 2016-03-21T20:40:59Z MINOR: update new version in additional places Note: This goes only to trunk. 0.10.0 branch will need a separate PR with different versions. Author: Gwen Shapira <csh...@gmail.com> Reviewers: Ismael Juma <ism...@juma.me.uk>, Ewen Cheslack-Postava <e...@confluent.io> Closes #1109 from gwenshap/minor-fix-version-trunk commit aa6f0d8d5f084126bbba1fb6b40e392f2b908262 Author: Gwen Shapira <csh...@gmail.com> Date: 2016-03-22T01:58:45Z MINOR: update new version in additional places matching set of version fixes. ewencp junrao Author: Gwen Shapira <csh...@gmail.com> Reviewers: Ismael Juma <ism...@juma.me.uk>, Geoff Anderson <ge...@confluent.io>, Ewen Cheslack-Postava <e...@confluent.io> Closes #1110 from gwenshap/minor-fix-version-010 commit 0773bc4ba604bc8b57040583ac4c1cb6832ba188 Author: Gwen Shapira <csh...@gmail.com> Date: 2016-03-23T22:41:07Z MINOR: Revert 0.10.0 branch to SNAPSHOT per change in release process Author: Gwen Shapira <csh...@gmail.com> Reviewers: Ewen Cheslack-Postava Closes #1126 from gwenshap/minor-release-version commit e8593d1b4529a7b9f3471ac8c1411dba336d6708 Author: Ryan P <ryan.n.pridg...@gmail.com> Date: 2016-03-24T17:12:19Z KAFKA-3445: Validate TASKS_MAX_CONFIG's lower bound Currently the property TASKS_MAX_CONFIG is not validated against nonsensical values such as 0. This patch leverages the Range.atLeast() method to ensure value is at least 1. Author: Ryan P <ryan.n.pridg...@gmail.com> Reviewers: Ewen Cheslack-Postava <e...@confluent.io> Closes #1132 from rnpridgeon/KAFKA-3445 commit ae0a5a0dfdb6f5d69322ce0fa4da2c6e5e0daeb6 Author: Jeremy Custenborder <jcustenbor...@gmail.com> Date: 2016-03-24T18:03:30Z KAFKA-3407 - ErrorLoggingCallback trims helpful diagnostic information. This should help when diagnosing issues with the console producer. This allows the logger to use `exception` rather than `exception.getMessage()`. Author: Jeremy Custenborder <jcustenbor...@gmail.com> Reviewers: Ewen Cheslack-Postava <e...@confluent.io> Closes #1079 from jcustenborder/KAFKA-3407 commit b5de41227f11a495d5dd7e1cf785220365d84534 Author: Ashish Singh <asi...@cloudera.com> Date: 2016-04-01T21:12:49Z MINOR: Add check for empty topics iterator in ReplicaVerificationTool. Author: Ashish Singh <asi...@cloudera.com> Reviewers: Guozhang Wang, Gwen Shapira Closes #1167 from SinghAsDev/minorFixRelicaLagTool commit c588a72ad21f313d0c0ced11f083eca18fab84a1 Author: Ismael Juma <ism...@juma.me.uk> Date: 2016-04-01T22:25:35Z KAFKA-2844; Separate keytabs for sasl tests Use a different keytab for server and client in SASL tests Also: * Improve approach used to build the JAAS files programmatically * Delete stale `kafka_jaas.conf` file * Move `FourLetterWords` to its own file, add `Zk` prefix and clean-up its usage Author: Ismael Juma <ism...@juma.me.uk> Reviewers: Harsha Chintalapani, Gwen Shapira Closes #533 from ijuma/separate-keytabs-for-sasl-tests ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---