[GitHub] kafka pull request #1834: [WIP] KAFKA-4140: make system tests parallel frien...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/1834 [WIP] KAFKA-4140: make system tests parallel friendly Updates to take advantage of soon-to-be-released ducktape features. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka systest-parallel-friendly Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1834.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1834 commit 7f8d49d32d35e0980c84c895b6384d9d4f9e15e8 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-05T01:46:51Z Added state check in stop() method in zookeeper.py commit 4ac3aa410e9a1fd692e063d9bd4d238cf63299cb Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-05T01:47:24Z Added wait_until for line_count check in console consumer sanity check test commit 9f727d6afe6e5a77c6d272b2a1cc876c64b80101 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-08T06:10:02Z Tweak system tests/services for running in parallel commit c049cdaed50b31d28da4fc7bdc1d255657c8654d Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-08T17:55:52Z Save keystore/truststore in local scratch to make parallel safe commit a7b1530597b04508ebe78aeb7fcc89fea75ce597 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-08T23:08:16Z More informative error message commit 7471460ebf7359bd63e9ce90d63289163d6758bb Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-08T23:12:26Z Use stdout instead of stderr commit ff1221862f11fff8daf82cb88c5b7ff5ab6f9ae7 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-09T19:54:01Z Some adjustments to expected cluster usage commit 051825dfd47d92a0f6856faa53a80db8e3680a76 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-11T17:03:25Z Cluster size adjustments and other fixes commit 7f447ae50dd1518a0f6d48daa13688c22dde8cad Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-11T21:52:26Z More fixes to tests commit 150e8438ca4b1ec2ad2d198ba954c09a04fdc11b Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-30T17:58:16Z Minor cleanup commit 3eb185307f31d02034dcf3d4f8e684b8324baf0c Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-30T23:27:45Z Use per-test local scratch directory in minikdc commit b1cca95b78004275fe8bf0602b7c2566abd87105 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-08-31T23:20:23Z Removed a few uses of scp_to in system tests commit b29e1fa179be201cf201a11e92fc1a4c21fa18d1 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-09-04T07:46:18Z Tabs to spaces, scp_to -> copy_to after rebase commit 9ebb4c35b29796e1d3d0ab92b9ae4e8bad6bf2c3 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-09-06T06:07:13Z Updated scratch_dir -> local_scratch_dir per changes in ducktape --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request #1659: MINOR: cleanup apache license in python files
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/1659 MINOR: cleanup apache license in python files @ijuma As discussed in https://github.com/apache/kafka/pull/1645, this patch removes an extraneous line from several __init__.py files, and a few others as well You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-cleanup-init-files Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1659.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1659 commit e08c63a30870107a3fb1fc474391fbce96db6302 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-07-25T00:32:53Z Removed extraneous line from several __init__.py files commit 9fc334f4be0e7d53fe455aea025aa090892a6587 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-07-25T00:43:54Z Removed remaining ocurrences of extraneous line --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Bump system test ducktape dependency to...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/1397 MINOR: Bump system test ducktape dependency to 0.5.1 You can merge this pull request into a Git repository by running: $ git pull https://github.com/granders/kafka minor-increment-ducktape Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1397.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1397 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Add version check on enable-systest-eve...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/1298 MINOR: Add version check on enable-systest-events flag Recent patch adding enable-systest-events flag without any version check breaks all uses of versioned console consumer. E.g. upgrade tests, compatibility tests etc. Added a check to only apply the flag if running 0.10.0 or greater. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-systest-fix-versioned-console-consumer Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1298.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1298 commit ceebd81078fa377b692e60f749f6e195d21fcfdb Author: Geoff Anderson <ge...@confluent.io> Date: 2016-04-30T00:43:27Z Add version check on enable-systest-events flag --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-3581: add timeouts to joins in backgroun...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/1297 KAFKA-3581: add timeouts to joins in background thread services This actually removes joins altogether, as well as references to self.worker_threads, which is best left as an implementation detail in BackgroundThreadService. This makes use of @hachikuji 's recent ducktape patch, and updates ducktape dependency to 0.5.0. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-3581-systest-add-join-timeout Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1297.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1297 commit a9108e8867afa44bdecbe760d47deccab0b94975 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-04-29T22:54:07Z Removed expicit references to worker_threads, and added wait_node with timeouts --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-3592: System test - configurable paths [...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/1245 KAFKA-3592: System test - configurable paths [WIP] This patch adds logic for the following: - remove hard-coded paths to various scripts and jars in kafkatest service classes - provide a mechanism for overriding path resolution logic with a "pluggable" path resolver class You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka configurable-install-path Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1245.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1245 commit 1bd1d63e8aeec23bf043774af9aa59f0b038084a Author: Geoff Anderson <ge...@confluent.io> Date: 2016-04-11T20:09:40Z First pass on updating path resolution commit 088e6d1a2e8ea30905d899c8fb1cf60c6fa3f934 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-04-12T00:36:38Z Moved system test path resolution logic commit 386f995594d0fb8769d43b5914b43fe7a77085db Author: Geoff Anderson <ge...@confluent.io> Date: 2016-04-12T01:31:39Z Renamed kafka system test path resolver commit c6c764e867450e5b263c66a58f46c735bc0bc622 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-04-14T01:13:49Z Cleanup of path resolution, moved kafka version to avoid circular imports. commit 9a0a8bedff68a9998c87c8382f9672abceef7233 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-04-15T00:10:32Z Updated services to use path resolver commit a0751503445678b4ae76e1fc33bd1b0fbf374142 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-04-15T23:17:43Z Refactored path resolver; simplified method definitions commit 0cb26c7f2b186bbbc0203826f88cf189faf6d1f8 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-04-19T17:56:05Z Added missing path resolver commit 293ae1dafa10eef2ff36d08f2877e565ed083ab5 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-04-20T19:44:19Z Added python unit tests for system test path resolution logic --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Advance system test ducktape dependency...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/1165 MINOR: Advance system test ducktape dependency from 0.3.10 to 0.4.0 Previous version of ducktape was found to have a memory leak which caused occasional failures in nightly runs. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-advance-ducktape-to-0.4.0 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1165.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1165 commit 74ce1af3206b1bb2e72c57995a070da87ddab357 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-03-29T23:17:19Z Advanced system test ducktape dependency from 0.3.10 to 0.4.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Ignoring streams tests until there is f...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/1031 MINOR: Ignoring streams tests until there is fix for KAFKA-3354 Per discussion with @guozhangwang, `@ignore` failing streams system tests until fix for KAFKA-3354 is checked in. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka ignore-streams-systest Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1031.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1031 commit 90b72c5fecd3b5646ce8d3f24ba5522023dacc96 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-03-09T02:36:26Z Ignoring streams tests until there is fix for KAFKA-3354 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Add vagrant up wrapper for simple paral...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/982 MINOR: Add vagrant up wrapper for simple parallel bringup on aws The main impediment to bringing up aws machines in parallel using vagrant was the interaction between `vagrant-hostmanager` and `vagrant-aws`. If you disable hostmanager during the `up` phase, and run it after the cluster is up, parallel bringup is possible. The only caveat is that machines must be brought up in small-ish batches to prevent rate limit errors from AWS since `vagrant-aws` doesn't seem to have mechanisms to This PR: - disables `vagrant-hostmanager` during bringup - adds a wrapper script to make it convenient to bring machines up in batches on aws You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka vagrant-disable-hostmanager Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/982.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #982 commit f94aa2caf483d6d53becc2b13eb38198a349df57 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-02-26T22:33:56Z Add vagrant up wrapper for easier parallel brinup on aws --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Stabilize transient replication test fa...
Github user granders closed the pull request at: https://github.com/apache/kafka/pull/890 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Stabilize transient replication test fa...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/890 MINOR: Stabilize transient replication test failures in 0.9.0 - ported timeout values in `produce_consume_validate.py` from trunk to 0.9.0 - ported `producer_throughput_value` in `replication_test.py` from trunk to 0.9.0 - fixed `min.insync.replicas` config, which due to an error, was not getting applied to its intended topics You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka stabilize-transient-failures-0.9.0 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/890.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #890 commit 5ce08dbfacdea41b8eb7844004407dd0c5776625 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-02-08T19:47:06Z Update timeout on consumption check to match trunk commit 99c62e46fef6771909e7fdf6d1c839fb501e3996 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-02-08T22:07:59Z Match timeout in trunk in producer check commit b65b017b809363401077ab10b949f1fd6f68698a Author: Geoff Anderson <ge...@confluent.io> Date: 2016-02-09T02:55:20Z Fixed invalid configuration of min.insync.replicas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Updated kafkatest version to match vers...
Github user granders closed the pull request at: https://github.com/apache/kafka/pull/878 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Updated kafkatest version to match vers...
GitHub user granders opened a pull request:
https://github.com/apache/kafka/pull/878
MINOR: Updated kafkatest version to match version specified in
gradle.properties
This discrepancy was causing a few system tests which to some version
validation to fail consistently on 0.9.0 branch. Namely:
```
Module: kafkatest.sanity_checks.test_verifiable_producer
Class: TestVerifiableProducer
Method: test_simple_run
Arguments:
{
"producer_version": "0.8.2.2"
}
Module: kafkatest.sanity_checks.test_verifiable_producer
Class: TestVerifiableProducer
Method: test_simple_run
Arguments:
{
"producer_version": "trunk"
}
Module: kafkatest.sanity_checks.test_kafka_version
Class: KafkaVersionTest
Method: test_multi_version
```
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/confluentinc/kafka
increment-kafkatest-version-0.9.0
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/878.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #878
commit bbc70530d5439863d53543bed5d298cbf646e9e7
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-02-04T01:37:24Z
Updated kafkatest version to match kafka version specified in
gradle.properties
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] kafka pull request: MINOR: Pin to system tests to ducktape 0.3.10
Github user granders closed the pull request at: https://github.com/apache/kafka/pull/863 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Removed unnecessary Vagrantfile hack
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/867 MINOR: Removed unnecessary Vagrantfile hack The hack here is no longer necessary with up-to-date versions of Vagrant, vagrant-hostmanager, and vagrant-aws. What's more, the change in c8b60b63 caused a chain of infinite recursion on OSX. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka remove-vagrantfile-hack Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/867.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #867 commit 8799afe3190345457adaf12befb47e3a6f8adcf2 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-02-03T23:44:58Z Removed Vagrantfile hack which is no longer necessary with up-to-date versions of Vagrant, vagrant-hostmanager, and vagrant-aws --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Pin to system tests to ducktape 0.3.10
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/863 MINOR: Pin to system tests to ducktape 0.3.10 You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka increment-ducktape-0.9.0 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/863.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #863 commit 053548a81024aaf6fffc90499a24b32785e390cd Author: Geoff Anderson <ge...@confluent.io> Date: 2016-02-03T23:39:12Z Pin to system tests to ducktape 0.3.10 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Increment ducktape dependency
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/852 MINOR: Increment ducktape dependency Pin kafka system tests to a newer version of ducktape. Ran in branch builder; only one preexisting (transient) failure: http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/2016-02-01--001.1454333721--confluentinc--increment-ducktape-dependency--a40f474/report.html You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka increment-ducktape-dependency Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/852.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #852 commit 49ddd6a038bf12fb0eee453b05d86d0f60c25519 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-01-31T23:53:34Z For system tests require ducktape 0.3.9 commit a40f474dd35ad89f5826c9a28681c5c7e8a5724c Author: Geoff Anderson <ge...@confluent.io> Date: 2016-02-01T07:13:58Z Skip ducktape 0.3.9 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: vagrant aws overrideable ec2 instance n...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/801 MINOR: vagrant aws overrideable ec2 instance name prefix @ewencp This small change allows users to use Vagrantfile.local to specify a custom prefix for names of ec2 instances brought up with vagrant. This makes management of multiple aws test clusters a little easier since individual clusters can be assigned different name prefixes. if `ec2_instance_name_prefix` is not specified in `Vagrantfile.local`, behavior will be exactly the same as before this change. Testing: - aws: I verified worker nodes, broker nodes, zk nodes with and without the prefix override. Behavior is as expected - locally: I verified that bringing up worker nodes, broker nodes, zk nodes on a local machine is not impacted by this change. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-vagrant-aws-overrideable-prefix Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/801.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #801 commit 761a8a04c26a26120e6943d3204ce861daf1cfbb Author: Geoff Anderson <ge...@confluent.io> Date: 2016-01-21T23:35:32Z Made it possible to use Vagrantfile.local to override the prefix for ec2 instance names on ducktape slave machines commit 40c6e29e0d245655efd40f1fd8cf2b76721355c9 Author: Geoff Anderson <ge...@confluent.io> Date: 2016-01-21T23:49:12Z Fixed scoping problem --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2928: system test: fix version sanity ch...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/656 KAFKA-2928: system test: fix version sanity checks Fixed version sanity checks by updated kafkatest version to match kafka version You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2928-fix-version-sanity-checks Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/656.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #656 commit 1196d5aefa32e338881e7b3b50682e082733c625 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-12-10T01:43:04Z Fixed version sanity checks by updated kafkatest version to match kafka version --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2927: reduce system test storage footpri...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/657 KAFKA-2927: reduce system test storage footprint Split kafka logging into two levels - DEBUG and INFO, and do not collect DEBUG by default. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2927-reduce-log-footprint Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/657.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #657 commit 0dc3a1a367083f57f3cb6d8e1cd82571598d7108 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-12-10T01:09:59Z Split kafka logging into two levels - DEBUG and INFO, and do not collect DEBUG by default --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2772: Stabilize failures on replication ...
Github user granders closed the pull request at: https://github.com/apache/kafka/pull/481 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Manually ported changes in 8c3c9548b636...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/620 MINOR: Manually ported changes in 8c3c9548b636cdf760d2537afe115942d13bc003 Porting manually to 0.9.0 (no cherry-pick due to conflicts) This will allow concurrent system test runs on the same machine You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-0.9.0-minikdc-conflict Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/620.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #620 commit ee8a7ce9a4789e4538cf9d337b2fc0d80204da06 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-12-02T23:42:57Z Manually ported changes in 8c3c9548b636cdf760d2537afe115942d13bc003 to 0.9.0 (no cherry-pick due to conflicts) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Log at INFO level in Benchmark tests
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/569 MINOR: Log at INFO level in Benchmark tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-reduce-benchmark-logs Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/569.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #569 commit 2b202aba9b57bd5bb4009b8341094362fbbc2e2f Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-20T19:05:27Z Log at INFO level in Benchmark tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2820: Remove log threshold on appender i...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/556 KAFKA-2820: Remove log threshold on appender in tools-log4j.properties Removed a config in tools-log4j.properties which prevented certain service classes from running at TRACE level. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2820-systest-tool-loglevel Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/556.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #556 commit d58be9e6ed248882ef669e5d402dbb427a153eb7 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-19T01:53:52Z Remove log threshold on appender in tools-log4j.properties --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2845: new client old broker compatibilit...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/537 KAFKA-2845: new client old broker compatibility You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2845-new-client-old-broker-compatibility Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/537.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #537 commit f8cb7f9ba8f4c6f08d15af4c1df8d439739e15a9 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-10-29T21:43:40Z Sketch of compatibility test commit 2c3b65ef7c26fef035b83e44d6ed1f301cc80a34 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-16T22:15:46Z Add test for 0.9 consumer against 0.8 brokers commit 924a281eeace248f852551d30bf55e8c5d79a7b8 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-16T22:40:03Z Added compatibility test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2820: systest log level
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/538 KAFKA-2820: systest log level This restores control over log level in KafkaService, and adds SASL debug logging when SASL is enabled You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2820-systest-log-level Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/538.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #538 commit 0f27b3b547226d20dc7161acf02753ebbe9b5235 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-17T00:38:44Z Add debug logging for SASL commit 0fc43371e3094cdb9df336430ed5145490b0010c Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-17T00:39:04Z Restore control over log level in KafkaService --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Tuned timeout parameter to reduce chanc...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/521 MINOR: Tuned timeout parameter to reduce chance of transient failure Increased timeout in downstream consumer doing validation step. This addresses a transient failure case in mirror maker tests with mirror maker failover. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-mm-transient-failure Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/521.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #521 commit d93e40afe22207e15ed73b2e02e6b2b7ea640e23 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-13T00:56:07Z Tuned timeout parameter to reduce chance of transient failure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Do not collect zk persistent data by de...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/504 MINOR: Do not collect zk persistent data by default In system tests zookeeper service, it is overkill and space-intensive to collect zookeeper data logs by default. This minor patch turns off default collection. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-zk-change-log-collect Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/504.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #504 commit 4f41760e0cb7f71ebeb383b3576e11fe901180a7 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-12T02:33:36Z Do not collect zk persistent data by default --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: update system test readme
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/487 MINOR: update system test readme You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-update-test-readme Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/487.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #487 commit 98b18228dca8a405738669cade199720db753e93 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-10T02:22:19Z Minor update to test README commit 44b5543649f4ce6b2d7a9ee515e4c7d81199e009 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-10T18:57:46Z Tweaked explanation commit d0ea7d95dad2ba0f6aedac8864fb00060eee4c29 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-10T18:58:49Z Tweak --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2772: Stabilize failures on replication ...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/481 KAFKA-2772: Stabilize failures on replication with hard bounce You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2772-stabilize-replicationtest Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/481.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #481 commit ff171abb0874d7dd53a5dcc8d471c876b45155c9 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-09T00:49:34Z Stabilize failures on replication with hard bounce --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2773: (0.9.0 branch)Fixed broken vagrant...
Github user granders closed the pull request at: https://github.com/apache/kafka/pull/455 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2773: Fixed broken vagrant provision scr...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/455 KAFKA-2773: Fixed broken vagrant provision scripts for static zk/broker cluster You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2773-0.9.0-vagrant-fix Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/455.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #455 commit 88701a98ca041b2837090335e6045437688b516e Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-09T01:52:06Z Fixed broken vagrant provision scripts for static zk/broker cluster --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2773: Fixed broken vagrant provision scr...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/454 KAFKA-2773: Fixed broken vagrant provision scripts for static zk/broker cluster You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2773-vagrant-fix Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/454.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #454 commit d696bbbc9ff67318be40005b63b2e72f2e60c728 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-09T01:52:06Z Fixed broken vagrant provision scripts for static zk/broker cluster --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2258[WIP]: add failover to mirrormaker t...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/427 KAFKA-2258[WIP]: add failover to mirrormaker test This PR adds failover to simple end to end mirror maker test Marked as WIP for 2 reasons: - We may want to add a couple more test cases where kafka is being used to store offsets - There appears to be a test failure in the hard failover case You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2258-mirrormaker-test Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/427.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #427 commit b5db56912720e98ab3f191370a6dadca4efed1f9 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-10-28T23:59:51Z Added sketch of mirror maker failover commit 1c9bc561bf5047360974cfb121f039c63a2bf1a8 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-05T01:41:46Z Cleaned up logging commit 62cfe5db519975f74e4ccf5ff5695b36322ae6cb Author: Geoff Anderson <ge...@confluent.io> Date: 2015-11-05T01:44:02Z Removed extra spaces from producer.properties --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Removed previous system_test folder
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/392 MINOR: Removed previous system_test folder @ewencp Nothing too complicated here You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-remove-system-test Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/392.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #392 commit 81df4b946721dea99d401e7a7038b8345ea0411c Author: Geoff Anderson <ge...@confluent.io> Date: 2015-10-30T21:11:53Z Removed previous system_test folder --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: update to correct clock skew
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/383 MINOR: update to correct clock skew @ewencp Updated the provisioning script to install ntp daemon. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-systest-clock-skew Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/383.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #383 commit d6931c978a678d75e47d01c2b1cbff7b068a4090 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-10-29T18:06:37Z Updates vagrant to install ntp daemon; helps with clock skew in system tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: Update which makes kafkatest services useable ...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/385 Update which makes kafkatest services useable by external dependencies @ewencp Some *.properties files were missing from `kafkatest` package I've tested this change on aws with confluent system tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-update-test-manifest Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/385.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #385 commit 0a97dd64a097bc3ac3d67c9e3b3ada3b178d4812 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-10-29T22:45:45Z Update which makes kafkatest services useable by external dependencies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-1888 [WIP]: rolling upgrade test
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/229 KAFKA-1888 [WIP]: rolling upgrade test @ewencp @gwenshap This needs some refactoring to avoid the duplicated code between replication test and upgrade test, but in shape for initial feedback. I'm interested in feedback on the added `KafkaConfig` class and `kafka_props` file. This addition makes it: - easier to attach different configs to different nodes (e.g. during broker upgrade process) - easier to reason about the configuration of a particular node Notes: - in the default values in the KafkaConfig class, I removed many properties which were in kafka.properties before. This is because most of those properties were set to what is already the default value. - when running non-trunk VerifiableProducer, I append the trunk tools jar to the classpath, and run it with the non-trunk kafka-run-class.sh script You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-1888-upgrade-test Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/229.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #229 commit 22eae20df7ced03ca49f2f97033c21809c19c2e9 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-09-02T23:24:01Z Added simple mechanism for setting version on a Kafka node. Also updated provisioning script to bring in kafka 0.8.2.1, and included simple sanity tests. commit 1fe461d1e6a9aa28fa23ce61a85ad5722691e003 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-09-15T01:04:44Z Added sanity checks on VerifiableProducer - check that we can successfully start and produce on trunk and on 0.8.2.1 commit 06dcb337ced72876bc03d0242e88971ea4bf57a6 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-09-15T01:13:55Z Added versioning on console consumer service commit 80cbe0a0b03411e43439cfedab4bb2b63b26f869 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-09-15T01:18:56Z Added versioning for verifiable producer, as well as recoverable log4j logging commit 4b8cfc72cb00474f2072cc7bc3136151688277f3 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-09-15T01:23:32Z Updated Kafka to include versioning and use KafkaConfig class instead of properties template file, and added upgrade test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: Added scripts to automate Vagrant setup...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/201 MINOR: Added scripts to automate Vagrant setup for system tests Updated testing README accordingly. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-vagrant-package-script Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/201.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #201 commit b0293d8a761abce049da83501bab6928e6f2bd7f Author: Geoff Anderson <ge...@confluent.io> Date: 2015-09-09T07:53:59Z Added tools to simplify Vagrant setup when running system tests, and updated testing README accordingly. commit 26d3d6c0d9620735c15c0caddde68d6719a45bf8 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-09-09T17:29:35Z Fixed check on Vagrant installation. Also, restore original Vagrantfile.local if vagrant up fails during box packaging. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: Updated testing readme
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/187 Updated testing readme Minor update to point to testing tutorial, and install the correct version of vagrant-hostmanager You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-testing-readme-update Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/187.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #187 commit 15ac78f36ed284a24113d7babfd5b11c92ca4b60 Author: Geoff Anderson <ge...@confluent.io> Date: 2015-09-02T18:29:09Z Updated testing readme --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2489: add benchmark for new consumer
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/179 KAFKA-2489: add benchmark for new consumer @ewencp The changes here are smaller than they look - mostly refactoring/cleanup. - ConsumerPerformance.scala - corrected timeout inequality which had prevented this from working with new consumer - ConsumerPerformanceService: added new_consumer flag, and exposed more command-line settings - benchmark.py: refactored to use `@parametrize` and `@matrix` - this reduced some amount of repeated code - benchmark.py: added consumer performance tests with new consumer (using `@parametrize`) - benchmark.py: added more detailed test descriptions - performance.py: broke into separate files You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2489-benchmark-new-consumer Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/179.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #179 commit 6525594e2c4803f85403f260ddcb18ff5ae6c0a0 Author: Geoff Anderson ge...@confluent.io Date: 2015-08-29T05:24:29Z Fixed typo in ProducerPerformance.java commit fa5f81094215a69f00076cc2a07c2e3d19f9a34f Author: Geoff Anderson ge...@confluent.io Date: 2015-08-29T05:25:53Z Fixed ConsumerPerformance.scala with new consumer: incorrect inequality previously caused this to time out without consuming any messages with new consumer. commit 45b31f3d5f7a2ae6d4d27737012495cc8ad1c70d Author: Geoff Anderson ge...@confluent.io Date: 2015-08-29T05:28:57Z Updated consumer throughput tests to run with new and old consumer. Refactored with @parametrize and @matrix to reduce duplicated code. commit f4d837330fdda2bc7918b97e740ba91a9d456462 Author: Geoff Anderson ge...@confluent.io Date: 2015-08-29T05:30:37Z Refactored performance.py - broke services into individual files. This does not change the way external users would import and use the performance services however. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: kafkatest add manifest
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/173 MINOR: kafkatest add manifest This patch makes it possible to publish kafkatest (system test package) to pypi and use it as a library in other projects by: - including necessary static resources with the package - renaming the version to conform w/PEP 440, since python packaging tools reject the current version name You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-kafkatest-add-manifest Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/173.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #173 commit 924f287b619ae3b888e3ae70795e857d007d227b Author: Geoff Anderson ge...@confluent.io Date: 2015-08-25T21:29:28Z Updated kafkatest package to include *.properties files when installed commit b22e99a5993c30f7d4e14c3f7640e2ecddaedb5d Author: Geoff Anderson ge...@confluent.io Date: 2015-08-25T21:29:28Z Updated kafkatest package to include *.properties files when installed commit 126c27bc8463f6218092badc56ec0a408b019d35 Author: Geoff Anderson ge...@confluent.io Date: 2015-08-27T23:56:28Z Merge branch 'minor-kafkatest-add-manifest' of github.com:confluentinc/kafka into minor-kafkatest-add-manifest --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2439: Add MirrorMaker service class for ...
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/148 KAFKA-2439: Add MirrorMaker service class for system tests Added MirrorMaker service and a few corresponding sanity checks, as well as necessary config template files. A few additional updates to accomodate the change in wait_until from ducktape0.2.0-0.3.0 You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2439 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/148.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #148 commit 1b4b04935eafa2e93583ea5683c2e8851ed43476 Author: Geoff Anderson ge...@confluent.io Date: 2015-08-18T08:15:00Z Added MirrorMaker service and a few corresponding sanity checks, as well as necessary config template files. A few additional updates to accomodate the change in wait_until from ducktape0.2.0-0.3.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: MINOR: expose vagrant base box as variable
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/137 MINOR: expose vagrant base box as variable Added base_box variable to Vagrantfile. This makes it possible to override the base box in Vagrantfile.local. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka minor-expose-vagrant-box Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/137.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #137 commit 44936f7918a80aed42729d466d348b99703395ff Author: Geoff Anderson ge...@confluent.io Date: 2015-08-13T21:18:41Z Added base_box variable to Vagrantfile. This makes it possible to override the base box in Vagrantfile.local. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2327
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/73 KAFKA-2327 Added unit tests as well. These fail without the fix, but pass with the fix. You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2327 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/73.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #73 commit 23b3340b91800ff6568ac8f07f9188659358ecc3 Author: Geoff Anderson ge...@confluent.io Date: 2015-07-09T19:01:27Z Fixes KAFKA-2327 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: Kafka 2276
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/70 Kafka 2276 Initial patch for KIP-25 Note that to install ducktape, do *not* use pip to install ducktape. Instead: ``` $ git clone g...@github.com:confluentinc/ducktape.git $ cd ducktape $ python setup.py install ``` You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka KAFKA-2276 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/70.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #70 commit 81e41562f3836e95e89e12f215c82b1b2d505381 Author: Liquan Pei liquan...@gmail.com Date: 2015-04-24T01:32:54Z Bootstrap Kafka system tests commit f1914c3ba9b52d0f8db3989c8b031127b42ac59e Author: Liquan Pei liquan...@gmail.com Date: 2015-04-24T01:33:44Z Merge pull request #2 from confluentinc/system_tests Bootstrap Kafka system tests commit a2789885806f98dcd1fd58edc9a10a30e4bd314c Author: Geoff Anderson ge...@confluent.io Date: 2015-05-26T22:21:23Z fixed typos commit 07cd1c66a952ee29fc3c8e85464acb43a6981b8a Author: Geoff Anderson ge...@confluent.io Date: 2015-05-26T22:22:14Z Added simple producer which prints status of produced messages to stdout. commit da94b8cbe79e6634cc32fbe8f6deb25388923029 Author: Geoff Anderson ge...@confluent.io Date: 2015-05-27T21:07:20Z Added number of messages option. commit 212b39a2d75027299fbb1b1008d463a82aab Author: Geoff Anderson ge...@confluent.io Date: 2015-05-27T22:35:06Z Added some metadata to producer output. commit 8b4b1f2aa9681632ef65aa92dfd3066cd7d62851 Author: Geoff Anderson ge...@confluent.io Date: 2015-05-29T23:38:32Z Minor updates to VerboseProducer commit c0526fe44cea739519a0889ebe9ead01b406b365 Author: Geoff Anderson ge...@confluent.io Date: 2015-06-01T02:27:15Z Updates per review comments. commit bc009f218e00241cbdd23931d01b52c442eef6b7 Author: Geoff Anderson ge...@confluent.io Date: 2015-06-01T02:28:28Z Got rid of VerboseProducer in core (moved to clients) commit 475423bb642ac8f816e8080f891867a6362c17fa Author: Geoff Anderson ge...@confluent.io Date: 2015-06-01T04:05:09Z Convert class to string before adding to json object. commit 0a5de8e0590e3a8dce1a91769ad41497b5e07d17 Author: Geoff Anderson ge...@confluent.io Date: 2015-06-02T22:46:52Z Fixed checkstyle errors. Changed name to VerifiableProducer. Added synchronization for thread safety on println statements. commit 9100417ce0717a71c822c5a279fe7858bfe7a7ee Author: Geoff Anderson ge...@confluent.io Date: 2015-06-03T19:50:11Z Updated command-line options for VerifiableProducer. Extracted throughput logic to make it reusable. commit 1228eefc4e52b58c214b3ad45feab36a475d5a66 Author: Geoff Anderson ge...@confluent.io Date: 2015-06-04T01:09:14Z Renamed throttler commit 6842ed1ffad62a84df67a0f0b6a651a6df085d12 Author: Geoff Anderson ge...@confluent.io Date: 2015-06-04T01:12:11Z left out a file from last commit commit d586fb0eb63409807c02f280fae786cec55fb348 Author: Geoff Anderson ge...@confluent.io Date: 2015-06-04T01:22:34Z Updated comments to reflect that throttler is not message-specific commit a80a4282ba9a288edba7cdf409d31f01ebf3d458 Author: Geoff Anderson ge...@confluent.io Date: 2015-06-04T20:47:21Z Added shell program for VerifiableProducer. commit 51a94fd6ece926bcdd864af353efcf4c4d1b8ad8 Author: Geoff Anderson ge...@confluent.io Date: 2015-06-04T20:55:02Z Use argparse4j instead of joptsimple. ThroughputThrottler now has more intuitive behavior when targetThroughput is 0. commit 632be12d2384bfd1ed3b057913dfd363cab71726 Author: Geoff grand...@gmail.com Date: 2015-06-04T22:22:44Z Merge pull request #3 from confluentinc/verbose-client Verbose client commit fc7c81c1f6cce497c19da34f7c452ee44800ab6d Author: Geoff Anderson ge...@confluent.io Date: 2015-06-11T01:01:39Z added setup.py commit 884b20e3a7ce7a94f22594782322e4366b51f7eb Author: Geoff Anderson ge...@confluent.io Date: 2015-06-11T01:02:11Z Moved a bunch of files to kafkatest directory commit 25a413d6ae938e9773eb2b20509760bab464 Author: Geoff grand...@gmail.com Date: 2015-06-11T20:29:21Z Update aws-example-Vagrantfile.local commit 96533c3718a9285d78393fb453b951592c72a490 Author: Geoff grand...@gmail.com Date: 2015-06-11T20:36:33Z Update aws-access-keys-commands commit e5edf031aeb99b9176a6ae8375963f2aedaaa6d7 Author: Geoff Anderson ge...@confluent.io Date: 2015-06-12T00:27:49Z Updated example aws Vagrantfile.local commit 5af88fc1d9fc357c191a7c5fdbca60e37f42e9fc Author: Geoff Anderson ge...@confluent.io Date: 2015-06-12T00:28:19Z Updated README to include aws quickstart commit
