GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/5828
[DO NO MERGE] Debugging Kafka 0.8.2 test hang in Jenkins
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tdas/spark SPARK-2808-debug
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5828.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5828
----
commit e768164fca1c93ec0a99f7020e301368f798156c
Author: Helena Edelson <[email protected]>
Date: 2014-12-07T15:50:44Z
#2808 update kafka to version 0.8.2
commit d9dc2bc77d2e40c43699ef8fa6a9bfa7216575cd
Author: Helena Edelson <[email protected]>
Date: 2014-12-23T15:38:52Z
Merge remote-tracking branch 'upstream/master' into
wip-2808-kafka-0.8.2-upgrade
commit 2e67c66b174bd1641ea8986edde3ce5598add612
Author: Helena Edelson <[email protected]>
Date: 2015-02-05T13:08:19Z
#SPARK-2808 Update to Kafka 0.8.2.0 GA from beta.
commit 69534291ae46c7f0865e5a5ae444135c5ed3e27f
Author: cody koeninger <[email protected]>
Date: 2015-02-11T20:30:41Z
[SPARK-2808][Streaming][Kafka] update kafka to 0.8.2
commit 77de6c251e95b4e7eafbe5fc1668ae7bde7dbe8c
Author: cody koeninger <[email protected]>
Date: 2015-03-18T12:05:21Z
Merge branch 'master' into wip-2808-kafka-0.8.2-upgrade
commit 407382eae4f94489dd0ee1f4e84fcb0f6114f6e3
Author: cody koeninger <[email protected]>
Date: 2015-03-18T14:13:17Z
[SPARK-2808][Streaming][Kafka] update kafka to 0.8.2.1
commit ed02d2c71312138ec937cde047000e3a695f49c1
Author: cody koeninger <[email protected]>
Date: 2015-04-15T16:47:28Z
[SPARK-2808][Streaming][Kafka] move default argument for api version to
overloaded method, for binary compat
commit 1d10751fb39a418cfd11a3d2e2b90f53cb71fdc5
Author: cody koeninger <[email protected]>
Date: 2015-04-27T14:25:02Z
Merge branch 'master' into wip-2808-kafka-0.8.2-upgrade
Conflicts:
external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaStreamSuite.scala
commit c70ee43bb66aeccb75145dcc8eb06f1e11e92859
Author: cody koeninger <[email protected]>
Date: 2015-04-28T19:30:28Z
[SPARK-2808][Streaming][Kafka] add more asserts to test, try to figure out
why it fails on jenkins but not locally
commit 9edab4c10553bb054ab8e2b542a6be71195c4029
Author: cody koeninger <[email protected]>
Date: 2015-04-28T21:55:40Z
[SPARK-2808][Streaming][Kafka] more shots in the dark on jenkins failing
test
commit af6f3ecd36a07d93baebe73206310428d712decb
Author: cody koeninger <[email protected]>
Date: 2015-04-29T01:50:11Z
[SPARK-2808][Streaming][Kafka] delay test until latest leader offset
matches expected value
commit 61b3464cada26c10ee42271e5a958bc85e8c3cfb
Author: cody koeninger <[email protected]>
Date: 2015-04-29T02:43:54Z
[SPARK-2808][Streaming][Kafka] delay for second send in boundary condition
test
commit 3824ce390721c32610e6da90a5c08d4f4b68ad32
Author: cody koeninger <[email protected]>
Date: 2015-04-29T14:39:09Z
[SPARK-2808][Streaming][Kafka] naming / comments per tdas
commit 2b92d3f919a045d20965ddc6b02465a7e5b2c64d
Author: cody koeninger <[email protected]>
Date: 2015-04-29T16:47:04Z
[SPARK-2808][Streaming][Kafka] wait for leader offsets in the java test as
well
commit 2712649dfa1578d7b744244b6cb87206a441b1bb
Author: cody koeninger <[email protected]>
Date: 2015-04-29T20:42:40Z
[SPARK-2808][Streaming][Kafka] add more logging to python test, see why its
timing out in jenkins
commit 115aeee7e7dc1844094c0d9b76558a6450b480e0
Author: cody koeninger <[email protected]>
Date: 2015-04-29T21:18:26Z
Merge branch 'master' into wip-2808-kafka-0.8.2-upgrade
Conflicts:
python/pyspark/streaming/tests.py
commit 4c4557f149e0d96b2f5ea8020079cd3159388dec
Author: cody koeninger <[email protected]>
Date: 2015-04-30T18:00:40Z
[SPARK-2808][Streaming][Kafka] add even more logging to python test
commit 1d896e2a262569089b80b5cc018b3dff8121368e
Author: cody koeninger <[email protected]>
Date: 2015-04-30T20:11:40Z
[SPARK-2808][Streaming][Kafka] add even even more logging to python test
commit bb0cfe27919c31d2826d35b7669115006e91e58a
Author: Tathagata Das <[email protected]>
Date: 2015-05-01T00:06:47Z
Changes to debug flaky streaming tests.
commit ae12eb255042f4b8949eeb704fbc0e0777c37f66
Author: Tathagata Das <[email protected]>
Date: 2015-05-01T05:59:15Z
Enable only kafka streaming test
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
