Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73653296
[Test build #27178 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27178/consoleFull)
for PR 4384 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73653301
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73647726
[Test build #27178 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27178/consoleFull)
for PR 4384 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/4384
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24386248
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala
---
@@ -179,121 +182,194 @@ object KafkaUtils {
errs =
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24386265
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala
---
@@ -179,121 +182,194 @@ object KafkaUtils {
errs =
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73335178
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73335167
[Test build #26966 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26966/consoleFull)
for PR 4384 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73326747
[Test build #26966 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26966/consoleFull)
for PR 4384 at commit
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24272277
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala
---
@@ -179,121 +182,190 @@ object KafkaUtils {
errs =
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73455353
[Test build #27078 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27078/consoleFull)
for PR 4384 at commit
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73448717
@pwendell Could you take a look at the scala docs?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73459269
[Test build #27078 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27078/consoleFull)
for PR 4384 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73459273
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24267609
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala
---
@@ -179,121 +182,190 @@ object KafkaUtils {
errs =
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24265028
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaRDD.scala
---
@@ -36,14 +36,12 @@ import kafka.utils.VerifiableProperties
*
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24268021
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/OffsetRange.scala
---
@@ -19,16 +19,35 @@ package org.apache.spark.streaming.kafka
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24268035
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala
---
@@ -179,121 +182,190 @@ object KafkaUtils {
errs
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24267569
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala
---
@@ -179,121 +182,190 @@ object KafkaUtils {
errs =
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73207199
[Test build #589 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/589/consoleFull)
for PR 4384 at commit
Github user koeninger commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73269084
Thanks for adding the java friendly kafka uitls methods.
Your original reason for wanting Array[Leader] rather than
Map[TopicAndPartition, Broker] was for java
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24252680
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala
---
@@ -179,121 +182,190 @@ object KafkaUtils {
errs
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24252952
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala
---
@@ -179,121 +182,190 @@ object KafkaUtils {
errs
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24253794
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/OffsetRange.scala
---
@@ -19,16 +19,35 @@ package
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24251761
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaRDD.scala
---
@@ -36,14 +36,12 @@ import kafka.utils.VerifiableProperties
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73180459
[Test build #26888 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26888/consoleFull)
for PR 4384 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73180462
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73182394
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73182388
[Test build #26891 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26891/consoleFull)
for PR 4384 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73178166
[Test build #26891 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26891/consoleFull)
for PR 4384 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73195603
[Test build #589 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/589/consoleFull)
for PR 4384 at commit
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24216559
--- Diff:
examples/scala-2.10/src/main/scala/org/apache/spark/examples/streaming/DirectKafkaWordCount.scala
---
@@ -0,0 +1,60 @@
+/*
+ * Licensed to
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73164892
[Test build #26878 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26878/consoleFull)
for PR 4384 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73170929
[Test build #26878 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26878/consoleFull)
for PR 4384 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73170936
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73175650
[Test build #26888 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26888/consoleFull)
for PR 4384 at commit
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24142354
--- Diff:
examples/scala-2.10/src/main/scala/org/apache/spark/examples/streaming/DirectKafkaWordCount.scala
---
@@ -0,0 +1,60 @@
+/*
+ * Licensed
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/4384#discussion_r24142682
--- Diff:
external/kafka/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala
---
@@ -0,0 +1,201 @@
+/*
+ * Licensed to the
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-73003057
[Test build #586 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/586/consoleFull)
for PR 4384 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-72997883
[Test build #586 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/586/consoleFull)
for PR 4384 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-72991452
[Test build #26822 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26822/consoleFull)
for PR 4384 at commit
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-72992469
@koeninger Can you please take a look.
@pwendell (Optional) Take a look if you are interested.
---
If your project is set up for it, you can reply to this email and
GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/4384
[SPARK-4964][Streaming][Kafka] More updates to Exactly-once Kafka stream
Changes
- Added example
- Added a critical unit test that verifies that offset ranges can be
recovered through
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-72994795
[Test build #26822 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26822/consoleFull)
for PR 4384 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4384#issuecomment-72994801
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
45 matches
Mail list logo
