Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/21488
@tedyu I forgot one place:
https://github.com/apache/spark/blob/master/external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaContinuousSourceSuite.scala#L32
Could you also
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/21488
@tedyu could you update the PR title and description to reflect the latest
changes, such as `[SPARK-18057][SS] Update Kafka client version from 0.10.0.1
to 1.1.0`? Otherwise, LGTM.
---
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/21488
Okey. In Kafka 1.1.0, deleting a topic when a Kafka client is running may
make the client hang at this line forever:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93212/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #93212 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93212/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93213/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #93213 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93213/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #93213 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93213/testReport)**
for PR 21488 at commit
Github user tedyu commented on the issue:
https://github.com/apache/spark/pull/21488
Pulled in your commits.
Will look at test failures.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #93212 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93212/testReport)**
for PR 21488 at commit
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/21488
@tedyu my branch https://github.com/zsxwing/spark/commits/review-pr21488
should fix most of unit tests. Could you check and add to your PRs? Several
tests are still flaky and ignored. If you have
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93190/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #93190 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93190/testReport)**
for PR 21488 at commit
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/21488
@tedyu this patch should fix most of unit tests:
https://github.com/zsxwing/spark/commit/c2834e2aeaa979f3c4a3f550404856c2de573463
I'm still thinking about how to fix the stress test. By the
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/21488
I see. It should be a test dependency. You don't need to add it into the
compile scope.
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #93188 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93188/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93188/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #93190 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93190/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user tedyu commented on the issue:
https://github.com/apache/spark/pull/21488
Not sure what to do with the following build error which is not caused by
the PR:
```
[ERROR]
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #93188 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93188/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/21488
@tedyu We don't need to block on the release. I would expect the Kafka
client is backward complicity. In addition, most of Spark users will not
upgrade their Kafka at once after the new version
Github user tedyu commented on the issue:
https://github.com/apache/spark/pull/21488
@ijuma
Sorry for the late response. 9 days ago I was in China where access to
gmail is intermittent.
---
-
To unsubscribe,
Github user tedyu commented on the issue:
https://github.com/apache/spark/pull/21488
w.r.t. stable Kafka release, it seems 2.0.0 RC2 would pass:
http://search-hadoop.com/m/Kafka/uyzND1ClBEezundG1?subj=Re+VOTE+2+0+0+RC2
---
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/21488
@tedyu could you please just bump to 1.1.0, the current official latest
release from Apache Kafka?
---
-
To unsubscribe,
Github user ijuma commented on the issue:
https://github.com/apache/spark/pull/21488
Any luck getting to the bottom of the issue? It would be great to include
this in the next version of Spark?
---
-
To
Github user tedyu commented on the issue:
https://github.com/apache/spark/pull/21488
Located the test output:
```
-rw-r--r-- 1 hbase hadoop 35335485506 Jun 13 20:36 target/unit-tests.log
```
Still need to find out cause for assertion failure.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3870/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3869/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91589/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91589 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91589/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91589 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91589/testReport)**
for PR 21488 at commit
Github user tedyu commented on the issue:
https://github.com/apache/spark/pull/21488
Made some progress in testing.
Now facing:
```
- assign from latest offsets (failOnDataLoss: true) *** FAILED ***
java.lang.IllegalArgumentException: requirement failed
at
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91587 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91587/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91587/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91587 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91587/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3834/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91529 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91529/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91529/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91529 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91529/testReport)**
for PR 21488 at commit
Github user tedyu commented on the issue:
https://github.com/apache/spark/pull/21488
There is only
target/surefire-reports/TEST-org.apache.spark.sql.kafka010.KafkaMicroBatchV2SourceSuite.xml
under target/surefire-reports
That file doesn't contain test output.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3826/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91508 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91508/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91508/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91508 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91508/testReport)**
for PR 21488 at commit
Github user tedyu commented on the issue:
https://github.com/apache/spark/pull/21488
I tried the following change but didn't seem to get more output from Kafka:
```
diff --git a/external/kafka-0-10-sql/src/test/resources/log4j.properties
Github user tedyu commented on the issue:
https://github.com/apache/spark/pull/21488
Currently I am trying to get test suite pass first.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3814/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91487/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91487 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91487/testReport)**
for PR 21488 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91487 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91487/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3813/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91485 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91485/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91485/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91485 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91485/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3788/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91432 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91432/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91432/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91432 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91432/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3787/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91431 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91431/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91431/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91431 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91431/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3785/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91429 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91429/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91429/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91429 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91429/testReport)**
for PR 21488 at commit
94 matches
Mail list logo
