GitHub user dilipbiswal opened a pull request:
https://github.com/apache/spark/pull/22671
[SPARK-25615][SQL][TEST] Improve the test runtime of KafkaSinkSuite:
streaming write to non-existing topic
## What changes were proposed in this pull request?
Specify `kafka.max.block.ms` to 10 seconds while creating the kafka writer.
In the absence of this overridden config, by default it uses a default time out
of 60 seconds.
With this change the test completes in close to 10 seconds as opposed to 1
minute.
## How was this patch tested?
This is a test fix.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dilipbiswal/spark SPARK-25615
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22671.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22671
----
commit 6a36250dec0e23520f482d8d092cb658ce147fb7
Author: Dilip Biswal <dbiswal@...>
Date: 2018-10-08T09:07:47Z
[SPARK-25615] Improve the test runtime of KafkaSinkSuite: streaming - write
to non-existing topic
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
