GitHub user HeartSaVioR opened a pull request:
https://github.com/apache/spark/pull/22238
[SPARK-25245][DOCS][SS] Explain regarding limiting modification on
"spark.sql.shuffle.partitions" for structured streaming
## What changes were proposed in this pull request?
This patch adds explanation of `why "spark.sql.shuffle.partitions" keeps
unchanged in structured streaming`, which couple of users already wondered and
some of them even thought it as a bug.
This patch would help other end users to know about such behavior before
they find by theirselves and being wondered.
## How was this patch tested?
No need to test because this is a simple addition on guide doc with
markdown editor.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HeartSaVioR/spark SPARK-25245
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22238.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22238
----
commit ec24f2941021d34058d7af3d3f103094582fd79d
Author: Jungtaek Lim <kabhwan@...>
Date: 2018-08-26T21:08:04Z
SPARK-25245 Explain regarding limiting modification on
"spark.sql.shuffle.partitions" for structured streaming
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
