Github user HeartSaVioR commented on a diff in the pull request:
https://github.com/apache/spark/pull/22238#discussion_r213179259
--- Diff: docs/structured-streaming-programming-guide.md ---
@@ -2812,7 +2812,18 @@ See [Input Sources](#input-sources) and [Output
Sinks](#output-sinks) sections f
# Additional Information
-**Further Reading**
+## Configuration Options For Structured Streaming
+
+This section is for configurations which are only available for structured
streaming, or they behave differently with batch query.
+
+- spark.sql.shuffle.partitions
--- End diff --
I can revert adding a new section if you meant adding `##` on it. While
gotcha looks more like funny, I will change it to `**Notes**`.
The rationalization on adding this to doc is, this restriction had been
making lots of wondering around SO and user mailing list, as well as even a
patch for fixing this. So all of end users who use structured streaming would
be nice to see it at least once, even they skim the doc, so that they can
remember and revisit the doc once they get stuck on this.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
