Github user HyukjinKwon commented on a diff in the pull request:

    https://github.com/apache/spark/pull/22238#discussion_r213180977
  
    --- Diff: docs/structured-streaming-programming-guide.md ---
    @@ -2812,7 +2812,18 @@ See [Input Sources](#input-sources) and [Output 
Sinks](#output-sinks) sections f
     
     # Additional Information
     
    -**Further Reading**
    +## Configuration Options For Structured Streaming
    +
    +This section is for configurations which are only available for structured 
streaming, or they behave differently with batch query.
    +
    +- spark.sql.shuffle.partitions
    --- End diff --
    
    I was thinking adding this information somewhere API or configuration only. 
For instance, notes like https://github.com/apache/spark/pull/19617. 
    
    > lots of wondering around SO and user mailing list,
    
    I don't object to note these stuff but usually the site has only key points 
for some features or configurations. 
    
    If there are more instance to describe specifically for structured 
streaming (where the same SQL configurations could lead to some confusions), I 
am fine with adding this. If not or less sure for now, I would add them into 
API's doc or configuration's doc.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to