HyukjinKwon opened a new pull request #35972:
URL: https://github.com/apache/spark/pull/35972


   ### What changes were proposed in this pull request?
   
   This PR proposes to show options for Pandas API on Spark in UI.
   
   The options in Pandas API on Spark 
(https://spark.apache.org/docs/latest/api/python/user_guide/pandas_on_spark/options.html#available-options)
 are currently not shown properly in "SQL Properties". It is shown, under "SQL 
Properties", as something like `pandas_on_Spark.compute.ops_on_diff_frames` as 
a key and `false` as its value that is the format internally used.
   
   This PR extracts pandas-on-Spark specific options and show separately.
   
   Additionally, this PR also proposes to hide "SQL Properties" is none of 
configurations set.
   
   ### Why are the changes needed?
   
   For better readability and UX for pandas API on Spark.
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes. Now, we're able to show pandas-on-Spark specific options under "Pandas 
API on Spark: Properties" as below:
   
   ![Screen Shot 2022-03-25 at 6 43 02 
PM](https://user-images.githubusercontent.com/6477701/160097940-58d1f1c5-0023-433e-9df6-5c3317cf6abe.png)
   
   ![Screen Shot 2022-03-25 at 6 43 28 
PM](https://user-images.githubusercontent.com/6477701/160097946-1ba5cd43-0f0d-4998-95e6-408a984a5374.png)
   
   ### How was this patch tested?
   
   Manually tested as above.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to