Albertus Kelvin created SPARK-28590:
---------------------------------------
Summary: Add sort_stats Setter for Custom Profiler
Key: SPARK-28590
URL: https://issues.apache.org/jira/browse/SPARK-28590
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 2.4.0
Reporter: Albertus Kelvin
When doing profiling using custom profilers, I sometimes need to re-create
another custom profiler class when using different sorter in *sort_stats*. I
think it would be better if the users are able to set their own sorting columns
preference. To do this, I thought of creating a *setter* method in the
*Profiler* class (python/pyspark/profiler.py).
FYI, I implemented the changes in PySpark only.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]