Haejoon Lee created SPARK-45551:
-----------------------------------

             Summary: Enchance PySpark testing utils
                 Key: SPARK-45551
                 URL: https://issues.apache.org/jira/browse/SPARK-45551
             Project: Spark
          Issue Type: Umbrella
          Components: PySpark
    Affects Versions: 4.0.0
            Reporter: Haejoon Lee


We have added several testing utils for PySpark testing: 
[https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.testing.assertDataFrameEqual.html.]

We might need to enhance the functionality of those functions to make testing 
easier for users. The existing testing utils could be enhanced by:
 * Adding new parameters to the existing utils
 * Returning a debuggable object for failed assertions

and any other suggestions are welcome.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to