I’d like to start with a +1, better Python testing tools integrated into the project make sense.
On Wed, Jun 21, 2023 at 8:11 AM Amanda Liu <amandastephanie...@gmail.com> wrote: > Hi all, > > I'd like to start the vote for SPIP: PySpark Test Framework. > > The high-level summary for the SPIP is that it proposes an official test > framework for PySpark. Currently, there are only disparate open-source > repos and blog posts for PySpark testing resources. We can streamline and > simplify the testing process by incorporating test features, such as a > PySpark Test Base class (which allows tests to share Spark sessions) and > test util functions (for example, asserting dataframe and schema equality). > > *SPIP doc:* > https://docs.google.com/document/d/1OkyBn3JbEHkkQgSQ45Lq82esXjr9rm2Vj7Ih_4zycRc/edit#heading=h.f5f0u2riv07v > > *JIRA ticket:* https://issues.apache.org/jira/browse/SPARK-44042 > > *Discussion thread:* > https://lists.apache.org/thread/trwgbgn3ycoj8b8k8lkxko2hql23o41n > > Please vote on the SPIP for the next 72 hours: > [ ] +1: Accept the proposal as an official SPIP > [ ] +0 > [ ] -1: I don’t think this is a good idea because __. > > Thank you! > > Best, > Amanda Liu > -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
