[ https://issues.apache.org/jira/browse/SPARK-37036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-37036. ---------------------------------- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34389 [https://github.com/apache/spark/pull/34389] > Add util function to raise advice warning for pandas API on Spark. > ------------------------------------------------------------------ > > Key: SPARK-37036 > URL: https://issues.apache.org/jira/browse/SPARK-37036 > Project: Spark > Issue Type: Improvement > Components: PySpark > Affects Versions: 3.3.0 > Reporter: Haejoon Lee > Assignee: Haejoon Lee > Priority: Major > Fix For: 3.3.0 > > > Pandas API on Spark has some features that potentially cause the performance > degradation or an unexpected behavior e.g. `sort_index`, `index_col`, > `to_pandas`, etc. > > We should raise the proper advice warning for those functions so that users > can adjust their pandas-on-Spark code base more robust. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org