Yikun opened a new pull request, #36711: URL: https://github.com/apache/spark/pull/36711
### What changes were proposed in this pull request? Respect ps.concat sort parameter to follow pandas behavior: - Remove the multi-index special sort process case and add ut. - Still keep `num_series != 1` for now to follow pandas behavior ### Why are the changes needed? Since pandas 1.4+ (https://github.com/pandas-dev/pandas/commit/01b8d2a77e5109adda2504b1cb4b1daeab3c74df), ps.concat method the sort parameter. We need to follow pandas behavior. ### Does this PR introduce _any_ user-facing change? Yes, but follow pandas 1.4 behavior ### How was this patch tested? test_concat_index_axis, test_concat_multiindex_sort, concat doctest passed with 1.3/1.4 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
