[ https://issues.apache.org/jira/browse/SPARK-29127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun updated SPARK-29127: ---------------------------------- Summary: Add a Python, Pandas and PyArrow versions in clue at SQL query tests (was: Support partitioning for DataSource V2 tables in DataFrameWriter.save) > Add a Python, Pandas and PyArrow versions in clue at SQL query tests > -------------------------------------------------------------------- > > Key: SPARK-29127 > URL: https://issues.apache.org/jira/browse/SPARK-29127 > Project: Spark > Issue Type: Bug > Components: PySpark, SQL > Affects Versions: 3.0.0 > Reporter: Burak Yavuz > Priority: Major > > Currently, any data source that that upgrades to DataSource V2 loses the > partition transform information when using DataFrameWriter.save. The main > reason is the lack of an API for "creating" a table with partitioning and > schema information for V2 tables without a catalog. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org