[jira] [Updated] (SPARK-34440) Allow saving/loading datetime in ORC w/o rebasing
[ https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Che Wei updated SPARK-34440: Attachment: 00_0 > Allow saving/loading datetime in ORC w/o rebasing > - > > Key: SPARK-34440 > URL: https://issues.apache.org/jira/browse/SPARK-34440 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 3.2.0 >Reporter: Max Gekk >Priority: Major > Attachments: 00_0 > > > Currently, Spark always performs rebasing of date/timestamp columns in ORC > datasource but this is not required by parquet spec. This tickets aims to > allow users to turn off rebasing via SQL configs or DS options. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-34440) Allow saving/loading datetime in ORC w/o rebasing
[ https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34440: --- Affects Version/s: (was: 3.1.0) 3.2.0 > Allow saving/loading datetime in ORC w/o rebasing > - > > Key: SPARK-34440 > URL: https://issues.apache.org/jira/browse/SPARK-34440 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 3.2.0 >Reporter: Maxim Gekk >Assignee: Maxim Gekk >Priority: Major > > Currently, Spark always performs rebasing of date/timestamp columns in ORC > datasource but this is not required by parquet spec. This tickets aims to > allow users to turn off rebasing via SQL configs or DS options. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-34440) Allow saving/loading datetime in ORC w/o rebasing
[ https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34440: --- Fix Version/s: (was: 3.2.0) > Allow saving/loading datetime in ORC w/o rebasing > - > > Key: SPARK-34440 > URL: https://issues.apache.org/jira/browse/SPARK-34440 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 3.1.0 >Reporter: Maxim Gekk >Assignee: Maxim Gekk >Priority: Major > > Currently, Spark always performs rebasing of date/timestamp columns in ORC > datasource but this is not required by parquet spec. This tickets aims to > allow users to turn off rebasing via SQL configs or DS options. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-34440) Allow saving/loading datetime in ORC w/o rebasing
[ https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34440: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Allow saving/loading datetime in ORC w/o rebasing > - > > Key: SPARK-34440 > URL: https://issues.apache.org/jira/browse/SPARK-34440 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 3.1.0 >Reporter: Maxim Gekk >Assignee: Maxim Gekk >Priority: Major > Fix For: 3.2.0 > > > Currently, Spark always performs rebasing of INT96 columns in Parquet > datasource but this is not required by parquet spec. This tickets aims to > allow users to turn off rebasing via SQL config. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-34440) Allow saving/loading datetime in ORC w/o rebasing
[ https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34440: --- Description: Currently, Spark always performs rebasing of date/timestamp columns in ORC datasource but this is not required by parquet spec. This tickets aims to allow users to turn off rebasing via SQL configs or DS options. (was: Currently, Spark always performs rebasing of INT96 columns in Parquet datasource but this is not required by parquet spec. This tickets aims to allow users to turn off rebasing via SQL config.) > Allow saving/loading datetime in ORC w/o rebasing > - > > Key: SPARK-34440 > URL: https://issues.apache.org/jira/browse/SPARK-34440 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 3.1.0 >Reporter: Maxim Gekk >Assignee: Maxim Gekk >Priority: Major > Fix For: 3.2.0 > > > Currently, Spark always performs rebasing of date/timestamp columns in ORC > datasource but this is not required by parquet spec. This tickets aims to > allow users to turn off rebasing via SQL configs or DS options. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
