[jira] [Created] (SPARK-34737) Discrepancy between TIMESTAMP_SECONDS and cast from float

2021-03-13 Thread Max Gekk (Jira)
Max Gekk created SPARK-34737: Summary: Discrepancy between TIMESTAMP_SECONDS and cast from float Key: SPARK-34737 URL: https://issues.apache.org/jira/browse/SPARK-34737 Project: Spark Issue Type:

[jira] [Created] (SPARK-34739) Add an year-month interval to a timestamp

2021-03-14 Thread Max Gekk (Jira)
Max Gekk created SPARK-34739: Summary: Add an year-month interval to a timestamp Key: SPARK-34739 URL: https://issues.apache.org/jira/browse/SPARK-34739 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34739) Add an year-month interval to a timestamp

2021-03-14 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34739: - Description: Support adding of YearMonthIntervalType values to TIMESTAMP values. (was: Support adding o

[jira] [Resolved] (SPARK-34739) Add an year-month interval to a timestamp

2021-03-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34739. -- Resolution: Done > Add an year-month interval to a timestamp > ---

[jira] [Updated] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34761: - Description: Support adding of DayTimeIntervalType values to TIMESTAMP values. (was: Support adding of

[jira] [Created] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Max Gekk (Jira)
Max Gekk created SPARK-34761: Summary: Add a day-time interval to a timestamp Key: SPARK-34761 URL: https://issues.apache.org/jira/browse/SPARK-34761 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34793) Prohibit saving of day-time and year-month intervals

2021-03-18 Thread Max Gekk (Jira)
Max Gekk created SPARK-34793: Summary: Prohibit saving of day-time and year-month intervals Key: SPARK-34793 URL: https://issues.apache.org/jira/browse/SPARK-34793 Project: Spark Issue Type: Sub-

[jira] [Commented] (SPARK-27790) Support ANSI SQL INTERVAL types

2021-03-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304965#comment-17304965 ] Max Gekk commented on SPARK-27790: -- > how will DateTime addition work with the new inte

[jira] [Resolved] (SPARK-34793) Prohibit saving of day-time and year-month intervals

2021-03-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34793. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31884 [https://github.com

[jira] [Resolved] (SPARK-34815) Update CSVBenchmark

2021-03-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34815. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31917 [https://github.com

[jira] [Assigned] (SPARK-34815) Update CSVBenchmark

2021-03-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-34815: Assignee: Hyukjin Kwon > Update CSVBenchmark > > > Key: SPA

[jira] [Created] (SPARK-34824) Multiply year-month interval by numeric

2021-03-22 Thread Max Gekk (Jira)
Max Gekk created SPARK-34824: Summary: Multiply year-month interval by numeric Key: SPARK-34824 URL: https://issues.apache.org/jira/browse/SPARK-34824 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34837) Support ANSI SQL intervals by the aggregate function `avg`

2021-03-23 Thread Max Gekk (Jira)
Max Gekk created SPARK-34837: Summary: Support ANSI SQL intervals by the aggregate function `avg` Key: SPARK-34837 URL: https://issues.apache.org/jira/browse/SPARK-34837 Project: Spark Issue Type

[jira] [Updated] (SPARK-34837) Support ANSI SQL intervals by the aggregate function `avg`

2021-03-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34837: - Description: Extend org.apache.spark.sql.catalyst.expressions.aggregate.Average to support DayTimeInter

[jira] [Resolved] (SPARK-34824) Multiply year-month interval by numeric

2021-03-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34824. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31929 [https://github.com

[jira] [Created] (SPARK-34841) Push ANSI interval binary expressions into into (if / case) branches

2021-03-23 Thread Max Gekk (Jira)
Max Gekk created SPARK-34841: Summary: Push ANSI interval binary expressions into into (if / case) branches Key: SPARK-34841 URL: https://issues.apache.org/jira/browse/SPARK-34841 Project: Spark

[jira] [Commented] (SPARK-34841) Push ANSI interval binary expressions into into (if / case) branches

2021-03-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307236#comment-17307236 ] Max Gekk commented on SPARK-34841: -- See https://github.com/apache/spark/pull/30955#disc

[jira] [Updated] (SPARK-34850) Multiply day-time interval by numeric

2021-03-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34850: - Description: Support the multiply op over day-time interval by numeric types including: # ByteType # Sho

[jira] [Created] (SPARK-34850) Multiply day-time interval by numeric

2021-03-23 Thread Max Gekk (Jira)
Max Gekk created SPARK-34850: Summary: Multiply day-time interval by numeric Key: SPARK-34850 URL: https://issues.apache.org/jira/browse/SPARK-34850 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-34850) Multiply day-time interval by numeric

2021-03-25 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34850. -- Resolution: Fixed Issue resolved by pull request 31951 [https://github.com/apache/spark/pull/31951] >

[jira] [Updated] (SPARK-34868) Divide year-month interval by numeric

2021-03-25 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34868: - Description: Support the divide op of year-month interval by numeric types including: # ByteType # Short

[jira] [Created] (SPARK-34868) Divide year-month interval by numeric

2021-03-25 Thread Max Gekk (Jira)
Max Gekk created SPARK-34868: Summary: Divide year-month interval by numeric Key: SPARK-34868 URL: https://issues.apache.org/jira/browse/SPARK-34868 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34875) Divide day-time interval by numeric

2021-03-26 Thread Max Gekk (Jira)
Max Gekk created SPARK-34875: Summary: Divide day-time interval by numeric Key: SPARK-34875 URL: https://issues.apache.org/jira/browse/SPARK-34875 Project: Spark Issue Type: Sub-task Co

[jira] [Updated] (SPARK-34875) Divide day-time interval by numeric

2021-03-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34875: - Description: Support the divide op of day-time interval by numeric types including: # ByteType # ShortTy

[jira] [Created] (SPARK-34878) Test actual size of year-month and day-time intervals

2021-03-26 Thread Max Gekk (Jira)
Max Gekk created SPARK-34878: Summary: Test actual size of year-month and day-time intervals Key: SPARK-34878 URL: https://issues.apache.org/jira/browse/SPARK-34878 Project: Spark Issue Type: Sub

[jira] [Resolved] (SPARK-34841) Push ANSI interval binary expressions into into (if / case) branches

2021-03-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34841. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31978 [https://github.com

[jira] [Assigned] (SPARK-34841) Push ANSI interval binary expressions into into (if / case) branches

2021-03-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-34841: Assignee: angerszhu > Push ANSI interval binary expressions into into (if / case) branches >

[jira] [Resolved] (SPARK-34879) Hive inspect support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34879. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31979 [https://github.com

[jira] [Assigned] (SPARK-34879) Hive inspect support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-34879: Assignee: angerszhu > Hive inspect support DayTimeIntervalType and YearMonthIntervalType > --

[jira] [Created] (SPARK-34896) Return ANSI intervals from subtraction of dates/timestamps

2021-03-29 Thread Max Gekk (Jira)
Max Gekk created SPARK-34896: Summary: Return ANSI intervals from subtraction of dates/timestamps Key: SPARK-34896 URL: https://issues.apache.org/jira/browse/SPARK-34896 Project: Spark Issue Type

[jira] [Commented] (SPARK-34896) Return ANSI intervals from subtraction of dates/timestamps

2021-03-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310471#comment-17310471 ] Max Gekk commented on SPARK-34896: -- I am working on this. > Return ANSI intervals from

[jira] [Updated] (SPARK-34896) Return day-time interval from dates subtraction

2021-03-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34896: - Description: # Add SQL config to switch between new ANSI intervals and CalendarIntervalType # Modify Sub

[jira] [Updated] (SPARK-34896) Return day-time interval from dates subtraction

2021-03-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34896: - Summary: Return day-time interval from dates subtraction (was: Return ANSI intervals from subtraction o

[jira] [Created] (SPARK-34903) Return day-time interval from timestamps subtraction

2021-03-29 Thread Max Gekk (Jira)
Max Gekk created SPARK-34903: Summary: Return day-time interval from timestamps subtraction Key: SPARK-34903 URL: https://issues.apache.org/jira/browse/SPARK-34903 Project: Spark Issue Type: Sub-

[jira] [Commented] (SPARK-34903) Return day-time interval from timestamps subtraction

2021-03-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311150#comment-17311150 ] Max Gekk commented on SPARK-34903: -- I plan to work on this soon. > Return day-time int

[jira] [Updated] (SPARK-34903) Return day-time interval from timestamps subtraction

2021-03-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34903: - Description: Modify SubtractTimestamps to return DayTimeIntervalType (under a flag). (was: # Add SQL co

[jira] [Created] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-03-30 Thread Max Gekk (Jira)
Max Gekk created SPARK-34905: Summary: Enable ANSI intervals in SQLQueryTestSuite Key: SPARK-34905 URL: https://issues.apache.org/jira/browse/SPARK-34905 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-03-30 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34905: - Description: Remove the following code from SQLQueryTestSuite: {code:java} localSparkSession.conf.se

[jira] [Resolved] (SPARK-34896) Return day-time interval from dates subtraction

2021-03-30 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34896. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31996 [https://github.com

[jira] [Resolved] (SPARK-34903) Return day-time interval from timestamps subtraction

2021-04-01 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34903. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32016 [https://github.com

[jira] [Assigned] (SPARK-36778) Support ILIKE API on Scala(dataframe)

2021-09-17 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36778: Assignee: Leona Yoda > Support ILIKE API on Scala(dataframe) > --

[jira] [Resolved] (SPARK-36778) Support ILIKE API on Scala(dataframe)

2021-09-17 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36778. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34027 [https://github.com

[jira] [Commented] (SPARK-36807) Merge ANSI interval types to a tightest common type

2021-09-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417592#comment-17417592 ] Max Gekk commented on SPARK-36807: -- I am working on this. > Merge ANSI interval types

[jira] [Created] (SPARK-36807) Merge ANSI interval types to a tightest common type

2021-09-20 Thread Max Gekk (Jira)
Max Gekk created SPARK-36807: Summary: Merge ANSI interval types to a tightest common type Key: SPARK-36807 URL: https://issues.apache.org/jira/browse/SPARK-36807 Project: Spark Issue Type: Sub-t

[jira] [Resolved] (SPARK-36807) Merge ANSI interval types to a tightest common type

2021-09-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36807. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34049 [https://github.com

[jira] [Commented] (SPARK-36825) Read/write dataframes with ANSI intervals from/to parquet files

2021-09-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418530#comment-17418530 ] Max Gekk commented on SPARK-36825: -- I am working on this. > Read/write dataframes with

[jira] [Created] (SPARK-36825) Read/write dataframes with ANSI intervals from/to parquet files

2021-09-22 Thread Max Gekk (Jira)
Max Gekk created SPARK-36825: Summary: Read/write dataframes with ANSI intervals from/to parquet files Key: SPARK-36825 URL: https://issues.apache.org/jira/browse/SPARK-36825 Project: Spark Issu

[jira] [Created] (SPARK-36830) Read/write dataframes with ANSI intervals from/to JSON files

2021-09-23 Thread Max Gekk (Jira)
Max Gekk created SPARK-36830: Summary: Read/write dataframes with ANSI intervals from/to JSON files Key: SPARK-36830 URL: https://issues.apache.org/jira/browse/SPARK-36830 Project: Spark Issue T

[jira] [Assigned] (SPARK-36830) Read/write dataframes with ANSI intervals from/to JSON files

2021-09-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36830: Assignee: (was: Max Gekk) > Read/write dataframes with ANSI intervals from/to JSON files > --

[jira] [Created] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

2021-09-23 Thread Max Gekk (Jira)
Max Gekk created SPARK-36831: Summary: Read/write dataframes with ANSI intervals from/to CSV files Key: SPARK-36831 URL: https://issues.apache.org/jira/browse/SPARK-36831 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-36825) Read/write dataframes with ANSI intervals from/to parquet files

2021-09-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36825. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34057 [https://github.com

[jira] [Assigned] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

2021-09-24 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36831: Assignee: (was: Max Gekk) > Read/write dataframes with ANSI intervals from/to CSV files > ---

[jira] [Created] (SPARK-36851) Incorrect parsing of negative ANSI typed interval literals

2021-09-25 Thread Max Gekk (Jira)
Max Gekk created SPARK-36851: Summary: Incorrect parsing of negative ANSI typed interval literals Key: SPARK-36851 URL: https://issues.apache.org/jira/browse/SPARK-36851 Project: Spark Issue Type

[jira] [Commented] (SPARK-36851) Incorrect parsing of negative ANSI typed interval literals

2021-09-25 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420091#comment-17420091 ] Max Gekk commented on SPARK-36851: -- [~gengliang] [~cloud_fan] FYI, I reproduced this on

[jira] [Comment Edited] (SPARK-36851) Incorrect parsing of negative ANSI typed interval literals

2021-09-25 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420092#comment-17420092 ] Max Gekk edited comment on SPARK-36851 at 9/25/21, 9:26 AM:

[jira] [Commented] (SPARK-36851) Incorrect parsing of negative ANSI typed interval literals

2021-09-25 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420092#comment-17420092 ] Max Gekk commented on SPARK-36851: -- There is a workaround: {code:sql} spark-sql> selec

[jira] [Created] (SPARK-36852) Test ANSI interval support by the Parquet datasource

2021-09-25 Thread Max Gekk (Jira)
Max Gekk created SPARK-36852: Summary: Test ANSI interval support by the Parquet datasource Key: SPARK-36852 URL: https://issues.apache.org/jira/browse/SPARK-36852 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-36854) Parquet reader fails on load of ANSI interval when off-heap is enabled

2021-09-25 Thread Max Gekk (Jira)
Max Gekk created SPARK-36854: Summary: Parquet reader fails on load of ANSI interval when off-heap is enabled Key: SPARK-36854 URL: https://issues.apache.org/jira/browse/SPARK-36854 Project: Spark

[jira] [Created] (SPARK-36866) Pushdown filters with ANSI interval values to parquet

2021-09-27 Thread Max Gekk (Jira)
Max Gekk created SPARK-36866: Summary: Pushdown filters with ANSI interval values to parquet Key: SPARK-36866 URL: https://issues.apache.org/jira/browse/SPARK-36866 Project: Spark Issue Type: Sub

[jira] [Updated] (SPARK-36866) Pushdown filters with ANSI interval values to parquet

2021-09-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36866: - Description: Spark doesn't push down filters with ANSI intervals to the Parquet datasource: {code:scala

[jira] [Updated] (SPARK-36866) Pushdown filters with ANSI interval values to parquet

2021-09-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36866: - Description: Spark doesn't push down filters with ANSI intervals to the Parquet datasource. The ticket

[jira] [Created] (SPARK-36889) Respect `spark.sql.parquet.filterPushdown` by explain() for DSv2

2021-09-28 Thread Max Gekk (Jira)
Max Gekk created SPARK-36889: Summary: Respect `spark.sql.parquet.filterPushdown` by explain() for DSv2 Key: SPARK-36889 URL: https://issues.apache.org/jira/browse/SPARK-36889 Project: Spark Iss

[jira] [Commented] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

2021-09-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17422093#comment-17422093 ] Max Gekk commented on SPARK-36831: -- [~sarutak] No, feel free to take this. > Read/writ

[jira] [Assigned] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

2021-09-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36831: Assignee: Kousuke Saruta > Read/write dataframes with ANSI intervals from/to CSV files >

[jira] [Resolved] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

2021-09-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36831. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34142 [https://github.com

[jira] [Commented] (SPARK-36830) Read/write dataframes with ANSI intervals from/to JSON files

2021-09-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17422341#comment-17422341 ] Max Gekk commented on SPARK-36830: -- [~sarutak] FYI, I don't plan to work on this. Pleas

[jira] [Assigned] (SPARK-36830) Read/write dataframes with ANSI intervals from/to JSON files

2021-09-30 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36830: Assignee: Kousuke Saruta > Read/write dataframes with ANSI intervals from/to JSON files > ---

[jira] [Resolved] (SPARK-36830) Read/write dataframes with ANSI intervals from/to JSON files

2021-09-30 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36830. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34155 [https://github.com

[jira] [Created] (SPARK-36920) Support ANSI intervals by ABS

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36920: Summary: Support ANSI intervals by ABS Key: SPARK-36920 URL: https://issues.apache.org/jira/browse/SPARK-36920 Project: Spark Issue Type: Sub-task Componen

[jira] [Created] (SPARK-36921) The DIV function should support ANSI intervals

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36921: Summary: The DIV function should support ANSI intervals Key: SPARK-36921 URL: https://issues.apache.org/jira/browse/SPARK-36921 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36922) The sign function should support ANSI intervals

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36922: Summary: The sign function should support ANSI intervals Key: SPARK-36922 URL: https://issues.apache.org/jira/browse/SPARK-36922 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-36922) The SIGN/SIGNUM functions should support ANSI intervals

2021-10-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36922: - Summary: The SIGN/SIGNUM functions should support ANSI intervals (was: The sign function should support

[jira] [Updated] (SPARK-36922) The SIGN/SIGNUM functions should support ANSI intervals

2021-10-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36922: - Description: Extend the *sign/signum* functions to support ANSI intervals. (was: Extend the *sign* func

[jira] [Created] (SPARK-36923) Allow coercing of an interval expression to a specific interval type

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36923: Summary: Allow coercing of an interval expression to a specific interval type Key: SPARK-36923 URL: https://issues.apache.org/jira/browse/SPARK-36923 Project: Spark

[jira] [Created] (SPARK-36924) CAST between ANSI intervals and numerics

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36924: Summary: CAST between ANSI intervals and numerics Key: SPARK-36924 URL: https://issues.apache.org/jira/browse/SPARK-36924 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-36920) Support ANSI intervals by ABS

2021-10-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36920: Assignee: Max Gekk > Support ANSI intervals by ABS > - > >

[jira] [Commented] (SPARK-36920) Support ANSI intervals by ABS

2021-10-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423882#comment-17423882 ] Max Gekk commented on SPARK-36920: -- I am working on this. > Support ANSI intervals by

[jira] [Updated] (SPARK-36921) The DIV function should support ANSI intervals

2021-10-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36921: - Description: Extended the div function to support ANSI intervals. The operation should produce quotient

[jira] [Created] (SPARK-36928) Handle ANSI intervals in ColumnarRow, ColumnarBatchRow and ColumnarArray

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36928: Summary: Handle ANSI intervals in ColumnarRow, ColumnarBatchRow and ColumnarArray Key: SPARK-36928 URL: https://issues.apache.org/jira/browse/SPARK-36928 Project: Spark

[jira] [Resolved] (SPARK-36937) Change OrcSourceSuite to test both V1 and V2 sources.

2021-10-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36937. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34194 [https://github.com

[jira] [Created] (SPARK-36941) Check saving of a dataframe with ANSI intervals to a Hive parquet table

2021-10-06 Thread Max Gekk (Jira)
Max Gekk created SPARK-36941: Summary: Check saving of a dataframe with ANSI intervals to a Hive parquet table Key: SPARK-36941 URL: https://issues.apache.org/jira/browse/SPARK-36941 Project: Spark

[jira] [Commented] (SPARK-36941) Check saving of a dataframe with ANSI intervals to a Hive parquet table

2021-10-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17425196#comment-17425196 ] Max Gekk commented on SPARK-36941: -- I am working on this. > Check saving of a datafram

[jira] [Resolved] (SPARK-36941) Check saving of a dataframe with ANSI intervals to a Hive parquet table

2021-10-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36941. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34201 [https://github.com

[jira] [Created] (SPARK-36948) Check CREATE TABLE with ANSI intervals using Hive external catalog and Parquet

2021-10-07 Thread Max Gekk (Jira)
Max Gekk created SPARK-36948: Summary: Check CREATE TABLE with ANSI intervals using Hive external catalog and Parquet Key: SPARK-36948 URL: https://issues.apache.org/jira/browse/SPARK-36948 Project: Spark

[jira] [Created] (SPARK-36949) Fix CREATE TABLE AS SELECT of ANSI intervals

2021-10-07 Thread Max Gekk (Jira)
Max Gekk created SPARK-36949: Summary: Fix CREATE TABLE AS SELECT of ANSI intervals Key: SPARK-36949 URL: https://issues.apache.org/jira/browse/SPARK-36949 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-36948) Check CREATE TABLE with ANSI intervals using Hive external catalog and Parquet

2021-10-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36948. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34215 [https://github.com

[jira] [Assigned] (SPARK-36931) Read/write dataframes with ANSI intervals from/to ORC files

2021-10-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36931: Assignee: Kousuke Saruta > Read/write dataframes with ANSI intervals from/to ORC files >

[jira] [Resolved] (SPARK-36931) Read/write dataframes with ANSI intervals from/to ORC files

2021-10-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36931. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34184 [https://github.com

[jira] [Resolved] (SPARK-36960) Pushdown filters with ANSI interval values to ORC

2021-10-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36960. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34224 [https://github.com

[jira] [Commented] (SPARK-36949) Fix CREATE TABLE AS SELECT of ANSI intervals

2021-10-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17426617#comment-17426617 ] Max Gekk commented on SPARK-36949: -- [~cloud_fan] [~csun] FYI, even if I map Catalyst's

[jira] [Commented] (SPARK-36949) Fix CREATE TABLE AS SELECT of ANSI intervals

2021-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17427195#comment-17427195 ] Max Gekk commented on SPARK-36949: -- I wasn't able to create a table with intervals: {c

[jira] [Assigned] (SPARK-36970) Manual disabled format `B` for `date_format` function to compatibility with Java 8 behavior.

2021-10-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36970: Assignee: Yang Jie > Manual disabled format `B` for `date_format` function to compatibility with

[jira] [Resolved] (SPARK-36970) Manual disabled format `B` for `date_format` function to compatibility with Java 8 behavior.

2021-10-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36970. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34237 [https://github.com

[jira] [Assigned] (SPARK-36921) The DIV function should support ANSI intervals

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36921: Assignee: PengLei > The DIV function should support ANSI intervals >

[jira] [Resolved] (SPARK-36921) The DIV function should support ANSI intervals

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36921. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34257 [https://github.com

[jira] [Assigned] (SPARK-36993) Fix json_tuple throw NPE if fields exist no foldable null value

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36993: Assignee: XiDuo You > Fix json_tuple throw NPE if fields exist no foldable null value > -

[jira] [Resolved] (SPARK-36993) Fix json_tuple throw NPE if fields exist no foldable null value

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36993. -- Fix Version/s: 3.1.3 3.2.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-36949) Fix CREATE TABLE AS SELECT of ANSI intervals

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36949: Assignee: Max Gekk > Fix CREATE TABLE AS SELECT of ANSI intervals > -

[jira] [Resolved] (SPARK-36949) Fix CREATE TABLE AS SELECT of ANSI intervals

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36949. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34259 [https://github.com

[jira] [Updated] (SPARK-36993) Fix json_tuple throw NPE if fields exist no foldable null value

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36993: - Fix Version/s: 3.3.0 > Fix json_tuple throw NPE if fields exist no foldable null value > ---

  1   2   3   4   5   6   7   8   9   10   >