[jira] [Assigned] (SPARK-30532) DataFrameStatFunctions.approxQuantile doesn't work with TABLE.COLUMN syntax

[ https://issues.apache.org/jira/browse/SPARK-30532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30532: --- Assignee: Oleksii Kachaiev > DataFrameStatFunctions.approxQuantile doesn't work with

[jira] [Resolved] (SPARK-30532) DataFrameStatFunctions.approxQuantile doesn't work with TABLE.COLUMN syntax

[ https://issues.apache.org/jira/browse/SPARK-30532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30532. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27916

[jira] [Assigned] (SPARK-31283) Simplify ChiSq by adding a common method

[ https://issues.apache.org/jira/browse/SPARK-31283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-31283: Assignee: zhengruifeng > Simplify ChiSq by adding a common method >

[jira] [Resolved] (SPARK-31283) Simplify ChiSq by adding a common method

[ https://issues.apache.org/jira/browse/SPARK-31283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-31283. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28045

[jira] [Resolved] (SPARK-31286) Specify formats of time zone ID for JSON/CSV option and from/to_utc_timestamp

[ https://issues.apache.org/jira/browse/SPARK-31286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31286. - Resolution: Fixed Issue resolved by pull request 28051

[jira] [Commented] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070688#comment-17070688 ] Reynold Xin commented on SPARK-22231: - [~fqaiser94] thanks for your persistence and my apologies for

[jira] [Updated] (SPARK-31291) SQLQueryTestSuite: Avoid load test data if test case not uses them.

[ https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-31291: --- Summary: SQLQueryTestSuite: Avoid load test data if test case not uses them. (was:

[jira] [Updated] (SPARK-31291) SQLQueryTestSuiteAvoid load test data if test case not uses them

[ https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-31291: --- Summary: SQLQueryTestSuiteAvoid load test data if test case not uses them (was: Avoid load test

[jira] [Updated] (SPARK-31291) Avoid load test data if test case not uses them

[ https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31291: -- Parent: SPARK-25604 Issue Type: Sub-task (was: Improvement) > Avoid load test data

[jira] [Updated] (SPARK-31291) Avoid load test data if test case not uses them

[ https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31291: -- Priority: Minor (was: Major) > Avoid load test data if test case not uses them >

[jira] [Updated] (SPARK-31291) Avoid load test data if test case not uses them

[ https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31291: -- Component/s: Tests > Avoid load test data if test case not uses them >

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Fix Version/s: (was: 3.1.0) > Upgrade Janino to 3.0.16 > > >

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Fix Version/s: 2.4.6 3.0.0 > Upgrade Janino to 3.0.16 >

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Issue Type: Bug (was: Dependency upgrade) > Upgrade Janino to 3.0.16 >

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Component/s: (was: SQL) Build > Upgrade Janino to 3.0.16 >

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Affects Version/s: (was: 3.1.0) 3.0.0 > Upgrade Janino to 3.0.16 >

[jira] [Updated] (SPARK-31293) Fix wrong examples and help messages for Kinesis integration

[ https://issues.apache.org/jira/browse/SPARK-31293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31293: -- Affects Version/s: 2.3.4 > Fix wrong examples and help messages for Kinesis integration >

[jira] [Assigned] (SPARK-31293) Fix wrong examples and help messages for Kinesis integration

[ https://issues.apache.org/jira/browse/SPARK-31293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31293: - Assignee: Kengo Seki > Fix wrong examples and help messages for Kinesis integration >

[jira] [Resolved] (SPARK-31293) Fix wrong examples and help messages for Kinesis integration

[ https://issues.apache.org/jira/browse/SPARK-31293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31293. --- Fix Version/s: 3.0.0 2.4.6 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-31293) Fix wrong examples and help messages for Kinesis integration

[ https://issues.apache.org/jira/browse/SPARK-31293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31293: -- Affects Version/s: 2.4.5 > Fix wrong examples and help messages for Kinesis integration >

[jira] [Updated] (SPARK-31293) Fix wrong examples and help messages for Kinesis integration

[ https://issues.apache.org/jira/browse/SPARK-31293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31293: -- Issue Type: Bug (was: Improvement) > Fix wrong examples and help messages for Kinesis

[jira] [Comment Edited] (SPARK-31281) Hit OOM Error - GC Limit

[ https://issues.apache.org/jira/browse/SPARK-31281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070478#comment-17070478 ] Alfred Davidson edited comment on SPARK-31281 at 3/29/20, 6:54 PM: ---

[jira] [Comment Edited] (SPARK-31281) Hit OOM Error - GC Limit

[ https://issues.apache.org/jira/browse/SPARK-31281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070478#comment-17070478 ] Alfred Davidson edited comment on SPARK-31281 at 3/29/20, 6:54 PM: ---

[jira] [Commented] (SPARK-31281) Hit OOM Error - GC Limit

[ https://issues.apache.org/jira/browse/SPARK-31281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070478#comment-17070478 ] Alfred Davidson commented on SPARK-31281: - The allocated driver memory will be split for

[jira] [Resolved] (SPARK-31280) Perform propagating empty relation after RewritePredicateSubquery

[ https://issues.apache.org/jira/browse/SPARK-31280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31280. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28043

[jira] [Assigned] (SPARK-31280) Perform propagating empty relation after RewritePredicateSubquery

[ https://issues.apache.org/jira/browse/SPARK-31280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31280: - Assignee: Kent Yao > Perform propagating empty relation after RewritePredicateSubquery

[jira] [Commented] (SPARK-31297) Speed-up date-time rebasing

[ https://issues.apache.org/jira/browse/SPARK-31297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070457#comment-17070457 ] Maxim Gekk commented on SPARK-31297: The rebasing of days doesn't depend on time zone, and has just

[jira] [Commented] (SPARK-30272) Remove usage of Guava that breaks in Guava 27

[ https://issues.apache.org/jira/browse/SPARK-30272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070391#comment-17070391 ] Sean R. Owen commented on SPARK-30272: -- The reason is simply that this is the version Hadoop uses

[jira] [Updated] (SPARK-31298) validate CTAS table path in SPARK-19724 seems conflict and External table also need to check non-empty

[ https://issues.apache.org/jira/browse/SPARK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31298: -- Summary: validate CTAS table path in SPARK-19724 seems conflict and External table also need to check

[jira] [Updated] (SPARK-31298) validate CTAS table path in SPARK-19724 seems conflict

[ https://issues.apache.org/jira/browse/SPARK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31298: -- Summary: validate CTAS table path in SPARK-19724 seems conflict (was: validate External path in

[jira] [Updated] (SPARK-31298) validate External path in SPARK-19724 seems conflict

[ https://issues.apache.org/jira/browse/SPARK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31298: -- Description: In  SessionCatalog.validateTableLocation() {code:java} val tableLocation = new

[jira] [Created] (SPARK-31298) validate External path in SPARK-19724 seems conflict

angerszhu created SPARK-31298: - Summary: validate External path in SPARK-19724 seems conflict Key: SPARK-31298 URL: https://issues.apache.org/jira/browse/SPARK-31298 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31297) Speed-up date-time rebasing

[ https://issues.apache.org/jira/browse/SPARK-31297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070286#comment-17070286 ] Maxim Gekk commented on SPARK-31297: [~cloud_fan] [~hyukjin.kwon] [~dongjoon] WDYT? > Speed-up

[jira] [Created] (SPARK-31297) Speed-up date-time rebasing

Maxim Gekk created SPARK-31297: -- Summary: Speed-up date-time rebasing Key: SPARK-31297 URL: https://issues.apache.org/jira/browse/SPARK-31297 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-30272) Remove usage of Guava that breaks in Guava 27

[ https://issues.apache.org/jira/browse/SPARK-30272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070255#comment-17070255 ] Jorge Machado commented on SPARK-30272: --- So I was able to fix it. I build it with profile hadoop

[jira] [Updated] (SPARK-31296) Benchmark date-time rebasing in Parquet datasource

[ https://issues.apache.org/jira/browse/SPARK-31296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-31296: --- Summary: Benchmark date-time rebasing in Parquet datasource (was: Benchmark date-time rebasing

[jira] [Created] (SPARK-31296) Benchmark date-time rebasing to/from Julian calendar

Maxim Gekk created SPARK-31296: -- Summary: Benchmark date-time rebasing to/from Julian calendar Key: SPARK-31296 URL: https://issues.apache.org/jira/browse/SPARK-31296 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30363) Add Documentation for Refresh Resources

[ https://issues.apache.org/jira/browse/SPARK-30363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-30363: --- Parent: SPARK-28588 Issue Type: Sub-task (was: Improvement) > Add Documentation for