[jira] [Commented] (SPARK-24528) Missing optimization for Aggregations/Windowing on a bucketed table

[ https://issues.apache.org/jira/browse/SPARK-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189004#comment-17189004 ] Apache Spark commented on SPARK-24528: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24528) Missing optimization for Aggregations/Windowing on a bucketed table

[ https://issues.apache.org/jira/browse/SPARK-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24528: Assignee: Apache Spark > Missing optimization for Aggregations/Windowing on a bucketed

[jira] [Assigned] (SPARK-24528) Missing optimization for Aggregations/Windowing on a bucketed table

[ https://issues.apache.org/jira/browse/SPARK-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24528: Assignee: (was: Apache Spark) > Missing optimization for Aggregations/Windowing on a

[jira] [Commented] (SPARK-32767) Bucket join should work if spark.sql.shuffle.partitions larger than bucket number

[ https://issues.apache.org/jira/browse/SPARK-32767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188970#comment-17188970 ] Apache Spark commented on SPARK-32767: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188958#comment-17188958 ] Dongjoon Hyun commented on SPARK-32691: --- You don't need to be sorry for not fixing the issue.

[jira] [Commented] (SPARK-32776) Limit in streaming should not be optimized away by PropagateEmptyRelation

[ https://issues.apache.org/jira/browse/SPARK-32776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188913#comment-17188913 ] Apache Spark commented on SPARK-32776: -- User 'liwensun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32776) Limit in streaming should not be optimized away by PropagateEmptyRelation

[ https://issues.apache.org/jira/browse/SPARK-32776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32776: Assignee: Apache Spark > Limit in streaming should not be optimized away by

[jira] [Assigned] (SPARK-32776) Limit in streaming should not be optimized away by PropagateEmptyRelation

[ https://issues.apache.org/jira/browse/SPARK-32776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32776: Assignee: (was: Apache Spark) > Limit in streaming should not be optimized away by

[jira] [Commented] (SPARK-32746) Not able to run Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-32746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188907#comment-17188907 ] Hyukjin Kwon commented on SPARK-32746: -- It's still not clear to say from the logs. Can you run

[jira] [Created] (SPARK-32776) Limit in streaming should not be optimized away by PropagateEmptyRelation

Liwen Sun created SPARK-32776: - Summary: Limit in streaming should not be optimized away by PropagateEmptyRelation Key: SPARK-32776 URL: https://issues.apache.org/jira/browse/SPARK-32776 Project: Spark

[jira] [Commented] (SPARK-32758) Spark ignores limit(1) and starts tasks for all partition

[ https://issues.apache.org/jira/browse/SPARK-32758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188904#comment-17188904 ] Hyukjin Kwon commented on SPARK-32758: -- Does this happen when you read a file from the HDFS with

[jira] [Commented] (SPARK-32758) Spark ignores limit(1) and starts tasks for all partition

[ https://issues.apache.org/jira/browse/SPARK-32758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188903#comment-17188903 ] Hyukjin Kwon commented on SPARK-32758: -- I think this is because you're creating the DataFrame from

[jira] [Issue Comment Deleted] (SPARK-32758) Spark ignores limit(1) and starts tasks for all partition

[ https://issues.apache.org/jira/browse/SPARK-32758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32758: - Comment: was deleted (was: I think this is because you're creating the DataFrame from the local

[jira] [Resolved] (SPARK-32760) Support for INET data type

[ https://issues.apache.org/jira/browse/SPARK-32760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32760. -- Resolution: Later > Support for INET data type > -- > >

[jira] [Commented] (SPARK-32760) Support for INET data type

[ https://issues.apache.org/jira/browse/SPARK-32760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188902#comment-17188902 ] Hyukjin Kwon commented on SPARK-32760: -- The problem is that you should implement the serde for

[jira] [Resolved] (SPARK-32766) s3a: bucket names with dots cannot be used

[ https://issues.apache.org/jira/browse/SPARK-32766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32766. -- Resolution: Invalid This doesn't looks like a problem in Spark. > s3a: bucket names with

[jira] [Resolved] (SPARK-32771) The example of expressions.Aggregator in Javadoc / Scaladoc is wrong

[ https://issues.apache.org/jira/browse/SPARK-32771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32771. -- Fix Version/s: 3.1.0 2.4.7 3.0.1 Resolution:

[jira] [Resolved] (SPARK-32774) Don't track docs/.jekyll-cache

[ https://issues.apache.org/jira/browse/SPARK-32774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32774. -- Target Version/s: 3.0.1, 3.1.0 Resolution: Fixed > Don't track docs/.jekyll-cache >

[jira] [Updated] (SPARK-32774) Don't track docs/.jekyll-cache

[ https://issues.apache.org/jira/browse/SPARK-32774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32774: - Target Version/s: (was: 3.0.1, 3.1.0) > Don't track docs/.jekyll-cache >

[jira] [Updated] (SPARK-32774) Don't track docs/.jekyll-cache

[ https://issues.apache.org/jira/browse/SPARK-32774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32774: - Fix Version/s: 3.1.0 3.0.1 > Don't track docs/.jekyll-cache >

[jira] [Commented] (SPARK-32774) Don't track docs/.jekyll-cache

[ https://issues.apache.org/jira/browse/SPARK-32774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188890#comment-17188890 ] Hyukjin Kwon commented on SPARK-32774: -- Fixed in https://github.com/apache/spark/pull/29622 >

[jira] [Updated] (SPARK-32767) Bucket join should work if spark.sql.shuffle.partitions larger than bucket number

[ https://issues.apache.org/jira/browse/SPARK-32767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32767: Affects Version/s: (was: 3.1.0) 3.0.0 > Bucket join should work if

[jira] [Commented] (SPARK-32530) SPIP: Kotlin support for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-32530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188879#comment-17188879 ] Jungtaek Lim commented on SPARK-32530: -- I'm not sure the relation between supports for vendors and

[jira] [Updated] (SPARK-32775) [k8s] Spark client dependency support ignores non-local paths

[ https://issues.apache.org/jira/browse/SPARK-32775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuzhou Yin updated SPARK-32775: --- Description: According to the logic of this line:

[jira] [Updated] (SPARK-32775) [k8s] Spark client dependency support ignores non-local paths

[ https://issues.apache.org/jira/browse/SPARK-32775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuzhou Yin updated SPARK-32775: --- Description: According to the logic of this line:

[jira] [Created] (SPARK-32775) [k8s] Spark client dependency support ignores non-local paths

Xuzhou Yin created SPARK-32775: -- Summary: [k8s] Spark client dependency support ignores non-local paths Key: SPARK-32775 URL: https://issues.apache.org/jira/browse/SPARK-32775 Project: Spark

[jira] [Updated] (SPARK-32767) Bucket join should work if spark.sql.shuffle.partitions larger than bucket number

[ https://issues.apache.org/jira/browse/SPARK-32767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32767: Description: How to reproduce this issue: {code:scala} spark.range(1000).write.bucketBy(432,

[jira] [Assigned] (SPARK-32774) Don't track docs/.jekyll-cache

[ https://issues.apache.org/jira/browse/SPARK-32774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32774: Assignee: Kousuke Saruta (was: Apache Spark) > Don't track docs/.jekyll-cache >

[jira] [Assigned] (SPARK-32774) Don't track docs/.jekyll-cache

[ https://issues.apache.org/jira/browse/SPARK-32774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32774: Assignee: Apache Spark (was: Kousuke Saruta) > Don't track docs/.jekyll-cache >

[jira] [Commented] (SPARK-32774) Don't track docs/.jekyll-cache

[ https://issues.apache.org/jira/browse/SPARK-32774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188827#comment-17188827 ] Apache Spark commented on SPARK-32774: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-32774) Don't track docs/.jekyll-cache

[ https://issues.apache.org/jira/browse/SPARK-32774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188828#comment-17188828 ] Apache Spark commented on SPARK-32774: -- User 'sarutak' has created a pull request for this issue:

[jira] [Created] (SPARK-32774) Don't track docs/.jekyll-cache

Kousuke Saruta created SPARK-32774: -- Summary: Don't track docs/.jekyll-cache Key: SPARK-32774 URL: https://issues.apache.org/jira/browse/SPARK-32774 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188826#comment-17188826 ] Apache Spark commented on SPARK-32119: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188825#comment-17188825 ] Apache Spark commented on SPARK-32119: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-32530) SPIP: Kotlin support for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-32530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188816#comment-17188816 ] Dennis Jaheruddin commented on SPARK-32530: --- Please note that a significant number of on prem

[jira] [Commented] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188808#comment-17188808 ] Kousuke Saruta commented on SPARK-32119: Yeah, it's a bug fix so we may have a chance to

[jira] [Commented] (SPARK-32773) The behavior of listJars and listFiles is not consistent between YARN and other cluster managers

[ https://issues.apache.org/jira/browse/SPARK-32773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188801#comment-17188801 ] Apache Spark commented on SPARK-32773: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-32773) The behavior of listJars and listFiles is not consistent between YARN and other cluster managers

[ https://issues.apache.org/jira/browse/SPARK-32773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188800#comment-17188800 ] Apache Spark commented on SPARK-32773: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32773) The behavior of listJars and listFiles is not consistent between YARN and other cluster managers

[ https://issues.apache.org/jira/browse/SPARK-32773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32773: Assignee: Apache Spark (was: Kousuke Saruta) > The behavior of listJars and listFiles

[jira] [Assigned] (SPARK-32773) The behavior of listJars and listFiles is not consistent between YARN and other cluster managers

[ https://issues.apache.org/jira/browse/SPARK-32773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32773: Assignee: Kousuke Saruta (was: Apache Spark) > The behavior of listJars and listFiles

[jira] [Updated] (SPARK-32773) The behavior of listJars and listFiles is not consistent between YARN and other cluster managers

[ https://issues.apache.org/jira/browse/SPARK-32773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32773: --- Description: Jars/files specified with --jars / --files options are listed by sc.listJars

[jira] [Updated] (SPARK-32773) The behavior of listJars and listFiles is not consistent between YARN and other cluster managers

[ https://issues.apache.org/jira/browse/SPARK-32773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32773: --- Description: Jars/files specified with --jars / --files options are listed by sc.listJars

[jira] [Updated] (SPARK-32773) The behavior of listJars and listFiles is not consistent between YARN and other cluster managers

[ https://issues.apache.org/jira/browse/SPARK-32773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32773: --- Summary: The behavior of listJars and listFiles is not consistent between YARN and other

[jira] [Created] (SPARK-32773) The behavior of listJars and listFiles is not consistent with YARN and other cluster managers

Kousuke Saruta created SPARK-32773: -- Summary: The behavior of listJars and listFiles is not consistent with YARN and other cluster managers Key: SPARK-32773 URL: https://issues.apache.org/jira/browse/SPARK-32773

[jira] [Commented] (SPARK-32772) Reduce log messages for spark-sql CLI

[ https://issues.apache.org/jira/browse/SPARK-32772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188782#comment-17188782 ] Apache Spark commented on SPARK-32772: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32772) Reduce log messages for spark-sql CLI

[ https://issues.apache.org/jira/browse/SPARK-32772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32772: Assignee: Kousuke Saruta (was: Apache Spark) > Reduce log messages for spark-sql CLI >

[jira] [Commented] (SPARK-32772) Reduce log messages for spark-sql CLI

[ https://issues.apache.org/jira/browse/SPARK-32772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188781#comment-17188781 ] Apache Spark commented on SPARK-32772: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32772) Reduce log messages for spark-sql CLI

[ https://issues.apache.org/jira/browse/SPARK-32772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32772: Assignee: Apache Spark (was: Kousuke Saruta) > Reduce log messages for spark-sql CLI >

[jira] [Updated] (SPARK-32772) Reduce log messages for spark-sql CLI

[ https://issues.apache.org/jira/browse/SPARK-32772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32772: --- Description: When we launch spark-sql CLI, too many log messages are shown and it's

[jira] [Updated] (SPARK-32772) Reduce log messages for spark-sql CLI

[ https://issues.apache.org/jira/browse/SPARK-32772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32772: --- Summary: Reduce log messages for spark-sql CLI (was: Suppress log for spark-sql CLI) >

[jira] [Created] (SPARK-32772) Suppress log for spark-sql CLI

Kousuke Saruta created SPARK-32772: -- Summary: Suppress log for spark-sql CLI Key: SPARK-32772 URL: https://issues.apache.org/jira/browse/SPARK-32772 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-19320) Allow guaranteed amount of GPU to be used when launching jobs

[ https://issues.apache.org/jira/browse/SPARK-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188779#comment-17188779 ] Apache Spark commented on SPARK-19320: -- User 'farhan5900' has created a pull request for this

[jira] [Commented] (SPARK-19320) Allow guaranteed amount of GPU to be used when launching jobs

[ https://issues.apache.org/jira/browse/SPARK-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188778#comment-17188778 ] Apache Spark commented on SPARK-19320: -- User 'farhan5900' has created a pull request for this

[jira] [Commented] (SPARK-32771) The example of expressions.Aggregator in Javadoc / Scaladoc is wrong

[ https://issues.apache.org/jira/browse/SPARK-32771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188777#comment-17188777 ] Apache Spark commented on SPARK-32771: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-32771) The example of expressions.Aggregator in Javadoc / Scaladoc is wrong

[ https://issues.apache.org/jira/browse/SPARK-32771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188776#comment-17188776 ] Apache Spark commented on SPARK-32771: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32771) The example of expressions.Aggregator in Javadoc / Scaladoc is wrong

[ https://issues.apache.org/jira/browse/SPARK-32771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32771: Assignee: Apache Spark (was: Kousuke Saruta) > The example of expressions.Aggregator in

[jira] [Assigned] (SPARK-32771) The example of expressions.Aggregator in Javadoc / Scaladoc is wrong

[ https://issues.apache.org/jira/browse/SPARK-32771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32771: Assignee: Kousuke Saruta (was: Apache Spark) > The example of expressions.Aggregator in

[jira] [Created] (SPARK-32771) The example of expressions.Aggregator in Javadoc / Scaladoc is wrong

Kousuke Saruta created SPARK-32771: -- Summary: The example of expressions.Aggregator in Javadoc / Scaladoc is wrong Key: SPARK-32771 URL: https://issues.apache.org/jira/browse/SPARK-32771 Project:

[jira] [Commented] (SPARK-32770) Add missing imports

[ https://issues.apache.org/jira/browse/SPARK-32770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188764#comment-17188764 ] Apache Spark commented on SPARK-32770: -- User 'Fokko' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32770) Add missing imports

[ https://issues.apache.org/jira/browse/SPARK-32770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32770: Assignee: (was: Apache Spark) > Add missing imports > --- > >

[jira] [Commented] (SPARK-32770) Add missing imports

[ https://issues.apache.org/jira/browse/SPARK-32770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188763#comment-17188763 ] Apache Spark commented on SPARK-32770: -- User 'Fokko' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32770) Add missing imports

[ https://issues.apache.org/jira/browse/SPARK-32770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32770: Assignee: Apache Spark > Add missing imports > --- > >

[jira] [Commented] (SPARK-32770) Add missing imports

[ https://issues.apache.org/jira/browse/SPARK-32770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188762#comment-17188762 ] Apache Spark commented on SPARK-32770: -- User 'Fokko' has created a pull request for this issue:

[jira] [Created] (SPARK-32770) Add missing imports

Fokko Driesprong created SPARK-32770: Summary: Add missing imports Key: SPARK-32770 URL: https://issues.apache.org/jira/browse/SPARK-32770 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32769) setting spark.network.timeout no longer sets spark.storage.blockManagerSlaveTimeoutMs

Tim Osborne created SPARK-32769: --- Summary: setting spark.network.timeout no longer sets spark.storage.blockManagerSlaveTimeoutMs Key: SPARK-32769 URL: https://issues.apache.org/jira/browse/SPARK-32769

[jira] [Commented] (SPARK-32765) EliminateJoinToEmptyRelation should respect exchange behavior when canChangeNumPartitions == false

[ https://issues.apache.org/jira/browse/SPARK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188709#comment-17188709 ] Apache Spark commented on SPARK-32765: -- User 'leanken' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32765) EliminateJoinToEmptyRelation should respect exchange behavior when canChangeNumPartitions == false

[ https://issues.apache.org/jira/browse/SPARK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32765: Assignee: Apache Spark > EliminateJoinToEmptyRelation should respect exchange behavior

[jira] [Commented] (SPARK-32765) EliminateJoinToEmptyRelation should respect exchange behavior when canChangeNumPartitions == false

[ https://issues.apache.org/jira/browse/SPARK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188706#comment-17188706 ] Apache Spark commented on SPARK-32765: -- User 'leanken' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32765) EliminateJoinToEmptyRelation should respect exchange behavior when canChangeNumPartitions == false

[ https://issues.apache.org/jira/browse/SPARK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32765: Assignee: (was: Apache Spark) > EliminateJoinToEmptyRelation should respect exchange

[jira] [Updated] (SPARK-32765) EliminateJoinToEmptyRelation should respect exchange behavior when canChangeNumPartitions == false

[ https://issues.apache.org/jira/browse/SPARK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-32765: Environment: (was: Currently, EliminateJoinToEmptyRelation Rule will convert Join into

[jira] [Updated] (SPARK-32765) EliminateJoinToEmptyRelation should respect exchange behavior when canChangeNumPartitions == false

[ https://issues.apache.org/jira/browse/SPARK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-32765: Description: Currently, EliminateJoinToEmptyRelation Rule will convert Join into EmptyRelation

[jira] [Updated] (SPARK-32768) Add Parquet Timestamp output configuration to docs

[ https://issues.apache.org/jira/browse/SPARK-32768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron DeFreitas updated SPARK-32768: -- Description: {{Spark 2.3.0 added the spark.sql.parquet.outputTimestampType configuration

[jira] [Updated] (SPARK-32768) Add Parquet Timestamp output configuration to docs

[ https://issues.apache.org/jira/browse/SPARK-32768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron DeFreitas updated SPARK-32768: -- Description: {{Spark 2.3.0 added the spark.sql.parquet.outputTimestampType configuration

[jira] [Updated] (SPARK-32768) Add Parquet Timestamp output configuration to docs

[ https://issues.apache.org/jira/browse/SPARK-32768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron DeFreitas updated SPARK-32768: -- Description: {{Spark 2.3.0 added the spark.sql.parquet.outputTimestampType configuration

[jira] [Commented] (SPARK-32768) Add Parquet Timestamp output configuration to docs

[ https://issues.apache.org/jira/browse/SPARK-32768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188646#comment-17188646 ] Apache Spark commented on SPARK-32768: -- User 'rdefreitas' has created a pull request for this

[jira] [Assigned] (SPARK-32768) Add Parquet Timestamp output configuration to docs

[ https://issues.apache.org/jira/browse/SPARK-32768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32768: Assignee: (was: Apache Spark) > Add Parquet Timestamp output configuration to docs >

[jira] [Assigned] (SPARK-32768) Add Parquet Timestamp output configuration to docs

[ https://issues.apache.org/jira/browse/SPARK-32768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32768: Assignee: Apache Spark > Add Parquet Timestamp output configuration to docs >

[jira] [Commented] (SPARK-32767) Bucket join should work if spark.sql.shuffle.partitions larger than bucket number

[ https://issues.apache.org/jira/browse/SPARK-32767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188642#comment-17188642 ] Apache Spark commented on SPARK-32767: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32767) Bucket join should work if spark.sql.shuffle.partitions larger than bucket number

[ https://issues.apache.org/jira/browse/SPARK-32767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32767: Assignee: Apache Spark > Bucket join should work if spark.sql.shuffle.partitions larger

[jira] [Assigned] (SPARK-32767) Bucket join should work if spark.sql.shuffle.partitions larger than bucket number

[ https://issues.apache.org/jira/browse/SPARK-32767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32767: Assignee: (was: Apache Spark) > Bucket join should work if

[jira] [Commented] (SPARK-32767) Bucket join should work if spark.sql.shuffle.partitions larger than bucket number

[ https://issues.apache.org/jira/browse/SPARK-32767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188639#comment-17188639 ] Apache Spark commented on SPARK-32767: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-32768) Add Parquet Timestamp output configuration to docs

[ https://issues.apache.org/jira/browse/SPARK-32768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron DeFreitas updated SPARK-32768: -- Target Version/s: (was: 2.4.7, 2.4.8, 3.0.1, 3.1.0, 3.0.2) > Add Parquet Timestamp output

[jira] [Created] (SPARK-32768) Add Parquet Timestamp output configuration to docs

Ron DeFreitas created SPARK-32768: - Summary: Add Parquet Timestamp output configuration to docs Key: SPARK-32768 URL: https://issues.apache.org/jira/browse/SPARK-32768 Project: Spark Issue

[jira] [Created] (SPARK-32767) Bucket join should work if SHUFFLE_PARTITIONS larger than bucket number

Yuming Wang created SPARK-32767: --- Summary: Bucket join should work if SHUFFLE_PARTITIONS larger than bucket number Key: SPARK-32767 URL: https://issues.apache.org/jira/browse/SPARK-32767 Project: Spark

[jira] [Updated] (SPARK-32767) Bucket join should work if spark.sql.shuffle.partitions larger than bucket number

[ https://issues.apache.org/jira/browse/SPARK-32767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32767: Summary: Bucket join should work if spark.sql.shuffle.partitions larger than bucket number (was:

[jira] [Comment Edited] (SPARK-32760) Support for INET data type

[ https://issues.apache.org/jira/browse/SPARK-32760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188612#comment-17188612 ] Ruslan Dautkhanov edited comment on SPARK-32760 at 9/1/20, 4:29 PM:

[jira] [Commented] (SPARK-32760) Support for INET data type

[ https://issues.apache.org/jira/browse/SPARK-32760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188612#comment-17188612 ] Ruslan Dautkhanov commented on SPARK-32760: --- [~smilegator] understood. Would be great to

[jira] [Resolved] (SPARK-28554) implement basic catalog functionalities

[ https://issues.apache.org/jira/browse/SPARK-28554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28554. - Assignee: (was: Wenchen Fan) Resolution: Duplicate > implement basic catalog

[jira] [Commented] (SPARK-28554) implement basic catalog functionalities

[ https://issues.apache.org/jira/browse/SPARK-28554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188609#comment-17188609 ] Wenchen Fan commented on SPARK-28554: - closed as it's done by other smaller PRs. See the sub-tasks

[jira] [Issue Comment Deleted] (SPARK-28554) implement basic catalog functionalities

[ https://issues.apache.org/jira/browse/SPARK-28554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-28554: Comment: was deleted (was: closed as it's done by other smaller PRs. See the sub-tasks of the

[jira] [Commented] (SPARK-28554) implement basic catalog functionalities

[ https://issues.apache.org/jira/browse/SPARK-28554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188610#comment-17188610 ] Wenchen Fan commented on SPARK-28554: - closed as it's done by other smaller PRs. See the sub-tasks

[jira] [Assigned] (SPARK-32754) Unify to `assertEqualJoinPlans ` for join reorder suites

[ https://issues.apache.org/jira/browse/SPARK-32754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32754: - Assignee: Zhenhua Wang (was: Apache Spark) > Unify to `assertEqualJoinPlans ` for

[jira] [Updated] (SPARK-32754) Unify to `assertEqualJoinPlans ` for join reorder suites

[ https://issues.apache.org/jira/browse/SPARK-32754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32754: -- Summary: Unify to `assertEqualJoinPlans ` for join reorder suites (was: Unify

[jira] [Resolved] (SPARK-32754) Unify `assertEqualPlans` for join reorder suites

[ https://issues.apache.org/jira/browse/SPARK-32754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32754. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29594

[jira] [Created] (SPARK-32766) s3a: bucket names with dots cannot be used

Ondrej Kokes created SPARK-32766: Summary: s3a: bucket names with dots cannot be used Key: SPARK-32766 URL: https://issues.apache.org/jira/browse/SPARK-32766 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-32761) Planner error when aggregating multiple distinct Constant columns

[ https://issues.apache.org/jira/browse/SPARK-32761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32761. - Fix Version/s: 3.1.0 Assignee: Liu, Linhong Resolution: Fixed > Planner error

[jira] [Commented] (SPARK-32763) DiskStore can remove block from blockSizes even if block is not removed from disk

[ https://issues.apache.org/jira/browse/SPARK-32763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188405#comment-17188405 ] Apache Spark commented on SPARK-32763: -- User 'q2w' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32108) Silent mode of spark-sql is broken

[ https://issues.apache.org/jira/browse/SPARK-32108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-32108. Resolution: Not A Problem > Silent mode of spark-sql is broken >

[jira] [Created] (SPARK-32765) EliminateJoinToEmptyRelation should respect exchange behavior when canChangeNumPartitions == false

Leanken.Lin created SPARK-32765: --- Summary: EliminateJoinToEmptyRelation should respect exchange behavior when canChangeNumPartitions == false Key: SPARK-32765 URL: https://issues.apache.org/jira/browse/SPARK-32765

[jira] [Commented] (SPARK-32637) SPARK SQL JDBC truncates last value of seconds for datetime2 values for Azure SQL DB

[ https://issues.apache.org/jira/browse/SPARK-32637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188384#comment-17188384 ] Maxim Gekk commented on SPARK-32637: Spark's TIMESTAMP type has microsecond precision. This is by

  1   2   >