[jira] [Assigned] (SPARK-33740) hadoop configs in hive-site.xml can overrides pre-existing hadoop ones

[ https://issues.apache.org/jira/browse/SPARK-33740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33740: Assignee: Apache Spark > hadoop configs in hive-site.xml can overrides pre-existing hadoo

[jira] [Commented] (SPARK-33740) hadoop configs in hive-site.xml can overrides pre-existing hadoop ones

[ https://issues.apache.org/jira/browse/SPARK-33740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247329#comment-17247329 ] Apache Spark commented on SPARK-33740: -- User 'yaooqinn' has created a pull request

[jira] [Created] (SPARK-33740) hadoop configs in hive-site.xml can overrides pre-existing hadoop ones

Kent Yao created SPARK-33740: Summary: hadoop configs in hive-site.xml can overrides pre-existing hadoop ones Key: SPARK-33740 URL: https://issues.apache.org/jira/browse/SPARK-33740 Project: Spark

[jira] [Updated] (SPARK-33739) Jobs committed through the S3A Magic committer don't report the bytes written

[ https://issues.apache.org/jira/browse/SPARK-33739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-33739: --- Summary: Jobs committed through the S3A Magic committer don't report the bytes written (was

[jira] [Created] (SPARK-33739) Magic committer files don't have the count of bytes written collected by spark

Steve Loughran created SPARK-33739: -- Summary: Magic committer files don't have the count of bytes written collected by spark Key: SPARK-33739 URL: https://issues.apache.org/jira/browse/SPARK-33739 Pr

[jira] [Commented] (SPARK-32110) -0.0 vs 0.0 is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247305#comment-17247305 ] Robert Joseph Evans commented on SPARK-32110: - I have not tried this again o

[jira] [Updated] (SPARK-33732) Kubernetes integration tests doesn't work with Minikube 1.9+

[ https://issues.apache.org/jira/browse/SPARK-33732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33732: --- Fix Version/s: 2.4.8 > Kubernetes integration tests doesn't work with Minikube 1.9+ > --

[jira] [Updated] (SPARK-33738) Add timeout info for ShuffleBlockFetcherIterator when get remote block

[ https://issues.apache.org/jira/browse/SPARK-33738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-33738: -- Description: In order to facilitate the troubleshooting of hotspots or data skew， it's better to add

[jira] [Updated] (SPARK-33738) Add timeout info for ShuffleBlockFetcherIterator when get remote block

[ https://issues.apache.org/jira/browse/SPARK-33738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-33738: -- Description: In order to facilitate the troubleshooting of hotspots or data skew， it's better to add

[jira] [Created] (SPARK-33738) Add timeout info for ShuffleBlockFetcherIterator when get remote block

chenliang created SPARK-33738: - Summary: Add timeout info for ShuffleBlockFetcherIterator when get remote block Key: SPARK-33738 URL: https://issues.apache.org/jira/browse/SPARK-33738 Project: Spark

[jira] [Commented] (SPARK-32110) -0.0 vs 0.0 is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247252#comment-17247252 ] Wenchen Fan commented on SPARK-32110: - Similar problems were reported by others, e.g

[jira] [Commented] (SPARK-32110) -0.0 vs 0.0 is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247250#comment-17247250 ] Wenchen Fan commented on SPARK-32110: - [~revans2] have you tried the latest master b

[jira] [Commented] (SPARK-33707) Support multiple types of function partition pruning on hive metastore

[ https://issues.apache.org/jira/browse/SPARK-33707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247235#comment-17247235 ] Apache Spark commented on SPARK-33707: -- User 'southernriver' has created a pull req

[jira] [Assigned] (SPARK-33707) Support multiple types of function partition pruning on hive metastore

[ https://issues.apache.org/jira/browse/SPARK-33707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33707: Assignee: Apache Spark > Support multiple types of function partition pruning on hive met

[jira] [Assigned] (SPARK-33707) Support multiple types of function partition pruning on hive metastore

[ https://issues.apache.org/jira/browse/SPARK-33707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33707: Assignee: (was: Apache Spark) > Support multiple types of function partition pruning

[jira] [Assigned] (SPARK-32208) Spark SQL throw Illegal character exception when load certain abnormal path of HDFS

[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32208: Assignee: (was: Apache Spark) > Spark SQL throw Illegal character exception when loa

[jira] [Assigned] (SPARK-32208) Spark SQL throw Illegal character exception when load certain abnormal path of HDFS

[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32208: Assignee: Apache Spark > Spark SQL throw Illegal character exception when load certain a

[jira] [Commented] (SPARK-32208) Spark SQL throw Illegal character exception when load certain abnormal path of HDFS

[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247234#comment-17247234 ] Apache Spark commented on SPARK-32208: -- User 'southernriver' has created a pull req

[jira] [Updated] (SPARK-32208) Spark SQL throw Illegal character exception when load certain abnormal path of HDFS

[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-32208: -- Summary: Spark SQL throw Illegal character exception when load certain abnormal path of HDFS (was:

[jira] [Reopened] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang reopened SPARK-32208: --- [~hyukjin.kwon] Thanks a lot , I have filled the PR description. > SparkSQL throw Illegal character ex

[jira] [Updated] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-32208: -- Description: In the distributed hdfs storage system，Space and other special character are allowed in

[jira] [Updated] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-32208: -- Description: In the distributed hdfs storage system，Space and other special character are allowed in

[jira] [Updated] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-32208: -- Description: In the distributed hdfs storage system，Space and other special character are allowed in

[jira] [Updated] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-32208: -- Affects Version/s: 3.2.0 Description: In the distributed hdfs storage system，Space and other

[jira] [Commented] (SPARK-23889) DataSourceV2: Add interfaces to pass required sorting and clustering for writes

[ https://issues.apache.org/jira/browse/SPARK-23889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247204#comment-17247204 ] Anton Okolnychyi commented on SPARK-23889: -- I propose to keep the scope of this

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a [watch|https://github.c

[jira] [Commented] (SPARK-23889) DataSourceV2: Add interfaces to pass required sorting and clustering for writes

[ https://issues.apache.org/jira/browse/SPARK-23889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247190#comment-17247190 ] Apache Spark commented on SPARK-23889: -- User 'aokolnychyi' has created a pull reque

[jira] [Commented] (SPARK-23889) DataSourceV2: Add interfaces to pass required sorting and clustering for writes

[ https://issues.apache.org/jira/browse/SPARK-23889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247189#comment-17247189 ] Apache Spark commented on SPARK-23889: -- User 'aokolnychyi' has created a pull reque

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a [watch|https://github.c

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a [watch|https://github.c

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a [watch|https://github.c

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a [watch|https://github.c

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a [watch|https://github.c

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a [watch|https://github.c

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a [watch|https://github.c

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a [watch|https://github.c

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a [watch|https://github.c

[jira] [Created] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

Stavros Kontopoulos created SPARK-33737: --- Summary: Use an Informer+Lister API in the ExecutorPodWatcher Key: SPARK-33737 URL: https://issues.apache.org/jira/browse/SPARK-33737 Project: Spark

[jira] [Created] (SPARK-33736) Handle MERGE in ReplaceNullWithFalseInPredicate

Anton Okolnychyi created SPARK-33736: Summary: Handle MERGE in ReplaceNullWithFalseInPredicate Key: SPARK-33736 URL: https://issues.apache.org/jira/browse/SPARK-33736 Project: Spark Issue

[jira] [Commented] (SPARK-33736) Handle MERGE in ReplaceNullWithFalseInPredicate

[ https://issues.apache.org/jira/browse/SPARK-33736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247156#comment-17247156 ] Anton Okolnychyi commented on SPARK-33736: -- I'll submit a PR soon. > Handle ME

[jira] [Commented] (SPARK-33735) Handle UPDATE in ReplaceNullWithFalseInPredicate

[ https://issues.apache.org/jira/browse/SPARK-33735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247155#comment-17247155 ] Anton Okolnychyi commented on SPARK-33735: -- I'll submit a PR soon. > Handle UP

[jira] [Created] (SPARK-33735) Handle UPDATE in ReplaceNullWithFalseInPredicate

Anton Okolnychyi created SPARK-33735: Summary: Handle UPDATE in ReplaceNullWithFalseInPredicate Key: SPARK-33735 URL: https://issues.apache.org/jira/browse/SPARK-33735 Project: Spark Issu

[jira] [Assigned] (SPARK-33546) CREATE TABLE LIKE should resolve hive serde correctly like CREATE TABLE

[ https://issues.apache.org/jira/browse/SPARK-33546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33546: Assignee: Apache Spark (was: Wenchen Fan) > CREATE TABLE LIKE should resolve hive serde

[jira] [Commented] (SPARK-33546) CREATE TABLE LIKE should resolve hive serde correctly like CREATE TABLE

[ https://issues.apache.org/jira/browse/SPARK-33546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247147#comment-17247147 ] Apache Spark commented on SPARK-33546: -- User 'leanken' has created a pull request f

[jira] [Commented] (SPARK-33546) CREATE TABLE LIKE should resolve hive serde correctly like CREATE TABLE

[ https://issues.apache.org/jira/browse/SPARK-33546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247148#comment-17247148 ] Apache Spark commented on SPARK-33546: -- User 'leanken' has created a pull request f

[jira] [Assigned] (SPARK-33546) CREATE TABLE LIKE should resolve hive serde correctly like CREATE TABLE

[ https://issues.apache.org/jira/browse/SPARK-33546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33546: Assignee: Wenchen Fan (was: Apache Spark) > CREATE TABLE LIKE should resolve hive serde

[jira] [Commented] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247137#comment-17247137 ] Dongjoon Hyun commented on SPARK-33273: --- Thanks for sharing, [~Qin Yao]. > Fix Fl

[jira] [Created] (SPARK-33734) Spark Core

Aparna created SPARK-33734: -- Summary: Spark Core Key: SPARK-33734 URL: https://issues.apache.org/jira/browse/SPARK-33734 Project: Spark Issue Type: Bug Components: Spark Core Affects

[jira] [Updated] (SPARK-33732) Kubernetes integration tests doesn't work with Minikube 1.9+

[ https://issues.apache.org/jira/browse/SPARK-33732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33732: -- Affects Version/s: 2.4.7 3.0.1 > Kubernetes integration tests doesn't w

[jira] [Updated] (SPARK-33732) Kubernetes integration tests doesn't work with Minikube 1.9+

[ https://issues.apache.org/jira/browse/SPARK-33732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33732: -- Issue Type: Bug (was: Improvement) > Kubernetes integration tests doesn't work with Minikube

[jira] [Commented] (SPARK-33732) Kubernetes integration tests doesn't work with Minikube 1.9+

[ https://issues.apache.org/jira/browse/SPARK-33732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247117#comment-17247117 ] Apache Spark commented on SPARK-33732: -- User 'sarutak' has created a pull request f

[jira] [Updated] (SPARK-33732) Kubernetes integration tests doesn't work with Minikube 1.9+

[ https://issues.apache.org/jira/browse/SPARK-33732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33732: -- Fix Version/s: 3.0.2 > Kubernetes integration tests doesn't work with Minikube 1.9+ >

[jira] [Updated] (SPARK-33692) view shouldn't use current catalog and namespace to lookup function

[ https://issues.apache.org/jira/browse/SPARK-33692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33692: Summary: view shouldn't use current catalog and namespace to lookup function (was: Permanent view

[jira] [Resolved] (SPARK-33692) Permanent view shouldn't use current catalog and namespace to lookup function

[ https://issues.apache.org/jira/browse/SPARK-33692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33692. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30662 [https://gith

[jira] [Assigned] (SPARK-33692) Permanent view shouldn't use current catalog and namespace to lookup function

[ https://issues.apache.org/jira/browse/SPARK-33692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33692: --- Assignee: Linhong Liu > Permanent view shouldn't use current catalog and namespace to looku

[jira] [Commented] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247084#comment-17247084 ] Kent Yao commented on SPARK-33273: -- https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[jira] [Commented] (SPARK-33732) Kubernetes integration tests doesn't work with Minikube 1.9+

[ https://issues.apache.org/jira/browse/SPARK-33732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247080#comment-17247080 ] Apache Spark commented on SPARK-33732: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-33733) PullOutNondeterministic should check and collect deterministic field

[ https://issues.apache.org/jira/browse/SPARK-33733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33733: Assignee: (was: Apache Spark) > PullOutNondeterministic should check and collect dete

[jira] [Commented] (SPARK-33733) PullOutNondeterministic should check and collect deterministic field

[ https://issues.apache.org/jira/browse/SPARK-33733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247079#comment-17247079 ] Apache Spark commented on SPARK-33733: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-33732) Kubernetes integration tests doesn't work with Minikube 1.9+

[ https://issues.apache.org/jira/browse/SPARK-33732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247078#comment-17247078 ] Apache Spark commented on SPARK-33732: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-33733) PullOutNondeterministic should check and collect deterministic field

[ https://issues.apache.org/jira/browse/SPARK-33733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33733: Assignee: Apache Spark > PullOutNondeterministic should check and collect deterministic f

<    1   2