[jira] [Commented] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17202744#comment-17202744 ] Apache Spark commented on SPARK-33008: -- User 'luluorta' has created a pull request

[jira] [Commented] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17202743#comment-17202743 ] Apache Spark commented on SPARK-33008: -- User 'luluorta' has created a pull request

[jira] [Assigned] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33008: Assignee: (was: Apache Spark) > Division by zero on divide-like operations returns in

[jira] [Assigned] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33008: Assignee: Apache Spark > Division by zero on divide-like operations returns incorrect res

[jira] [Commented] (SPARK-32852) spark.sql.hive.metastore.jars support HDFS location

[ https://issues.apache.org/jira/browse/SPARK-32852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17202736#comment-17202736 ] Apache Spark commented on SPARK-32852: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-32852) spark.sql.hive.metastore.jars support HDFS location

[ https://issues.apache.org/jira/browse/SPARK-32852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32852: Assignee: Apache Spark > spark.sql.hive.metastore.jars support HDFS location > --

[jira] [Assigned] (SPARK-32852) spark.sql.hive.metastore.jars support HDFS location

[ https://issues.apache.org/jira/browse/SPARK-32852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32852: Assignee: (was: Apache Spark) > spark.sql.hive.metastore.jars support HDFS location >

[jira] [Commented] (SPARK-32852) spark.sql.hive.metastore.jars support HDFS location

[ https://issues.apache.org/jira/browse/SPARK-32852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17202735#comment-17202735 ] Apache Spark commented on SPARK-32852: -- User 'AngersZh' has created a pull requ

[jira] [Updated] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-33008: -- Summary: Division by zero on divide-like operations returns incorrect result (was: Throw exception on divisio

[jira] [Created] (SPARK-33008) Throw exception on division by zero

Lu Lu created SPARK-33008: - Summary: Throw exception on division by zero Key: SPARK-33008 URL: https://issues.apache.org/jira/browse/SPARK-33008 Project: Spark Issue Type: Sub-task Componen

[jira] [Updated] (SPARK-33008) Throw exception on division by zero

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-33008: -- Description: Spark SQL: {code:sql} spark-sql> SELECT 1/0; NULL Time taken: 3.002 seconds, Fetched 1 row(s) {co

[jira] [Updated] (SPARK-33008) Throw exception on division by zero

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-33008: -- Description: Spark SQL: {code:sql} spark-sql> SELECT 1/0; NULL Time taken: 3.002 seconds, Fetched 1 row(s) {co

[jira] [Assigned] (SPARK-32974) FeatureHasher transform optimization

[ https://issues.apache.org/jira/browse/SPARK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-32974: Assignee: zhengruifeng > FeatureHasher transform optimization > -

[jira] [Resolved] (SPARK-32974) FeatureHasher transform optimization

[ https://issues.apache.org/jira/browse/SPARK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-32974. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29850 [https://gi

[jira] [Created] (SPARK-33007) Optimize to_json + named_struct + from_json expression chain

L. C. Hsieh created SPARK-33007: --- Summary: Optimize to_json + named_struct + from_json expression chain Key: SPARK-33007 URL: https://issues.apache.org/jira/browse/SPARK-33007 Project: Spark I

[jira] [Updated] (SPARK-32997) Support dynamic PVC creation/deletion for K8s driver

[ https://issues.apache.org/jira/browse/SPARK-32997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32997: -- Summary: Support dynamic PVC creation/deletion for K8s driver (was: Support dynamic PVC creat

[jira] [Created] (SPARK-33006) Add dynamic PVC usage example into K8s doc

Dongjoon Hyun created SPARK-33006: - Summary: Add dynamic PVC usage example into K8s doc Key: SPARK-33006 URL: https://issues.apache.org/jira/browse/SPARK-33006 Project: Spark Issue Type: Sub-

[jira] [Assigned] (SPARK-33006) Add dynamic PVC usage example into K8s doc

[ https://issues.apache.org/jira/browse/SPARK-33006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33006: - Assignee: Dongjoon Hyun > Add dynamic PVC usage example into K8s doc >

[jira] [Updated] (SPARK-32354) Fix & re-enable failing R K8s tests

[ https://issues.apache.org/jira/browse/SPARK-32354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32354: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Bug) > Fix & re-enable failing R K8s t

[jira] [Updated] (SPARK-32657) Decommissioning Integration Test checks for old string

[ https://issues.apache.org/jira/browse/SPARK-32657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32657: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Bug) > Decommissioning Integration Tes

[jira] [Updated] (SPARK-31208) Expose the ability for user to cleanup shuffle files

[ https://issues.apache.org/jira/browse/SPARK-31208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31208: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Expose the ability for

[jira] [Updated] (SPARK-32367) Fix typo of parameter in KubernetesTestComponents

[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32367: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Bug) > Fix typo of parameter in Kubern

[jira] [Updated] (SPARK-32235) Kubernetes Configuration to set Service Account to Executors

[ https://issues.apache.org/jira/browse/SPARK-32235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32235: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Kubernetes Configuratio

[jira] [Resolved] (SPARK-32235) Kubernetes Configuration to set Service Account to Executors

[ https://issues.apache.org/jira/browse/SPARK-32235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32235. --- Resolution: Duplicate > Kubernetes Configuration to set Service Account to Executors > -

[jira] [Closed] (SPARK-32235) Kubernetes Configuration to set Service Account to Executors

[ https://issues.apache.org/jira/browse/SPARK-32235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-32235. - > Kubernetes Configuration to set Service Account to Executors > ---

[jira] [Reopened] (SPARK-32235) Kubernetes Configuration to set Service Account to Executors

[ https://issues.apache.org/jira/browse/SPARK-32235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-32235: --- > Kubernetes Configuration to set Service Account to Executors > ---

[jira] [Updated] (SPARK-32235) Kubernetes Configuration to set Service Account to Executors

[ https://issues.apache.org/jira/browse/SPARK-32235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32235: -- Fix Version/s: (was: 3.1.0) > Kubernetes Configuration to set Service Account to Executors

[jira] [Updated] (SPARK-32448) Fix mismatched versions in test artifacts

[ https://issues.apache.org/jira/browse/SPARK-32448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32448: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Bug) > Fix mismatched versions in test

[jira] [Updated] (SPARK-32335) Remove Python2 test from K8s IT

[ https://issues.apache.org/jira/browse/SPARK-32335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32335: -- Parent: (was: SPARK-29909) Issue Type: Task (was: Sub-task) > Remove Python2 test

[jira] [Updated] (SPARK-32335) Remove Python2 test from K8s IT

[ https://issues.apache.org/jira/browse/SPARK-32335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32335: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Task) > Remove Python2 test from K8s I

[jira] [Updated] (SPARK-32997) Support dynamic PVC creation and deletion in K8s driver

[ https://issues.apache.org/jira/browse/SPARK-32997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32997: -- Parent: SPARK-33005 Issue Type: Sub-task (was: New Feature) > Support dynamic PVC cre

[jira] [Updated] (SPARK-32882) Remove python2 installation in K8s python image

[ https://issues.apache.org/jira/browse/SPARK-32882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32882: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Remove python2 installa

[jira] [Updated] (SPARK-32971) Support dynamic PVC creation/deletion for K8s executors

[ https://issues.apache.org/jira/browse/SPARK-32971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32971: -- Parent: SPARK-33005 Issue Type: Sub-task (was: New Feature) > Support dynamic PVC cre

[jira] [Updated] (SPARK-31394) Support for Kubernetes NFS volume mounts

[ https://issues.apache.org/jira/browse/SPARK-31394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31394: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Support for Kubernetes

[jira] [Updated] (SPARK-32655) Support appId/execId placeholder in K8s SPARK_EXECUTOR_DIRS

[ https://issues.apache.org/jira/browse/SPARK-32655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32655: -- Parent: SPARK-33005 Issue Type: Sub-task (was: New Feature) > Support appId/execId pl

[jira] [Updated] (SPARK-32713) Support execId placeholder in executor PVC conf

[ https://issues.apache.org/jira/browse/SPARK-32713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32713: -- Parent: SPARK-33005 Issue Type: Sub-task (was: New Feature) > Support execId placehol

[jira] [Updated] (SPARK-30981) Fix flaky "Test basic decommissioning" test

[ https://issues.apache.org/jira/browse/SPARK-30981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30981: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Bug) > Fix flaky "Test basic decommiss

[jira] [Updated] (SPARK-31125) When processing new K8s state snapshots Spark treats Terminating nodes as terminated.

[ https://issues.apache.org/jira/browse/SPARK-31125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31125: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Bug) > When processing new K8s state s

[jira] [Updated] (SPARK-31062) Improve Spark Decommissioning K8s test relability

[ https://issues.apache.org/jira/browse/SPARK-31062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31062: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Improve Spark Decommiss

[jira] [Updated] (SPARK-30949) Driver cores in kubernetes are coupled with container resources, not spark.driver.cores

[ https://issues.apache.org/jira/browse/SPARK-30949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30949: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Driver cores in kuberne

[jira] [Updated] (SPARK-27702) Allow using some alternatives for service accounts

[ https://issues.apache.org/jira/browse/SPARK-27702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27702: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Allow using some altern

[jira] [Updated] (SPARK-30122) Allow setting serviceAccountName for executor pods

[ https://issues.apache.org/jira/browse/SPARK-30122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30122: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Allow setting serviceAc

[jira] [Updated] (SPARK-25355) Support --proxy-user for Spark on K8s

[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25355: -- Parent: SPARK-33005 Issue Type: Sub-task (was: New Feature) > Support --proxy-user fo

[jira] [Updated] (SPARK-29905) ExecutorPodsLifecycleManager has sub-optimal behavior with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-29905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29905: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > ExecutorPodsLifecycleMa

[jira] [Updated] (SPARK-32554) Remove the words "experimental" in the k8s document

[ https://issues.apache.org/jira/browse/SPARK-32554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32554: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Remove the words "exper

[jira] [Created] (SPARK-33005) Kubernetes GA Preparation

Dongjoon Hyun created SPARK-33005: - Summary: Kubernetes GA Preparation Key: SPARK-33005 URL: https://issues.apache.org/jira/browse/SPARK-33005 Project: Spark Issue Type: Umbrella Co

[jira] [Commented] (SPARK-33004) Migrate DESCRIBE COLUMN to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17202701#comment-17202701 ] Apache Spark commented on SPARK-33004: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-33004) Migrate DESCRIBE COLUMN to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33004: Assignee: (was: Apache Spark) > Migrate DESCRIBE COLUMN to new resolution framework >

[jira] [Assigned] (SPARK-33004) Migrate DESCRIBE COLUMN to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33004: Assignee: Apache Spark > Migrate DESCRIBE COLUMN to new resolution framework > --

[jira] [Updated] (SPARK-32999) TreeNode.nodeName should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-32999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32999: -- Target Version/s: (was: 2.4.8, 3.0.2, 3.1.0) > TreeNode.nodeName should not throw malformed

[jira] [Resolved] (SPARK-32999) TreeNode.nodeName should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-32999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32999. --- Fix Version/s: 3.1.0 3.0.2 Assignee: Kris Mok Resolution:

[jira] [Created] (SPARK-33004) Migrate DESCRIBE COLUMN to new resolution framework

Terry Kim created SPARK-33004: - Summary: Migrate DESCRIBE COLUMN to new resolution framework Key: SPARK-33004 URL: https://issues.apache.org/jira/browse/SPARK-33004 Project: Spark Issue Type: Sub

[jira] [Commented] (SPARK-33002) Post-port removal of non-API stubs

[ https://issues.apache.org/jira/browse/SPARK-33002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17202696#comment-17202696 ] Apache Spark commented on SPARK-33002: -- User 'zero323' has created a pull request f

[jira] [Assigned] (SPARK-33002) Post-port removal of non-API stubs

[ https://issues.apache.org/jira/browse/SPARK-33002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33002: Assignee: (was: Apache Spark) > Post-port removal of non-API stubs >

[jira] [Commented] (SPARK-33002) Post-port removal of non-API stubs

[ https://issues.apache.org/jira/browse/SPARK-33002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17202695#comment-17202695 ] Apache Spark commented on SPARK-33002: -- User 'zero323' has created a pull request f

[jira] [Assigned] (SPARK-33002) Post-port removal of non-API stubs

[ https://issues.apache.org/jira/browse/SPARK-33002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33002: Assignee: Apache Spark > Post-port removal of non-API stubs > ---

[jira] [Created] (SPARK-33003) Add type hints guideliness to the documentation

Maciej Szymkiewicz created SPARK-33003: -- Summary: Add type hints guideliness to the documentation Key: SPARK-33003 URL: https://issues.apache.org/jira/browse/SPARK-33003 Project: Spark I

[jira] [Created] (SPARK-33002) Post-port removal of non-API stubs

Maciej Szymkiewicz created SPARK-33002: -- Summary: Post-port removal of non-API stubs Key: SPARK-33002 URL: https://issues.apache.org/jira/browse/SPARK-33002 Project: Spark Issue Type: Su

[jira] [Commented] (SPARK-32714) Port pyspark-stubs

[ https://issues.apache.org/jira/browse/SPARK-32714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17202670#comment-17202670 ] Apache Spark commented on SPARK-32714: -- User 'zero323' has created a pull request f

[jira] [Commented] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17202567#comment-17202567 ] Mingxian commented on SPARK-16859: -- "spark.eventLog.logBlockUpdates.enabled=true" works