[jira] [Resolved] (SPARK-40992) Support toDF(columnNames) in Connect DSL

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40992. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38475 [https://gith

[jira] [Assigned] (SPARK-40992) Support toDF(columnNames) in Connect DSL

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40992: --- Assignee: Rui Wang > Support toDF(columnNames) in Connect DSL > ---

[jira] [Assigned] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41056: Assignee: Hyukjin Kwon > Fix new R_LIBS_SITE behavior introduced in R 4.2 > -

[jira] [Resolved] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41056. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38570 [https://gi

[jira] [Created] (SPARK-41073) Spark ThriftServer generate huge amounts of DelegationToken

2022-11-08 Thread zhengchenyu (Jira)
zhengchenyu created SPARK-41073: --- Summary: Spark ThriftServer generate huge amounts of DelegationToken Key: SPARK-41073 URL: https://issues.apache.org/jira/browse/SPARK-41073 Project: Spark Is

[jira] [Assigned] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41058: --- Assignee: Deng Ziming > Removing unused code in connect > --- >

[jira] [Resolved] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41058. - Resolution: Fixed Issue resolved by pull request 38491 [https://github.com/apache/spark/pull/384

[jira] [Commented] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630780#comment-17630780 ] Apache Spark commented on SPARK-41064: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41064: Assignee: Ruifeng Zheng (was: Apache Spark) > Implement `DataFrame.crosstab` and `DataFr

[jira] [Commented] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630779#comment-17630779 ] Apache Spark commented on SPARK-41064: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41064: Assignee: Apache Spark (was: Ruifeng Zheng) > Implement `DataFrame.crosstab` and `DataFr

[jira] [Created] (SPARK-41072) Convert the internal error about failed stream to user-facing error

2022-11-08 Thread Max Gekk (Jira)
Max Gekk created SPARK-41072: Summary: Convert the internal error about failed stream to user-facing error Key: SPARK-41072 URL: https://issues.apache.org/jira/browse/SPARK-41072 Project: Spark

[jira] [Commented] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630772#comment-17630772 ] Apache Spark commented on SPARK-41071: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41071: Assignee: (was: Apache Spark) > Metaspace OOM when Local run dev/make-distribution.sh

[jira] [Assigned] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41071: Assignee: Apache Spark > Metaspace OOM when Local run dev/make-distribution.sh > ---

[jira] [Commented] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630768#comment-17630768 ] Apache Spark commented on SPARK-41071: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630761#comment-17630761 ] Yang Jie commented on SPARK-41071: -- cc [~hyukjin.kwon]  [~yumwang]  I run  {code:java}

[jira] [Commented] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630760#comment-17630760 ] Apache Spark commented on SPARK-41062: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41062: Assignee: (was: Apache Spark) > Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED

[jira] [Assigned] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41062: Assignee: Apache Spark > Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

[jira] [Updated] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41071: - Summary: Metaspace OOM when Local run dev/make-distribution.sh (was: Metaspace OOm when Local run dev/

[jira] [Created] (SPARK-41071) Metaspace OOm when Local run dev/make-distribution.sh

2022-11-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-41071: Summary: Metaspace OOm when Local run dev/make-distribution.sh Key: SPARK-41071 URL: https://issues.apache.org/jira/browse/SPARK-41071 Project: Spark Issue Type: Im

[jira] [Updated] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

2022-11-08 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-41070: Description: We are connecting Tera data from spark SQL with below API {color:#ff8b00}Dataset jdb

[jira] [Updated] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

2022-11-08 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-41070: Description: We are connecting Tera data from spark SQL with below API {color:#ff8b00}Dataset jdb

[jira] [Created] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

2022-11-08 Thread Ramakrishna (Jira)
Ramakrishna created SPARK-41070: --- Summary: Performance issue when Spark SQL connects with TeraData Key: SPARK-41070 URL: https://issues.apache.org/jira/browse/SPARK-41070 Project: Spark Issue

[jira] [Commented] (SPARK-40948) Introduce new error class: PATH_NOT_FOUND

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630757#comment-17630757 ] Apache Spark commented on SPARK-40948: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-40948) Introduce new error class: PATH_NOT_FOUND

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630758#comment-17630758 ] Apache Spark commented on SPARK-40948: -- User 'itholic' has created a pull request f

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Affects Version/s: 3.1.2 > Spark Submitter generates a ConfigMap with the same name >

[jira] [Commented] (SPARK-41063) `hive-thriftserver` module compilation deadlock

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630744#comment-17630744 ] Hyukjin Kwon commented on SPARK-41063: -- Is this from our CI? > `hive-thriftserver`

[jira] [Commented] (SPARK-41063) `hive-thriftserver` module compilation deadlock

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630742#comment-17630742 ] Hyukjin Kwon commented on SPARK-41063: -- I am aware of this issue but I don't exactl

[jira] [Created] (SPARK-41069) Implement `DataFrame.approxQuantile` and `DataFrame.stat.approxQuantile`

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41069: - Summary: Implement `DataFrame.approxQuantile` and `DataFrame.stat.approxQuantile` Key: SPARK-41069 URL: https://issues.apache.org/jira/browse/SPARK-41069 Project: S

[jira] [Created] (SPARK-41068) Implement `DataFrame.stat.corr`

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41068: - Summary: Implement `DataFrame.stat.corr` Key: SPARK-41068 URL: https://issues.apache.org/jira/browse/SPARK-41068 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41067) Implement `DataFrame.stat.cov`

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41067: - Summary: Implement `DataFrame.stat.cov` Key: SPARK-41067 URL: https://issues.apache.org/jira/browse/SPARK-41067 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Description: There's a problem with submitting spark jobs to K8s cluster: the library gen

[jira] [Created] (SPARK-41066) Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy `

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41066: - Summary: Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy ` Key: SPARK-41066 URL: https://issues.apache.org/jira/browse/SPARK-41066 Project: Spark

[jira] [Created] (SPARK-41065) Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems `

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41065: - Summary: Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems ` Key: SPARK-41065 URL: https://issues.apache.org/jira/browse/SPARK-41065 Project: Spark

[jira] [Assigned] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41064: - Assignee: Ruifeng Zheng > Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

[jira] [Created] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41064: - Summary: Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab` Key: SPARK-41064 URL: https://issues.apache.org/jira/browse/SPARK-41064 Project: Spark

[jira] [Assigned] (SPARK-40917) Add a dedicated logical plan for `Summary`

2022-11-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40917: - Assignee: Ruifeng Zheng > Add a dedicated logical plan for `Summary` >

[jira] [Resolved] (SPARK-40917) Add a dedicated logical plan for `Summary`

2022-11-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40917. --- Resolution: Workaround > Add a dedicated logical plan for `Summary` > --

[jira] [Commented] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630737#comment-17630737 ] Apache Spark commented on SPARK-41060: -- User '19Serhii99' has created a pull reques

[jira] [Assigned] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41060: Assignee: (was: Apache Spark) > Spark Submitter generates a ConfigMap with the same n

[jira] [Commented] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630736#comment-17630736 ] Apache Spark commented on SPARK-41060: -- User '19Serhii99' has created a pull reques

[jira] [Assigned] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41060: Assignee: Apache Spark > Spark Submitter generates a ConfigMap with the same name > -

[jira] [Commented] (SPARK-40513) SPIP: Support Docker Official Image for Spark

2022-11-08 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630735#comment-17630735 ] Yikun Jiang commented on SPARK-40513: - Enable Github Autolink references for spark-d

[jira] [Commented] (SPARK-40513) SPIP: Support Docker Official Image for Spark

2022-11-08 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630733#comment-17630733 ] Yikun Jiang commented on SPARK-40513: - Add secrets.DOCKER_USER and secrets.DOCKER_TO

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Description: There's a problem with submitting spark jobs to K8s cluster: the library gen

[jira] [Commented] (SPARK-41063) `hive-thriftserver` module compilation deadlock

2022-11-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630731#comment-17630731 ] Yang Jie commented on SPARK-41063: -- cc [~hyukjin.kwon]  > `hive-thriftserver` module c

[jira] [Commented] (SPARK-41051) Optimize ProcfsMetrics file acquisition

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630730#comment-17630730 ] Apache Spark commented on SPARK-41051: -- User 'Narcasserun' has created a pull reque

[jira] [Commented] (SPARK-41063) `hive-thriftserver` module compilation deadlock

2022-11-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630729#comment-17630729 ] Yang Jie commented on SPARK-41063: --   Always printing similar logs in a loop   {code:

[jira] [Created] (SPARK-41063) `hive-thriftserver` module compilation deadlock

2022-11-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-41063: Summary: `hive-thriftserver` module compilation deadlock Key: SPARK-41063 URL: https://issues.apache.org/jira/browse/SPARK-41063 Project: Spark Issue Type: Improveme

[jira] [Resolved] (SPARK-41051) Optimize ProcfsMetrics file acquisition

2022-11-08 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-41051. - Fix Version/s: 3.4.0 (was: 3.3.2) Resolution: Fixed

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Description: There's a problem with submitting spark job to K8s cluster: the library gene

[jira] [Created] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

2022-11-08 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41062: --- Summary: Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE Key: SPARK-41062 URL: https://issues.apache.org/jira/browse/SPARK-41062 Project: Spark

[jira] [Commented] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

2022-11-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630724#comment-17630724 ] Haejoon Lee commented on SPARK-41062: - I'm working on it > Rename UNSUPPORTED_CORRE

[jira] [Commented] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630723#comment-17630723 ] Apache Spark commented on SPARK-41061: -- User 'amaliujia' has created a pull request

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Description: There's a problem with submitting spark job to K8s cluster: the library gener

[jira] [Assigned] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41061: Assignee: Apache Spark > Support SelectExpr which apply Projection by expressions in Stri

[jira] [Commented] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630720#comment-17630720 ] Apache Spark commented on SPARK-41061: -- User 'amaliujia' has created a pull request

[jira] [Assigned] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41061: Assignee: (was: Apache Spark) > Support SelectExpr which apply Projection by expressi

[jira] [Assigned] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41059: Assignee: (was: Apache Spark) > Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FU

[jira] [Assigned] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41059: Assignee: Apache Spark > Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION > --

[jira] [Commented] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630718#comment-17630718 ] Apache Spark commented on SPARK-41059: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41059: Assignee: Apache Spark > Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION > --

[jira] [Commented] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630719#comment-17630719 ] Apache Spark commented on SPARK-41059: -- User 'itholic' has created a pull request f

[jira] [Created] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-08 Thread Rui Wang (Jira)
Rui Wang created SPARK-41061: Summary: Support SelectExpr which apply Projection by expressions in Strings in Connect DSL Key: SPARK-41061 URL: https://issues.apache.org/jira/browse/SPARK-41061 Project: S

[jira] [Created] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
Serhii Nesterov created SPARK-41060: --- Summary: Spark Submitter generates a ConfigMap with the same name Key: SPARK-41060 URL: https://issues.apache.org/jira/browse/SPARK-41060 Project: Spark

[jira] [Created] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41059: --- Summary: Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION Key: SPARK-41059 URL: https://issues.apache.org/jira/browse/SPARK-41059 Project: Spark Is

[jira] [Commented] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630716#comment-17630716 ] Haejoon Lee commented on SPARK-41059: - I'm working on it > Rename _LEGACY_ERROR_TEM

[jira] [Commented] (SPARK-37555) spark-sql should pass last unclosed comment to backend and execute throw a exception

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630715#comment-17630715 ] Apache Spark commented on SPARK-37555: -- User 'AngersZh' has created a pull requ

[jira] [Resolved] (SPARK-41039) Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41039. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38550 [https://gi

[jira] [Assigned] (SPARK-41039) Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41039: Assignee: Yang Jie > Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13 > -

[jira] [Updated] (SPARK-41039) Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41039: - Priority: Trivial (was: Major) > Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13 >

[jira] [Commented] (SPARK-41057) Support other data type conversion in the DataTypeProtoConverter

2022-11-08 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630711#comment-17630711 ] Deng Ziming commented on SPARK-41057: - Thank you [~amaliujia] , I'm willing to have

[jira] [Comment Edited] (SPARK-41057) Support other data type conversion in the DataTypeProtoConverter

2022-11-08 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630706#comment-17630706 ] Rui Wang edited comment on SPARK-41057 at 11/9/22 2:55 AM: --- [~

[jira] [Assigned] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41058: Assignee: (was: Apache Spark) > Removing unused code in connect > ---

[jira] [Assigned] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41058: Assignee: Apache Spark > Removing unused code in connect > --

[jira] [Commented] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630709#comment-17630709 ] Apache Spark commented on SPARK-41058: -- User 'dengziming' has created a pull reques

[jira] [Assigned] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41056: Assignee: Apache Spark > Fix new R_LIBS_SITE behavior introduced in R 4.2 > -

[jira] [Commented] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630708#comment-17630708 ] Apache Spark commented on SPARK-41056: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41056: Assignee: (was: Apache Spark) > Fix new R_LIBS_SITE behavior introduced in R 4.2 > --

[jira] [Created] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Deng Ziming (Jira)
Deng Ziming created SPARK-41058: --- Summary: Removing unused code in connect Key: SPARK-41058 URL: https://issues.apache.org/jira/browse/SPARK-41058 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41057) Support other data type conversion in the DataTypeProtoConverter

2022-11-08 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630706#comment-17630706 ] Rui Wang commented on SPARK-41057: -- @dengziming Are you interested in this JIRA? > Su

[jira] [Updated] (SPARK-41057) Support other data type conversion in the DataTypeProtoConverter

2022-11-08 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-41057: - Description: In https://github.com/apache/spark/blob/master/connector/connect/src/main/scala/org/apache

[jira] [Created] (SPARK-41057) Support other data type conversion in the DataTypeProtoConverter

2022-11-08 Thread Rui Wang (Jira)
Rui Wang created SPARK-41057: Summary: Support other data type conversion in the DataTypeProtoConverter Key: SPARK-41057 URL: https://issues.apache.org/jira/browse/SPARK-41057 Project: Spark Iss

[jira] [Created] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41056: Summary: Fix new R_LIBS_SITE behavior introduced in R 4.2 Key: SPARK-41056 URL: https://issues.apache.org/jira/browse/SPARK-41056 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630699#comment-17630699 ] Apache Spark commented on SPARK-41055: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630698#comment-17630698 ] Apache Spark commented on SPARK-41055: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41055: Assignee: Apache Spark > Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE > -

[jira] [Assigned] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41055: Assignee: (was: Apache Spark) > Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

[jira] [Commented] (SPARK-41046) Support CreateView in Connect DSL

2022-11-08 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630696#comment-17630696 ] Deng Ziming commented on SPARK-41046: - [~amaliujia] Aha, I'll review your code when

[jira] [Commented] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630694#comment-17630694 ] Haejoon Lee commented on SPARK-41055: - I'm working on it > Rename _LEGACY_ERROR_TEM

[jira] [Created] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41055: --- Summary: Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE Key: SPARK-41055 URL: https://issues.apache.org/jira/browse/SPARK-41055 Project: Spark Issue Type

[jira] [Assigned] (SPARK-41035) Incorrect results or NPE when a literal is reused across distinct aggregations

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41035: Assignee: Bruce Robbins > Incorrect results or NPE when a literal is reused across distin

[jira] [Resolved] (SPARK-41035) Incorrect results or NPE when a literal is reused across distinct aggregations

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41035. -- Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution: Fixed

[jira] [Resolved] (SPARK-40569) Add smoke test in standalone cluster for spark-docker

2022-11-08 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40569. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 21 [https://github.

[jira] [Commented] (SPARK-41051) Optimize ProcfsMetrics file acquisition

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630685#comment-17630685 ] Apache Spark commented on SPARK-41051: -- User 'Narcasserun' has created a pull reque

[jira] [Resolved] (SPARK-40852) Implement `DataFrame.summary`

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40852. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38318 [https://gith

[jira] [Commented] (SPARK-41047) round function with negative scale value runs failed

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630676#comment-17630676 ] Hyukjin Kwon commented on SPARK-41047: -- cc [~wuyi] [~cloud_fan]. This seems from h

[jira] [Updated] (SPARK-41050) Upgrade scalafmt from 3.5.9 to 3.6.1

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41050: - Priority: Trivial (was: Minor) > Upgrade scalafmt from 3.5.9 to 3.6.1 > --

  1   2   >