[jira] [Commented] (SPARK-35578) Add a test case for a janino bug

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354508#comment-17354508 ] Apache Spark commented on SPARK-35578: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-35578) Add a test case for a janino bug

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354507#comment-17354507 ] Apache Spark commented on SPARK-35578: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-35578) Add a test case for a janino bug

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35578: Assignee: Apache Spark > Add a test case for a janino bug > -

[jira] [Assigned] (SPARK-35578) Add a test case for a janino bug

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35578: Assignee: (was: Apache Spark) > Add a test case for a janino bug > --

[jira] [Updated] (SPARK-35579) Fix a bug in janino or work around it in Spark.

2021-05-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-35579: Priority: Critical (was: Major) > Fix a bug in janino or work around it in Spark. > -

[jira] [Updated] (SPARK-35576) Redact the sensitive info in the result of Set command

2021-05-31 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35576: --- Affects Version/s: 3.1.2 > Redact the sensitive info in the result of Set command >

[jira] [Created] (SPARK-35579) Fix a bug in janino or work around it in Spark.

2021-05-31 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-35579: --- Summary: Fix a bug in janino or work around it in Spark. Key: SPARK-35579 URL: https://issues.apache.org/jira/browse/SPARK-35579 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-35578) Add a test case for a janino bug

2021-05-31 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-35578: --- Summary: Add a test case for a janino bug Key: SPARK-35578 URL: https://issues.apache.org/jira/browse/SPARK-35578 Project: Spark Issue Type: Test Com

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

2021-05-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Summary: Adapt uses of JDK 17 Internal APIs (was: Adapt uses of JDK 17 Internal APIs (Unsafe, e

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs (Unsafe, etc)

2021-05-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Description: I tried to run a Spark pipeline using the most recent 3.2.0-SNAPSHOT with Spark 2.

[jira] [Commented] (SPARK-35564) Support subexpression elimination for non-common branches of conditional expressions

2021-05-31 Thread Adam Binford (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354447#comment-17354447 ] Adam Binford commented on SPARK-35564: -- >Do you mean "Create a subexpression if an

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs (Unsafe, etc)

2021-05-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Description: I tried to run a Spark pipeline using the most recent 3.2.0-SNAPSHOT with Spark 2.

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs (Unsafe, etc)

2021-05-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Summary: Adapt uses of JDK 17 Internal APIs (Unsafe, etc) (was: Adapt uses of JDK Internal APIs

[jira] [Commented] (SPARK-35577) Allow to log container output for docker integration tests

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354429#comment-17354429 ] Apache Spark commented on SPARK-35577: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-35577) Allow to log container output for docker integration tests

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35577: Assignee: Kousuke Saruta (was: Apache Spark) > Allow to log container output for docker

[jira] [Assigned] (SPARK-35577) Allow to log container output for docker integration tests

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35577: Assignee: Apache Spark (was: Kousuke Saruta) > Allow to log container output for docker

[jira] [Commented] (SPARK-35577) Allow to log container output for docker integration tests

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354428#comment-17354428 ] Apache Spark commented on SPARK-35577: -- User 'sarutak' has created a pull request f

[jira] [Created] (SPARK-35577) Allow to log container output for docker integration tests

2021-05-31 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35577: -- Summary: Allow to log container output for docker integration tests Key: SPARK-35577 URL: https://issues.apache.org/jira/browse/SPARK-35577 Project: Spark

[jira] [Commented] (SPARK-35411) Essential information missing in TreeNode json string

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354383#comment-17354383 ] Apache Spark commented on SPARK-35411: -- User 'ivoson' has created a pull request fo

[jira] [Commented] (SPARK-35411) Essential information missing in TreeNode json string

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354382#comment-17354382 ] Apache Spark commented on SPARK-35411: -- User 'ivoson' has created a pull request fo

[jira] [Commented] (SPARK-35576) Redact the sensitive info in the result of Set command

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354377#comment-17354377 ] Apache Spark commented on SPARK-35576: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-35576) Redact the sensitive info in the result of Set command

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354376#comment-17354376 ] Apache Spark commented on SPARK-35576: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-35576) Redact the sensitive info in the result of Set command

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35576: Assignee: Apache Spark (was: Gengliang Wang) > Redact the sensitive info in the result o

[jira] [Assigned] (SPARK-35576) Redact the sensitive info in the result of Set command

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35576: Assignee: Gengliang Wang (was: Apache Spark) > Redact the sensitive info in the result o

[jira] [Updated] (SPARK-35576) Redact the sensitive info in the result of Set command

2021-05-31 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35576: --- Description: Currently, the results of following SQL queries are not redacted: ``` SET [KEY]

[jira] [Created] (SPARK-35576) Redact the sensitive info in the result of Set command

2021-05-31 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-35576: -- Summary: Redact the sensitive info in the result of Set command Key: SPARK-35576 URL: https://issues.apache.org/jira/browse/SPARK-35576 Project: Spark Is

[jira] [Assigned] (SPARK-35575) Recover updating build status in GitHub Actions

2021-05-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35575: Assignee: Hyukjin Kwon > Recover updating build status in GitHub Actions > --

[jira] [Resolved] (SPARK-35575) Recover updating build status in GitHub Actions

2021-05-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35575. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32711 [https://gi

[jira] [Assigned] (SPARK-35575) Recover updating build status in GitHub Actions

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35575: Assignee: (was: Apache Spark) > Recover updating build status in GitHub Actions > ---

[jira] [Assigned] (SPARK-35575) Recover updating build status in GitHub Actions

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35575: Assignee: Apache Spark > Recover updating build status in GitHub Actions > --

[jira] [Commented] (SPARK-35575) Recover updating build status in GitHub Actions

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354365#comment-17354365 ] Apache Spark commented on SPARK-35575: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-35575) Recover updating build status in GitHub Actions

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354364#comment-17354364 ] Apache Spark commented on SPARK-35575: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-34808) Removes outer join if it only has distinct on streamed side

2021-05-31 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-34808: --- Assignee: Yuming Wang > Removes outer join if it only has distinct on streamed side > -

[jira] [Resolved] (SPARK-34808) Removes outer join if it only has distinct on streamed side

2021-05-31 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-34808. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31908 [https://gith

[jira] [Assigned] (SPARK-35574) Turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35574: Assignee: Apache Spark > Turn compilation warnings related to `procedure syntax` to error

[jira] [Assigned] (SPARK-35574) Turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35574: Assignee: (was: Apache Spark) > Turn compilation warnings related to `procedure synta

[jira] [Commented] (SPARK-35574) Turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354358#comment-17354358 ] Apache Spark commented on SPARK-35574: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-35575) Recover updating build status in GitHub Actions

2021-05-31 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-35575: Summary: Recover updating build status in GitHub Actions Key: SPARK-35575 URL: https://issues.apache.org/jira/browse/SPARK-35575 Project: Spark Issue Type: B

[jira] [Created] (SPARK-35574) Turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

2021-05-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-35574: Summary: Turn compilation warnings related to `procedure syntax` to errors in Scala 2.13 Key: SPARK-35574 URL: https://issues.apache.org/jira/browse/SPARK-35574 Project: Spar

[jira] [Resolved] (SPARK-35562) Fix places about Yarn and Kubernetes in Cluster Overview and Submitting Applications pages

2021-05-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35562. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32701 [https://

[jira] [Assigned] (SPARK-35562) Fix places about Yarn and Kubernetes in Cluster Overview and Submitting Applications pages

2021-05-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35562: - Assignee: Shiqi Sun > Fix places about Yarn and Kubernetes in Cluster Overview and Sub

[jira] [Commented] (SPARK-35573) Support R 4.1.0

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354273#comment-17354273 ] Apache Spark commented on SPARK-35573: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-35573) Support R 4.1.0

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35573: Assignee: (was: Apache Spark) > Support R 4.1.0 > --- > >

[jira] [Assigned] (SPARK-35573) Support R 4.1.0

2021-05-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35573: Assignee: Apache Spark > Support R 4.1.0 > --- > > Key: SPARK

[jira] [Commented] (SPARK-35573) Support R 4.1.0

2021-05-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354269#comment-17354269 ] Hyukjin Kwon commented on SPARK-35573: -- will take a look > Support R 4.1.0 > -

[jira] [Resolved] (SPARK-35566) Fix number of output rows for StateStoreRestoreExec

2021-05-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35566. -- Fix Version/s: 3.0.3 3.1.3 3.2.0 Resolution: Fixed

[jira] [Created] (SPARK-35573) Support R 4.1.0

2021-05-31 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-35573: - Summary: Support R 4.1.0 Key: SPARK-35573 URL: https://issues.apache.org/jira/browse/SPARK-35573 Project: Spark Issue Type: Bug Components: R

[jira] [Updated] (SPARK-35571) tag v3.0.0 org.apache.spark.sql.catalyst.parser.AstBuilder import error

2021-05-31 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-35571: Target Version/s: (was: 3.0.0) > tag v3.0.0 org.apache.spark.sql.catalyst.parser.AstBuilder impo

<    1   2