[jira] [Updated] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

2021-05-18 Thread Domagoj (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Domagoj updated SPARK-35089: Description:    edit 2021-05-18 I have make it  simpler to reproduce; I've put already generated

[jira] [Updated] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

2021-05-18 Thread Domagoj (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Domagoj updated SPARK-35089: Description:    edit 2021-05-18 I have make it  simpler to reproduce; I've put already generated

[jira] [Created] (SPARK-35434) Upgrade scalatestplus artifacts 3.2.9.0

2021-05-18 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35434: -- Summary: Upgrade scalatestplus artifacts 3.2.9.0 Key: SPARK-35434 URL: https://issues.apache.org/jira/browse/SPARK-35434 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35434) Upgrade scalatestplus artifacts to 3.2.9.0

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346888#comment-17346888 ] Apache Spark commented on SPARK-35434: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35434) Upgrade scalatestplus artifacts to 3.2.9.0

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35434: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade scalatestplus artifacts to

[jira] [Commented] (SPARK-35425) Add note about Jinja2 as a required dependency for document build.

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346717#comment-17346717 ] Apache Spark commented on SPARK-35425: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-35434) Upgrade scalatestplus artifacts to 3.2.9.0

2021-05-18 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35434: --- Summary: Upgrade scalatestplus artifacts to 3.2.9.0 (was: Upgrade scalatestplus artifacts

[jira] [Assigned] (SPARK-35422) Many test cases failed in Scala 2.13 CI

2021-05-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35422: --- Assignee: Takeshi Yamamuro > Many test cases failed in Scala 2.13 CI >

[jira] [Resolved] (SPARK-35422) Many test cases failed in Scala 2.13 CI

2021-05-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35422. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32577

[jira] [Updated] (SPARK-35433) Move CSV data source options from Python and Scala into a single page.

2021-05-18 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-35433: Description: Refer to https://issues.apache.org/jira/browse/SPARK-34491 > Move CSV data source

[jira] [Created] (SPARK-35433) Move CSV data source options from Python and Scala into a single page.

2021-05-18 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-35433: --- Summary: Move CSV data source options from Python and Scala into a single page. Key: SPARK-35433 URL: https://issues.apache.org/jira/browse/SPARK-35433 Project: Spark

[jira] [Created] (SPARK-35432) Expose TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions via Scala, Python and R APIs

2021-05-18 Thread Max Gekk (Jira)
Max Gekk created SPARK-35432: Summary: Expose TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions via Scala, Python and R APIs Key: SPARK-35432 URL: https://issues.apache.org/jira/browse/SPARK-35432

[jira] [Resolved] (SPARK-35389) Analyzer should set progagateNull to false for magic function invocation

2021-05-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35389. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32553

[jira] [Assigned] (SPARK-35389) Analyzer should set progagateNull to false for magic function invocation

2021-05-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35389: --- Assignee: Chao Sun > Analyzer should set progagateNull to false for magic function

[jira] [Commented] (SPARK-35434) Upgrade scalatestplus artifacts to 3.2.9.0

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346887#comment-17346887 ] Apache Spark commented on SPARK-35434: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35434) Upgrade scalatestplus artifacts to 3.2.9.0

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35434: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade scalatestplus artifacts to

[jira] [Updated] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

2021-05-18 Thread Domagoj (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Domagoj updated SPARK-35089: Description:    edit 2021-05-18 I have make it  simpler to reproduce; I've put already generated

[jira] [Commented] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

2021-05-18 Thread Domagoj (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346704#comment-17346704 ] Domagoj commented on SPARK-35089: - I've made test data available via public s3 bucket, so it's easier to

[jira] [Commented] (SPARK-18683) REST APIs for standalone Master、Workers and Applications

2021-05-18 Thread Mayank Asthana (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346739#comment-17346739 ] Mayank Asthana commented on SPARK-18683: Can we reopen this? My usecase is to have spark

[jira] [Created] (SPARK-35435) Not able to capture driver and executor logs in console

2021-05-18 Thread Sugumar (Jira)
Sugumar created SPARK-35435: --- Summary: Not able to capture driver and executor logs in console Key: SPARK-35435 URL: https://issues.apache.org/jira/browse/SPARK-35435 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35436) RocksDBFileManager - save checkpoint to DFS

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346978#comment-17346978 ] Apache Spark commented on SPARK-35436: -- User 'xuanyuanking' has created a pull request for this

[jira] [Updated] (SPARK-34734) Update sbt version to 1.4.9

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34734: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Improvement) > Update sbt version to

[jira] [Assigned] (SPARK-35437) Hive partition filtering client optimization

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35437: Assignee: Apache Spark > Hive partition filtering client optimization >

[jira] [Assigned] (SPARK-35437) Hive partition filtering client optimization

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35437: Assignee: (was: Apache Spark) > Hive partition filtering client optimization >

[jira] [Created] (SPARK-35436) RocksDBFileManager - save checkpoint to DFS

2021-05-18 Thread Yuanjian Li (Jira)
Yuanjian Li created SPARK-35436: --- Summary: RocksDBFileManager - save checkpoint to DFS Key: SPARK-35436 URL: https://issues.apache.org/jira/browse/SPARK-35436 Project: Spark Issue Type:

[jira] [Updated] (SPARK-35425) Pin jinja2 in spark-rm/Dockerfile and add as a required dependency in the release README.md

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35425: -- Summary: Pin jinja2 in spark-rm/Dockerfile and add as a required dependency in the release

[jira] [Assigned] (SPARK-35436) RocksDBFileManager - save checkpoint to DFS

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35436: Assignee: (was: Apache Spark) > RocksDBFileManager - save checkpoint to DFS >

[jira] [Assigned] (SPARK-35436) RocksDBFileManager - save checkpoint to DFS

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35436: Assignee: Apache Spark > RocksDBFileManager - save checkpoint to DFS >

[jira] [Commented] (SPARK-35436) RocksDBFileManager - save checkpoint to DFS

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346976#comment-17346976 ] Apache Spark commented on SPARK-35436: -- User 'xuanyuanking' has created a pull request for this

[jira] [Created] (SPARK-35437) Hive partition filtering client optimization

2021-05-18 Thread dzcxzl (Jira)
dzcxzl created SPARK-35437: -- Summary: Hive partition filtering client optimization Key: SPARK-35437 URL: https://issues.apache.org/jira/browse/SPARK-35437 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-35437) Hive partition filtering client optimization

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347017#comment-17347017 ] Apache Spark commented on SPARK-35437: -- User 'cxzl25' has created a pull request for this issue:

[jira] [Updated] (SPARK-35425) Pin jinja2 in spark-rm/Dockerfile and add as a required dependency in the release README.md

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35425: -- Fix Version/s: 3.2.0 3.1.2 3.0.3 > Pin jinja2 in

[jira] [Updated] (SPARK-35425) Pin jinja2 in spark-rm/Dockerfile and add as a required dependency in the release README.md

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35425: -- Affects Version/s: 3.0.2 3.1.1 > Pin jinja2 in spark-rm/Dockerfile and

[jira] [Updated] (SPARK-35425) Pin jinja2 in spark-rm/Dockerfile and add as a required dependency in the release README.md

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35425: -- Issue Type: Bug (was: Improvement) > Pin jinja2 in spark-rm/Dockerfile and add as a required

[jira] [Updated] (SPARK-35434) Upgrade scalatestplus artifacts to 3.2.9.0

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35434: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Improvement) > Upgrade scalatestplus

[jira] [Updated] (SPARK-35434) Upgrade scalatestplus artifacts to 3.2.9.0

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35434: -- Affects Version/s: (was: 3.20) 3.2.0 > Upgrade scalatestplus

[jira] [Resolved] (SPARK-35434) Upgrade scalatestplus artifacts to 3.2.9.0

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35434. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32581

[jira] [Assigned] (SPARK-35411) Essential information missing in TreeNode json string

2021-05-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35411: --- Assignee: huangtengfei > Essential information missing in TreeNode json string >

[jira] [Resolved] (SPARK-35411) Essential information missing in TreeNode json string

2021-05-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35411. - Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-35425) Pin jinja2 in spark-rm/Dockerfile and add as a required dependency in the release README.md

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35425: -- Target Version/s: 3.0.3, 3.1.2, 3.2.0 (was: 3.20) > Pin jinja2 in spark-rm/Dockerfile and

[jira] [Commented] (SPARK-35079) Transform with udf gives incorrect result

2021-05-18 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346970#comment-17346970 ] koert kuipers commented on SPARK-35079: --- looks to me like this is a duplicate of SPARK-34829 >

[jira] [Updated] (SPARK-34959) Upgrade SBT to 1.5.0

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34959: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Improvement) > Upgrade SBT to 1.5.0 >

[jira] [Resolved] (SPARK-35305) Upgrade ZooKeeper to 3.7.0

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35305. --- Resolution: Later According to the discussion on the PR, we already upgraded Netty library

[jira] [Commented] (SPARK-35438) Minor documentation fix for window physical operator

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347219#comment-17347219 ] Apache Spark commented on SPARK-35438: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35438) Minor documentation fix for window physical operator

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35438: Assignee: (was: Apache Spark) > Minor documentation fix for window physical operator

[jira] [Commented] (SPARK-35438) Minor documentation fix for window physical operator

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347218#comment-17347218 ] Apache Spark commented on SPARK-35438: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35438) Minor documentation fix for window physical operator

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35438: Assignee: Apache Spark > Minor documentation fix for window physical operator >

[jira] [Created] (SPARK-35438) Minor documentation fix for window physical operator

2021-05-18 Thread Cheng Su (Jira)
Cheng Su created SPARK-35438: Summary: Minor documentation fix for window physical operator Key: SPARK-35438 URL: https://issues.apache.org/jira/browse/SPARK-35438 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35439) Use LinkedHashMap as the map of equivalent expressions to preserve insertion order

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347286#comment-17347286 ] Apache Spark commented on SPARK-35439: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35439) Use LinkedHashMap as the map of equivalent expressions to preserve insertion order

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35439: Assignee: Apache Spark (was: L. C. Hsieh) > Use LinkedHashMap as the map of equivalent

[jira] [Assigned] (SPARK-35439) Use LinkedHashMap as the map of equivalent expressions to preserve insertion order

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35439: Assignee: L. C. Hsieh (was: Apache Spark) > Use LinkedHashMap as the map of equivalent

[jira] [Assigned] (SPARK-35439) Use LinkedHashMap as the map of equivalent expressions to preserve insertion order

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35439: Assignee: Apache Spark (was: L. C. Hsieh) > Use LinkedHashMap as the map of equivalent

[jira] [Commented] (SPARK-35440) Add language type to `ExpressionInfo` for UDF

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347299#comment-17347299 ] Apache Spark commented on SPARK-35440: -- User 'linhongliu-db' has created a pull request for this

[jira] [Assigned] (SPARK-35440) Add language type to `ExpressionInfo` for UDF

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35440: Assignee: (was: Apache Spark) > Add language type to `ExpressionInfo` for UDF >

[jira] [Assigned] (SPARK-35440) Add language type to `ExpressionInfo` for UDF

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35440: Assignee: Apache Spark > Add language type to `ExpressionInfo` for UDF >

[jira] [Resolved] (SPARK-35370) IllegalArgumentException when loading a PipelineModel with Spark 3

2021-05-18 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-35370. -- Resolution: Not A Problem > IllegalArgumentException when loading a PipelineModel with Spark

[jira] [Resolved] (SPARK-35263) Refactor ShuffleBlockFetcherIteratorSuite to reduce duplicated code

2021-05-18 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-35263. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-35263) Refactor ShuffleBlockFetcherIteratorSuite to reduce duplicated code

2021-05-18 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-35263: --- Assignee: Erik Krogen > Refactor ShuffleBlockFetcherIteratorSuite to

[jira] [Resolved] (SPARK-35398) Simplify the way to get classes from ClassBodyEvaluator in CodeGenerator.updateAndGetCompilationStats method

2021-05-18 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35398. -- Fix Version/s: 3.2.0 Assignee: Yang Jie Resolution: Fixed Resolved by 

[jira] [Created] (SPARK-35440) Add language type to `ExpressionInfo` for UDF

2021-05-18 Thread Linhong Liu (Jira)
Linhong Liu created SPARK-35440: --- Summary: Add language type to `ExpressionInfo` for UDF Key: SPARK-35440 URL: https://issues.apache.org/jira/browse/SPARK-35440 Project: Spark Issue Type: Task

[jira] [Comment Edited] (SPARK-35291) NullPointerException at org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.CreateExternalRow_0$(Unknown Source)

2021-05-18 Thread Umar Asir (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347302#comment-17347302 ] Umar Asir edited comment on SPARK-35291 at 5/19/21, 5:19 AM: - It's an issue

[jira] [Commented] (SPARK-35129) Construct year-month interval column from integral fields

2021-05-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347271#comment-17347271 ] angerszhu commented on SPARK-35129: --- Can I take this if no update for a long time? > Construct

[jira] [Updated] (SPARK-35440) Add language type to `ExpressionInfo` for UDF

2021-05-18 Thread Linhong Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linhong Liu updated SPARK-35440: Description: add "scala", "java", "python", "hive", "built-in" > Add language type to

[jira] [Commented] (SPARK-35291) NullPointerException at org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.CreateExternalRow_0$(Unknown Source)

2021-05-18 Thread Umar Asir (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347302#comment-17347302 ] Umar Asir commented on SPARK-35291: --- It's an issue with delta.  > NullPointerException at >

[jira] [Created] (SPARK-35439) Use LinkedHashMap as the map of equivalent expressions to preserve insertion order

2021-05-18 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-35439: --- Summary: Use LinkedHashMap as the map of equivalent expressions to preserve insertion order Key: SPARK-35439 URL: https://issues.apache.org/jira/browse/SPARK-35439

[jira] [Commented] (SPARK-35129) Construct year-month interval column from integral fields

2021-05-18 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347306#comment-17347306 ] Max Gekk commented on SPARK-35129: -- [~mrpowers] Are you working on this? > Construct year-month

[jira] [Resolved] (SPARK-35425) Add note about Jinja2 as a required dependency for document build.

2021-05-18 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35425. Target Version/s: 3.20 Resolution: Fixed This issue was resolved in

[jira] [Updated] (SPARK-35420) Replace the usage of toStringHelper with ToStringBuilder

2021-05-18 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35420: --- Fix Version/s: 3.2.0 > Replace the usage of toStringHelper with ToStringBuilder >

[jira] [Updated] (SPARK-35256) Subexpression elimination leading to a performance regression

2021-05-18 Thread Ondrej Kokes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ondrej Kokes updated SPARK-35256: - Summary: Subexpression elimination leading to a performance regression (was: str_to_map +

[jira] [Resolved] (SPARK-35351) Add code-gen for left anti sort merge join

2021-05-18 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35351. -- Fix Version/s: 3.2.0 Assignee: Cheng Su Resolution: Fixed Resolved by 

[jira] [Commented] (SPARK-35425) Add note about Jinja2 as a required dependency for document build.

2021-05-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346682#comment-17346682 ] Apache Spark commented on SPARK-35425: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-35439) Children subexpr should come first than parent subexpr in subexpression elimination

2021-05-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-35439: Description: EquivalentExpressions maintains a map of equivalent expressions. It is HashMap now

[jira] [Updated] (SPARK-35439) Children subexpr should come first than parent subexpr in subexpression elimination

2021-05-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-35439: Affects Version/s: (was: 3.1.1) (was: 3.0.2) > Children subexpr

[jira] [Updated] (SPARK-35439) Children subexpr should come first than parent subexpr in subexpression elimination

2021-05-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-35439: Priority: Major (was: Minor) > Children subexpr should come first than parent subexpr in

[jira] [Updated] (SPARK-35439) Children subexpr should come first than parent subexpr in subexpression elimination

2021-05-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-35439: Summary: Children subexpr should come first than parent subexpr in subexpression elimination

[jira] [Comment Edited] (SPARK-12139) REGEX Column Specification for Hive Queries

2021-05-18 Thread Ranga Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346581#comment-17346581 ] Ranga Reddy edited comment on SPARK-12139 at 5/18/21, 6:07 AM: --- Hi

[jira] [Updated] (SPARK-35431) Sort elements generated by collect_set in SQLQueryTestSuite

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35431: -- Fix Version/s: 3.1.2 > Sort elements generated by collect_set in SQLQueryTestSuite >

[jira] [Updated] (SPARK-35431) Sort elements generated by collect_set in SQLQueryTestSuite

2021-05-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35431: -- Affects Version/s: 3.1.2 > Sort elements generated by collect_set in SQLQueryTestSuite >