[jira] [Assigned] (SPARK-34137) The tree string does not contain statistics for nested scalar sub queries

2021-02-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-34137: --- Assignee: angerszhu (was: Yuming Wang) > The tree string does not contain statistics for n

[jira] [Commented] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

2021-02-11 Thread Ranju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283519#comment-17283519 ] Ranju commented on SPARK-34389: --- ya Attila, got it now.. thanks! > Spark job on Kubernete

[jira] [Commented] (SPARK-29965) Race in executor shutdown handling can lead to executor never fully unregistering

2021-02-11 Thread Sushil Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283495#comment-17283495 ] Sushil Kumar commented on SPARK-29965: -- I'm also facing same issue in Spark 2.3.4.

[jira] [Issue Comment Deleted] (SPARK-27667) when hive.cli.print.current.db is set, spark cli is not working as expected

2021-02-11 Thread NEIL MCGUIGAN (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] NEIL MCGUIGAN updated SPARK-27667: -- Comment: was deleted (was: use spark.hadoop.hive.cli.print.current.db=true) > when hive.cli.p

[jira] [Commented] (SPARK-27667) when hive.cli.print.current.db is set, spark cli is not working as expected

2021-02-11 Thread NEIL MCGUIGAN (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283311#comment-17283311 ] NEIL MCGUIGAN commented on SPARK-27667: --- use spark.hadoop.hive.cli.print.current.d

[jira] [Updated] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-11 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-34421: Target Version/s: 3.1.0 > Custom functions can't be used in temporary views with CTEs > --

[jira] [Updated] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-11 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-34421: Priority: Blocker (was: Major) > Custom functions can't be used in temporary views with CTEs > --

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

2021-02-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283182#comment-17283182 ] Dongjoon Hyun commented on SPARK-25075: --- Thanks, [~smarter] . Yes, we are moving f

[jira] [Resolved] (SPARK-34422) CSV(/JSON?) files with corrupt row + Permissive mode can yield wrong partial result row

2021-02-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34422. -- Resolution: Not A Problem Hm, no I am not sure this is a problem in Spark. The semantics are d

[jira] [Commented] (SPARK-34423) Allow FileTable.fileIndex to be reused for custom partition schema in DataSourceV2 read path

2021-02-11 Thread Omer Ozarslan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283107#comment-17283107 ] Omer Ozarslan commented on SPARK-34423: --- If this sounds good, I can happily submit

[jira] [Created] (SPARK-34423) Allow FileTable.fileIndex to be reused for custom partition schema in DataSourceV2 read path

2021-02-11 Thread Omer Ozarslan (Jira)
Omer Ozarslan created SPARK-34423: - Summary: Allow FileTable.fileIndex to be reused for custom partition schema in DataSourceV2 read path Key: SPARK-34423 URL: https://issues.apache.org/jira/browse/SPARK-34423

[jira] [Assigned] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34421: Assignee: Apache Spark > Custom functions can't be used in temporary views with CTEs > --

[jira] [Assigned] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34421: Assignee: (was: Apache Spark) > Custom functions can't be used in temporary views wit

[jira] [Commented] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283060#comment-17283060 ] Apache Spark commented on SPARK-34421: -- User 'peter-toth' has created a pull reques

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

2021-02-11 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283059#comment-17283059 ] Guillaume Martres commented on SPARK-25075: --- Looks like 2.13 snapshot builds a

[jira] [Updated] (SPARK-34422) CSV(/JSON?) files with corrupt row + Permissive mode can yield wrong partial result row

2021-02-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34422: - Priority: Major (was: Minor) > CSV(/JSON?) files with corrupt row + Permissive mode can yield w

[jira] [Created] (SPARK-34422) CSV(/JSON?) files with corrupt row + Permissive mode can yield wrong partial result row

2021-02-11 Thread Sean R. Owen (Jira)
Sean R. Owen created SPARK-34422: Summary: CSV(/JSON?) files with corrupt row + Permissive mode can yield wrong partial result row Key: SPARK-34422 URL: https://issues.apache.org/jira/browse/SPARK-34422

[jira] [Commented] (SPARK-34410) Vincenty distance spark function

2021-02-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283020#comment-17283020 ] Sean R. Owen commented on SPARK-34410: -- More niche than haversine, so like in SPARK

[jira] [Commented] (SPARK-34409) haversine distance spark function

2021-02-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283019#comment-17283019 ] Sean R. Owen commented on SPARK-34409: -- Hm, haversine might be useful, but typicall

[jira] [Commented] (SPARK-34314) Wrong discovered partition value

2021-02-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282995#comment-17282995 ] Apache Spark commented on SPARK-34314: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

2021-02-11 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282994#comment-17282994 ] Attila Zsolt Piros commented on SPARK-34389: [~ranju] as I see your question

[jira] [Commented] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

2021-02-11 Thread Ranju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282953#comment-17282953 ] Ranju commented on SPARK-34389: --- Ya i understood this part earlier, i was asking something