[jira] [Resolved] (SPARK-27296) Efficient User Defined Aggregators

[ https://issues.apache.org/jira/browse/SPARK-27296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27296. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25024

[jira] [Resolved] (SPARK-30353) Use constraints in SimplifyBinaryComparison optimization

[ https://issues.apache.org/jira/browse/SPARK-30353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30353. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27008

[jira] [Assigned] (SPARK-30353) Use constraints in SimplifyBinaryComparison optimization

[ https://issues.apache.org/jira/browse/SPARK-30353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30353: --- Assignee: ulysses you > Use constraints in SimplifyBinaryComparison optimization >

[jira] [Comment Edited] (SPARK-30484) Job History Storage Tab does not display RDD Table

[ https://issues.apache.org/jira/browse/SPARK-30484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013656#comment-17013656 ] Ajith S edited comment on SPARK-30484 at 1/12/20 6:36 AM: -- This is not a issue.

[jira] [Commented] (SPARK-30484) Job History Storage Tab does not display RDD Table

[ https://issues.apache.org/jira/browse/SPARK-30484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013656#comment-17013656 ] Ajith S commented on SPARK-30484: - As SparkListenerBlockUpdated is filtered by default for performance

[jira] [Commented] (SPARK-30488) Deadlock between block-manager-slave-async-thread-pool and spark context cleaner

[ https://issues.apache.org/jira/browse/SPARK-30488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013651#comment-17013651 ] Ajith S commented on SPARK-30488: - As from log, i see `sbt` classes  in the deadlock threads,this is

[jira] [Updated] (SPARK-30486) Bump lz4-java version to 1.7.1

[ https://issues.apache.org/jira/browse/SPARK-30486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30486: -- Issue Type: Bug (was: Improvement) > Bump lz4-java version to 1.7.1 >

[jira] [Updated] (SPARK-30408) orderBy in sortBy clause is removed by EliminateSorts

[ https://issues.apache.org/jira/browse/SPARK-30408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30408: -- Component/s: (was: Optimizer) SQL > orderBy in sortBy clause is removed

[jira] [Resolved] (SPARK-30458) The Executor Computing Time in Time Line of Stage Page is Wrong

[ https://issues.apache.org/jira/browse/SPARK-30458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30458. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-30458) The Executor Computing Time in Time Line of Stage Page is Wrong

[ https://issues.apache.org/jira/browse/SPARK-30458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30458: - Assignee: SongXun > The Executor Computing Time in Time Line of Stage Page is Wrong >

[jira] [Updated] (SPARK-30458) The Executor Computing Time in Time Line of Stage Page is Wrong

[ https://issues.apache.org/jira/browse/SPARK-30458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30458: -- Affects Version/s: (was: 3.1.0) 3.0.0 2.0.2

[jira] [Commented] (SPARK-30458) The Executor Computing Time in Time Line of Stage Page is Wrong

[ https://issues.apache.org/jira/browse/SPARK-30458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013638#comment-17013638 ] Dongjoon Hyun commented on SPARK-30458: --- [~sddyljsx]. I saw that you are using `3.1.0` at `Affects

[jira] [Updated] (SPARK-30458) The Executor Computing Time in Time Line of Stage Page is Wrong

[ https://issues.apache.org/jira/browse/SPARK-30458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30458: -- Labels: (was: pull-request-available) > The Executor Computing Time in Time Line of Stage

[jira] [Assigned] (SPARK-30478) Fix memory package doc

[ https://issues.apache.org/jira/browse/SPARK-30478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30478: - Assignee: SongXun > Fix memory package doc > --- > >

[jira] [Resolved] (SPARK-30478) Fix memory package doc

[ https://issues.apache.org/jira/browse/SPARK-30478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30478. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-30478) Fix memory package doc

[ https://issues.apache.org/jira/browse/SPARK-30478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30478: -- Component/s: Documentation > Fix memory package doc > --- > >

[jira] [Updated] (SPARK-30478) Fix memory package doc

[ https://issues.apache.org/jira/browse/SPARK-30478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30478: -- Affects Version/s: (was: 3.1.0) 3.0.0 2.0.2

[jira] [Updated] (SPARK-30478) Fix memory package doc

[ https://issues.apache.org/jira/browse/SPARK-30478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30478: -- Issue Type: Documentation (was: Improvement) > Fix memory package doc >

[jira] [Updated] (SPARK-30478) Fix memory package doc

[ https://issues.apache.org/jira/browse/SPARK-30478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30478: -- Summary: Fix memory package doc (was: update memory package doc ) > Fix memory package doc

[jira] [Updated] (SPARK-30447) Constant propagation nullability issue

[ https://issues.apache.org/jira/browse/SPARK-30447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30447: -- Labels: correctness (was: ) > Constant propagation nullability issue >

[jira] [Updated] (SPARK-30491) Enable dependency audit files to tell dependency classifier

[ https://issues.apache.org/jira/browse/SPARK-30491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-30491: - Shepherd: (was: Xinrong Meng) > Enable dependency audit files to tell dependency classifier >

[jira] [Commented] (SPARK-30447) Constant propagation nullability issue

[ https://issues.apache.org/jira/browse/SPARK-30447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013633#comment-17013633 ] Dongjoon Hyun commented on SPARK-30447: --- Thank you, [~petertoth]! > Constant propagation

[jira] [Updated] (SPARK-30491) Enable dependency audit files to tell dependency classifier

[ https://issues.apache.org/jira/browse/SPARK-30491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-30491: - Shepherd: Xinrong Meng > Enable dependency audit files to tell dependency classifier >

[jira] [Created] (SPARK-30491) Enable dependency audit files to tell dependency classifier

Xinrong Meng created SPARK-30491: Summary: Enable dependency audit files to tell dependency classifier Key: SPARK-30491 URL: https://issues.apache.org/jira/browse/SPARK-30491 Project: Spark

[jira] [Commented] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception

[ https://issues.apache.org/jira/browse/SPARK-24915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013591#comment-17013591 ] Joachim Hereth commented on SPARK-24915: [~bryanc]Is there any chance that SPARK-29748 will be

[jira] [Updated] (SPARK-30312) Preserve path permission when truncate table

[ https://issues.apache.org/jira/browse/SPARK-30312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30312: -- Fix Version/s: 2.4.5 > Preserve path permission when truncate table >

[jira] [Commented] (SPARK-30447) Constant propagation nullability issue

[ https://issues.apache.org/jira/browse/SPARK-30447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013495#comment-17013495 ] Peter Toth commented on SPARK-30447: [~dongjoon], 2.3.4 is affected, 2.2.3 isn't. > Constant

[jira] [Updated] (SPARK-30447) Constant propagation nullability issue

[ https://issues.apache.org/jira/browse/SPARK-30447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-30447: --- Affects Version/s: 2.3.4 > Constant propagation nullability issue >

[jira] [Comment Edited] (SPARK-27750) Standalone scheduler - ability to prioritize applications over drivers, many drivers act like Denial of Service

[ https://issues.apache.org/jira/browse/SPARK-27750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989249#comment-16989249 ] t oo edited comment on SPARK-27750 at 1/11/20 12:59 PM: WDYT [~Ngone51]

[jira] [Updated] (SPARK-30490) Eliminate warnings in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-30490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30490: --- Summary: Eliminate warnings in Avro datasource (was: Eliminate deprecation warning in Avro

[jira] [Created] (SPARK-30490) Eliminate deprecation warning in Avro datasource

Maxim Gekk created SPARK-30490: -- Summary: Eliminate deprecation warning in Avro datasource Key: SPARK-30490 URL: https://issues.apache.org/jira/browse/SPARK-30490 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30485) Remove SQL configs deprecated before v2.4

[ https://issues.apache.org/jira/browse/SPARK-30485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30485: --- Description: Remove the following SQL configs: * spark.sql.variable.substitute.depth *