[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877501#comment-16877501 ] Dongjoon Hyun commented on SPARK-24152: --- Thank you so much! > SparkR CRAN feasibility check

[jira] [Comment Edited] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877497#comment-16877497 ] Liang-Chi Hsieh edited comment on SPARK-24152 at 7/3/19 5:19 AM: -

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877497#comment-16877497 ] Liang-Chi Hsieh commented on SPARK-24152: - Received reply that is cleaned up. > SparkR CRAN

[jira] [Commented] (SPARK-28133) Hyperbolic Functions

[ https://issues.apache.org/jira/browse/SPARK-28133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877489#comment-16877489 ] Apache Spark commented on SPARK-28133: -- User 'Tonix517' has created a pull request for this issue:

[jira] [Updated] (SPARK-28083) Support LIKE ... ESCAPE syntax

[ https://issues.apache.org/jira/browse/SPARK-28083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28083: -- Summary: Support LIKE ... ESCAPE syntax (was: ANSI SQL: LIKE predicate: ESCAPE clause) >

[jira] [Assigned] (SPARK-28238) DESCRIBE TABLE for Data Source V2 tables

[ https://issues.apache.org/jira/browse/SPARK-28238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28238: Assignee: (was: Apache Spark) > DESCRIBE TABLE for Data Source V2 tables >

[jira] [Assigned] (SPARK-28238) DESCRIBE TABLE for Data Source V2 tables

[ https://issues.apache.org/jira/browse/SPARK-28238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28238: Assignee: Apache Spark > DESCRIBE TABLE for Data Source V2 tables >

[jira] [Created] (SPARK-28238) DESCRIBE TABLE for Data Source V2 tables

Matt Cheah created SPARK-28238: -- Summary: DESCRIBE TABLE for Data Source V2 tables Key: SPARK-28238 URL: https://issues.apache.org/jira/browse/SPARK-28238 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-14067) spark-shell WARN ObjectStore: Failed to get database default,returning NoSuchObjectException

[ https://issues.apache.org/jira/browse/SPARK-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877450#comment-16877450 ] gloCalHelp.com commented on SPARK-14067: Thank you for your guiding, sorry for no time to

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877405#comment-16877405 ] Hyukjin Kwon commented on SPARK-24152: -- Thanks for followup! > SparkR CRAN feasibility check

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877401#comment-16877401 ] Liang-Chi Hsieh commented on SPARK-24152: - I noticed that this issue happens now again.

[jira] [Commented] (SPARK-27296) User Defined Aggregating Functions (UDAFs) have a major efficiency problem

[ https://issues.apache.org/jira/browse/SPARK-27296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877374#comment-16877374 ] Erik Erlandson commented on SPARK-27296: The basic approach as described above appears to be

[jira] [Assigned] (SPARK-28237) Add a new batch strategy called Idempotent to catch potential bugs in corresponding rules

[ https://issues.apache.org/jira/browse/SPARK-28237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28237: Assignee: (was: Apache Spark) > Add a new batch strategy called Idempotent to catch

[jira] [Assigned] (SPARK-28237) Add a new batch strategy called Idempotent to catch potential bugs in corresponding rules

[ https://issues.apache.org/jira/browse/SPARK-28237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28237: Assignee: Apache Spark > Add a new batch strategy called Idempotent to catch potential

[jira] [Created] (SPARK-28237) Add a new batch strategy called Idempotent to catch potential bugs in corresponding rules

Yesheng Ma created SPARK-28237: -- Summary: Add a new batch strategy called Idempotent to catch potential bugs in corresponding rules Key: SPARK-28237 URL: https://issues.apache.org/jira/browse/SPARK-28237

[jira] [Assigned] (SPARK-27489) UI updates to show executor resource information

[ https://issues.apache.org/jira/browse/SPARK-27489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27489: Assignee: Apache Spark (was: Thomas Graves) > UI updates to show executor resource

[jira] [Assigned] (SPARK-27489) UI updates to show executor resource information

[ https://issues.apache.org/jira/browse/SPARK-27489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27489: Assignee: Thomas Graves (was: Apache Spark) > UI updates to show executor resource

[jira] [Assigned] (SPARK-28236) Fix PullOutNondeterministic Analyzer rule to enforce idempotence

[ https://issues.apache.org/jira/browse/SPARK-28236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28236: Assignee: Apache Spark > Fix PullOutNondeterministic Analyzer rule to enforce

[jira] [Assigned] (SPARK-28236) Fix PullOutNondeterministic Analyzer rule to enforce idempotence

[ https://issues.apache.org/jira/browse/SPARK-28236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28236: Assignee: (was: Apache Spark) > Fix PullOutNondeterministic Analyzer rule to enforce

[jira] [Assigned] (SPARK-28235) Decimal sum return type

[ https://issues.apache.org/jira/browse/SPARK-28235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28235: Assignee: Apache Spark > Decimal sum return type > --- > >

[jira] [Assigned] (SPARK-28235) Decimal sum return type

[ https://issues.apache.org/jira/browse/SPARK-28235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28235: Assignee: (was: Apache Spark) > Decimal sum return type > --- >

[jira] [Commented] (SPARK-28015) Invalid date formats should throw an exception

[ https://issues.apache.org/jira/browse/SPARK-28015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877275#comment-16877275 ] Iskender Unlu commented on SPARK-28015: --- I will try to work on this issue as my first contribution

[jira] [Created] (SPARK-28236) Fix PullOutNondeterministic Analyzer rule to enforce idempotence

Yesheng Ma created SPARK-28236: -- Summary: Fix PullOutNondeterministic Analyzer rule to enforce idempotence Key: SPARK-28236 URL: https://issues.apache.org/jira/browse/SPARK-28236 Project: Spark

[jira] [Created] (SPARK-28235) Decimal sum return type

Marco Gaido created SPARK-28235: --- Summary: Decimal sum return type Key: SPARK-28235 URL: https://issues.apache.org/jira/browse/SPARK-28235 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28222) Feature importance outputs different values in GBT and Random Forest in 2.3.3 and 2.4 pyspark version

[ https://issues.apache.org/jira/browse/SPARK-28222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877267#comment-16877267 ] Marco Gaido commented on SPARK-28222: - Mmmmh, there has been a bug fix for it (see SPARK-26721), but

[jira] [Commented] (SPARK-28219) Data source v2 user guide

[ https://issues.apache.org/jira/browse/SPARK-28219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877172#comment-16877172 ] Ryan Blue commented on SPARK-28219: --- I'm closing this as a duplicate. Please use SPARK-27708. If you

[jira] [Resolved] (SPARK-28219) Data source v2 user guide

[ https://issues.apache.org/jira/browse/SPARK-28219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue resolved SPARK-28219. --- Resolution: Duplicate > Data source v2 user guide > - > >

[jira] [Assigned] (SPARK-27560) HashPartitioner uses Object.hashCode which is not seeded

[ https://issues.apache.org/jira/browse/SPARK-27560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27560: Assignee: Apache Spark > HashPartitioner uses Object.hashCode which is not seeded >

[jira] [Assigned] (SPARK-27560) HashPartitioner uses Object.hashCode which is not seeded

[ https://issues.apache.org/jira/browse/SPARK-27560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27560: Assignee: (was: Apache Spark) > HashPartitioner uses Object.hashCode which is not

[jira] [Resolved] (SPARK-28223) stream-stream joins should fail unsupported checker in update mode

[ https://issues.apache.org/jira/browse/SPARK-28223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Torres resolved SPARK-28223. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25023

[jira] [Created] (SPARK-28234) Spark Resources - add python support to get resources

Thomas Graves created SPARK-28234: - Summary: Spark Resources - add python support to get resources Key: SPARK-28234 URL: https://issues.apache.org/jira/browse/SPARK-28234 Project: Spark

[jira] [Assigned] (SPARK-28224) Sum aggregation returns null on overflow decimals

[ https://issues.apache.org/jira/browse/SPARK-28224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28224: Assignee: Apache Spark > Sum aggregation returns null on overflow decimals >

[jira] [Assigned] (SPARK-28224) Sum aggregation returns null on overflow decimals

[ https://issues.apache.org/jira/browse/SPARK-28224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28224: Assignee: (was: Apache Spark) > Sum aggregation returns null on overflow decimals >

[jira] [Commented] (SPARK-27360) Standalone cluster mode support for GPU-aware scheduling

[ https://issues.apache.org/jira/browse/SPARK-27360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877086#comment-16877086 ] Thomas Graves commented on SPARK-27360: --- Are you going to handle updating the master/worker UI to

[jira] [Updated] (SPARK-28233) Upgrade maven-jar-plugin and maven-source-plugin

[ https://issues.apache.org/jira/browse/SPARK-28233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28233: Description: Upgrade {{maven-jar-plugin}} to 3.1.2 and {{maven-source-plugin}} to 3.1.0 to

[jira] [Assigned] (SPARK-28233) Upgrade maven-jar-plugin and maven-source-plugin

[ https://issues.apache.org/jira/browse/SPARK-28233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28233: Assignee: (was: Apache Spark) > Upgrade maven-jar-plugin and maven-source-plugin >

[jira] [Created] (SPARK-28233) Upgrade maven-jar-plugin and maven-source-plugin

Yuming Wang created SPARK-28233: --- Summary: Upgrade maven-jar-plugin and maven-source-plugin Key: SPARK-28233 URL: https://issues.apache.org/jira/browse/SPARK-28233 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-28233) Upgrade maven-jar-plugin and maven-source-plugin

[ https://issues.apache.org/jira/browse/SPARK-28233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28233: Assignee: Apache Spark > Upgrade maven-jar-plugin and maven-source-plugin >

[jira] [Assigned] (SPARK-25353) executeTake in SparkPlan could decode rows more than necessary.

[ https://issues.apache.org/jira/browse/SPARK-25353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25353: --- Assignee: Dooyoung Hwang > executeTake in SparkPlan could decode rows more than necessary.

[jira] [Commented] (SPARK-28230) Fix Spark Streaming gracefully shutdown on Hadopp 2.8.x

[ https://issues.apache.org/jira/browse/SPARK-28230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876941#comment-16876941 ] Burak KÖSE commented on SPARK-28230: This is a problem for teams using cloud solutions, such as EMR.

[jira] [Resolved] (SPARK-25353) executeTake in SparkPlan could decode rows more than necessary.

[ https://issues.apache.org/jira/browse/SPARK-25353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25353. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22347

[jira] [Resolved] (SPARK-28232) Add groupIdPrefix for Kafka batch connector

[ https://issues.apache.org/jira/browse/SPARK-28232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28232. - Resolution: Fixed Assignee: Gabor Somogyi Fix Version/s: 3.0.0 > Add

[jira] [Commented] (SPARK-27877) Implement SQL-standard LATERAL subqueries

[ https://issues.apache.org/jira/browse/SPARK-27877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876909#comment-16876909 ] Yuming Wang commented on SPARK-27877: - [~lishuming] tickets are assigned only once the PR is merged.

[jira] [Commented] (SPARK-28230) Fix Spark Streaming gracefully shutdown on Hadopp 2.8.x

[ https://issues.apache.org/jira/browse/SPARK-28230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876880#comment-16876880 ] Yuming Wang commented on SPARK-28230: - Hadoop 2.8.6 should support it. See HADOOP-15679 for more

[jira] [Commented] (SPARK-27877) Implement SQL-standard LATERAL subqueries

[ https://issues.apache.org/jira/browse/SPARK-27877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876865#comment-16876865 ] ShuMing Li commented on SPARK-27877: Can this issue assign to me?  Let me do it. > Implement

[jira] [Assigned] (SPARK-28232) Add groupIdPrefix for Kafka batch connector

[ https://issues.apache.org/jira/browse/SPARK-28232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28232: Assignee: Apache Spark > Add groupIdPrefix for Kafka batch connector >

[jira] [Assigned] (SPARK-28232) Add groupIdPrefix for Kafka batch connector

[ https://issues.apache.org/jira/browse/SPARK-28232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28232: Assignee: (was: Apache Spark) > Add groupIdPrefix for Kafka batch connector >

[jira] [Updated] (SPARK-28231) Adaptive execution should ignore RepartitionByExpression

[ https://issues.apache.org/jira/browse/SPARK-28231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jrex Ge updated SPARK-28231: Description: Dataset repartitionby will modify the partition information by adaptive execution >

[jira] [Created] (SPARK-28232) Add groupIdPrefix for Kafka batch connector

Gabor Somogyi created SPARK-28232: - Summary: Add groupIdPrefix for Kafka batch connector Key: SPARK-28232 URL: https://issues.apache.org/jira/browse/SPARK-28232 Project: Spark Issue Type:

[jira] [Created] (SPARK-28231) Adaptive execution should ignore RepartitionByExpression

Jrex Ge created SPARK-28231: --- Summary: Adaptive execution should ignore RepartitionByExpression Key: SPARK-28231 URL: https://issues.apache.org/jira/browse/SPARK-28231 Project: Spark Issue Type:

[jira] [Created] (SPARK-28230) Fix Spark Streaming gracefully shutdown on Hadopp 2.8.x

Burak KÖSE created SPARK-28230: -- Summary: Fix Spark Streaming gracefully shutdown on Hadopp 2.8.x Key: SPARK-28230 URL: https://issues.apache.org/jira/browse/SPARK-28230 Project: Spark Issue

[jira] [Created] (SPARK-28229) How to implement the same functionality as presto's TRY(expr) ?

U Shaw created SPARK-28229: -- Summary: How to implement the same functionality as presto's TRY(expr) ? Key: SPARK-28229 URL: https://issues.apache.org/jira/browse/SPARK-28229 Project: Spark Issue

[jira] [Updated] (SPARK-28228) Fix substitution order of nested WITH clauses

[ https://issues.apache.org/jira/browse/SPARK-28228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28228: --- Summary: Fix substitution order of nested WITH clauses (was: Better support for WITH clause) >

[jira] [Assigned] (SPARK-28228) Better support for WITH clause

[ https://issues.apache.org/jira/browse/SPARK-28228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28228: Assignee: Apache Spark > Better support for WITH clause > --

[jira] [Assigned] (SPARK-28228) Better support for WITH clause

[ https://issues.apache.org/jira/browse/SPARK-28228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28228: Assignee: (was: Apache Spark) > Better support for WITH clause >

[jira] [Updated] (SPARK-28228) Better support for WITH clause

[ https://issues.apache.org/jira/browse/SPARK-28228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28228: --- Description: PostgreSQL handles nested WITHs in a different way then Spark does currently. These

[jira] [Updated] (SPARK-28228) Better support for WITH clause

[ https://issues.apache.org/jira/browse/SPARK-28228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28228: --- Affects Version/s: (was: 2.2.0) 3.0.0 > Better support for WITH clause >

[jira] [Created] (SPARK-28228) Better support for WITH clause

Peter Toth created SPARK-28228: -- Summary: Better support for WITH clause Key: SPARK-28228 URL: https://issues.apache.org/jira/browse/SPARK-28228 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-27802) SparkUI throws NoSuchElementException when inconsistency appears between `ExecutorStageSummaryWrapper`s and `ExecutorSummaryWrapper`s

[ https://issues.apache.org/jira/browse/SPARK-27802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875945#comment-16875945 ] liupengcheng edited comment on SPARK-27802 at 7/2/19 6:23 AM: -- [~shahid]