[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794403#comment-16794403 ] Mi Zi commented on SPARK-26961: --- copy or create a new Configuration every time in

[jira] [Commented] (SPARK-26929) table owner should use user instead of principal when use kerberos

[ https://issues.apache.org/jira/browse/SPARK-26929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794401#comment-16794401 ] hong dongdong commented on SPARK-26929: --- cc [~dongjoon], could you help to review PR

[jira] [Updated] (SPARK-27180) Fix testing issues with yarn module in Hadoop-3

[ https://issues.apache.org/jira/browse/SPARK-27180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27180: Issue Type: Sub-task (was: Improvement) Parent: SPARK-23710 > Fix testing issues with

[jira] [Updated] (SPARK-27179) Exclude javax.ws.rs:jsr311-api from hadoop-client

[ https://issues.apache.org/jira/browse/SPARK-27179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27179: Issue Type: Sub-task (was: Bug) Parent: SPARK-23710 > Exclude javax.ws.rs:jsr311-api

[jira] [Updated] (SPARK-27177) Update jenkins locale to en_US.UTF-8

[ https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27177: Issue Type: Sub-task (was: Improvement) Parent: SPARK-23710 > Update jenkins locale to

[jira] [Commented] (SPARK-23749) Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

[ https://issues.apache.org/jira/browse/SPARK-23749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794396#comment-16794396 ] Yuming Wang commented on SPARK-23749: - [~dongjoon] Could we update the status? > Replace built-in

[jira] [Updated] (SPARK-27175) Upgrade hadoop-3 to 3.2.0

[ https://issues.apache.org/jira/browse/SPARK-27175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27175: Issue Type: Sub-task (was: Improvement) Parent: SPARK-23710 > Upgrade hadoop-3 to 3.2.0

[jira] [Updated] (SPARK-27175) Upgrade hadoop-3 to 3.2.0

[ https://issues.apache.org/jira/browse/SPARK-27175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27175: -- Priority: Minor (was: Major) > Upgrade hadoop-3 to 3.2.0 > - > >

[jira] [Assigned] (SPARK-26941) incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming

[ https://issues.apache.org/jira/browse/SPARK-26941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26941: - Assignee: liupengcheng > incorrect computation of maxNumExecutorFailures in ApplicationMaster

[jira] [Resolved] (SPARK-26941) incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming

[ https://issues.apache.org/jira/browse/SPARK-26941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26941. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23845

[jira] [Updated] (SPARK-26941) incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming

[ https://issues.apache.org/jira/browse/SPARK-26941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26941: -- Priority: Minor (was: Major) > incorrect computation of maxNumExecutorFailures in ApplicationMaster

[jira] [Resolved] (SPARK-27175) Upgrade hadoop-3 to 3.2.0

[ https://issues.apache.org/jira/browse/SPARK-27175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27175. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24106

[jira] [Assigned] (SPARK-27175) Upgrade hadoop-3 to 3.2.0

[ https://issues.apache.org/jira/browse/SPARK-27175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27175: - Assignee: Yuming Wang > Upgrade hadoop-3 to 3.2.0 > - > >

[jira] [Created] (SPARK-27181) Add public expression and transform API for DSv2 partitioning

Ryan Blue created SPARK-27181: - Summary: Add public expression and transform API for DSv2 partitioning Key: SPARK-27181 URL: https://issues.apache.org/jira/browse/SPARK-27181 Project: Spark

[jira] [Assigned] (SPARK-27181) Add public expression and transform API for DSv2 partitioning

[ https://issues.apache.org/jira/browse/SPARK-27181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27181: Assignee: (was: Apache Spark) > Add public expression and transform API for DSv2

[jira] [Assigned] (SPARK-27181) Add public expression and transform API for DSv2 partitioning

[ https://issues.apache.org/jira/browse/SPARK-27181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27181: Assignee: Apache Spark > Add public expression and transform API for DSv2 partitioning >

[jira] [Resolved] (SPARK-19412) HiveContext hive queries differ from CLI hive queries

[ https://issues.apache.org/jira/browse/SPARK-19412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-19412. - Resolution: Invalid > HiveContext hive queries differ from CLI hive queries >

[jira] [Commented] (SPARK-21395) Spark SQL hive-thriftserver doesn't register operation log before execute sql statement

[ https://issues.apache.org/jira/browse/SPARK-21395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794383#comment-16794383 ] Yuming Wang commented on SPARK-21395: - Fixed by https://issues.apache.org/jira/browse/SPARK-22496 >

[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794382#comment-16794382 ] Yuming Wang commented on SPARK-21918: - DDL should be supported after the metastore is upgraded to

[jira] [Assigned] (SPARK-27157) Add Executor level metrics to monitoring docs

[ https://issues.apache.org/jira/browse/SPARK-27157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27157: - Assignee: Lantao Jin > Add Executor level metrics to monitoring docs >

[jira] [Resolved] (SPARK-27157) Add Executor level metrics to monitoring docs

[ https://issues.apache.org/jira/browse/SPARK-27157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27157. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24090

[jira] [Resolved] (SPARK-27134) array_distinct function does not work correctly with columns containing array of array

[ https://issues.apache.org/jira/browse/SPARK-27134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27134. --- Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 3.0.0

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794300#comment-16794300 ] Sean Owen commented on SPARK-26961: --- Hm! OK, I believe it. That almost seems like a bug in the JDK. I

[jira] [Commented] (SPARK-27170) Better error message for syntax error with extraneous comma in the SQL parser

[ https://issues.apache.org/jira/browse/SPARK-27170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794194#comment-16794194 ] Wataru Yukawa commented on SPARK-27170: --- [~dkbiswal] Thank you for your comment! I completely

[jira] [Comment Edited] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793675#comment-16793675 ] shahid edited comment on SPARK-27169 at 3/16/19 8:40 AM: - Seems event drop has

[jira] [Assigned] (SPARK-27180) Fix testing issues with yarn module in Hadoop-3

[ https://issues.apache.org/jira/browse/SPARK-27180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27180: Assignee: Apache Spark > Fix testing issues with yarn module in Hadoop-3 >

[jira] [Assigned] (SPARK-27180) Fix testing issues with yarn module in Hadoop-3

[ https://issues.apache.org/jira/browse/SPARK-27180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27180: Assignee: (was: Apache Spark) > Fix testing issues with yarn module in Hadoop-3 >

[jira] [Created] (SPARK-27180) Fix testing issues with yarn module in Hadoop-3

Yuming Wang created SPARK-27180: --- Summary: Fix testing issues with yarn module in Hadoop-3 Key: SPARK-27180 URL: https://issues.apache.org/jira/browse/SPARK-27180 Project: Spark Issue Type:

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-27160: --- Description: DecimalType Literal should not be casted to Long. eg. For `df.filter("x < 3.14")`,

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-27160: --- Priority: Blocker (was: Major) > Incorrect Literal Casting of DecimalType in OrcFilters >

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-27160: --- Target Version/s: (was: 2.4.1) > Incorrect Literal Casting of DecimalType in OrcFilters >

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-27160: --- Fix Version/s: 3.0.0 > Incorrect Literal Casting of DecimalType in OrcFilters >

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-27160: --- Fix Version/s: 2.4.1 > Incorrect Literal Casting of DecimalType in OrcFilters >

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-27160: --- Labels: correctness (was: ) > Incorrect Literal Casting of DecimalType in OrcFilters >

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-27160: --- Target Version/s: 2.4.1 > Incorrect Literal Casting of DecimalType in OrcFilters >