[jira] [Assigned] (SPARK-31674) Make Prometheus-format metric endpoints experimental

2020-05-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31674: - Assignee: Dongjoon Hyun > Make Prometheus-format metric endpoints experimental > --

[jira] [Resolved] (SPARK-31674) Make Prometheus-format metric endpoints experimental

2020-05-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31674. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28495 [https://

[jira] [Resolved] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

2020-05-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31672. - Resolution: Fixed Issue resolved by pull request 28489 [https://github.com/apache/spark/pull/284

[jira] [Issue Comment Deleted] (SPARK-31622) Test-jar in the Spark distribution

2020-05-10 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Raj Boudh updated SPARK-31622: Comment: was deleted (was: [~hyukjin.kwon] , ok I will check and will update you.) > Test

[jira] [Commented] (SPARK-31622) Test-jar in the Spark distribution

2020-05-10 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104069#comment-17104069 ] Ankit Raj Boudh commented on SPARK-31622: - [~hyukjin.kwon] , ok I will check and

[jira] [Commented] (SPARK-31622) Test-jar in the Spark distribution

2020-05-10 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104068#comment-17104068 ] Ankit Raj Boudh commented on SPARK-31622: - [~hyukjin.kwon] , ok I will check and

[jira] [Updated] (SPARK-31674) Make Prometheus-format metric endpoints experimental

2020-05-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31674: -- Component/s: Documentation > Make Prometheus-format metric endpoints experimental > --

[jira] [Issue Comment Deleted] (SPARK-31674) Make Prometheus-format metric endpoints experimental

2020-05-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31674: -- Comment: was deleted (was: User 'dongjoon-hyun' has created a pull request for this issue: htt

[jira] [Assigned] (SPARK-31674) Make Prometheus-format metric endpoints experimental

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31674: Assignee: Apache Spark > Make Prometheus-format metric endpoints experimental > -

[jira] [Commented] (SPARK-31674) Make Prometheus-format metric endpoints experimental

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104057#comment-17104057 ] Apache Spark commented on SPARK-31674: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-31674) Make Prometheus-format metric endpoints experimental

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31674: Assignee: (was: Apache Spark) > Make Prometheus-format metric endpoints experimental

[jira] [Commented] (SPARK-31674) Make Prometheus-format metric endpoints experimental

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104056#comment-17104056 ] Apache Spark commented on SPARK-31674: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-31674) Make Prometheus-format metric endpoints experimental

2020-05-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31674: -- Description: Although the new metrics are disabled by default, we had better make it experimen

[jira] [Created] (SPARK-31674) Make Prometheus-format metric endpoints experimental

2020-05-10 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-31674: - Summary: Make Prometheus-format metric endpoints experimental Key: SPARK-31674 URL: https://issues.apache.org/jira/browse/SPARK-31674 Project: Spark Issue

[jira] [Commented] (SPARK-24074) Maven package resolver downloads javadoc instead of jar

2020-05-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104048#comment-17104048 ] Hyukjin Kwon commented on SPARK-24074: -- Feel free to reopen if the issue persists i

[jira] [Commented] (SPARK-31668) Saving and loading HashingTF leads to hash function changed

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104009#comment-17104009 ] Apache Spark commented on SPARK-31668: -- User 'WeichenXu123' has created a pull requ

[jira] [Commented] (SPARK-31620) TreeNodeException: Binding attribute, tree: sum#19L

2020-05-10 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104008#comment-17104008 ] wuyi commented on SPARK-31620: -- I'm working on this now. > TreeNodeException: Binding attr

[jira] [Commented] (SPARK-31338) Spark SQL JDBC Data Source partitioned read : Spark SQL does not honor for NOT NULL table definition of partition key.

2020-05-10 Thread Oleg Kuznetsov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103974#comment-17103974 ] Oleg Kuznetsov commented on SPARK-31338: [~minfa] Could you try to execute it li

[jira] [Assigned] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31456: Assignee: Apache Spark > If shutdownhook is added with priority Integer.MIN_VALUE, it's s

[jira] [Assigned] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31456: Assignee: (was: Apache Spark) > If shutdownhook is added with priority Integer.MIN_VA

[jira] [Commented] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103967#comment-17103967 ] Apache Spark commented on SPARK-31456: -- User 'oleg-smith' has created a pull reques

[jira] [Assigned] (SPARK-31673) Enhance QueryExecution.debugFile to take an additional explain mode parameter.

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31673: Assignee: Apache Spark > Enhance QueryExecution.debugFile to take an additional explain m

[jira] [Commented] (SPARK-31673) Enhance QueryExecution.debugFile to take an additional explain mode parameter.

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103966#comment-17103966 ] Apache Spark commented on SPARK-31673: -- User 'dilipbiswal' has created a pull reque

[jira] [Commented] (SPARK-31673) Enhance QueryExecution.debugFile to take an additional explain mode parameter.

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103965#comment-17103965 ] Apache Spark commented on SPARK-31673: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-31673) Enhance QueryExecution.debugFile to take an additional explain mode parameter.

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31673: Assignee: (was: Apache Spark) > Enhance QueryExecution.debugFile to take an additiona

[jira] [Commented] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

2020-05-10 Thread Oleg Kuznetsov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103962#comment-17103962 ] Oleg Kuznetsov commented on SPARK-31456: I will work on that. > If shutdownhook

[jira] [Created] (SPARK-31673) Enhance QueryExecution.debugFile to take an additional explain mode parameter.

2020-05-10 Thread Dilip Biswal (Jira)
Dilip Biswal created SPARK-31673: Summary: Enhance QueryExecution.debugFile to take an additional explain mode parameter. Key: SPARK-31673 URL: https://issues.apache.org/jira/browse/SPARK-31673 Projec

[jira] [Updated] (SPARK-31669) RowEncoderSuite.encode/decode fails on 1000-02-29

2020-05-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31669: - Component/s: Tests Priority: Minor (was: Major) > RowEncoderSuite.encode/decode fails on

[jira] [Resolved] (SPARK-31669) RowEncoderSuite.encode/decode fails on 1000-02-29

2020-05-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31669. -- Fix Version/s: 3.0.0 Assignee: Maxim Gekk Resolution: Fixed Resolved by https:/

[jira] [Commented] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103917#comment-17103917 ] Apache Spark commented on SPARK-27249: -- User 'nafshartous' has created a pull reque

[jira] [Assigned] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27249: Assignee: Apache Spark > Developers API for Transformers beyond UnaryTransformer > --

[jira] [Commented] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103915#comment-17103915 ] Apache Spark commented on SPARK-27249: -- User 'nafshartous' has created a pull reque

[jira] [Assigned] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27249: Assignee: (was: Apache Spark) > Developers API for Transformers beyond UnaryTransform

[jira] [Resolved] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31636. -- Fix Version/s: 3.0.0 Assignee: Huaxin Gao Resolution: Fixed Resolved by https:

[jira] [Commented] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

2020-05-10 Thread Arseniy Tashoyan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103871#comment-17103871 ] Arseniy Tashoyan commented on SPARK-30267: -- Hi [~Gengliang.Wang], Surprisingly

[jira] [Commented] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103869#comment-17103869 ] Apache Spark commented on SPARK-30267: -- User 'tashoyan' has created a pull request

[jira] [Assigned] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30267: Assignee: Steven Aerts (was: Apache Spark) > avro deserializer: ArrayList cannot be cast

[jira] [Commented] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103870#comment-17103870 ] Apache Spark commented on SPARK-30267: -- User 'tashoyan' has created a pull request

[jira] [Assigned] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30267: Assignee: Apache Spark (was: Steven Aerts) > avro deserializer: ArrayList cannot be cast

[jira] [Resolved] (SPARK-27497) Spark wipes out bucket spec in metastore when updating table stats

2020-05-10 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-27497. --- Fix Version/s: 3.1.0 2.4.6 Resolution: Fixed > Spark wipes out buc

[jira] [Commented] (SPARK-27497) Spark wipes out bucket spec in metastore when updating table stats

2020-05-10 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103860#comment-17103860 ] Bruce Robbins commented on SPARK-27497: --- This is fixed in recent versions of 2.4.x

[jira] [Commented] (SPARK-31670) Using complex type in Aggregation with cube failed Analysis error

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103829#comment-17103829 ] Apache Spark commented on SPARK-31670: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-31670) Using complex type in Aggregation with cube failed Analysis error

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31670: Assignee: Apache Spark > Using complex type in Aggregation with cube failed Analysis erro

[jira] [Assigned] (SPARK-31670) Using complex type in Aggregation with cube failed Analysis error

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31670: Assignee: (was: Apache Spark) > Using complex type in Aggregation with cube failed An

[jira] [Issue Comment Deleted] (SPARK-31561) Add QUALIFY Clause

2020-05-10 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco updated SPARK-31561: --- Comment: was deleted (was: I'm working on this) > Add QUALIFY Clause >

[jira] [Commented] (SPARK-24074) Maven package resolver downloads javadoc instead of jar

2020-05-10 Thread Gur Ronen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103793#comment-17103793 ] Gur Ronen commented on SPARK-24074: --- Hey [~hyukjin.kwon] can confirm this still happen

[jira] [Commented] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103761#comment-17103761 ] Apache Spark commented on SPARK-31672: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31672: Assignee: Apache Spark (was: Maxim Gekk) > Reading wrong timestamps from dictionary enco

[jira] [Assigned] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

2020-05-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31672: Assignee: Maxim Gekk (was: Apache Spark) > Reading wrong timestamps from dictionary enco

[jira] [Updated] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

2020-05-10 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-31672: --- Description: Write dates with dictionary encoding enabled to parquet files: {code:scala} Welcome to

[jira] [Created] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

2020-05-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31672: -- Summary: Reading wrong timestamps from dictionary encoded columns in Parquet files Key: SPARK-31672 URL: https://issues.apache.org/jira/browse/SPARK-31672 Project: Spark