[jira] [Assigned] (SPARK-31674) Make Prometheus-format metric endpoints experimental

[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31674: - Assignee: Dongjoon Hyun > Make Prometheus-format metric endpoints experimental >

[jira] [Resolved] (SPARK-31674) Make Prometheus-format metric endpoints experimental

[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31674. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28495

[jira] [Resolved] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

[ https://issues.apache.org/jira/browse/SPARK-31672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31672. - Resolution: Fixed Issue resolved by pull request 28489

[jira] [Issue Comment Deleted] (SPARK-31622) Test-jar in the Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-31622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Raj Boudh updated SPARK-31622: Comment: was deleted (was: [~hyukjin.kwon] , ok I will check and will update you.) >

[jira] [Commented] (SPARK-31622) Test-jar in the Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-31622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104069#comment-17104069 ] Ankit Raj Boudh commented on SPARK-31622: - [~hyukjin.kwon] , ok I will check and will update

[jira] [Commented] (SPARK-31622) Test-jar in the Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-31622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104068#comment-17104068 ] Ankit Raj Boudh commented on SPARK-31622: - [~hyukjin.kwon] , ok I will check and will update you 

[jira] [Updated] (SPARK-31674) Make Prometheus-format metric endpoints experimental

[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31674: -- Component/s: Documentation > Make Prometheus-format metric endpoints experimental >

[jira] [Issue Comment Deleted] (SPARK-31674) Make Prometheus-format metric endpoints experimental

[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31674: -- Comment: was deleted (was: User 'dongjoon-hyun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31674) Make Prometheus-format metric endpoints experimental

[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31674: Assignee: Apache Spark > Make Prometheus-format metric endpoints experimental >

[jira] [Commented] (SPARK-31674) Make Prometheus-format metric endpoints experimental

[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104057#comment-17104057 ] Apache Spark commented on SPARK-31674: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-31674) Make Prometheus-format metric endpoints experimental

[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31674: Assignee: (was: Apache Spark) > Make Prometheus-format metric endpoints experimental

[jira] [Commented] (SPARK-31674) Make Prometheus-format metric endpoints experimental

[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104056#comment-17104056 ] Apache Spark commented on SPARK-31674: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-31674) Make Prometheus-format metric endpoints experimental

[ https://issues.apache.org/jira/browse/SPARK-31674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31674: -- Description: Although the new metrics are disabled by default, we had better make it

[jira] [Created] (SPARK-31674) Make Prometheus-format metric endpoints experimental

Dongjoon Hyun created SPARK-31674: - Summary: Make Prometheus-format metric endpoints experimental Key: SPARK-31674 URL: https://issues.apache.org/jira/browse/SPARK-31674 Project: Spark Issue

[jira] [Commented] (SPARK-24074) Maven package resolver downloads javadoc instead of jar

[ https://issues.apache.org/jira/browse/SPARK-24074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104048#comment-17104048 ] Hyukjin Kwon commented on SPARK-24074: -- Feel free to reopen if the issue persists in non-EOL

[jira] [Commented] (SPARK-31668) Saving and loading HashingTF leads to hash function changed

[ https://issues.apache.org/jira/browse/SPARK-31668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104009#comment-17104009 ] Apache Spark commented on SPARK-31668: -- User 'WeichenXu123' has created a pull request for this

[jira] [Commented] (SPARK-31620) TreeNodeException: Binding attribute, tree: sum#19L

[ https://issues.apache.org/jira/browse/SPARK-31620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104008#comment-17104008 ] wuyi commented on SPARK-31620: -- I'm working on this now. > TreeNodeException: Binding attribute, tree:

[jira] [Commented] (SPARK-31338) Spark SQL JDBC Data Source partitioned read : Spark SQL does not honor for NOT NULL table definition of partition key.

[ https://issues.apache.org/jira/browse/SPARK-31338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103974#comment-17103974 ] Oleg Kuznetsov commented on SPARK-31338: [~minfa] Could you try to execute it like this and

[jira] [Commented] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103967#comment-17103967 ] Apache Spark commented on SPARK-31456: -- User 'oleg-smith' has created a pull request for this

[jira] [Assigned] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31456: Assignee: Apache Spark > If shutdownhook is added with priority Integer.MIN_VALUE, it's

[jira] [Assigned] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31456: Assignee: (was: Apache Spark) > If shutdownhook is added with priority

[jira] [Assigned] (SPARK-31673) Enhance QueryExecution.debugFile to take an additional explain mode parameter.

[ https://issues.apache.org/jira/browse/SPARK-31673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31673: Assignee: Apache Spark > Enhance QueryExecution.debugFile to take an additional explain

[jira] [Commented] (SPARK-31673) Enhance QueryExecution.debugFile to take an additional explain mode parameter.

[ https://issues.apache.org/jira/browse/SPARK-31673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103966#comment-17103966 ] Apache Spark commented on SPARK-31673: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-31673) Enhance QueryExecution.debugFile to take an additional explain mode parameter.

[ https://issues.apache.org/jira/browse/SPARK-31673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31673: Assignee: (was: Apache Spark) > Enhance QueryExecution.debugFile to take an

[jira] [Commented] (SPARK-31673) Enhance QueryExecution.debugFile to take an additional explain mode parameter.

[ https://issues.apache.org/jira/browse/SPARK-31673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103965#comment-17103965 ] Apache Spark commented on SPARK-31673: -- User 'dilipbiswal' has created a pull request for this

[jira] [Commented] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103962#comment-17103962 ] Oleg Kuznetsov commented on SPARK-31456: I will work on that. > If shutdownhook is added with

[jira] [Created] (SPARK-31673) Enhance QueryExecution.debugFile to take an additional explain mode parameter.

Dilip Biswal created SPARK-31673: Summary: Enhance QueryExecution.debugFile to take an additional explain mode parameter. Key: SPARK-31673 URL: https://issues.apache.org/jira/browse/SPARK-31673

[jira] [Updated] (SPARK-31669) RowEncoderSuite.encode/decode fails on 1000-02-29

[ https://issues.apache.org/jira/browse/SPARK-31669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31669: - Component/s: Tests Priority: Minor (was: Major) > RowEncoderSuite.encode/decode fails on

[jira] [Resolved] (SPARK-31669) RowEncoderSuite.encode/decode fails on 1000-02-29

[ https://issues.apache.org/jira/browse/SPARK-31669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31669. -- Fix Version/s: 3.0.0 Assignee: Maxim Gekk Resolution: Fixed Resolved by

[jira] [Commented] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103917#comment-17103917 ] Apache Spark commented on SPARK-27249: -- User 'nafshartous' has created a pull request for this

[jira] [Assigned] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27249: Assignee: Apache Spark > Developers API for Transformers beyond UnaryTransformer >

[jira] [Commented] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103915#comment-17103915 ] Apache Spark commented on SPARK-27249: -- User 'nafshartous' has created a pull request for this

[jira] [Assigned] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27249: Assignee: (was: Apache Spark) > Developers API for Transformers beyond

[jira] [Resolved] (SPARK-31636) Remove HTML syntax in SQL reference

[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31636. -- Fix Version/s: 3.0.0 Assignee: Huaxin Gao Resolution: Fixed Resolved by

[jira] [Commented] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103871#comment-17103871 ] Arseniy Tashoyan commented on SPARK-30267: -- Hi [~Gengliang.Wang], Surprisingly, my tests run

[jira] [Commented] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103869#comment-17103869 ] Apache Spark commented on SPARK-30267: -- User 'tashoyan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30267: Assignee: Steven Aerts (was: Apache Spark) > avro deserializer: ArrayList cannot be

[jira] [Commented] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103870#comment-17103870 ] Apache Spark commented on SPARK-30267: -- User 'tashoyan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

[ https://issues.apache.org/jira/browse/SPARK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30267: Assignee: Apache Spark (was: Steven Aerts) > avro deserializer: ArrayList cannot be

[jira] [Resolved] (SPARK-27497) Spark wipes out bucket spec in metastore when updating table stats

[ https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-27497. --- Fix Version/s: 3.1.0 2.4.6 Resolution: Fixed > Spark wipes out

[jira] [Commented] (SPARK-27497) Spark wipes out bucket spec in metastore when updating table stats

[ https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103860#comment-17103860 ] Bruce Robbins commented on SPARK-27497: --- This is fixed in recent versions of 2.4.x and 3.x.

[jira] [Commented] (SPARK-31670) Using complex type in Aggregation with cube failed Analysis error

[ https://issues.apache.org/jira/browse/SPARK-31670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103829#comment-17103829 ] Apache Spark commented on SPARK-31670: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-31670) Using complex type in Aggregation with cube failed Analysis error

[ https://issues.apache.org/jira/browse/SPARK-31670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31670: Assignee: Apache Spark > Using complex type in Aggregation with cube failed Analysis

[jira] [Assigned] (SPARK-31670) Using complex type in Aggregation with cube failed Analysis error

[ https://issues.apache.org/jira/browse/SPARK-31670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31670: Assignee: (was: Apache Spark) > Using complex type in Aggregation with cube failed

[jira] [Issue Comment Deleted] (SPARK-31561) Add QUALIFY Clause

[ https://issues.apache.org/jira/browse/SPARK-31561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco updated SPARK-31561: --- Comment: was deleted (was: I'm working on this) > Add QUALIFY Clause >

[jira] [Commented] (SPARK-24074) Maven package resolver downloads javadoc instead of jar

[ https://issues.apache.org/jira/browse/SPARK-24074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103793#comment-17103793 ] Gur Ronen commented on SPARK-24074: --- Hey [~hyukjin.kwon] can confirm this still happens with Spark

[jira] [Assigned] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

[ https://issues.apache.org/jira/browse/SPARK-31672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31672: Assignee: Apache Spark (was: Maxim Gekk) > Reading wrong timestamps from dictionary

[jira] [Commented] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

[ https://issues.apache.org/jira/browse/SPARK-31672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103761#comment-17103761 ] Apache Spark commented on SPARK-31672: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

[ https://issues.apache.org/jira/browse/SPARK-31672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31672: Assignee: Maxim Gekk (was: Apache Spark) > Reading wrong timestamps from dictionary

[jira] [Updated] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

[ https://issues.apache.org/jira/browse/SPARK-31672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-31672: --- Description: Write dates with dictionary encoding enabled to parquet files: {code:scala} Welcome to

[jira] [Created] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

Maxim Gekk created SPARK-31672: -- Summary: Reading wrong timestamps from dictionary encoded columns in Parquet files Key: SPARK-31672 URL: https://issues.apache.org/jira/browse/SPARK-31672 Project: Spark

[jira] [Resolved] (SPARK-31629) "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save" in pyspark 2.3.1

[ https://issues.apache.org/jira/browse/SPARK-31629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31629. -- Resolution: Invalid > "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save"

[jira] [Commented] (SPARK-31629) "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save" in pyspark 2.3.1

[ https://issues.apache.org/jira/browse/SPARK-31629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103672#comment-17103672 ] Hyukjin Kwon commented on SPARK-31629: -- {code} py4j.protocol.Py4JJavaError: An error occurred while

[jira] [Updated] (SPARK-31629) "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save" in pyspark 2.3.1

[ https://issues.apache.org/jira/browse/SPARK-31629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31629: - Target Version/s: (was: 2.3.1) > "py4j.protocol.Py4JJavaError: An error occurred while

[jira] [Updated] (SPARK-31629) "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save" in pyspark 2.3.1

[ https://issues.apache.org/jira/browse/SPARK-31629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31629: - Fix Version/s: (was: 1.4.1) (was: 1.5.0) >

[jira] [Updated] (SPARK-31629) "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save" in pyspark 2.3.1

[ https://issues.apache.org/jira/browse/SPARK-31629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31629: - Priority: Major (was: Critical) > "py4j.protocol.Py4JJavaError: An error occurred while

[jira] [Resolved] (SPARK-31648) Filtering is supported only on partition keys of type string Issue

[ https://issues.apache.org/jira/browse/SPARK-31648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31648. -- Resolution: Cannot Reproduce > Filtering is supported only on partition keys of type string

[jira] [Resolved] (SPARK-31654) sequence producing inconsistent intervals for month step

[ https://issues.apache.org/jira/browse/SPARK-31654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31654. -- Resolution: Cannot Reproduce > sequence producing inconsistent intervals for month step >

[jira] [Commented] (SPARK-31657) CSV Writer writes no header for empty DataFrames

[ https://issues.apache.org/jira/browse/SPARK-31657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103670#comment-17103670 ] Hyukjin Kwon commented on SPARK-31657: -- That's already fixed in the master: {code] >>> df1 =

[jira] [Comment Edited] (SPARK-31657) CSV Writer writes no header for empty DataFrames

[ https://issues.apache.org/jira/browse/SPARK-31657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103670#comment-17103670 ] Hyukjin Kwon edited comment on SPARK-31657 at 5/10/20, 6:16 AM: That's

[jira] [Resolved] (SPARK-31657) CSV Writer writes no header for empty DataFrames

[ https://issues.apache.org/jira/browse/SPARK-31657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31657. -- Resolution: Duplicate > CSV Writer writes no header for empty DataFrames >

[jira] [Resolved] (SPARK-31660) Dataset.joinWith supports JoinType object as input parameter

[ https://issues.apache.org/jira/browse/SPARK-31660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31660. -- Resolution: Duplicate I think SPARK-26739 includes this. > Dataset.joinWith supports