[jira] [Updated] (SPARK-27266) Support ANALYZE TABLE to collect tables stats for cached catalog views

[ https://issues.apache.org/jira/browse/SPARK-27266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-27266: - Description: The master doesn't support ANALYZE TABLE to collect tables stats for

[jira] [Created] (SPARK-27266) Support ANALYZE TABLE to collect tables stats for cached catalog views

Takeshi Yamamuro created SPARK-27266: Summary: Support ANALYZE TABLE to collect tables stats for cached catalog views Key: SPARK-27266 URL: https://issues.apache.org/jira/browse/SPARK-27266

[jira] [Updated] (SPARK-26854) Support ANY/SOME subquery

[ https://issues.apache.org/jira/browse/SPARK-26854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26854: -- Priority: Major (was: Minor) > Support ANY/SOME subquery > - > >

[jira] [Resolved] (SPARK-27261) Spark submit passing multiple configurations not documented clearly

[ https://issues.apache.org/jira/browse/SPARK-27261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27261. --- Resolution: Fixed Assignee: Sujith Chacko Fix Version/s: 3.0.0 This is

[jira] [Resolved] (SPARK-27219) Misleading exceptions in transport code's SASL fallback path

[ https://issues.apache.org/jira/browse/SPARK-27219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27219. --- Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 3.0.0 This is

[jira] [Updated] (SPARK-27265) Provide convenience accessors for values by Column Name

[ https://issues.apache.org/jira/browse/SPARK-27265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Reynolds updated SPARK-27265: - Description: There are convenient methods for accessing SQL primitive values by column

[jira] [Commented] (SPARK-27265) Provide convenience accessors for values by Column Name

[ https://issues.apache.org/jira/browse/SPARK-27265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800389#comment-16800389 ] Michael Reynolds commented on SPARK-27265: -- PR is here

[jira] [Created] (SPARK-27265) Provide convenience accessors for values by Column Name

Michael Reynolds created SPARK-27265: Summary: Provide convenience accessors for values by Column Name Key: SPARK-27265 URL: https://issues.apache.org/jira/browse/SPARK-27265 Project: Spark

[jira] [Commented] (SPARK-27204) First time Loading application page from History Server is taking time when event log size is huge

[ https://issues.apache.org/jira/browse/SPARK-27204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800384#comment-16800384 ] ABHISHEK KUMAR GUPTA commented on SPARK-27204: -- Even we enable spark.history.store.path

[jira] [Updated] (SPARK-27256) If the configuration is used to set the number of bytes, we'd better use `bytesConf`'.

[ https://issues.apache.org/jira/browse/SPARK-27256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-27256: Description: Currently, if we want to configure `spark. sql. files. maxPartitionBytes` to 256 megabytes,

[jira] [Commented] (SPARK-25464) Dropping database can remove the hive warehouse directory contents

[ https://issues.apache.org/jira/browse/SPARK-25464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800365#comment-16800365 ] Nikhil Lakshman commented on SPARK-25464: - Hi Was there a fix done for this ? This happened to

[jira] [Commented] (SPARK-27264) spark sql released all executor but the job is not done

[ https://issues.apache.org/jira/browse/SPARK-27264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800357#comment-16800357 ] Mike Chan commented on SPARK-27264: --- [~ajithshetty] Would you mind providing some references for

[jira] [Updated] (SPARK-27262) Add explicit UTF-8 Encoding to DESCRIPTION

[ https://issues.apache.org/jira/browse/SPARK-27262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27262: - Fix Version/s: (was: 3.0.0) > Add explicit UTF-8 Encoding to DESCRIPTION >

[jira] [Commented] (SPARK-27262) Add explicit UTF-8 Encoding to DESCRIPTION

[ https://issues.apache.org/jira/browse/SPARK-27262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800356#comment-16800356 ] Hyukjin Kwon commented on SPARK-27262: -- Reverted - this JIRA is blocked by SPARK-27177 > Add

[jira] [Reopened] (SPARK-27262) Add explicit UTF-8 Encoding to DESCRIPTION

[ https://issues.apache.org/jira/browse/SPARK-27262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-27262: -- > Add explicit UTF-8 Encoding to DESCRIPTION > -- > >

[jira] [Commented] (SPARK-27264) spark sql released all executor but the job is not done

[ https://issues.apache.org/jira/browse/SPARK-27264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800351#comment-16800351 ] Yuming Wang commented on SPARK-27264: - Data skew? > spark sql released all executor but the job is

[jira] [Commented] (SPARK-27248) REFRESH TABLE should recreate cache with same cache name and storage level

[ https://issues.apache.org/jira/browse/SPARK-27248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800349#comment-16800349 ] Hyukjin Kwon commented on SPARK-27248: -- [~william1104], did you make a PR? I think I saw but looks

[jira] [Updated] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27249: - Affects Version/s: (was: 2.5.0) 3.0.0 > Developers API for

[jira] [Commented] (SPARK-27234) Continuous Streaming does not support python UDFs

[ https://issues.apache.org/jira/browse/SPARK-27234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800345#comment-16800345 ] Hyukjin Kwon commented on SPARK-27234: -- ping [~mhamilton] > Continuous Streaming does not support

[jira] [Updated] (SPARK-27259) Processing Compressed HDFS files with spark failing with error: "java.lang.IllegalArgumentException: requirement failed: length (-1) cannot be negative" from spark 2.2.X

[ https://issues.apache.org/jira/browse/SPARK-27259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27259: - Summary: Processing Compressed HDFS files with spark failing with error:

[jira] [Resolved] (SPARK-27239) Processing Compressed HDFS files with spark failing with error: "java.lang.IllegalArgumentException: requirement failed: length (-1) cannot be negative" from spark 2.2.

[ https://issues.apache.org/jira/browse/SPARK-27239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27239. -- Resolution: Duplicate > Processing Compressed HDFS files with spark failing with error: >

[jira] [Commented] (SPARK-27259) CLONE - Processing Compressed HDFS files with spark failing with error: "java.lang.IllegalArgumentException: requirement failed: length (-1) cannot be negative" from s

[ https://issues.apache.org/jira/browse/SPARK-27259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800341#comment-16800341 ] Hyukjin Kwon commented on SPARK-27259: -- Please avoid to set Ciritical+ which is usually reserved

[jira] [Updated] (SPARK-27259) CLONE - Processing Compressed HDFS files with spark failing with error: "java.lang.IllegalArgumentException: requirement failed: length (-1) cannot be negative" from spa

[ https://issues.apache.org/jira/browse/SPARK-27259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27259: - Priority: Major (was: Blocker) > CLONE - Processing Compressed HDFS files with spark failing

[jira] [Resolved] (SPARK-27233) Schema of ArrayType change after saveAsTable and read

[ https://issues.apache.org/jira/browse/SPARK-27233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27233. -- Resolution: Duplicate > Schema of ArrayType change after saveAsTable and read >

[jira] [Commented] (SPARK-27258) The value of "spark.app.name" or "--name" starts with number , which causes resourceName does not match regular expression

[ https://issues.apache.org/jira/browse/SPARK-27258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800340#comment-16800340 ] hehuiyuan commented on SPARK-27258: --- Thanks! > The value of "spark.app.name" or "--name" starts with

[jira] [Commented] (SPARK-27233) Schema of ArrayType change after saveAsTable and read

[ https://issues.apache.org/jira/browse/SPARK-27233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800336#comment-16800336 ] Hyukjin Kwon commented on SPARK-27233: -- Expected behaivour of asNullable is to return a type that

[jira] [Closed] (SPARK-27257) The value of "spark.app.name" or "--name" starts with number , which causes resourceName does not match regular expression

[ https://issues.apache.org/jira/browse/SPARK-27257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hehuiyuan closed SPARK-27257. - duplicated > The value of "spark.app.name" or "--name" starts with number , which causes > resourceName

[jira] [Commented] (SPARK-27228) Spark long delay on close, possible problem with killing executors

[ https://issues.apache.org/jira/browse/SPARK-27228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800330#comment-16800330 ] Hyukjin Kwon commented on SPARK-27228: -- How did you reproduce this problem, including the codes to

[jira] [Commented] (SPARK-27258) The value of "spark.app.name" or "--name" starts with number , which causes resourceName does not match regular expression

[ https://issues.apache.org/jira/browse/SPARK-27258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800325#comment-16800325 ] Hyukjin Kwon commented on SPARK-27258: -- Please avoid to set a fix version which is set when it's

[jira] [Resolved] (SPARK-27257) The value of "spark.app.name" or "--name" starts with number , which causes resourceName does not match regular expression

[ https://issues.apache.org/jira/browse/SPARK-27257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27257. -- Resolution: Duplicate Fix Version/s: (was: 3.0.0) > The value of "spark.app.name"

[jira] [Updated] (SPARK-27258) The value of "spark.app.name" or "--name" starts with number , which causes resourceName does not match regular expression

[ https://issues.apache.org/jira/browse/SPARK-27258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27258: - Fix Version/s: (was: 3.0.0) > The value of "spark.app.name" or "--name" starts with number

[jira] [Resolved] (SPARK-27260) Upgrade to Kafka 2.2.0

[ https://issues.apache.org/jira/browse/SPARK-27260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27260. -- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0 > Upgrade to

[jira] [Commented] (SPARK-27260) Upgrade to Kafka 2.2.0

[ https://issues.apache.org/jira/browse/SPARK-27260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800324#comment-16800324 ] Hyukjin Kwon commented on SPARK-27260: -- Fixed in https://github.com/apache/spark/pull/24190 >

[jira] [Commented] (SPARK-27264) spark sql released all executor but the job is not done

[ https://issues.apache.org/jira/browse/SPARK-27264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800323#comment-16800323 ] Ajith S commented on SPARK-27264: - Can you add a snippet to reproduce this.? > spark sql released all

[jira] [Updated] (SPARK-27263) [HistoryServer]The "Hadoop Properties" in Environment page is coming empty for older version of event logs

[ https://issues.apache.org/jira/browse/SPARK-27263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27263: -- Issue Type: Improvement (was: Bug) > [HistoryServer]The "Hadoop Properties" in Environment

[jira] [Updated] (SPARK-27263) Hide `Hadoop Properties` table in Environment page if it's empty

[ https://issues.apache.org/jira/browse/SPARK-27263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27263: -- Summary: Hide `Hadoop Properties` table in Environment page if it's empty (was:

[jira] [Commented] (SPARK-25212) Support Filter in ConvertToLocalRelation

[ https://issues.apache.org/jira/browse/SPARK-25212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800201#comment-16800201 ] Jose Sanchez commented on SPARK-25212: -- The issue here is that when catalyst runs the *Operator

[jira] [Resolved] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards

[ https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24935. - Resolution: Fixed Assignee: Parth Gandhi Fix Version/s: 3.0.0 2.4.1

[jira] [Comment Edited] (SPARK-27255) Aggregate functions should not be allowed in WHERE

[ https://issues.apache.org/jira/browse/SPARK-27255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800130#comment-16800130 ] Dilip Biswal edited comment on SPARK-27255 at 3/24/19 5:53 PM: ---

[jira] [Comment Edited] (SPARK-27255) Aggregate functions should not be allowed in WHERE

[ https://issues.apache.org/jira/browse/SPARK-27255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800130#comment-16800130 ] Dilip Biswal edited comment on SPARK-27255 at 3/24/19 5:53 PM: ---

[jira] [Commented] (SPARK-27255) Aggregate functions should not be allowed in WHERE

[ https://issues.apache.org/jira/browse/SPARK-27255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800130#comment-16800130 ] Dilip Biswal commented on SPARK-27255: -- [~chakravarthi] Hello, I had started working on this and

[jira] [Updated] (SPARK-27264) spark sql released all executor but the job is not done

[ https://issues.apache.org/jira/browse/SPARK-27264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Chan updated SPARK-27264: -- Environment: Azure HDinsight spark 2.4 on Azure storage SQL: Read and Join some data and finally

[jira] [Created] (SPARK-27264) spark sql released all executor but the job is not done

Mike Chan created SPARK-27264: - Summary: spark sql released all executor but the job is not done Key: SPARK-27264 URL: https://issues.apache.org/jira/browse/SPARK-27264 Project: Spark Issue

[jira] [Resolved] (SPARK-27250) Scala 2.11 maven compile should target Java 1.8

[ https://issues.apache.org/jira/browse/SPARK-27250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27250. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24184

[jira] [Commented] (SPARK-27263) [HistoryServer]The "Hadoop Properties" in Environment page is coming empty for older version of event logs

[ https://issues.apache.org/jira/browse/SPARK-27263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1687#comment-1687 ] Shivu Sondur commented on SPARK-27263: -- i am checking this issue > [HistoryServer]The "Hadoop

[jira] [Commented] (SPARK-27263) [HistoryServer]The "Hadoop Properties" in Environment page is coming empty for older version of event logs

[ https://issues.apache.org/jira/browse/SPARK-27263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1685#comment-1685 ] ABHISHEK KUMAR GUPTA commented on SPARK-27263: -- i am checking this issue >

[jira] [Issue Comment Deleted] (SPARK-27263) [HistoryServer]The "Hadoop Properties" in Environment page is coming empty for older version of event logs

[ https://issues.apache.org/jira/browse/SPARK-27263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-27263: - Comment: was deleted (was: i am checking this issue) > [HistoryServer]The

[jira] [Created] (SPARK-27263) [HistoryServer]The "Hadoop Properties" in Environment page is coming empty for older version of event logs

ABHISHEK KUMAR GUPTA created SPARK-27263: Summary: [HistoryServer]The "Hadoop Properties" in Environment page is coming empty for older version of event logs Key: SPARK-27263 URL:

[jira] [Assigned] (SPARK-27250) Scala 2.11 maven compile should target Java 1.8

[ https://issues.apache.org/jira/browse/SPARK-27250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-27250: - Assignee: John Zhuge > Scala 2.11 maven compile should target Java 1.8 >

[jira] [Resolved] (SPARK-27241) Add map_keys and map_values support to SelectedField in nested schema pruning

[ https://issues.apache.org/jira/browse/SPARK-27241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27241. --- Resolution: Fixed Fix Version/s: 3.0.0 This is resolved via

[jira] [Assigned] (SPARK-27241) Add map_keys and map_values support to SelectedField in nested schema pruning

[ https://issues.apache.org/jira/browse/SPARK-27241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-27241: - Assignee: Liang-Chi Hsieh > Add map_keys and map_values support to SelectedField in