[jira] [Assigned] (SPARK-23830) Spark on YARN in cluster deploy mode fail with NullPointerException when a Spark application is a Scala class not object

2018-04-27 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-23830: --- Assignee: Eric Maynard > Spark on YARN in cluster deploy mode fail with

[jira] [Resolved] (SPARK-23830) Spark on YARN in cluster deploy mode fail with NullPointerException when a Spark application is a Scala class not object

2018-04-27 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-23830. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21168

[jira] [Comment Edited] (SPARK-24086) Exception while executing spark streaming examples

2018-04-27 Thread Chandra Hasan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456003#comment-16456003 ] Chandra Hasan edited comment on SPARK-24086 at 4/27/18 6:47 AM:

[jira] [Comment Edited] (SPARK-24086) Exception while executing spark streaming examples

2018-04-27 Thread Chandra Hasan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456003#comment-16456003 ] Chandra Hasan edited comment on SPARK-24086 at 4/27/18 6:46 AM:

[jira] [Closed] (SPARK-24086) Exception while executing spark streaming examples

2018-04-27 Thread Chandra Hasan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandra Hasan closed SPARK-24086. - After adding necessary dependencies, its working fine > Exception while executing spark streaming

[jira] [Updated] (SPARK-21337) SQL which has large ‘case when’ expressions may cause code generation beyond 64KB

2018-04-27 Thread fengchaoge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-21337: --- Attachment: (was: t1.zip) > SQL which has large ‘case when’ expressions may cause code

[jira] [Updated] (SPARK-21337) SQL which has large ‘case when’ expressions may cause code generation beyond 64KB

2018-04-27 Thread fengchaoge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-21337: --- Attachment: t1.zip > SQL which has large ‘case when’ expressions may cause code generation beyond >

[jira] [Comment Edited] (SPARK-24086) Exception while executing spark streaming examples

2018-04-27 Thread Chandra Hasan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456003#comment-16456003 ] Chandra Hasan edited comment on SPARK-24086 at 4/27/18 6:47 AM:

[jira] [Created] (SPARK-24110) Avoid calling UGI loginUserFromKeytab in ThriftServer

2018-04-27 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-24110: --- Summary: Avoid calling UGI loginUserFromKeytab in ThriftServer Key: SPARK-24110 URL: https://issues.apache.org/jira/browse/SPARK-24110 Project: Spark Issue

[jira] [Created] (SPARK-24111) Add TPCDS v2.7 (latest) queries in TPCDSQueryBenchmark

2018-04-27 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-24111: Summary: Add TPCDS v2.7 (latest) queries in TPCDSQueryBenchmark Key: SPARK-24111 URL: https://issues.apache.org/jira/browse/SPARK-24111 Project: Spark

[jira] [Commented] (SPARK-24110) Avoid calling UGI loginUserFromKeytab in ThriftServer

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456076#comment-16456076 ] Apache Spark commented on SPARK-24110: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24110) Avoid calling UGI loginUserFromKeytab in ThriftServer

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24110: Assignee: (was: Apache Spark) > Avoid calling UGI loginUserFromKeytab in ThriftServer

[jira] [Assigned] (SPARK-24110) Avoid calling UGI loginUserFromKeytab in ThriftServer

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24110: Assignee: Apache Spark > Avoid calling UGI loginUserFromKeytab in ThriftServer >

[jira] [Commented] (SPARK-24086) Exception while executing spark streaming examples

2018-04-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456127#comment-16456127 ] Hyukjin Kwon commented on SPARK-24086: -- Yup, providing details is helpful to the community. If

[jira] [Assigned] (SPARK-24111) Add TPCDS v2.7 (latest) queries in TPCDSQueryBenchmark

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24111: Assignee: (was: Apache Spark) > Add TPCDS v2.7 (latest) queries in

[jira] [Commented] (SPARK-24111) Add TPCDS v2.7 (latest) queries in TPCDSQueryBenchmark

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456033#comment-16456033 ] Apache Spark commented on SPARK-24111: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24111) Add TPCDS v2.7 (latest) queries in TPCDSQueryBenchmark

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24111: Assignee: Apache Spark > Add TPCDS v2.7 (latest) queries in TPCDSQueryBenchmark >

[jira] [Commented] (SPARK-23897) Guava version

2018-04-27 Thread aze (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456143#comment-16456143 ] aze commented on SPARK-23897: - So how are you going to deal with this:

[jira] [Commented] (SPARK-24089) DataFrame.write().mode(SaveMode.Append).insertInto(TABLE)

2018-04-27 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456230#comment-16456230 ] Marco Gaido commented on SPARK-24089: - [~rkrgarlapati] the problem is that you are not inserting to

[jira] [Commented] (SPARK-23935) High-order function: map_entries(map<K, V>) → array<row<K,V>>

2018-04-27 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456274#comment-16456274 ] Marek Novotny commented on SPARK-23935: --- I will work on this one. Thanks. > High-order function:

[jira] [Comment Edited] (SPARK-24089) DataFrame.write().mode(SaveMode.Append).insertInto(TABLE)

2018-04-27 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456230#comment-16456230 ] Marco Gaido edited comment on SPARK-24089 at 4/27/18 11:01 AM: ---

[jira] [Commented] (SPARK-23934) High-order function: map_from_entries(array<row<K, V>>) → map<K,V>

2018-04-27 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456272#comment-16456272 ] Marek Novotny commented on SPARK-23934: --- I will work on this one. Thanks. > High-order function:

[jira] [Commented] (SPARK-24092) spark.python.worker.reuse does not work?

2018-04-27 Thread David Figueroa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456464#comment-16456464 ] David Figueroa commented on SPARK-24092: still no answer from community 

[jira] [Updated] (SPARK-22210) Online LDA variationalTopicInference should use random seed to have stable behavior

2018-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22210: -- Shepherd: Joseph K. Bradley > Online LDA variationalTopicInference should use random

[jira] [Assigned] (SPARK-22210) Online LDA variationalTopicInference should use random seed to have stable behavior

2018-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-22210: - Assignee: Lu Wang > Online LDA variationalTopicInference should use random

[jira] [Updated] (SPARK-24113) --archives hdfs://some/path.zip#newname renaming no longer works

2018-04-27 Thread Peter Parente (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Parente updated SPARK-24113: -- Description: In spark < 2.3.0, using #NAME as part of an archive name results in a symlink of 

[jira] [Created] (SPARK-24113) --archives hdfs://some/path.zip#newname renaming no longer works

2018-04-27 Thread Peter Parente (JIRA)
Peter Parente created SPARK-24113: - Summary: --archives hdfs://some/path.zip#newname renaming no longer works Key: SPARK-24113 URL: https://issues.apache.org/jira/browse/SPARK-24113 Project: Spark

[jira] [Created] (SPARK-24112) Add `spark.sql.hive.convertMetastoreTableProperty` for backward compatiblility

2018-04-27 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-24112: - Summary: Add `spark.sql.hive.convertMetastoreTableProperty` for backward compatiblility Key: SPARK-24112 URL: https://issues.apache.org/jira/browse/SPARK-24112

[jira] [Updated] (SPARK-24085) Scalar subquery error

2018-04-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24085: Fix Version/s: 2.4.0 > Scalar subquery error > - > > Key: SPARK-24085

[jira] [Resolved] (SPARK-24085) Scalar subquery error

2018-04-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24085. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.3.1 > Scalar subquery error >

[jira] [Assigned] (SPARK-24051) Incorrect results for certain queries using Java and Python APIs on Spark 2.3.0

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24051: Assignee: Apache Spark > Incorrect results for certain queries using Java and Python APIs

[jira] [Assigned] (SPARK-24051) Incorrect results for certain queries using Java and Python APIs on Spark 2.3.0

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24051: Assignee: (was: Apache Spark) > Incorrect results for certain queries using Java and

[jira] [Commented] (SPARK-24051) Incorrect results for certain queries using Java and Python APIs on Spark 2.3.0

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456862#comment-16456862 ] Apache Spark commented on SPARK-24051: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Commented] (SPARK-24113) --archives hdfs://some/path.zip#newname renaming no longer works

2018-04-27 Thread Peter Parente (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456897#comment-16456897 ] Peter Parente commented on SPARK-24113: --- Thanks for the crosslink [~vanzin]. I searched but

[jira] [Resolved] (SPARK-24113) --archives hdfs://some/path.zip#newname renaming no longer works

2018-04-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24113. Resolution: Duplicate > --archives hdfs://some/path.zip#newname renaming no longer works >

[jira] [Commented] (SPARK-23894) Flaky Test: BucketedWriteWithoutHiveSupportSuite

2018-04-27 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456919#comment-16456919 ] Imran Rashid commented on SPARK-23894: -- One thing I've noticed from looking at more instances of

[jira] [Commented] (SPARK-24112) Add `spark.sql.hive.convertMetastoreTableProperty` for backward compatiblility

2018-04-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456927#comment-16456927 ] Dongjoon Hyun commented on SPARK-24112: --- I'll make a PR for this and SPARK-22279 together. > Add

[jira] [Commented] (SPARK-23894) Flaky Test: BucketedWriteWithoutHiveSupportSuite

2018-04-27 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456969#comment-16456969 ] Imran Rashid commented on SPARK-23894: -- I think I understand what is happening here, but I don't

[jira] [Assigned] (SPARK-23894) Flaky Test: BucketedWriteWithoutHiveSupportSuite

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23894: Assignee: Apache Spark > Flaky Test: BucketedWriteWithoutHiveSupportSuite >

[jira] [Assigned] (SPARK-23894) Flaky Test: BucketedWriteWithoutHiveSupportSuite

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23894: Assignee: (was: Apache Spark) > Flaky Test: BucketedWriteWithoutHiveSupportSuite >

[jira] [Commented] (SPARK-23894) Flaky Test: BucketedWriteWithoutHiveSupportSuite

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456984#comment-16456984 ] Apache Spark commented on SPARK-23894: -- User 'squito' has created a pull request for this issue:

[jira] [Resolved] (SPARK-23565) Improved error message for when the number of sources for a query changes

2018-04-27 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-23565. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20946

[jira] [Assigned] (SPARK-22210) Online LDA variationalTopicInference should use random seed to have stable behavior

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22210: Assignee: Apache Spark > Online LDA variationalTopicInference should use random seed to

[jira] [Commented] (SPARK-22210) Online LDA variationalTopicInference should use random seed to have stable behavior

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456756#comment-16456756 ] Apache Spark commented on SPARK-22210: -- User 'ludatabricks' has created a pull request for this

[jira] [Assigned] (SPARK-22210) Online LDA variationalTopicInference should use random seed to have stable behavior

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22210: Assignee: (was: Apache Spark) > Online LDA variationalTopicInference should use

[jira] [Assigned] (SPARK-24068) CSV schema inferring doesn't work for compressed files

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24068: Assignee: Apache Spark > CSV schema inferring doesn't work for compressed files >

[jira] [Commented] (SPARK-24068) CSV schema inferring doesn't work for compressed files

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456654#comment-16456654 ] Apache Spark commented on SPARK-24068: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23565) Improved error message for when the number of sources for a query changes

2018-04-27 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-23565: Assignee: Patrick McGloin > Improved error message for when the number of sources for a

[jira] [Commented] (SPARK-22674) PySpark breaks serialization of namedtuple subclasses

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456551#comment-16456551 ] Apache Spark commented on SPARK-22674: -- User 'superbobry' has created a pull request for this issue:

[jira] [Commented] (SPARK-23736) High-order function: concat(array1, array2, ..., arrayN) → array

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456642#comment-16456642 ] Apache Spark commented on SPARK-23736: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24068) CSV schema inferring doesn't work for compressed files

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24068: Assignee: (was: Apache Spark) > CSV schema inferring doesn't work for compressed

[jira] [Updated] (SPARK-24109) Remove class SnappyOutputStreamWrapper

2018-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24109: -- Target Version/s: 3.0.0 Fix Version/s: (was: 2.4.0) > Remove class

[jira] [Commented] (SPARK-23894) Flaky Test: BucketedWriteWithoutHiveSupportSuite

2018-04-27 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16457003#comment-16457003 ] Imran Rashid commented on SPARK-23894: -- I believe this issue has existed since SPARK-10810 /

[jira] [Assigned] (SPARK-24112) Add `spark.sql.hive.convertMetastoreTableProperty` for backward compatiblility

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24112: Assignee: (was: Apache Spark) > Add `spark.sql.hive.convertMetastoreTableProperty`

[jira] [Assigned] (SPARK-24112) Add `spark.sql.hive.convertMetastoreTableProperty` for backward compatiblility

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24112: Assignee: Apache Spark > Add `spark.sql.hive.convertMetastoreTableProperty` for backward

[jira] [Created] (SPARK-24114) improve instrumentation for spark.ml.recommendation

2018-04-27 Thread yogesh garg (JIRA)
yogesh garg created SPARK-24114: --- Summary: improve instrumentation for spark.ml.recommendation Key: SPARK-24114 URL: https://issues.apache.org/jira/browse/SPARK-24114 Project: Spark Issue

[jira] [Commented] (SPARK-24114) improve instrumentation for spark.ml.recommendation

2018-04-27 Thread yogesh garg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16457110#comment-16457110 ] yogesh garg commented on SPARK-24114: - I would like to work on this. > improve instrumentation for

[jira] [Resolved] (SPARK-24104) SQLAppStatusListener overwrites metrics onDriverAccumUpdates instead of updating them

2018-04-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24104. Resolution: Fixed Fix Version/s: 2.3.1 2.4.0 Issue resolved by

[jira] [Assigned] (SPARK-24104) SQLAppStatusListener overwrites metrics onDriverAccumUpdates instead of updating them

2018-04-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24104: -- Assignee: Juliusz Sompolski > SQLAppStatusListener overwrites metrics

[jira] [Commented] (SPARK-24115) improve instrumentation for spark.ml.tuning

2018-04-27 Thread yogesh garg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16457113#comment-16457113 ] yogesh garg commented on SPARK-24115: - I would like to work on this. > improve instrumentation for

[jira] [Commented] (SPARK-22279) Turn on spark.sql.hive.convertMetastoreOrc by default

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16457079#comment-16457079 ] Apache Spark commented on SPARK-22279: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-24112) Add `spark.sql.hive.convertMetastoreTableProperty` for backward compatiblility

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16457080#comment-16457080 ] Apache Spark commented on SPARK-24112: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-24115) improve instrumentation for spark.ml.tuning

2018-04-27 Thread yogesh garg (JIRA)
yogesh garg created SPARK-24115: --- Summary: improve instrumentation for spark.ml.tuning Key: SPARK-24115 URL: https://issues.apache.org/jira/browse/SPARK-24115 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-23688) Refactor tests away from rate source

2018-04-27 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-23688: --- Assignee: Jungtaek Lim > Refactor tests away from rate source >

[jira] [Created] (SPARK-24116) SparkSQL inserting overwrite table has inconsistent behavior regarding HDFS trash

2018-04-27 Thread Rui Li (JIRA)
Rui Li created SPARK-24116: -- Summary: SparkSQL inserting overwrite table has inconsistent behavior regarding HDFS trash Key: SPARK-24116 URL: https://issues.apache.org/jira/browse/SPARK-24116 Project: Spark

[jira] [Assigned] (SPARK-24035) SQL syntax for Pivot

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24035: Assignee: Maryann Xue (was: Apache Spark) > SQL syntax for Pivot >

[jira] [Assigned] (SPARK-24035) SQL syntax for Pivot

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24035: Assignee: Apache Spark (was: Maryann Xue) > SQL syntax for Pivot >

[jira] [Commented] (SPARK-24035) SQL syntax for Pivot

2018-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16457316#comment-16457316 ] Apache Spark commented on SPARK-24035: -- User 'maryannxue' has created a pull request for this issue:

[jira] [Resolved] (SPARK-23688) Refactor tests away from rate source

2018-04-27 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-23688. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21152

[jira] [Commented] (SPARK-24086) Exception while executing spark streaming examples

2018-04-27 Thread Chandra Hasan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456003#comment-16456003 ] Chandra Hasan commented on SPARK-24086: --- [~hyukjin.kwon] Thanks mate, i included necessary

[jira] [Commented] (SPARK-24109) Remove class SnappyOutputStreamWrapper

2018-04-27 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456000#comment-16456000 ] Takeshi Yamamuro commented on SPARK-24109: -- IMO it'd be better to keep this ticket open because