[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2017-06-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1606#comment-1606 ] Wenchen Fan commented on SPARK-18016: - ok reverted > Code Generation: Constant Pool

[jira] [Updated] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2017-06-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-18016: Fix Version/s: (was: 2.1.2) > Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[jira] [Resolved] (SPARK-21079) ANALYZE TABLE fails to calculate totalSize for a partitioned table

2017-06-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21079. - Resolution: Fixed Assignee: Maria Fix Version/s: 2.2.0 > ANALYZE TABLE fails to calculate

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2017-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062207#comment-16062207 ] Reynold Xin commented on SPARK-18016: - Was this merged in 2.1? If yes we should rever

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2017-06-24 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062196#comment-16062196 ] Mark Grover commented on SPARK-18016: - Thanks for working on this [~aeskilson]. [~clo

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062194#comment-16062194 ] Liang-Chi Hsieh commented on SPARK-21198: - Have you profile the time spent in you

[jira] [Updated] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-21198: Component/s: (was: Spark Core) SQL > SparkSession catalog is terribly

[jira] [Assigned] (SPARK-21169) Spark HA: Jobs state is in WAITING status after reconnecting to standby master

2017-06-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21169: Assignee: (was: Apache Spark) > Spark HA: Jobs state is in WAITING status after reconn

[jira] [Assigned] (SPARK-21169) Spark HA: Jobs state is in WAITING status after reconnecting to standby master

2017-06-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21169: Assignee: Apache Spark > Spark HA: Jobs state is in WAITING status after reconnecting to s

[jira] [Commented] (SPARK-21169) Spark HA: Jobs state is in WAITING status after reconnecting to standby master

2017-06-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062190#comment-16062190 ] Apache Spark commented on SPARK-21169: -- User 'srini-daruna' has created a pull reque

[jira] [Assigned] (SPARK-21205) pmod(number, 0) should be null

2017-06-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21205: Assignee: Apache Spark > pmod(number, 0) should be null > ---

[jira] [Assigned] (SPARK-21205) pmod(number, 0) should be null

2017-06-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21205: Assignee: (was: Apache Spark) > pmod(number, 0) should be null >

[jira] [Commented] (SPARK-21205) pmod(number, 0) should be null

2017-06-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062188#comment-16062188 ] Apache Spark commented on SPARK-21205: -- User 'wangyum' has created a pull request fo

[jira] [Created] (SPARK-21205) pmod(number, 0) should be null

2017-06-24 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-21205: --- Summary: pmod(number, 0) should be null Key: SPARK-21205 URL: https://issues.apache.org/jira/browse/SPARK-21205 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-21204) RuntimeException with Set and Case Class in Spark 2.1.1

2017-06-24 Thread Leo Romanovsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leo Romanovsky updated SPARK-21204: --- Description: When attempting to produce a Dataset containing a Set, such as with: {code:java

[jira] [Created] (SPARK-21204) RuntimeException with Set and Case Class in Spark 2.1.1

2017-06-24 Thread Leo Romanovsky (JIRA)
Leo Romanovsky created SPARK-21204: -- Summary: RuntimeException with Set and Case Class in Spark 2.1.1 Key: SPARK-21204 URL: https://issues.apache.org/jira/browse/SPARK-21204 Project: Spark I

[jira] [Closed] (SPARK-21197) Tricky use case makes dead application struggle for a long duration

2017-06-24 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu closed SPARK-21197. --- Resolution: Won't Fix > Tricky use case makes dead application struggle for a long duration > ---

[jira] [Commented] (SPARK-21197) Tricky use case makes dead application struggle for a long duration

2017-06-24 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062162#comment-16062162 ] Nan Zhu commented on SPARK-21197: - yeah, after rethinking about the solution, I think dae

[jira] [Issue Comment Deleted] (SPARK-21176) Master UI hangs with spark.ui.reverseProxy=true if the master node has many CPUs

2017-06-24 Thread Anderson Osagie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anderson Osagie updated SPARK-21176: Comment: was deleted (was: Great find. This issue hit me earlier and forced me to turn off

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062070#comment-16062070 ] Saif Addin edited comment on SPARK-21198 at 6/24/17 5:27 PM: -

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062070#comment-16062070 ] Saif Addin edited comment on SPARK-21198 at 6/24/17 5:26 PM: -

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062070#comment-16062070 ] Saif Addin edited comment on SPARK-21198 at 6/24/17 5:26 PM: -

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062070#comment-16062070 ] Saif Addin commented on SPARK-21198: Thanks [~viirya] My program lists on a webpage t

[jira] [Comment Edited] (SPARK-21176) Master UI hangs with spark.ui.reverseProxy=true if the master node has many CPUs

2017-06-24 Thread Anderson Osagie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062062#comment-16062062 ] Anderson Osagie edited comment on SPARK-21176 at 6/24/17 5:05 PM: -

[jira] [Commented] (SPARK-21176) Master UI hangs with spark.ui.reverseProxy=true if the master node has many CPUs

2017-06-24 Thread Anderson Osagie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062062#comment-16062062 ] Anderson Osagie commented on SPARK-21176: - Great find. This hit us earlier and fo

[jira] [Comment Edited] (SPARK-12806) Support SQL expressions extracting values from VectorUDT

2017-06-24 Thread Franklyn Dsouza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061718#comment-16061718 ] Franklyn Dsouza edited comment on SPARK-12806 at 6/24/17 2:54 PM: -

[jira] [Resolved] (SPARK-21203) Wrong results of insertion of Array of Struct

2017-06-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21203. - Resolution: Fixed Fix Version/s: 2.2.0 2.1.2 > Wrong results of inserti

[jira] [Commented] (SPARK-21200) Spark REST API is not working or Spark documentation is wrong.

2017-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061979#comment-16061979 ] Sean Owen commented on SPARK-21200: --- There isn't detail about actual vs expected here a

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061977#comment-16061977 ] Liang-Chi Hsieh commented on SPARK-21198: - Btw, [~revolucion09] may I ask the num

[jira] [Comment Edited] (SPARK-21200) Spark REST API is not working or Spark documentation is wrong.

2017-06-24 Thread Srinivasarao Daruna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061971#comment-16061971 ] Srinivasarao Daruna edited comment on SPARK-21200 at 6/24/17 1:02 PM: -

[jira] [Comment Edited] (SPARK-21200) Spark REST API is not working or Spark documentation is wrong.

2017-06-24 Thread Srinivasarao Daruna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061971#comment-16061971 ] Srinivasarao Daruna edited comment on SPARK-21200 at 6/24/17 1:00 PM: -

[jira] [Commented] (SPARK-21200) Spark REST API is not working or Spark documentation is wrong.

2017-06-24 Thread Srinivasarao Daruna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061971#comment-16061971 ] Srinivasarao Daruna commented on SPARK-21200: - Hi Sean, What makes you think

[jira] [Commented] (SPARK-21200) Spark REST API is not working or Spark documentation is wrong.

2017-06-24 Thread Srinivasarao Daruna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061967#comment-16061967 ] Srinivasarao Daruna commented on SPARK-21200: - I was referring to this one.

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061901#comment-16061901 ] Liang-Chi Hsieh commented on SPARK-21198: - Btw, I personally think it's not a bug

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061900#comment-16061900 ] Liang-Chi Hsieh commented on SPARK-21198: - I will submit a PR for this soon. > S

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061899#comment-16061899 ] Liang-Chi Hsieh commented on SPARK-21198: - {{CatalogImpl.listTables}} actually re

[jira] [Updated] (SPARK-21201) SparkSQL Load data inpath into table tableName, file is moved

2017-06-24 Thread shining (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shining updated SPARK-21201: Issue Type: Question (was: Bug) > SparkSQL Load data inpath into table tableName, file is moved > ---

[jira] [Resolved] (SPARK-21202) Assignment operator ==== working, But equalTo is throw with error

2017-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21202. --- Resolution: Invalid This should be addressed on SO. Please don't copy here > Assignment operator ===

[jira] [Resolved] (SPARK-20428) REST interface about 'v1/submissions/ kill/', currently only supports delete a single ‘driver’, now let spark support delete some ‘drivers’

2017-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20428. --- Resolution: Not A Problem > REST interface about 'v1/submissions/ kill/', currently only supports del

[jira] [Resolved] (SPARK-21200) Spark REST API is not working or Spark documentation is wrong.

2017-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21200. --- Resolution: Invalid > Spark REST API is not working or Spark documentation is wrong. > --

[jira] [Commented] (SPARK-21197) Tricky use case makes dead application struggle for a long duration

2017-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061873#comment-16061873 ] Sean Owen commented on SPARK-21197: --- Isn't that an application problem? it failed to st

[jira] [Resolved] (SPARK-21201) SparkSQL Load data inpath into table tableName, file is moved

2017-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21201. --- Resolution: Invalid You need a lot more detail here, but, this does not belong on JIRA either. The m

[jira] [Assigned] (SPARK-21189) Handle unknown error codes in Jenkins rather then leaving incomplete comment in PRs

2017-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21189: - Assignee: Hyukjin Kwon Priority: Trivial (was: Major) > Handle unknown error codes in Jenki

[jira] [Resolved] (SPARK-21189) Handle unknown error codes in Jenkins rather then leaving incomplete comment in PRs

2017-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21189. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18399 [https://github.co

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061871#comment-16061871 ] Sean Owen commented on SPARK-21198: --- "This is slow" generally isn't an actionable JIRA.