[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277716#comment-15277716 ] Hyukjin Kwon commented on SPARK-15245: -- (BTW, as you might already know, the reason

[jira] [Comment Edited] (SPARK-14261) Memory leak in Spark Thrift Server

2016-05-09 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15275238#comment-15275238 ] Weizhong edited comment on SPARK-14261 at 5/10/16 6:52 AM: --- I a

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277700#comment-15277700 ] Hyukjin Kwon commented on SPARK-15245: -- Thank you so much. Let me close my PR. > st

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277697#comment-15277697 ] Sean Owen commented on SPARK-15245: --- The message seems correct. I agree it could possib

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277696#comment-15277696 ] Hyukjin Kwon commented on SPARK-15245: -- Oh, the main reason is, I thought {{'basePat

[jira] [Resolved] (SPARK-15239) spark document conflict about mesos cluster

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15239. --- Resolution: Not A Problem If you take a look at the docs in the repo you can see this has been update

[jira] [Resolved] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15228. --- Resolution: Not A Problem > pyspark.RDD.toLocalIterator Documentation > -

[jira] [Updated] (SPARK-14623) add label binarizer

2016-05-09 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiayin updated SPARK-14623: - Description: It relates to https://issues.apache.org/jira/browse/SPARK-7445 Map the labels to 0/1. For

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277690#comment-15277690 ] Sean Owen commented on SPARK-15245: --- Hm, what's the issue here? it says the arg was not

[jira] [Comment Edited] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-09 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277688#comment-15277688 ] Sandeep Singh edited comment on SPARK-15228 at 5/10/16 6:21 AM: ---

[jira] [Commented] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-09 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277688#comment-15277688 ] Sandeep Singh commented on SPARK-15228: --- Seems to be fixed in the current master.

[jira] [Commented] (SPARK-14162) java.lang.IllegalStateException: Did not find registered driver with class oracle.jdbc.OracleDriver

2016-05-09 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277682#comment-15277682 ] Sun Rui commented on SPARK-14162: - We met the same error. The cause is that in one worker

[jira] [Commented] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277681#comment-15277681 ] Sean Owen commented on SPARK-15228: --- Still not clear what that means. Can you make a pu

[jira] [Assigned] (SPARK-15246) Fix code style and improve volatile for SPARK-4452

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15246: Assignee: (was: Apache Spark) > Fix code style and improve volatile for SPARK-4452 >

[jira] [Updated] (SPARK-15246) Fix code style and improve volatile for SPARK-4452

2016-05-09 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-15246: - Summary: Fix code style and improve volatile for SPARK-4452 (was: Fix code style and improve v

[jira] [Commented] (SPARK-15246) Fix code style and improve volatile for SPARK-4452

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277672#comment-15277672 ] Apache Spark commented on SPARK-15246: -- User 'lianhuiwang' has created a pull reques

[jira] [Assigned] (SPARK-15246) Fix code style and improve volatile for SPARK-4452

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15246: Assignee: Apache Spark > Fix code style and improve volatile for SPARK-4452 > ---

[jira] [Created] (SPARK-15246) Fix code style and improve volatile for Spillable

2016-05-09 Thread Lianhui Wang (JIRA)
Lianhui Wang created SPARK-15246: Summary: Fix code style and improve volatile for Spillable Key: SPARK-15246 URL: https://issues.apache.org/jira/browse/SPARK-15246 Project: Spark Issue Type

[jira] [Assigned] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15245: Assignee: Apache Spark > stream API throws an exception with an incorrect message when the

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277647#comment-15277647 ] Apache Spark commented on SPARK-15245: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15245: Assignee: (was: Apache Spark) > stream API throws an exception with an incorrect messa

[jira] [Created] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-15245: Summary: stream API throws an exception with an incorrect message when the path is not a direcotry Key: SPARK-15245 URL: https://issues.apache.org/jira/browse/SPARK-15245

[jira] [Updated] (SPARK-15207) Use Travis CI for Java Linter and JDK7/8 compilation test

2016-05-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15207: -- Description: Currently, Java Linter is disabled in Jenkins tests. https://github.com/apache/sp

[jira] [Updated] (SPARK-15207) Use Travis CI for Java Linter and JDK7/8 compilation test

2016-05-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15207: -- Description: Currently, Java Linter is disabled in Jenkins tests. https://github.com/apache/sp

[jira] [Commented] (SPARK-15218) Error: Could not find or load main class org.apache.spark.launcher.Main when run from a directory containing colon ':'

2016-05-09 Thread Adam Cecile (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277610#comment-15277610 ] Adam Cecile commented on SPARK-15218: - Hello, Good catch, this mesos bug should fix

[jira] [Commented] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Koert Kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277600#comment-15277600 ] Koert Kuipers commented on SPARK-15204: --- Makes sense > Improve nullability infer

[jira] [Created] (SPARK-15244) Type of column name created with sqlContext.createDataFrame() is not consistent.

2016-05-09 Thread Kazuki Yokoishi (JIRA)
Kazuki Yokoishi created SPARK-15244: --- Summary: Type of column name created with sqlContext.createDataFrame() is not consistent. Key: SPARK-15244 URL: https://issues.apache.org/jira/browse/SPARK-15244

[jira] [Created] (SPARK-15243) Binarizer.explainParam(u"...") raises ValueError

2016-05-09 Thread Kazuki Yokoishi (JIRA)
Kazuki Yokoishi created SPARK-15243: --- Summary: Binarizer.explainParam(u"...") raises ValueError Key: SPARK-15243 URL: https://issues.apache.org/jira/browse/SPARK-15243 Project: Spark Issue

[jira] [Closed] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-15204. --- Resolution: Not A Bug > Improve nullability inference for Aggregator > --

[jira] [Reopened] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-15204: - > Improve nullability inference for Aggregator > > >

[jira] [Updated] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15204: Summary: Improve nullability inference for Aggregator (was: Nullable is not correct for Aggregator

[jira] [Updated] (SPARK-15204) Nullable is not correct for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15204: Issue Type: Improvement (was: Bug) > Nullable is not correct for Aggregator >

[jira] [Commented] (SPARK-15204) Nullable is not correct for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277592#comment-15277592 ] Reynold Xin commented on SPARK-15204: - I'm going to change the title because it is al

[jira] [Commented] (SPARK-4452) Shuffle data structures can starve others on the same thread for memory

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277583#comment-15277583 ] Apache Spark commented on SPARK-4452: - User 'lianhuiwang' has created a pull request f

[jira] [Updated] (SPARK-15187) Disallow Dropping Default Database

2016-05-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15187: Assignee: Xiao Li > Disallow Dropping Default Database > -- > >

[jira] [Resolved] (SPARK-15187) Disallow Dropping Default Database

2016-05-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15187. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12962 [https://githu

[jira] [Assigned] (SPARK-15241) support scala decimal in external row

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15241: Assignee: Apache Spark (was: Wenchen Fan) > support scala decimal in external row > -

[jira] [Assigned] (SPARK-15242) keep decimal precision and scale when convert external decimal to catalyst decimal

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15242: Assignee: Wenchen Fan (was: Apache Spark) > keep decimal precision and scale when convert

[jira] [Commented] (SPARK-15241) support scala decimal in external row

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277565#comment-15277565 ] Apache Spark commented on SPARK-15241: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-15242) keep decimal precision and scale when convert external decimal to catalyst decimal

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277566#comment-15277566 ] Apache Spark commented on SPARK-15242: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-15241) support scala decimal in external row

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15241: Assignee: Wenchen Fan (was: Apache Spark) > support scala decimal in external row > -

[jira] [Assigned] (SPARK-15242) keep decimal precision and scale when convert external decimal to catalyst decimal

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15242: Assignee: Apache Spark (was: Wenchen Fan) > keep decimal precision and scale when convert

[jira] [Created] (SPARK-15242) keep decimal precision and scale when convert external decimal to catalyst decimal

2016-05-09 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-15242: --- Summary: keep decimal precision and scale when convert external decimal to catalyst decimal Key: SPARK-15242 URL: https://issues.apache.org/jira/browse/SPARK-15242 Proj

[jira] [Created] (SPARK-15241) support scala decimal in external row

2016-05-09 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-15241: --- Summary: support scala decimal in external row Key: SPARK-15241 URL: https://issues.apache.org/jira/browse/SPARK-15241 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15240) Use buffer variables to improve buffer serialization/deserialization in TungstenAggregate

2016-05-09 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-15240: Summary: Use buffer variables to improve buffer serialization/deserialization in TungstenAg

[jira] [Assigned] (SPARK-15240) Use buffer variables for update/merge expressions instead duplicate serialization/deserialization

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15240: Assignee: (was: Apache Spark) > Use buffer variables for update/merge expressions inst

[jira] [Commented] (SPARK-15240) Use buffer variables for update/merge expressions instead duplicate serialization/deserialization

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277536#comment-15277536 ] Apache Spark commented on SPARK-15240: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-15240) Use buffer variables for update/merge expressions instead duplicate serialization/deserialization

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15240: Assignee: Apache Spark > Use buffer variables for update/merge expressions instead duplica

[jira] [Created] (SPARK-15240) Use buffer variables for update/merge expressions instead duplicate serialization/deserialization

2016-05-09 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-15240: --- Summary: Use buffer variables for update/merge expressions instead duplicate serialization/deserialization Key: SPARK-15240 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Resolved] (SPARK-15229) Make case sensitivity setting internal

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15229. - Resolution: Fixed Fix Version/s: 2.0.0 > Make case sensitivity setting internal >

[jira] [Resolved] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15234. - Resolution: Fixed Fix Version/s: 2.0.0 > spark.catalog.listDatabases.show() is not formatt

[jira] [Commented] (SPARK-12661) Drop Python 2.6 support in PySpark

2016-05-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277473#comment-15277473 ] Shivaram Venkataraman commented on SPARK-12661: --- Yes - We will do a full ro

[jira] [Assigned] (SPARK-15238) Clarify Python 3 support in docs

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15238: Assignee: Apache Spark > Clarify Python 3 support in docs > --

[jira] [Assigned] (SPARK-15238) Clarify Python 3 support in docs

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15238: Assignee: (was: Apache Spark) > Clarify Python 3 support in docs > ---

[jira] [Commented] (SPARK-15238) Clarify Python 3 support in docs

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277468#comment-15277468 ] Apache Spark commented on SPARK-15238: -- User 'nchammas' has created a pull request f

[jira] [Created] (SPARK-15239) spark document conflict about mesos cluster

2016-05-09 Thread JasonChang (JIRA)
JasonChang created SPARK-15239: -- Summary: spark document conflict about mesos cluster Key: SPARK-15239 URL: https://issues.apache.org/jira/browse/SPARK-15239 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-15238) Clarify Python 3 support in docs

2016-05-09 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-15238: Summary: Clarify Python 3 support in docs Key: SPARK-15238 URL: https://issues.apache.org/jira/browse/SPARK-15238 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-15237) SparkR corr function documentation

2016-05-09 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277454#comment-15277454 ] Sun Rui commented on SPARK-15237: - SparkR supports two types of corr(), something like co

[jira] [Commented] (SPARK-12661) Drop Python 2.6 support in PySpark

2016-05-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277450#comment-15277450 ] Nicholas Chammas commented on SPARK-12661: -- [~davies] / [~joshrosen] - Has this

[jira] [Commented] (SPARK-12661) Drop Python 2.6 support in PySpark

2016-05-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277448#comment-15277448 ] Nicholas Chammas commented on SPARK-12661: -- [~shivaram] - Can you confirm that s

[jira] [Commented] (SPARK-13634) Assigning spark context to variable results in serialization error

2016-05-09 Thread Kai Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277427#comment-15277427 ] Kai Chen commented on SPARK-13634: -- [~Rahul Palamuttam] and [~chrismattmann] Try {code}

[jira] [Updated] (SPARK-13485) (Dataset-oriented) API evolution in Spark 2.0

2016-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13485: - Labels: releasenotes (was: ) > (Dataset-oriented) API evolution in Spark 2.0 > -

[jira] [Updated] (SPARK-15025) creating datasource table with option (PATH) results in duplicate path key in serdeProperties

2016-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15025: - Assignee: Xin Wu > creating datasource table with option (PATH) results in duplicate path key in > serde

[jira] [Resolved] (SPARK-15025) creating datasource table with option (PATH) results in duplicate path key in serdeProperties

2016-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15025. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12804 [https://github.com/

[jira] [Created] (SPARK-15237) SparkR corr function documentation

2016-05-09 Thread Shaul (JIRA)
Shaul created SPARK-15237: - Summary: SparkR corr function documentation Key: SPARK-15237 URL: https://issues.apache.org/jira/browse/SPARK-15237 Project: Spark Issue Type: Documentation Comp

[jira] [Updated] (SPARK-15236) No way to disable Hive support in REPL

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15236: -- Component/s: Spark Shell > No way to disable Hive support in REPL > ---

[jira] [Updated] (SPARK-15019) Propagate all Spark Confs to HiveConf created in HiveClientImpl

2016-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15019: - Labels: release_notes releasenotes (was: ) > Propagate all Spark Confs to HiveConf created in HiveClient

[jira] [Commented] (SPARK-15019) Propagate all Spark Confs to HiveConf created in HiveClientImpl

2016-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277312#comment-15277312 ] Yin Huai commented on SPARK-15019: -- This change also drops the support of hive-site.xml.

[jira] [Resolved] (SPARK-15209) Web UI's timeline visualizations fails to render if descriptions contain single quotes

2016-05-09 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-15209. Resolution: Fixed > Web UI's timeline visualizations fails to render if descriptions contai

[jira] [Updated] (SPARK-15209) Web UI's timeline visualizations fails to render if descriptions contain single quotes

2016-05-09 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-15209: --- Fix Version/s: 2.0.0 1.6.2 > Web UI's timeline visualizations fails to ren

[jira] [Updated] (SPARK-15236) No way to disable Hive support in REPL

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15236: -- Assignee: (was: Andrew Or) > No way to disable Hive support in REPL > -

[jira] [Created] (SPARK-15236) No way to disable Hive support in REPL

2016-05-09 Thread Andrew Or (JIRA)
Andrew Or created SPARK-15236: - Summary: No way to disable Hive support in REPL Key: SPARK-15236 URL: https://issues.apache.org/jira/browse/SPARK-15236 Project: Spark Issue Type: Bug Co

[jira] [Assigned] (SPARK-15235) Corresponding row cannot be highlighted even though cursor is on the job on Web UI's timeline

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15235: Assignee: (was: Apache Spark) > Corresponding row cannot be highlighted even though cu

[jira] [Commented] (SPARK-15186) Add user guide for Generalized Linear Regression.

2016-05-09 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277293#comment-15277293 ] Seth Hendrickson commented on SPARK-15186: -- I have a PR for this once [SPARK-14

[jira] [Assigned] (SPARK-15235) Corresponding row cannot be highlighted even though cursor is on the job on Web UI's timeline

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15235: Assignee: Apache Spark > Corresponding row cannot be highlighted even though cursor is on

[jira] [Commented] (SPARK-15235) Corresponding row cannot be highlighted even though cursor is on the job on Web UI's timeline

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277295#comment-15277295 ] Apache Spark commented on SPARK-15235: -- User 'sarutak' has created a pull request fo

[jira] [Created] (SPARK-15235) Corresponding row cannot be highlighted even though cursor is on the job on Web UI's timeline

2016-05-09 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-15235: -- Summary: Corresponding row cannot be highlighted even though cursor is on the job on Web UI's timeline Key: SPARK-15235 URL: https://issues.apache.org/jira/browse/SPARK-15235

[jira] [Commented] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277263#comment-15277263 ] Apache Spark commented on SPARK-15234: -- User 'techaddict' has created a pull request

[jira] [Commented] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

2016-05-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277260#comment-15277260 ] Felix Cheung commented on SPARK-14995: -- should we have Experimental for new API like

[jira] [Commented] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-09 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277243#comment-15277243 ] Sandeep Singh commented on SPARK-15228: --- The Code is formatted properly at the end.

[jira] [Assigned] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-15234: - Assignee: Andrew Or > spark.catalog.listDatabases.show() is not formatted correctly > --

[jira] [Commented] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277237#comment-15277237 ] Apache Spark commented on SPARK-15234: -- User 'andrewor14' has created a pull request

[jira] [Commented] (SPARK-14983) Getting CompileException when feed an UDF with an array and another paramter

2016-05-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277221#comment-15277221 ] Shixiong Zhu commented on SPARK-14983: -- In addition, the Scala type for `ArrayType[S

[jira] [Assigned] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15234: Assignee: (was: Apache Spark) > spark.catalog.listDatabases.show() is not formatted co

[jira] [Assigned] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15234: Assignee: Apache Spark > spark.catalog.listDatabases.show() is not formatted correctly > -

[jira] [Commented] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277205#comment-15277205 ] Apache Spark commented on SPARK-15234: -- User 'techaddict' has created a pull request

[jira] [Resolved] (SPARK-14983) Getting CompileException when feed an UDF with an array and another paramter

2016-05-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-14983. -- Resolution: Duplicate This has been fixed in SPARK-10461 > Getting CompileException when feed

[jira] [Created] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Andrew Or (JIRA)
Andrew Or created SPARK-15234: - Summary: spark.catalog.listDatabases.show() is not formatted correctly Key: SPARK-15234 URL: https://issues.apache.org/jira/browse/SPARK-15234 Project: Spark Issu

[jira] [Updated] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15234: -- Description: {code} scala> spark.catalog.listDatabases.show() ++---+---

[jira] [Updated] (SPARK-15233) Spark task metrics should include hdfs read write latency

2016-05-09 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-15233: Affects Version/s: 1.6.1 Priority: Minor (was: Major) Description: Currently

[jira] [Created] (SPARK-15233) Spark UI should show metrics for hdfs read write latency

2016-05-09 Thread Sital Kedia (JIRA)
Sital Kedia created SPARK-15233: --- Summary: Spark UI should show metrics for hdfs read write latency Key: SPARK-15233 URL: https://issues.apache.org/jira/browse/SPARK-15233 Project: Spark Issue

[jira] [Updated] (SPARK-15229) Make case sensitivity setting internal

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15229: Description: Our case sensitivity support is different from what ANSI SQL standards support. Postg

[jira] [Resolved] (SPARK-14898) MultivariateGaussian could use Cholesky in calculateCovarianceConstants

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14898. --- Resolution: Not A Problem OK someone reopen this if we've misunderstood, but I think this isn't an is

[jira] [Commented] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277073#comment-15277073 ] Sean Owen commented on SPARK-15228: --- (What's the bug?) > pyspark.RDD.toLocalIterator D

[jira] [Commented] (SPARK-15231) Document the semantic of saveAsTable and insertInto and don't drop columns silently

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277003#comment-15277003 ] Apache Spark commented on SPARK-15231: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-15231) Document the semantic of saveAsTable and insertInto and don't drop columns silently

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15231: Assignee: Shixiong Zhu (was: Apache Spark) > Document the semantic of saveAsTable and ins

[jira] [Created] (SPARK-15232) Add subquery SQL building tests to LogicalPlanToSQLSuite

2016-05-09 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-15232: - Summary: Add subquery SQL building tests to LogicalPlanToSQLSuite Key: SPARK-15232 URL: https://issues.apache.org/jira/browse/SPARK-15232 Project: Spark

[jira] [Assigned] (SPARK-15231) Document the semantic of saveAsTable and insertInto and don't drop columns silently

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15231: Assignee: Apache Spark (was: Shixiong Zhu) > Document the semantic of saveAsTable and ins

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-05-09 Thread Trystan Leftwich (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trystan Leftwich updated SPARK-14318: - Description: TPCDS Q14 parses successfully, and plans created successfully. Spark tries t

[jira] [Created] (SPARK-15231) Document the semantic of saveAsTable and insertInto and don't drop columns silently

2016-05-09 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-15231: Summary: Document the semantic of saveAsTable and insertInto and don't drop columns silently Key: SPARK-15231 URL: https://issues.apache.org/jira/browse/SPARK-15231 P

  1   2   3   >