[jira] [Commented] (SPARK-18318) ML, Graph 2.1 QA: API: New Scala APIs, docs

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15695165#comment-15695165 ] Apache Spark commented on SPARK-18318: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Created] (SPARK-18586) netty-3.8.0.Final.jar has vulnerability CVE-2014-3488 and CVE-2014-0193

2016-11-24 Thread meiyoula (JIRA)
meiyoula created SPARK-18586: Summary: netty-3.8.0.Final.jar has vulnerability CVE-2014-3488 and CVE-2014-0193 Key: SPARK-18586 URL: https://issues.apache.org/jira/browse/SPARK-18586 Project: Spark

[jira] [Commented] (SPARK-18584) multiple Spark Thrift Servers running in the same machine throws org.apache.hadoop.security.AccessControlException

2016-11-24 Thread tanxinz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15695080#comment-15695080 ] tanxinz commented on SPARK-18584: - etl Spark Thrift Server:

[jira] [Updated] (SPARK-18518) HasSolver should support allowed values

2016-11-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-18518: Shepherd: Yanbo Liang > HasSolver should support allowed values >

[jira] [Updated] (SPARK-18518) HasSolver should support allowed values

2016-11-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-18518: Priority: Major (was: Minor) > HasSolver should support allowed values >

[jira] [Updated] (SPARK-18518) HasSolver should support allowed values

2016-11-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-18518: Assignee: zhengruifeng > HasSolver should support allowed values >

[jira] [Commented] (SPARK-18584) multiple Spark Thrift Servers running in the same machine throws org.apache.hadoop.security.AccessControlException

2016-11-24 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694945#comment-15694945 ] Takeshi Yamamuro commented on SPARK-18584: -- Can you describes more for your configurations? At

[jira] [Assigned] (SPARK-18585) Use `ev.isNull = "false"` if possible for Janino to have a chance to optimize.

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18585: Assignee: (was: Apache Spark) > Use `ev.isNull = "false"` if possible for Janino to

[jira] [Commented] (SPARK-18585) Use `ev.isNull = "false"` if possible for Janino to have a chance to optimize.

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694885#comment-15694885 ] Apache Spark commented on SPARK-18585: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18585) Use `ev.isNull = "false"` if possible for Janino to have a chance to optimize.

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18585: Assignee: Apache Spark > Use `ev.isNull = "false"` if possible for Janino to have a

[jira] [Created] (SPARK-18585) Use `ev.isNull = "false"` if possible for Janino to have a chance to optimize.

2016-11-24 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-18585: - Summary: Use `ev.isNull = "false"` if possible for Janino to have a chance to optimize. Key: SPARK-18585 URL: https://issues.apache.org/jira/browse/SPARK-18585

[jira] [Closed] (SPARK-18075) UDF doesn't work on non-local spark

2016-11-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan closed SPARK-18075. --- Resolution: Not A Problem > UDF doesn't work on non-local spark >

[jira] [Commented] (SPARK-18075) UDF doesn't work on non-local spark

2016-11-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694864#comment-15694864 ] Wenchen Fan commented on SPARK-18075: - I'm going to close this ticket as it's kind of a misusage

[jira] [Assigned] (SPARK-18583) Fix nullability of InputFileName.

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18583: Assignee: (was: Apache Spark) > Fix nullability of InputFileName. >

[jira] [Commented] (SPARK-18583) Fix nullability of InputFileName.

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694689#comment-15694689 ] Apache Spark commented on SPARK-18583: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18583) Fix nullability of InputFileName.

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18583: Assignee: Apache Spark > Fix nullability of InputFileName. >

[jira] [Created] (SPARK-18584) multiple Spark Thrift Servers running in the same machine throws org.apache.hadoop.security.AccessControlException

2016-11-24 Thread tanxinz (JIRA)
tanxinz created SPARK-18584: --- Summary: multiple Spark Thrift Servers running in the same machine throws org.apache.hadoop.security.AccessControlException Key: SPARK-18584 URL:

[jira] [Created] (SPARK-18583) Fix nullability of InputFileName.

2016-11-24 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-18583: - Summary: Fix nullability of InputFileName. Key: SPARK-18583 URL: https://issues.apache.org/jira/browse/SPARK-18583 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-14560) Cooperative Memory Management for Spillables

2016-11-24 Thread Roy Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694677#comment-15694677 ] Roy Wang edited comment on SPARK-14560 at 11/25/16 3:01 AM:

[jira] [Comment Edited] (SPARK-14560) Cooperative Memory Management for Spillables

2016-11-24 Thread Roy Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694677#comment-15694677 ] Roy Wang edited comment on SPARK-14560 at 11/25/16 2:56 AM:

[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

2016-11-24 Thread Roy Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694677#comment-15694677 ] Roy Wang commented on SPARK-14560: -- UnsafeExternalSorter used a lot of memory but it looked like that

[jira] [Commented] (SPARK-18554) leader master lost the leadership, when the slave become master, the perivious app's state display as waitting

2016-11-24 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694563#comment-15694563 ] Saisai Shao commented on SPARK-18554: - I think this is a known issue and I have a fix for it long

[jira] [Comment Edited] (SPARK-17251) "ClassCastException: OuterReference cannot be cast to NamedExpression" for correlated subquery on the RHS of an IN operator

2016-11-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694430#comment-15694430 ] Dongjoon Hyun edited comment on SPARK-17251 at 11/24/16 11:47 PM: -- Thank

[jira] [Commented] (SPARK-17251) "ClassCastException: OuterReference cannot be cast to NamedExpression" for correlated subquery on the RHS of an IN operator

2016-11-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694430#comment-15694430 ] Dongjoon Hyun commented on SPARK-17251: --- Thank you! I see. You mean it should be handled by

[jira] [Commented] (SPARK-17251) "ClassCastException: OuterReference cannot be cast to NamedExpression" for correlated subquery on the RHS of an IN operator

2016-11-24 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694400#comment-15694400 ] Herman van Hovell commented on SPARK-17251: --- Yeah, go ahead. The only thing is that it should

[jira] [Commented] (SPARK-17251) "ClassCastException: OuterReference cannot be cast to NamedExpression" for correlated subquery on the RHS of an IN operator

2016-11-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694381#comment-15694381 ] Dongjoon Hyun commented on SPARK-17251: --- Hi, [~hvanhovell]. The suggested solution seems to extend

[jira] [Closed] (SPARK-18574) Keep same style: adjust the position of

2016-11-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-18574. - Resolution: Duplicate Hi, [~uncleGen] It seems to be duplicated issue of yours. > Keep same

[jira] [Updated] (SPARK-18582) Whitelist LogicalPlan operators allowed in correlated subqueries

2016-11-24 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nattavut Sutyanyong updated SPARK-18582: Issue Type: Sub-task (was: Improvement) Parent: SPARK-18455 > Whitelist

[jira] [Commented] (SPARK-18582) Whitelist LogicalPlan operators allowed in correlated subqueries

2016-11-24 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694202#comment-15694202 ] Nattavut Sutyanyong commented on SPARK-18582: - [~hvanhovell] has broken down the whitelist

[jira] [Updated] (SPARK-18582) Whitelist LogicalPlan operators allowed in correlated subqueries

2016-11-24 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nattavut Sutyanyong updated SPARK-18582: Description: We want to tighten the code that handles correlated subquery to

[jira] [Updated] (SPARK-18582) Whitelist LogicalPlan operators allowed in correlated subqueries

2016-11-24 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nattavut Sutyanyong updated SPARK-18582: Description: We want to tighten the code that handles correlated subquery to

[jira] [Updated] (SPARK-18582) Whitelist LogicalPlan operators allowed in correlated subqueries

2016-11-24 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nattavut Sutyanyong updated SPARK-18582: Description: We want to tighten the code that handles correlated subquery to

[jira] [Created] (SPARK-18582) Whitelist LogicalPlan operators allowed in correlated subqueries

2016-11-24 Thread Nattavut Sutyanyong (JIRA)
Nattavut Sutyanyong created SPARK-18582: --- Summary: Whitelist LogicalPlan operators allowed in correlated subqueries Key: SPARK-18582 URL: https://issues.apache.org/jira/browse/SPARK-18582

[jira] [Resolved] (SPARK-18578) Full outer join in correlated subquery returns incorrect results

2016-11-24 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18578. --- Resolution: Fixed Assignee: Nattavut Sutyanyong Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-18548) OnlineLDAOptimizer reads the same broadcast data after deletion

2016-11-24 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693913#comment-15693913 ] yuhao yang commented on SPARK-18548: Are you referring to the latest code:

[jira] [Created] (SPARK-18581) MultivariateGaussian returns pdf value larger than 1

2016-11-24 Thread Hao Ren (JIRA)
Hao Ren created SPARK-18581: --- Summary: MultivariateGaussian returns pdf value larger than 1 Key: SPARK-18581 URL: https://issues.apache.org/jira/browse/SPARK-18581 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6378) srcAttr in graph.triplets don't update when the size of graph is huge

2016-11-24 Thread Rohit (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693791#comment-15693791 ] Rohit commented on SPARK-6378: -- [~rsaidi] You are right the problem seems to be in replicatedVertexView . I

[jira] [Commented] (SPARK-18580) Use spark.streaming.backpressure.initialRate in DirectKafkaInputDStream

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693741#comment-15693741 ] Apache Spark commented on SPARK-18580: -- User 'omuravskiy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18580) Use spark.streaming.backpressure.initialRate in DirectKafkaInputDStream

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18580: Assignee: (was: Apache Spark) > Use spark.streaming.backpressure.initialRate in

[jira] [Assigned] (SPARK-18580) Use spark.streaming.backpressure.initialRate in DirectKafkaInputDStream

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18580: Assignee: Apache Spark > Use spark.streaming.backpressure.initialRate in

[jira] [Commented] (SPARK-18580) Use spark.streaming.backpressure.initialRate in DirectKafkaInputDStream

2016-11-24 Thread Oleg Muravskiy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693710#comment-15693710 ] Oleg Muravskiy commented on SPARK-18580: Created a pull request:

[jira] [Commented] (SPARK-15754) org.apache.spark.deploy.yarn.Client changes the credential of current user

2016-11-24 Thread Michael Gong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693707#comment-15693707 ] Michael Gong commented on SPARK-15754: -- Hi Subroto, It looks like the change caused an issue with

[jira] [Created] (SPARK-18580) Use spark.streaming.backpressure.initialRate in DirectKafkaInputDStream

2016-11-24 Thread Oleg Muravskiy (JIRA)
Oleg Muravskiy created SPARK-18580: -- Summary: Use spark.streaming.backpressure.initialRate in DirectKafkaInputDStream Key: SPARK-18580 URL: https://issues.apache.org/jira/browse/SPARK-18580 Project:

[jira] [Created] (SPARK-18579) spark-csv strips whitespace (pyspark)

2016-11-24 Thread Adrian Bridgett (JIRA)
Adrian Bridgett created SPARK-18579: --- Summary: spark-csv strips whitespace (pyspark) Key: SPARK-18579 URL: https://issues.apache.org/jira/browse/SPARK-18579 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18578) Full outer join in correlated subquery returns incorrect results

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693614#comment-15693614 ] Apache Spark commented on SPARK-18578: -- User 'nsyca' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18578) Full outer join in correlated subquery returns incorrect results

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18578: Assignee: Apache Spark > Full outer join in correlated subquery returns incorrect results

[jira] [Assigned] (SPARK-18578) Full outer join in correlated subquery returns incorrect results

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18578: Assignee: (was: Apache Spark) > Full outer join in correlated subquery returns

[jira] [Commented] (SPARK-18455) General support for subquery processing

2016-11-24 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693569#comment-15693569 ] Nattavut Sutyanyong commented on SPARK-18455: - For my own reference, these JIRAs implemented

[jira] [Comment Edited] (SPARK-18455) General support for subquery processing

2016-11-24 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668577#comment-15668577 ] Nattavut Sutyanyong edited comment on SPARK-18455 at 11/24/16 3:39 PM:

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

2016-11-24 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693519#comment-15693519 ] Herman van Hovell commented on SPARK-18134: --- [~ChrisZ84] The current PR a proof of concept, and

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

2016-11-24 Thread Christian Zorneck (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693508#comment-15693508 ] Christian Zorneck commented on SPARK-18134: --- [~hvanhovell] are you going to commit your changes

[jira] [Commented] (SPARK-18578) Full outer join in correlated subquery returns incorrect results

2016-11-24 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693478#comment-15693478 ] Nattavut Sutyanyong commented on SPARK-18578: - Note that correlated predicates in the right

[jira] [Assigned] (SPARK-18482) make sure Spark can access the table metadata created by older version of spark

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18482: Assignee: Apache Spark > make sure Spark can access the table metadata created by older

[jira] [Assigned] (SPARK-18482) make sure Spark can access the table metadata created by older version of spark

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18482: Assignee: (was: Apache Spark) > make sure Spark can access the table metadata created

[jira] [Commented] (SPARK-18482) make sure Spark can access the table metadata created by older version of spark

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693465#comment-15693465 ] Apache Spark commented on SPARK-18482: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-18578) Full outer join in correlated subquery returns incorrect results

2016-11-24 Thread Nattavut Sutyanyong (JIRA)
Nattavut Sutyanyong created SPARK-18578: --- Summary: Full outer join in correlated subquery returns incorrect results Key: SPARK-18578 URL: https://issues.apache.org/jira/browse/SPARK-18578

[jira] [Commented] (SPARK-18577) Ambiguous reference with duplicate column names in aggregate

2016-11-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693451#comment-15693451 ] Sean Owen commented on SPARK-18577: --- Yes, my impression is that this should be considered ambiguous. At

[jira] [Commented] (SPARK-18577) Ambiguous reference with duplicate column names in aggregate

2016-11-24 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693356#comment-15693356 ] Takeshi Yamamuro commented on SPARK-18577: -- I reproduced this in master though, do we need to

[jira] [Resolved] (SPARK-18520) Add missing setXXXCol methods for BisectingKMeansModel and GaussianMixtureModel

2016-11-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-18520. - Resolution: Fixed Assignee: zhengruifeng Fix Version/s: 2.1.0 > Add missing

[jira] [Commented] (SPARK-18075) UDF doesn't work on non-local spark

2016-11-24 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693302#comment-15693302 ] Herman van Hovell commented on SPARK-18075: --- Any idea what causes it? > UDF doesn't work on

[jira] [Comment Edited] (SPARK-18482) make sure Spark can access the table metadata created by older version of spark

2016-11-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693057#comment-15693057 ] Wenchen Fan edited comment on SPARK-18482 at 11/24/16 12:40 PM: -I think

[jira] [Comment Edited] (SPARK-18482) make sure Spark can access the table metadata created by older version of spark

2016-11-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693057#comment-15693057 ] Wenchen Fan edited comment on SPARK-18482 at 11/24/16 12:40 PM: ~I think

[jira] [Created] (SPARK-18577) Ambiguous reference with duplicate column names in aggregate

2016-11-24 Thread Yerui Sun (JIRA)
Yerui Sun created SPARK-18577: - Summary: Ambiguous reference with duplicate column names in aggregate Key: SPARK-18577 URL: https://issues.apache.org/jira/browse/SPARK-18577 Project: Spark

[jira] [Commented] (SPARK-18482) make sure Spark can access the table metadata created by older version of spark

2016-11-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693057#comment-15693057 ] Wenchen Fan commented on SPARK-18482: - I think we should add test case by case, i.e. identify patches

[jira] [Comment Edited] (SPARK-18075) UDF doesn't work on non-local spark

2016-11-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692997#comment-15692997 ] Wenchen Fan edited comment on SPARK-18075 at 11/24/16 11:14 AM: ok I

[jira] [Commented] (SPARK-18075) UDF doesn't work on non-local spark

2016-11-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692997#comment-15692997 ] Wenchen Fan commented on SPARK-18075: - ok I reproduced, this bug can be triggered if you use sbt to

[jira] [Commented] (SPARK-18075) UDF doesn't work on non-local spark

2016-11-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692989#comment-15692989 ] Wenchen Fan commented on SPARK-18075: - I can't reproduce this bug with 2.0.1, can you provide more

[jira] [Commented] (SPARK-14742) Redirect spark-ec2 doc to new location

2016-11-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692937#comment-15692937 ] Sean Owen commented on SPARK-14742: --- I manually patched this in 2.0.1/2.0.2 docs for now. For some

[jira] [Created] (SPARK-18576) Expose basic TaskContext info in PySpark

2016-11-24 Thread holdenk (JIRA)
holdenk created SPARK-18576: --- Summary: Expose basic TaskContext info in PySpark Key: SPARK-18576 URL: https://issues.apache.org/jira/browse/SPARK-18576 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-18571) pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8

2016-11-24 Thread Adrian Bridgett (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692768#comment-15692768 ] Adrian Bridgett commented on SPARK-18571: - FYI I'm now setting LANG=en_US.UTF-8 in spark-env.sh

[jira] [Assigned] (SPARK-18341) Eliminate use of SingularMatrixException in WeightedLeastSquares logic

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18341: Assignee: Apache Spark > Eliminate use of SingularMatrixException in WeightedLeastSquares

[jira] [Commented] (SPARK-18341) Eliminate use of SingularMatrixException in WeightedLeastSquares logic

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692705#comment-15692705 ] Apache Spark commented on SPARK-18341: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18341) Eliminate use of SingularMatrixException in WeightedLeastSquares logic

2016-11-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18341: Assignee: (was: Apache Spark) > Eliminate use of SingularMatrixException in

[jira] [Comment Edited] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

2016-11-24 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692672#comment-15692672 ] Jiang Xingbo edited comment on SPARK-18549 at 11/24/16 8:53 AM: Do you

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

2016-11-24 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692672#comment-15692672 ] Jiang Xingbo commented on SPARK-18549: -- Do you think we can resolve this problem after we have added