[jira] [Commented] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2016-09-26 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523623#comment-15523623 ] Xiangrui Meng commented on SPARK-17647: --- Thanks [~joshrosen]! I updated the JIRA description. The

[jira] [Comment Edited] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2016-09-26 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523623#comment-15523623 ] Xiangrui Meng edited comment on SPARK-17647 at 9/26/16 5:06 PM: Thanks

[jira] [Updated] (SPARK-17647) SQL LIKE do not handle backslashes correctly

2016-09-26 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-17647: -- Summary: SQL LIKE do not handle backslashes correctly (was: SQL LIKE/RLIKE do not handle

[jira] [Updated] (SPARK-17647) SQL LIKE/RLIKE do not handle backslashes correctly

2016-09-26 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-17647: -- Description: Try the following in SQL shell: {code} select '' like '%\\%'; {code} It

[jira] [Updated] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2016-09-26 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-17647: -- Summary: SQL LIKE does not handle backslashes correctly (was: SQL LIKE do not handle

[jira] [Updated] (SPARK-17647) SQL LIKE/RLIKE do not handle backslashes correctly

2016-09-26 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-17647: -- Description: Try the following in SQL shell: {code} select '' like '%\\%'; {code} It

[jira] [Comment Edited] (SPARK-16854) mapWithState Support for Python

2016-09-26 Thread SORNALINGAM (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523507#comment-15523507 ] SORNALINGAM edited comment on SPARK-16854 at 9/26/16 4:22 PM: -- +1, It would

[jira] [Commented] (SPARK-16854) mapWithState Support for Python

2016-09-26 Thread SORNALINGAM (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523507#comment-15523507 ] SORNALINGAM commented on SPARK-16854: - +1 > mapWithState Support for Python >

[jira] [Updated] (SPARK-17666) take() or isEmpty() on dataset leaks s3a connections

2016-09-26 Thread Igor Berman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Berman updated SPARK-17666: Description: I'm experiensing problems with s3a and working with parquet with dataset api the

[jira] [Commented] (SPARK-17666) take() or isEmpty() on dataset leaks s3a connections

2016-09-26 Thread Igor Berman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523303#comment-15523303 ] Igor Berman commented on SPARK-17666: - sorry, still no idea. What's the difference between take and

[jira] [Commented] (SPARK-17666) take() or isEmpty() on dataset leaks s3a connections

2016-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523290#comment-15523290 ] Sean Owen commented on SPARK-17666: --- No, I mean what about take() do you believe leaks a connection? is

[jira] [Updated] (SPARK-17666) take() or isEmpty() on dataset leaks s3a connections

2016-09-26 Thread Igor Berman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Berman updated SPARK-17666: Description: I'm experiensing problems with s3a and working with parquet with dataset api the

[jira] [Commented] (SPARK-17666) take() or isEmpty() on dataset leaks s3a connections

2016-09-26 Thread Igor Berman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523286#comment-15523286 ] Igor Berman commented on SPARK-17666: - [~sowen], yes, I believe so rdd.isEmpty() uses take inside as

[jira] [Commented] (SPARK-17666) take() or isEmpty() on dataset leaks s3a connections

2016-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523280#comment-15523280 ] Sean Owen commented on SPARK-17666: --- Where are you saying the leak is, from take()? > take() or

[jira] [Created] (SPARK-17666) take() or isEmpty() on dataset leaks s3a connections

2016-09-26 Thread Igor Berman (JIRA)
Igor Berman created SPARK-17666: --- Summary: take() or isEmpty() on dataset leaks s3a connections Key: SPARK-17666 URL: https://issues.apache.org/jira/browse/SPARK-17666 Project: Spark Issue

[jira] [Commented] (SPARK-17454) Add option to specify Mesos resource offer constraints

2016-09-26 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523003#comment-15523003 ] Chris Bannister commented on SPARK-17454: - Yep, it would be good to also provide isolation

[jira] [Commented] (SPARK-17556) Executor side broadcast for broadcast joins

2016-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522817#comment-15522817 ] Apache Spark commented on SPARK-17556: -- User 'scwf' has created a pull request for this issue:

[jira] [Updated] (SPARK-17556) Executor side broadcast for broadcast joins

2016-09-26 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Wang updated SPARK-17556: - Attachment: executor broadcast.pdf update design doc > Executor side broadcast for broadcast joins >

[jira] [Updated] (SPARK-17556) Executor side broadcast for broadcast joins

2016-09-26 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Wang updated SPARK-17556: - Attachment: (was: executor broadcast.pdf) > Executor side broadcast for broadcast joins >

[jira] [Resolved] (SPARK-16356) Add testImplicits for ML unit tests and promote toDF()

2016-09-26 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-16356. - Resolution: Fixed Fix Version/s: 2.1.0 > Add testImplicits for ML unit tests and promote

[jira] [Commented] (SPARK-10872) Derby error (XSDB6) when creating new HiveContext after restarting SparkContext

2016-09-26 Thread hamroune zahir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522561#comment-15522561 ] hamroune zahir commented on SPARK-10872: the issue is still not resolved my workaround (in scala)

[jira] [Resolved] (SPARK-14909) Spark UI submitted time is wrong

2016-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14909. --- Resolution: Cannot Reproduce > Spark UI submitted time is wrong > >

[jira] [Resolved] (SPARK-14525) DataFrameWriter's save method should delegate to jdbc for jdbc datasource

2016-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14525. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 12601

[jira] [Updated] (SPARK-14525) DataFrameWriter's save method should delegate to jdbc for jdbc datasource

2016-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14525: -- Assignee: Justin Pihony > DataFrameWriter's save method should delegate to jdbc for jdbc datasource >

[jira] [Resolved] (SPARK-17664) Failed to saveAsHadoop when speculate is enabled

2016-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17664. --- Resolution: Duplicate > Failed to saveAsHadoop when speculate is enabled >

[jira] [Commented] (SPARK-16532) Provide a REST API for submitting and tracking status of jobs

2016-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522442#comment-15522442 ] Sean Owen commented on SPARK-16532: --- No I don't think this is about adding a whole new API. It might be

[jira] [Assigned] (SPARK-17665) SparkR does not support options in other types consistently other APIs

2016-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17665: Assignee: Apache Spark > SparkR does not support options in other types consistently

[jira] [Assigned] (SPARK-17665) SparkR does not support options in other types consistently other APIs

2016-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17665: Assignee: (was: Apache Spark) > SparkR does not support options in other types

[jira] [Commented] (SPARK-17665) SparkR does not support options in other types consistently other APIs

2016-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522398#comment-15522398 ] Apache Spark commented on SPARK-17665: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-17665) SparkR does not support options in other types consistently other APIs

2016-09-26 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522372#comment-15522372 ] Hyukjin Kwon commented on SPARK-17665: -- Let me please open a PR and then talk there as it would be a

[jira] [Commented] (SPARK-16532) Provide a REST API for submitting and tracking status of jobs

2016-09-26 Thread OuyangJin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522353#comment-15522353 ] OuyangJin commented on SPARK-16532: --- I'll take a look at this. You suggest spark provide a restful api

[jira] [Commented] (SPARK-17665) SparkR does not support options in other types consistently other APIs

2016-09-26 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522331#comment-15522331 ] Hyukjin Kwon commented on SPARK-17665: -- You are so fast! How about numeric types? Actually, I was

[jira] [Updated] (SPARK-17665) SparkR does not support options in other types consistently other APIs

2016-09-26 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-17665: - Summary: SparkR does not support options in other types consistently other APIs (was: SparkR

[jira] [Commented] (SPARK-17665) SparkR supports options in other types consistently other APIs

2016-09-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522240#comment-15522240 ] Felix Cheung commented on SPARK-17665: -- for backward compatibility, we might need to support values

<    1   2