[jira] [Commented] (SPARK-11199) Improve R context management story and add getOrCreate

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965560#comment-14965560 ] Apache Spark commented on SPARK-11199: -- User 'falaki' has created a pull request for this issue:

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-10-20 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965459#comment-14965459 ] Jonathan Kelly commented on SPARK-8332: --- [~srowen], isn't this still a problem? It seems odd that

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965477#comment-14965477 ] Sean Owen commented on SPARK-8332: -- I think Spark can use a later Jackson, though that's a different

[jira] [Commented] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-10-20 Thread Jerry Lam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965510#comment-14965510 ] Jerry Lam commented on SPARK-10309: --- Same issue, I got the following stacktrace: 15/10/20 18:20:43

[jira] [Closed] (SPARK-11201) StreamContext.getOrCreate is broken is yarn-client mode

2015-10-20 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan closed SPARK-11201. Resolution: Duplicate > StreamContext.getOrCreate is broken is yarn-client mode >

[jira] [Comment Edited] (SPARK-10953) Benchmark codegen vs. hand-written code for univariate statistics

2015-10-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958386#comment-14958386 ] Reynold Xin edited comment on SPARK-10953 at 10/20/15 7:24 PM: --- [~mengxr]

[jira] [Resolved] (SPARK-3842) Remove the hacks for Python callback server in py4j

2015-10-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3842. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8615

[jira] [Assigned] (SPARK-11199) Improve R context management story and add getOrCreate

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11199: Assignee: Apache Spark (was: Felix Cheung) > Improve R context management story and add

[jira] [Commented] (SPARK-11199) Improve R context management story and add getOrCreate

2015-10-20 Thread Hossein Falaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965559#comment-14965559 ] Hossein Falaki commented on SPARK-11199: Thanks for filing this [~felixcheung]. I submitted this

[jira] [Commented] (SPARK-3842) Remove the hacks for Python callback server in py4j

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965446#comment-14965446 ] Apache Spark commented on SPARK-3842: - User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-3842) Remove the hacks for Python callback server in py4j

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3842: --- Assignee: Apache Spark (was: Davies Liu) > Remove the hacks for Python callback server in

[jira] [Updated] (SPARK-9298) corr aggregate functions

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9298: - Assignee: Liang-Chi Hsieh > corr aggregate functions > > >

[jira] [Updated] (SPARK-9298) corr aggregate functions

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9298: - Shepherd: Xiangrui Meng > corr aggregate functions > > >

[jira] [Resolved] (SPARK-11214) Join with Unicode-String results wrong empty

2015-10-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11214. Resolution: Fixed Fix Version/s: 1.5.1 It looks like we have fixed this issue in Spark

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread Phil Kallos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965525#comment-14965525 ] Phil Kallos commented on SPARK-11193: - Ok, I was able to build Spark 1.5.x using Scala 2.11 (still

[jira] [Assigned] (SPARK-11215) Add multiple columns support to StringIndexer

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11215: Assignee: (was: Apache Spark) > Add multiple columns support to StringIndexer >

[jira] [Resolved] (SPARK-11213) Documentation for remote spark Submit for R Scripts from 1.5 on CDH 5.4

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11213. --- Resolution: Invalid This is not a bug, but a question. Please use the mailing list

[jira] [Commented] (SPARK-11215) Add multiple columns support to StringIndexer

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965261#comment-14965261 ] Apache Spark commented on SPARK-11215: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11215) Add multiple columns support to StringIndexer

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11215: Assignee: Apache Spark > Add multiple columns support to StringIndexer >

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-20 Thread Bilind Hajer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965391#comment-14965391 ] Bilind Hajer commented on SPARK-11190: -- Nvm, answered my own question. Will test on Master and let

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-20 Thread Bilind Hajer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965320#comment-14965320 ] Bilind Hajer commented on SPARK-11190: -- Sorry about that Sean Owen. So I'm assuming this fix is in

[jira] [Commented] (SPARK-11128) strange NPE when writing in non-existing S3 bucket

2015-10-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965358#comment-14965358 ] Steve Loughran commented on SPARK-11128: nothing to worry about then: problem is fixed already.

[jira] [Comment Edited] (SPARK-8418) Add single- and multi-value support to ML Transformers

2015-10-20 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965268#comment-14965268 ] Yanbo Liang edited comment on SPARK-8418 at 10/20/15 3:43 PM: -- [~josephkb] I

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965327#comment-14965327 ] Shivaram Venkataraman commented on SPARK-11190: --- The changes I mentioned are not in 1.5.2.

[jira] [Commented] (SPARK-8418) Add single- and multi-value support to ML Transformers

2015-10-20 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965268#comment-14965268 ] Yanbo Liang commented on SPARK-8418: [~josephkb] I have implemented StringIndexer supporting multiple

[jira] [Resolved] (SPARK-10463) remove PromotePrecision during optimization

2015-10-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10463. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8621

[jira] [Commented] (SPARK-11192) Spark sql seems to leak org.apache.spark.sql.execution.ui.SQLTaskMetrics objects over time

2015-10-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965371#comment-14965371 ] Josh Rosen commented on SPARK-11192: Hi [~blivingston], this sounds like it might be a duplicate of

[jira] [Commented] (SPARK-11216) add encoder/decoder for external row

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965346#comment-14965346 ] Apache Spark commented on SPARK-11216: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-20 Thread Bilind Hajer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965363#comment-14965363 ] Bilind Hajer commented on SPARK-11190: -- How can I get access to the master branch? Would I be able

[jira] [Resolved] (SPARK-11204) Delegate to scala DataFrame API rather than print in python

2015-10-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11204. Resolution: Duplicate > Delegate to scala DataFrame API rather than print in python >

[jira] [Commented] (SPARK-9506) DataFrames Postgresql JDBC unable to support most of the Postgresql's Data Type

2015-10-20 Thread Marius Van Niekerk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965319#comment-14965319 ] Marius Van Niekerk commented on SPARK-9506: --- This is related to SPARK-10186 > DataFrames

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965415#comment-14965415 ] Jean-Baptiste Onofré commented on SPARK-11193: -- I did the tests with Scala 2.10.4 (Spark

[jira] [Created] (SPARK-11215) Add multiple columns support to StringIndexer

2015-10-20 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11215: --- Summary: Add multiple columns support to StringIndexer Key: SPARK-11215 URL: https://issues.apache.org/jira/browse/SPARK-11215 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965249#comment-14965249 ] Jean-Baptiste Onofré commented on SPARK-11193: -- I confirm that it works fine for me (with

[jira] [Updated] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated SPARK-11193: - Attachment: screen.png > Spark 1.5+ Kinesis Streaming - ClassCastException when

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread Phil Kallos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965311#comment-14965311 ] Phil Kallos commented on SPARK-11193: - Ah yes, I have a different scala and Java version. I am using

[jira] [Assigned] (SPARK-11216) add encoder/decoder for external row

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11216: Assignee: (was: Apache Spark) > add encoder/decoder for external row >

[jira] [Created] (SPARK-11216) add encoder/decoder for external row

2015-10-20 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11216: --- Summary: add encoder/decoder for external row Key: SPARK-11216 URL: https://issues.apache.org/jira/browse/SPARK-11216 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-11216) add encoder/decoder for external row

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11216: Assignee: Apache Spark > add encoder/decoder for external row >

[jira] [Commented] (SPARK-11195) Exception thrown on executor throws ClassNotFound on driver

2015-10-20 Thread Hurshal Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965642#comment-14965642 ] Hurshal Patel commented on SPARK-11195: --- MyException is in Repro.scala - the assembly jar only has

[jira] [Commented] (SPARK-11213) Documentation for remote spark Submit for R Scripts from 1.5 on CDH 5.4

2015-10-20 Thread Ankit (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965736#comment-14965736 ] Ankit commented on SPARK-11213: --- Thanks for the quick reply.it would be great if the instructions could be

[jira] [Commented] (SPARK-9338) Aliases from SELECT not available in GROUP BY

2015-10-20 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965699#comment-14965699 ] Rick Hillegas commented on SPARK-9338: -- Technically, the requested syntax is not defined by the SQL

[jira] [Resolved] (SPARK-11111) Fast null-safe join

2015-10-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-1. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9120

[jira] [Resolved] (SPARK-11149) Improve performance of primitive types in columnar cache

2015-10-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11149. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9145

[jira] [Commented] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

2015-10-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965832#comment-14965832 ] Reynold Xin commented on SPARK-8029: It'd be really good to fix this in 1.6, and maybe even backport

[jira] [Updated] (SPARK-11218) `./sbin/start-slave.sh --help` should print out the help message

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11218: -- Affects Version/s: (was: 1.5.2) Priority: Minor (was: Major) Component/s:

[jira] [Commented] (SPARK-9297) covar_pop and covar_samp aggregate functions

2015-10-20 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965662#comment-14965662 ] Jihong MA commented on SPARK-9297: -- [~viirya] I just noticed your initial PR for Pearson's correlation is

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-10-20 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965703#comment-14965703 ] Jonathan Kelly commented on SPARK-8332: --- Good news! I tried compiling Spark with Jackson 2.5.3

[jira] [Commented] (SPARK-10827) AppClient should not use `askWithReply` in `receiveAndReply` directly

2015-10-20 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965781#comment-14965781 ] Bryan Cutler commented on SPARK-10827: -- Hi [~zsxwing], I can work on this if you don't mind. >

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965829#comment-14965829 ] Sean Owen commented on SPARK-8332: -- How about 2.6, just out of curiosity? The other issue is colliding

[jira] [Created] (SPARK-11217) Model import/export for non-meta estimators and transformers

2015-10-20 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-11217: - Summary: Model import/export for non-meta estimators and transformers Key: SPARK-11217 URL: https://issues.apache.org/jira/browse/SPARK-11217 Project: Spark

[jira] [Resolved] (SPARK-6740) SQL operator and condition precedence is not honoured

2015-10-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-6740. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8617

[jira] [Created] (SPARK-11218) `./sbin/start-slave.sh --help` should print out the help message

2015-10-20 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-11218: --- Summary: `./sbin/start-slave.sh --help` should print out the help message Key: SPARK-11218 URL: https://issues.apache.org/jira/browse/SPARK-11218 Project:

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-10-20 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965900#comment-14965900 ] Jonathan Kelly commented on SPARK-8332: --- Sorry, yes, I should have checked to see what the latest

[jira] [Commented] (SPARK-11220) SQL data source gives confusing error message when file not found

2015-10-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965927#comment-14965927 ] Michael Armbrust commented on SPARK-11220: -- My hunch is this has something to do with file

[jira] [Commented] (SPARK-11192) Spark sql seems to leak org.apache.spark.sql.execution.ui.SQLTaskMetrics objects over time

2015-10-20 Thread Blake Livingston (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965924#comment-14965924 ] Blake Livingston commented on SPARK-11192: -- I think that is the same issue. Closing this bug

[jira] [Created] (SPARK-11220) SQL data source gives confusing error message when file not found

2015-10-20 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11220: --- Summary: SQL data source gives confusing error message when file not found Key: SPARK-11220 URL: https://issues.apache.org/jira/browse/SPARK-11220 Project: Spark

[jira] [Assigned] (SPARK-6328) Python API for StreamingListener

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6328: --- Assignee: Apache Spark > Python API for StreamingListener >

[jira] [Commented] (SPARK-6328) Python API for StreamingListener

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965866#comment-14965866 ] Apache Spark commented on SPARK-6328: - User 'djalova' has created a pull request for this issue:

[jira] [Assigned] (SPARK-6328) Python API for StreamingListener

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6328: --- Assignee: (was: Apache Spark) > Python API for StreamingListener >

[jira] [Resolved] (SPARK-10272) Add @since annotation to pyspark.mllib.evaluation

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10272. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8628

[jira] [Updated] (SPARK-11207) Add test cases for solver selection of LinearRegression as followup.

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11207: -- Shepherd: Xiangrui Meng Assignee: Kai Sasaki > Add test cases for solver selection of

[jira] [Resolved] (SPARK-11192) Spark sql seems to leak org.apache.spark.sql.execution.ui.SQLTaskMetrics objects over time

2015-10-20 Thread Blake Livingston (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Blake Livingston resolved SPARK-11192. -- Resolution: Duplicate > Spark sql seems to leak

[jira] [Created] (SPARK-11219) Make Parameter Description Format Consistent in PySpark.MLlib

2015-10-20 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-11219: Summary: Make Parameter Description Format Consistent in PySpark.MLlib Key: SPARK-11219 URL: https://issues.apache.org/jira/browse/SPARK-11219 Project: Spark

[jira] [Comment Edited] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965210#comment-14965210 ] Jean-Baptiste Onofré edited comment on SPARK-11193 at 10/20/15 2:50 PM:

[jira] [Comment Edited] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965210#comment-14965210 ] Jean-Baptiste Onofré edited comment on SPARK-11193 at 10/20/15 2:53 PM:

[jira] [Created] (SPARK-11214) Join with Unicode-String results wrong empty

2015-10-20 Thread Hans Fischer (JIRA)
Hans Fischer created SPARK-11214: Summary: Join with Unicode-String results wrong empty Key: SPARK-11214 URL: https://issues.apache.org/jira/browse/SPARK-11214 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965230#comment-14965230 ] Apache Spark commented on SPARK-1537: - User 'steveloughran' has created a pull request for this issue:

[jira] [Closed] (SPARK-11213) Documentation for remote spark Submit for R Scripts from 1.5 on CDH 5.4

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-11213. - > Documentation for remote spark Submit for R Scripts from 1.5 on CDH 5.4 >

[jira] [Updated] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-10-20 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-9735: - Description: This code is copied from the hadoopFsRelationSuite.scala {code} partitionedTestDF = (for {

[jira] [Created] (SPARK-11222) Add style checker rules to validate doc tests aren't included in docs

2015-10-20 Thread holdenk (JIRA)
holdenk created SPARK-11222: --- Summary: Add style checker rules to validate doc tests aren't included in docs Key: SPARK-11222 URL: https://issues.apache.org/jira/browse/SPARK-11222 Project: Spark

[jira] [Commented] (SPARK-11171) PMML for Pipelines API

2015-10-20 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966008#comment-14966008 ] holdenk commented on SPARK-11171: - Is there an different API in mind for this, or would matching the

[jira] [Created] (SPARK-11223) CrossValidatorModel does not output metrics for every param in paramGrid

2015-10-20 Thread Raela Wang (JIRA)
Raela Wang created SPARK-11223: -- Summary: CrossValidatorModel does not output metrics for every param in paramGrid Key: SPARK-11223 URL: https://issues.apache.org/jira/browse/SPARK-11223 Project: Spark

[jira] [Updated] (SPARK-11212) Make RDD's preferred locations support the executor location and fix ReceiverTracker for multiple executors in a host

2015-10-20 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-11212: - Description: This patch includes the following changes: 1. Add a new preferred location format,

[jira] [Resolved] (SPARK-11153) Turns off Parquet filter push-down for string and binary columns

2015-10-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-11153. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull

[jira] [Commented] (SPARK-5818) unable to use "add jar" in hql

2015-10-20 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966065#comment-14966065 ] Gayathri Murali commented on SPARK-5818: I am trying to use add jar command on Spark 1.5 and run

[jira] [Commented] (SPARK-11171) PMML for Pipelines API

2015-10-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966077#comment-14966077 ] Joseph K. Bradley commented on SPARK-11171: --- I think matching should be fine, but it'd be worth

[jira] [Commented] (SPARK-7852) Set the initial weights based on the previous when GLMs are run with multiple regParams

2015-10-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966075#comment-14966075 ] Joseph K. Bradley commented on SPARK-7852: -- Note: In general, this is a good idea. But if people

[jira] [Commented] (SPARK-11220) SQL data source gives confusing error message when file not found

2015-10-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965959#comment-14965959 ] Josh Rosen commented on SPARK-11220: And it looks like both PRs were closed as soon as I pointed out

[jira] [Commented] (SPARK-11220) SQL data source gives confusing error message when file not found

2015-10-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965957#comment-14965957 ] Josh Rosen commented on SPARK-11220: This duplicates SPARK-10709, which has two open PRs to fix it

[jira] [Closed] (SPARK-8050) Make Savable and Loader Java-friendly.

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-8050. Resolution: Won't Fix Mark this as "Won't Fix" unless we see significant request for it. > Make

[jira] [Resolved] (SPARK-10082) Validate i, j in apply (Dense and Sparse Matrices)

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10082. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8271

[jira] [Updated] (SPARK-10082) Validate i, j in apply (Dense and Sparse Matrices)

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10082: -- Assignee: Manoj Kumar > Validate i, j in apply (Dense and Sparse Matrices) >

[jira] [Commented] (SPARK-7852) Set the initial weights based on the previous when GLMs are run with multiple regParams

2015-10-20 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966017#comment-14966017 ] holdenk commented on SPARK-7852: We should take a look at

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread Phil Kallos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966030#comment-14966030 ] Phil Kallos commented on SPARK-11193: - regarding the SynchronizedMap warning, you can find it on the

[jira] [Updated] (SPARK-7852) Set the initial weights based on the previous when GLMs are run with multiple regParams

2015-10-20 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-7852: --- Shepherd: DB Tsai > Set the initial weights based on the previous when GLMs are run with multiple >

[jira] [Updated] (SPARK-11223) CrossValidatorModel does not output metrics for every param in paramGrid

2015-10-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11223: -- Target Version/s: 1.6.0 > CrossValidatorModel does not output metrics for every param

[jira] [Commented] (SPARK-11116) Initial API Draft

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966071#comment-14966071 ] Apache Spark commented on SPARK-6: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11116) Initial API Draft

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6: Assignee: Michael Armbrust (was: Apache Spark) > Initial API Draft > - >

[jira] [Commented] (SPARK-9297) covar_pop and covar_samp aggregate functions

2015-10-20 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966084#comment-14966084 ] Liang-Chi Hsieh commented on SPARK-9297: Yes. I would like to take it. > covar_pop and covar_samp

[jira] [Commented] (SPARK-11221) Fix R doc for DataFrame function `lit`

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965960#comment-14965960 ] Apache Spark commented on SPARK-11221: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-11221) Fix R doc for DataFrame function `lit`

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11221: Assignee: Apache Spark > Fix R doc for DataFrame function `lit` >

[jira] [Assigned] (SPARK-11221) Fix R doc for DataFrame function `lit`

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11221: Assignee: (was: Apache Spark) > Fix R doc for DataFrame function `lit` >

[jira] [Resolved] (SPARK-11220) SQL data source gives confusing error message when file not found

2015-10-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11220. Resolution: Duplicate > SQL data source gives confusing error message when file not found >

[jira] [Created] (SPARK-11221) Fix R doc for DataFrame function `lit`

2015-10-20 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-11221: Summary: Fix R doc for DataFrame function `lit` Key: SPARK-11221 URL: https://issues.apache.org/jira/browse/SPARK-11221 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-11202) Unsupported dataType

2015-10-20 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966006#comment-14966006 ] holdenk commented on SPARK-11202: - Can you maybe mention what your source schema looks like? >

[jira] [Commented] (SPARK-11145) Cannot filter using a partition key and another column

2015-10-20 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966013#comment-14966013 ] holdenk commented on SPARK-11145: - It seems like a quick* fix would be avoiding pushing down the filter

[jira] [Commented] (SPARK-10928) Spark Mesos finegrain mode with single core CPUs, rendered useless

2015-10-20 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966028#comment-14966028 ] holdenk commented on SPARK-10928: - I've been meaning to learn more about the mesos integration, I can

[jira] [Commented] (SPARK-10658) Could pyspark provide addJars() as scala spark API?

2015-10-20 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966032#comment-14966032 ] holdenk commented on SPARK-10658: - I think adding addJars functionality makes sense, I'll take a look at

[jira] [Assigned] (SPARK-11116) Initial API Draft

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6: Assignee: Apache Spark (was: Michael Armbrust) > Initial API Draft > - >

<    1   2   3   >