[jira] [Updated] (SPARK-11223) PySpark CrossValidatorModel does not output metrics for every param in paramGrid

2015-10-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11223: -- Summary: PySpark CrossValidatorModel does not output metrics for every param in

[jira] [Resolved] (SPARK-10269) Add @since annotation to pyspark.mllib.classification

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10269. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8626

[jira] [Resolved] (SPARK-10261) Add @Since annotation to ml.evaluation

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10261. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8554

[jira] [Commented] (SPARK-10082) Validate i, j in apply (Dense and Sparse Matrices)

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965982#comment-14965982 ] Apache Spark commented on SPARK-10082: -- User 'mengxr' has created a pull request for this issue:

[jira] [Updated] (SPARK-10767) Make pyspark shared params codegen more consistent

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10767: -- Assignee: holdenk > Make pyspark shared params codegen more consistent >

[jira] [Resolved] (SPARK-10767) Make pyspark shared params codegen more consistent

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10767. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9017

[jira] [Updated] (SPARK-10767) Make pyspark shared params codegen more consistent

2015-10-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10767: -- Target Version/s: 1.6.0 > Make pyspark shared params codegen more consistent >

[jira] [Commented] (SPARK-11168) Explore precise behavior of treeAggregate

2015-10-20 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966011#comment-14966011 ] holdenk commented on SPARK-11168: - This sound interesting :) > Explore precise behavior of treeAggregate

[jira] [Created] (SPARK-11224) Flaky test: o.a.s.ExternalShuffleServiceSuite

2015-10-20 Thread Andrew Or (JIRA)
Andrew Or created SPARK-11224: - Summary: Flaky test: o.a.s.ExternalShuffleServiceSuite Key: SPARK-11224 URL: https://issues.apache.org/jira/browse/SPARK-11224 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11224) Flaky test: o.a.s.ExternalShuffleServiceSuite

2015-10-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11224: -- Labels: flaky-test (was: ) > Flaky test: o.a.s.ExternalShuffleServiceSuite >

[jira] [Issue Comment Deleted] (SPARK-11144) Add SparkLauncher for Spark Streaming, Spark SQL, etc

2015-10-20 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-11144: Comment: was deleted (was: Yes.) > Add SparkLauncher for Spark Streaming, Spark SQL, etc >

[jira] [Commented] (SPARK-11144) Add SparkLauncher for Spark Streaming, Spark SQL, etc

2015-10-20 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966102#comment-14966102 ] Yuhang Chen commented on SPARK-11144: - Yes. > Add SparkLauncher for Spark Streaming, Spark SQL, etc

[jira] [Commented] (SPARK-11144) Add SparkLauncher for Spark Streaming, Spark SQL, etc

2015-10-20 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966101#comment-14966101 ] Yuhang Chen commented on SPARK-11144: - Yes. > Add SparkLauncher for Spark Streaming, Spark SQL, etc

[jira] [Updated] (SPARK-10934) hashCode of unsafe array may crash

2015-10-20 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-10934: --- Summary: hashCode of unsafe array may crash (was: hashCode of unsafe array may crush) > hashCode

[jira] [Created] (SPARK-11225) Prevent generate empty file

2015-10-20 Thread xukun (JIRA)
xukun created SPARK-11225: - Summary: Prevent generate empty file Key: SPARK-11225 URL: https://issues.apache.org/jira/browse/SPARK-11225 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-11199) Improve R context management story and add getOrCreate

2015-10-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966206#comment-14966206 ] Felix Cheung commented on SPARK-11199: -- [~falaki]Nice - I have a slightly different scope in mind -

[jira] [Updated] (SPARK-11224) Flaky test: o.a.s.ExternalShuffleServiceSuite

2015-10-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11224: -- Description:

[jira] [Comment Edited] (SPARK-11200) NettyRpcEnv endless message "cannot send ${message} because RpcEnv is closed"

2015-10-20 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966119#comment-14966119 ] hujiayin edited comment on SPARK-11200 at 10/21/15 2:13 AM: Hi Sean, I think

[jira] [Commented] (SPARK-11200) NettyRpcEnv endless message "cannot send ${message} because RpcEnv is closed"

2015-10-20 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966119#comment-14966119 ] hujiayin commented on SPARK-11200: -- Hi Sean, I think it doesn't relate to environment since version 1.4

[jira] [Updated] (SPARK-11202) Unsupported dataType

2015-10-20 Thread whc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] whc updated SPARK-11202: Description: I read data from oracle and save as parquet ,then get the following error:

[jira] [Assigned] (SPARK-11225) Prevent generate empty file

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11225: Assignee: (was: Apache Spark) > Prevent generate empty file >

[jira] [Commented] (SPARK-11225) Prevent generate empty file

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966151#comment-14966151 ] Apache Spark commented on SPARK-11225: -- User 'viper-kun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11225) Prevent generate empty file

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11225: Assignee: Apache Spark > Prevent generate empty file > --- > >

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966214#comment-14966214 ] Jean-Baptiste Onofré commented on SPARK-11193: -- The warning is not a problem. Let me try

[jira] [Commented] (SPARK-11199) Improve R context management story and add getOrCreate

2015-10-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966218#comment-14966218 ] Felix Cheung commented on SPARK-11199: -- Also, we should consider converging to a single sqlContext

[jira] [Resolved] (SPARK-11221) Fix R doc for DataFrame function `lit`

2015-10-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11221. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11221) Fix R doc for DataFrame function `lit`

2015-10-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11221: -- Assignee: Felix Cheung > Fix R doc for DataFrame function `lit` >

[jira] [Commented] (SPARK-10903) Simplify SQLContext method signatures and use a singleton

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966225#comment-14966225 ] Apache Spark commented on SPARK-10903: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-10903) Simplify SQLContext method signatures and use a singleton

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10903: Assignee: Apache Spark > Simplify SQLContext method signatures and use a singleton >

[jira] [Assigned] (SPARK-10903) Simplify SQLContext method signatures and use a singleton

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10903: Assignee: (was: Apache Spark) > Simplify SQLContext method signatures and use a

[jira] [Resolved] (SPARK-11002) pyspark doesn't support UDAF

2015-10-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved SPARK-11002. Resolution: Duplicate Duplicate of SPARK-10915 > pyspark doesn't support UDAF >

[jira] [Commented] (SPARK-11209) Add window functions into SparkR [step 1]

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966243#comment-14966243 ] Apache Spark commented on SPARK-11209: -- User 'sun-rui' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11209) Add window functions into SparkR [step 1]

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11209: Assignee: Apache Spark > Add window functions into SparkR [step 1] >

[jira] [Assigned] (SPARK-11209) Add window functions into SparkR [step 1]

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11209: Assignee: (was: Apache Spark) > Add window functions into SparkR [step 1] >

[jira] [Commented] (SPARK-11144) Add SparkLauncher for Spark Streaming, Spark SQL, etc

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966298#comment-14966298 ] Jean-Baptiste Onofré commented on SPARK-11144: -- Why not leveraging spark-submit class in

[jira] [Commented] (SPARK-11144) Add SparkLauncher for Spark Streaming, Spark SQL, etc

2015-10-20 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966303#comment-14966303 ] Yuhang Chen commented on SPARK-11144: - Yes, spark-submit can be used to launch Spark, Spark

[jira] [Commented] (SPARK-10903) Simplify SQLContext method signatures and use a singleton

2015-10-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966222#comment-14966222 ] Felix Cheung commented on SPARK-10903: -- Thanks for testing this out and helping to diagnose the

[jira] [Updated] (SPARK-10903) Simplify SQLContext method signatures and use a singleton

2015-10-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-10903: - Summary: Simplify SQLContext method signatures and use a singleton (was: Make sqlContext global

[jira] [Commented] (SPARK-11144) Add SparkLauncher for Spark Streaming, Spark SQL, etc

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966294#comment-14966294 ] Sean Owen commented on SPARK-11144: --- Why do you say it doesn't support 'other libs'? spark-submit is

[jira] [Commented] (SPARK-11200) NettyRpcEnv endless message "cannot send ${message} because RpcEnv is closed"

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966291#comment-14966291 ] Sean Owen commented on SPARK-11200: --- OK, but why did you reopen this? it sounds like you're not sure

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965094#comment-14965094 ] Jean-Baptiste Onofré commented on SPARK-11193: -- Unfortunately, my amazon aws account expired

<    1   2   3