[jira] [Commented] (SPARK-4118) Create python bindings for Streaming KMeans

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564808#comment-14564808 ] Apache Spark commented on SPARK-4118: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-4118) Create python bindings for Streaming KMeans

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4118: --- Assignee: Apache Spark Create python bindings for Streaming KMeans

[jira] [Updated] (SPARK-7524) add configs for keytab and principal, move originals to internal

2015-05-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-7524: - Assignee: Tao Wang add configs for keytab and principal, move originals to internal

[jira] [Updated] (SPARK-7946) DecayFactor wrongly set in StreamingKMeans

2015-05-29 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-7946: --- Component/s: Streaming DecayFactor wrongly set in StreamingKMeans

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

2015-05-29 Thread Akshat Aranya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564919#comment-14564919 ] Akshat Aranya commented on SPARK-7708: -- Thanks, Josh. I'll look into it. I can't

[jira] [Commented] (SPARK-7950) HiveThriftServer2.startWithContext() doesn't set spark.sql.hive.version

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565000#comment-14565000 ] Apache Spark commented on SPARK-7950: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-7950) HiveThriftServer2.startWithContext() doesn't set spark.sql.hive.version

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7950: --- Assignee: Cheng Lian (was: Apache Spark) HiveThriftServer2.startWithContext() doesn't set

[jira] [Assigned] (SPARK-7950) HiveThriftServer2.startWithContext() doesn't set spark.sql.hive.version

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7950: --- Assignee: Apache Spark (was: Cheng Lian) HiveThriftServer2.startWithContext() doesn't set

[jira] [Closed] (SPARK-7524) add configs for keytab and principal, move originals to internal

2015-05-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-7524. Resolution: Fixed Fix Version/s: 1.5.0 add configs for keytab and principal, move originals

[jira] [Created] (SPARK-7950) HiveThriftServer2.startWithContext() doesn't set spark.sql.hive.version

2015-05-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-7950: - Summary: HiveThriftServer2.startWithContext() doesn't set spark.sql.hive.version Key: SPARK-7950 URL: https://issues.apache.org/jira/browse/SPARK-7950 Project: Spark

[jira] [Updated] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-05-29 Thread Alexander Nakos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Nakos updated SPARK-7944: --- Attachment: spark_shell_output_2.10.txt Spark-Shell 2.11 1.4.0-RC-03 does not add jars to

[jira] [Assigned] (SPARK-3873) Scala style: check import ordering

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3873: --- Assignee: (was: Apache Spark) Scala style: check import ordering

[jira] [Commented] (SPARK-3873) Scala style: check import ordering

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565066#comment-14565066 ] Apache Spark commented on SPARK-3873: - User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-7576) User guide update for spark.ml ElementwiseProduct

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7576: --- Assignee: Apache Spark (was: Octavian Geagla) User guide update for spark.ml

[jira] [Updated] (SPARK-7846) Use different way to pass spark.yarn.keytab and spark.yarn.principal in different modes

2015-05-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-7846: - Assignee: Tao Wang Use different way to pass spark.yarn.keytab and spark.yarn.principal in

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-05-29 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564943#comment-14564943 ] Vincent Warmerdam commented on SPARK-7230: -- [~shivaram] on it. you should see

[jira] [Updated] (SPARK-7950) HiveThriftServer2.startWithContext() doesn't set spark.sql.hive.version

2015-05-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-7950: -- Description: While testing the newly released Simba Spark SQL ODBC driver 1.0.8.1006 against

[jira] [Comment Edited] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-05-29 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564943#comment-14564943 ] Vincent Warmerdam edited comment on SPARK-7230 at 5/29/15 3:49 PM:

[jira] [Assigned] (SPARK-7576) User guide update for spark.ml ElementwiseProduct

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7576: --- Assignee: Octavian Geagla (was: Apache Spark) User guide update for spark.ml

[jira] [Commented] (SPARK-7576) User guide update for spark.ml ElementwiseProduct

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565040#comment-14565040 ] Apache Spark commented on SPARK-7576: - User 'ogeagla' has created a pull request for

[jira] [Assigned] (SPARK-5016) GaussianMixtureEM should distribute matrix inverse for large numFeatures, k

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5016: --- Assignee: Apache Spark GaussianMixtureEM should distribute matrix inverse for large

[jira] [Commented] (SPARK-3665) Java API for GraphX

2015-05-29 Thread Piotr Kozikowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565176#comment-14565176 ] Piotr Kozikowski commented on SPARK-3665: - Is this still planned to be included in

[jira] [Assigned] (SPARK-7939) Make URL partition recognition return String by default for all partition column types and values

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7939: --- Assignee: (was: Apache Spark) Make URL partition recognition return String by default

[jira] [Assigned] (SPARK-7939) Make URL partition recognition return String by default for all partition column types and values

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7939: --- Assignee: Apache Spark Make URL partition recognition return String by default for all

[jira] [Commented] (SPARK-7939) Make URL partition recognition return String by default for all partition column types and values

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565083#comment-14565083 ] Apache Spark commented on SPARK-7939: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-7555) User guide update for ElasticNet

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7555: --- Assignee: Apache Spark (was: DB Tsai) User guide update for ElasticNet

[jira] [Commented] (SPARK-7555) User guide update for ElasticNet

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565183#comment-14565183 ] Apache Spark commented on SPARK-7555: - User 'coderxiang' has created a pull request

[jira] [Assigned] (SPARK-7555) User guide update for ElasticNet

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7555: --- Assignee: DB Tsai (was: Apache Spark) User guide update for ElasticNet

[jira] [Resolved] (SPARK-7950) HiveThriftServer2.startWithContext() doesn't set spark.sql.hive.version

2015-05-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7950. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6500

[jira] [Updated] (SPARK-7946) DecayFactor wrongly set in StreamingKMeans

2015-05-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7946: - Assignee: Manoj Kumar DecayFactor wrongly set in StreamingKMeans

[jira] [Updated] (SPARK-7946) DecayFactor wrongly set in StreamingKMeans

2015-05-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7946: - Fix Version/s: (was: 1.6.0) DecayFactor wrongly set in StreamingKMeans

[jira] [Created] (SPARK-7951) Events Missing with custom sparkListener

2015-05-29 Thread Anubhav Srivastava (JIRA)
Anubhav Srivastava created SPARK-7951: - Summary: Events Missing with custom sparkListener Key: SPARK-7951 URL: https://issues.apache.org/jira/browse/SPARK-7951 Project: Spark Issue Type:

[jira] [Created] (SPARK-7959) Uneven distribution of receivers in the cluster

2015-05-29 Thread Nishkam Ravi (JIRA)
Nishkam Ravi created SPARK-7959: --- Summary: Uneven distribution of receivers in the cluster Key: SPARK-7959 URL: https://issues.apache.org/jira/browse/SPARK-7959 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-7910) Expose partitioner information in JavaRDD

2015-05-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7910: -- Assignee: holdenk Expose partitioner information in JavaRDD -

[jira] [Created] (SPARK-7958) Failed StreamingContext.start() can leak active actors

2015-05-29 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-7958: Summary: Failed StreamingContext.start() can leak active actors Key: SPARK-7958 URL: https://issues.apache.org/jira/browse/SPARK-7958 Project: Spark Issue

[jira] [Commented] (SPARK-7529) Java compatibility check for MLlib 1.4

2015-05-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565585#comment-14565585 ] Joseph K. Bradley commented on SPARK-7529: -- I'm putting together a PR for the

[jira] [Created] (SPARK-7960) Serialization problem when multiple receivers are specified in a loop

2015-05-29 Thread Nishkam Ravi (JIRA)
Nishkam Ravi created SPARK-7960: --- Summary: Serialization problem when multiple receivers are specified in a loop Key: SPARK-7960 URL: https://issues.apache.org/jira/browse/SPARK-7960 Project: Spark

[jira] [Updated] (SPARK-7959) Uneven distribution of receivers in the cluster

2015-05-29 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-7959: Attachment: Screen Shot 2015-05-29 at 3.52.01 PM.png Uneven distribution of receivers in the

[jira] [Resolved] (SPARK-7910) Expose partitioner information in JavaRDD

2015-05-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7910. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6464

[jira] [Resolved] (SPARK-7954) Implicitly create SparkContext in sparkRSQL.init

2015-05-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-7954. --- Resolution: Fixed Fix Version/s: 1.4.1 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-7954) Implicitly create SparkContext in sparkRSQL.init

2015-05-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-7954: -- Fix Version/s: (was: 1.6.0) 1.5.0 Implicitly create SparkContext in

[jira] [Updated] (SPARK-7529) Java compatibility check for MLlib 1.4

2015-05-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7529: - Description: Check Java compatibility for MLlib 1.4. We should create separate JIRAs for

[jira] [Updated] (SPARK-7955) Dynamic allocation: longer timeout for executors with cached blocks

2015-05-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7955: - Summary: Dynamic allocation: longer timeout for executors with cached blocks (was: Ensure executors that

[jira] [Updated] (SPARK-7955) Dynamic allocation: longer timeout for executors with cached blocks

2015-05-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7955: - Assignee: Hari Shreedharan Dynamic allocation: longer timeout for executors with cached blocks

[jira] [Updated] (SPARK-7955) Dynamic allocation: longer timeout for executors with cached blocks

2015-05-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7955: - Target Version/s: 1.5.0 Affects Version/s: 1.4.0 Dynamic allocation: longer timeout for executors

[jira] [Commented] (SPARK-7541) Check model save/load for MLlib 1.4

2015-05-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565583#comment-14565583 ] Joseph K. Bradley commented on SPARK-7541: -- Sounds good. We can make JIRAs for

[jira] [Commented] (SPARK-7558) Log test name when starting and finishing each test

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565604#comment-14565604 ] Apache Spark commented on SPARK-7558: - User 'andrewor14' has created a pull request

[jira] [Commented] (SPARK-7707) User guide and example code for Statistics.kernelDensity

2015-05-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565638#comment-14565638 ] Sandy Ryza commented on SPARK-7707: --- Sorry for the delayed response here. I will try to

[jira] [Commented] (SPARK-7938) Use errorprone in Spark

2015-05-29 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565836#comment-14565836 ] Yijie Shen commented on SPARK-7938: --- [~joshrosen] I can't integrate error prone into SBT

[jira] [Assigned] (SPARK-7938) Use errorprone in Spark

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7938: --- Assignee: Apache Spark Use errorprone in Spark ---

[jira] [Assigned] (SPARK-7938) Use errorprone in Spark

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7938: --- Assignee: (was: Apache Spark) Use errorprone in Spark ---

[jira] [Commented] (SPARK-7938) Use errorprone in Spark

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565835#comment-14565835 ] Apache Spark commented on SPARK-7938: - User 'yijieshen' has created a pull request for

[jira] [Commented] (SPARK-7498) Params.setDefault should keep varargs annotation

2015-05-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565778#comment-14565778 ] Joseph K. Bradley commented on SPARK-7498: -- [~mengxr] I'm frequently running into

[jira] [Updated] (SPARK-7961) Redesign SQLConf for better error message reporting

2015-05-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7961: --- Description: Right now, we don't validate config values and as a result will throw exceptions when

[jira] [Resolved] (SPARK-7957) Preserve partitioning in randomSplit in RDD.scala

2015-05-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7957. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Assignee: Burak

[jira] [Created] (SPARK-7961) Redesign SQLConf to report better error messages

2015-05-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7961: -- Summary: Redesign SQLConf to report better error messages Key: SPARK-7961 URL: https://issues.apache.org/jira/browse/SPARK-7961 Project: Spark Issue Type:

[jira] [Updated] (SPARK-7961) Redesign SQLConf for better error message reporting

2015-05-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7961: --- Summary: Redesign SQLConf for better error message reporting (was: Redesign SQLConf to report better

[jira] [Commented] (SPARK-7961) Redesign SQLConf for better error message reporting

2015-05-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565803#comment-14565803 ] Reynold Xin commented on SPARK-7961: One other thing that'd be nice as part of this

[jira] [Commented] (SPARK-6013) Add more Python ML examples for spark.ml

2015-05-29 Thread Ram Sriharsha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565819#comment-14565819 ] Ram Sriharsha commented on SPARK-6013: -- Cross Validator Example is covered as part of

[jira] [Resolved] (SPARK-7946) DecayFactor wrongly set in StreamingKMeans

2015-05-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7946. -- Resolution: Fixed Fix Version/s: 1.4.0 1.6.0 1.2.3

[jira] [Created] (SPARK-7955) Ensure executors that have cached blocks are not removed when dynamic allocation is enabled

2015-05-29 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-7955: --- Summary: Ensure executors that have cached blocks are not removed when dynamic allocation is enabled Key: SPARK-7955 URL: https://issues.apache.org/jira/browse/SPARK-7955

[jira] [Assigned] (SPARK-7955) Ensure executors that have cached blocks are not removed when dynamic allocation is enabled

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7955: --- Assignee: (was: Apache Spark) Ensure executors that have cached blocks are not removed

[jira] [Assigned] (SPARK-7955) Ensure executors that have cached blocks are not removed when dynamic allocation is enabled

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7955: --- Assignee: Apache Spark Ensure executors that have cached blocks are not removed when

[jira] [Commented] (SPARK-7955) Ensure executors that have cached blocks are not removed when dynamic allocation is enabled

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565387#comment-14565387 ] Apache Spark commented on SPARK-7955: - User 'harishreedharan' has created a pull

[jira] [Updated] (SPARK-7558) Log test name when starting and finishing each test

2015-05-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7558: - Fix Version/s: 1.5.0 Log test name when starting and finishing each test

[jira] [Commented] (SPARK-5610) Generate Java docs without package private classes and methods

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565293#comment-14565293 ] Apache Spark commented on SPARK-5610: - User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-7954) Implicitly create SparkContext in sparkRSQL.init

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7954: --- Assignee: Shivaram Venkataraman (was: Apache Spark) Implicitly create SparkContext in

[jira] [Commented] (SPARK-7954) Implicitly create SparkContext in sparkRSQL.init

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565327#comment-14565327 ] Apache Spark commented on SPARK-7954: - User 'shivaram' has created a pull request for

[jira] [Resolved] (SPARK-7940) Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH

2015-05-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7940. Resolution: Fixed Fix Version/s: 1.4.0 Enforce whitespace checking for DO, TRY, CATCH,

[jira] [Created] (SPARK-7952) equality check between boolean type and numeric type is broken.

2015-05-29 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-7952: -- Summary: equality check between boolean type and numeric type is broken. Key: SPARK-7952 URL: https://issues.apache.org/jira/browse/SPARK-7952 Project: Spark

[jira] [Closed] (SPARK-7921) Change includeFirst to dropLast in OneHotEncoder

2015-05-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-7921. Resolution: Fixed Fix Version/s: 1.4.0 Change includeFirst to dropLast in OneHotEncoder

[jira] [Created] (SPARK-7953) Spark should cleanup output dir if job fails

2015-05-29 Thread Mohit Sabharwal (JIRA)
Mohit Sabharwal created SPARK-7953: -- Summary: Spark should cleanup output dir if job fails Key: SPARK-7953 URL: https://issues.apache.org/jira/browse/SPARK-7953 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-7954) Implicitly create SparkContext in sparkRSQL.init

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7954: --- Assignee: Apache Spark (was: Shivaram Venkataraman) Implicitly create SparkContext in

[jira] [Resolved] (SPARK-7951) Events Missing with custom sparkListener

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7951. -- Resolution: Invalid I don't think this clearly describes a problem, and sounds like a question for

[jira] [Assigned] (SPARK-7952) equality check between boolean type and numeric type is broken.

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7952: --- Assignee: Apache Spark equality check between boolean type and numeric type is broken.

[jira] [Assigned] (SPARK-7952) equality check between boolean type and numeric type is broken.

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7952: --- Assignee: (was: Apache Spark) equality check between boolean type and numeric type is

[jira] [Commented] (SPARK-7952) equality check between boolean type and numeric type is broken.

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565270#comment-14565270 ] Apache Spark commented on SPARK-7952: - User 'cloud-fan' has created a pull request for

[jira] [Resolved] (SPARK-7899) PySpark sql/tests breaks pylint validation

2015-05-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-7899. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6439

[jira] [Assigned] (SPARK-7956) Use Janino to compile SQL expression

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7956: --- Assignee: Davies Liu (was: Apache Spark) Use Janino to compile SQL expression

[jira] [Created] (SPARK-7956) Use Janino to compile SQL expression

2015-05-29 Thread Davies Liu (JIRA)
Davies Liu created SPARK-7956: - Summary: Use Janino to compile SQL expression Key: SPARK-7956 URL: https://issues.apache.org/jira/browse/SPARK-7956 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-7956) Use Janino to compile SQL expression

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7956: --- Assignee: Apache Spark (was: Davies Liu) Use Janino to compile SQL expression

[jira] [Updated] (SPARK-3665) Java API for GraphX

2015-05-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3665: - Target Version/s: 1.5.0 (was: 1.4.0) Java API for GraphX ---

[jira] [Commented] (SPARK-3665) Java API for GraphX

2015-05-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565450#comment-14565450 ] Joseph K. Bradley commented on SPARK-3665: -- I'm afraid this is going to slip to

[jira] [Updated] (SPARK-7956) Use Janino to compile SQL expression

2015-05-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-7956: -- Description: The overhead of current implementation of codegen is to high (100ms - 500ms), which

[jira] [Commented] (SPARK-7953) Spark should cleanup output dir if job fails

2015-05-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565470#comment-14565470 ] Josh Rosen commented on SPARK-7953: --- Are you interested in submitting a PR for this?

[jira] [Created] (SPARK-7957) Preserve partitioning in randomSplit in RDD.scala

2015-05-29 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-7957: -- Summary: Preserve partitioning in randomSplit in RDD.scala Key: SPARK-7957 URL: https://issues.apache.org/jira/browse/SPARK-7957 Project: Spark Issue Type:

[jira] [Updated] (SPARK-7956) Use Janino to compile SQL expression

2015-05-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-7956: -- Description: The overhead of current implementation of codegen is to high (50ms - 500ms), which blocks

[jira] [Updated] (SPARK-7951) Events Missing with custom sparkListener

2015-05-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7951: -- Labels: (was: patch) Events Missing with custom sparkListener

[jira] [Commented] (SPARK-7951) Events Missing with custom sparkListener

2015-05-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565475#comment-14565475 ] Josh Rosen commented on SPARK-7951: --- This sounds like a possible duplicate of

[jira] [Assigned] (SPARK-7957) Preserve partitioning in randomSplit in RDD.scala

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7957: --- Assignee: (was: Apache Spark) Preserve partitioning in randomSplit in RDD.scala

[jira] [Assigned] (SPARK-7957) Preserve partitioning in randomSplit in RDD.scala

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7957: --- Assignee: Apache Spark Preserve partitioning in randomSplit in RDD.scala

[jira] [Commented] (SPARK-7957) Preserve partitioning in randomSplit in RDD.scala

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565482#comment-14565482 ] Apache Spark commented on SPARK-7957: - User 'brkyvz' has created a pull request for

<    1   2