[jira] [Commented] (SPARK-10518) Update code examples in spark.ml user guide to use LIBSVM data source instead of MLUtils

[ https://issues.apache.org/jira/browse/SPARK-10518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738625#comment-14738625 ] Apache Spark commented on SPARK-10518: -- User 'y-shimizu' has created a pull request

[jira] [Comment Edited] (SPARK-9610) Class and instance weighting for ML

[ https://issues.apache.org/jira/browse/SPARK-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738596#comment-14738596 ] Nickolay Yakushev edited comment on SPARK-9610 at 9/10/15 11:22 AM:

[jira] [Comment Edited] (SPARK-9610) Class and instance weighting for ML

[ https://issues.apache.org/jira/browse/SPARK-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738596#comment-14738596 ] Nickolay Yakushev edited comment on SPARK-9610 at 9/10/15 11:21 AM:

[jira] [Comment Edited] (SPARK-9610) Class and instance weighting for ML

[ https://issues.apache.org/jira/browse/SPARK-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738596#comment-14738596 ] Nickolay Yakushev edited comment on SPARK-9610 at 9/10/15 11:20 AM:

[jira] [Commented] (SPARK-9610) Class and instance weighting for ML

[ https://issues.apache.org/jira/browse/SPARK-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738596#comment-14738596 ] Nickolay Yakushev commented on SPARK-9610: -- Sometimes an algorithm for non-weight

[jira] [Commented] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738587#comment-14738587 ] Robert B. Kim commented on SPARK-8582: -- [~andrewor14] Because of this bug, we suffer

[jira] [Created] (SPARK-10533) DataFrame filter is not handling float/double with Scientific Notation 'e' / 'E'

Rishabh Bhardwaj created SPARK-10533: Summary: DataFrame filter is not handling float/double with Scientific Notation 'e' / 'E' Key: SPARK-10533 URL: https://issues.apache.org/jira/browse/SPARK-10533

[jira] [Comment Edited] (SPARK-10529) When creating multiple HiveContext objects in one jvm, jdbc connections to metastore cann't be released and it may cause PermGen OutOfMemoryError.

[ https://issues.apache.org/jira/browse/SPARK-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738541#comment-14738541 ] ZhengYaofeng edited comment on SPARK-10529 at 9/10/15 10:22 AM: ---

[jira] [Comment Edited] (SPARK-10529) When creating multiple HiveContext objects in one jvm, jdbc connections to metastore cann't be released and it may cause PermGen OutOfMemoryError.

[ https://issues.apache.org/jira/browse/SPARK-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738541#comment-14738541 ] ZhengYaofeng edited comment on SPARK-10529 at 9/10/15 10:13 AM: ---

[jira] [Comment Edited] (SPARK-10529) When creating multiple HiveContext objects in one jvm, jdbc connections to metastore cann't be released and it may cause PermGen OutOfMemoryError.

[ https://issues.apache.org/jira/browse/SPARK-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738541#comment-14738541 ] ZhengYaofeng edited comment on SPARK-10529 at 9/10/15 10:12 AM: ---

[jira] [Commented] (SPARK-10529) When creating multiple HiveContext objects in one jvm, jdbc connections to metastore cann't be released and it may cause PermGen OutOfMemoryError.

[ https://issues.apache.org/jira/browse/SPARK-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738541#comment-14738541 ] ZhengYaofeng commented on SPARK-10529: -- I find that IsolatedClientLoader class conta

[jira] [Updated] (SPARK-10532) Added new option to specify "user profile" of AWS credentials in spark/spark-ec2.py

[ https://issues.apache.org/jira/browse/SPARK-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] teramonagi updated SPARK-10532: --- Description: AWS users want to use "Named Profiles" sometimes. - http://docs.aws.amazon.com/cli/lat

[jira] [Assigned] (SPARK-10532) Added new option to specify "user profile" of AWS credentials in spark/spark-ec2.py

[ https://issues.apache.org/jira/browse/SPARK-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10532: Assignee: (was: Apache Spark) > Added new option to specify "user profile" of AWS cred

[jira] [Assigned] (SPARK-10532) Added new option to specify "user profile" of AWS credentials in spark/spark-ec2.py

[ https://issues.apache.org/jira/browse/SPARK-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10532: Assignee: Apache Spark > Added new option to specify "user profile" of AWS credentials in

[jira] [Commented] (SPARK-10532) Added new option to specify "user profile" of AWS credentials in spark/spark-ec2.py

[ https://issues.apache.org/jira/browse/SPARK-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738519#comment-14738519 ] Apache Spark commented on SPARK-10532: -- User 'teramonagi' has created a pull request

[jira] [Created] (SPARK-10532) Added new option to specify "user profile" of AWS credentials in spark/spark-ec2.py

teramonagi created SPARK-10532: -- Summary: Added new option to specify "user profile" of AWS credentials in spark/spark-ec2.py Key: SPARK-10532 URL: https://issues.apache.org/jira/browse/SPARK-10532 Proje

[jira] [Updated] (SPARK-10529) When creating multiple HiveContext objects in one jvm, jdbc connections to metastore cann't be released and it may cause PermGen OutOfMemoryError.

[ https://issues.apache.org/jira/browse/SPARK-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZhengYaofeng updated SPARK-10529: - Description: Test code as follows: object SqlTest { def main(args: Array[String]) { def c

[jira] [Updated] (SPARK-10529) When creating multiple HiveContext objects in one jvm, jdbc connections to metastore cann't be released and it may cause PermGen OutOfMemoryError.

[ https://issues.apache.org/jira/browse/SPARK-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZhengYaofeng updated SPARK-10529: - Description: Test code as follows: object SqlTest { def main(args: Array[String]) { def c

[jira] [Commented] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738479#comment-14738479 ] Sun Rui commented on SPARK-10500: - I also realized that SPARK-8313 has problem in Standa

[jira] [Commented] (SPARK-10285) Add @since annotation to pyspark.ml.util

[ https://issues.apache.org/jira/browse/SPARK-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738472#comment-14738472 ] Apache Spark commented on SPARK-10285: -- User 'yu-iskw' has created a pull request fo

[jira] [Comment Edited] (SPARK-10525) Add Python example for VectorSlicer to user guide

[ https://issues.apache.org/jira/browse/SPARK-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738439#comment-14738439 ] Yanbo Liang edited comment on SPARK-10525 at 9/10/15 9:21 AM: -

[jira] [Comment Edited] (SPARK-10525) Add Python example for VectorSlicer to user guide

[ https://issues.apache.org/jira/browse/SPARK-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738439#comment-14738439 ] Yanbo Liang edited comment on SPARK-10525 at 9/10/15 9:21 AM: -

[jira] [Assigned] (SPARK-10285) Add @since annotation to pyspark.ml.util

[ https://issues.apache.org/jira/browse/SPARK-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10285: Assignee: Apache Spark > Add @since annotation to pyspark.ml.util > --

[jira] [Assigned] (SPARK-10285) Add @since annotation to pyspark.ml.util

[ https://issues.apache.org/jira/browse/SPARK-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10285: Assignee: (was: Apache Spark) > Add @since annotation to pyspark.ml.util > ---

[jira] [Comment Edited] (SPARK-10525) Add Python example for VectorSlicer to user guide

[ https://issues.apache.org/jira/browse/SPARK-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738439#comment-14738439 ] Yanbo Liang edited comment on SPARK-10525 at 9/10/15 9:19 AM: -

[jira] [Comment Edited] (SPARK-10525) Add Python example for VectorSlicer to user guide

[ https://issues.apache.org/jira/browse/SPARK-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738439#comment-14738439 ] Yanbo Liang edited comment on SPARK-10525 at 9/10/15 9:18 AM: -

[jira] [Comment Edited] (SPARK-10525) Add Python example for VectorSlicer to user guide

[ https://issues.apache.org/jira/browse/SPARK-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738439#comment-14738439 ] Yanbo Liang edited comment on SPARK-10525 at 9/10/15 9:17 AM: -

[jira] [Comment Edited] (SPARK-10525) Add Python example for VectorSlicer to user guide

[ https://issues.apache.org/jira/browse/SPARK-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738439#comment-14738439 ] Yanbo Liang edited comment on SPARK-10525 at 9/10/15 9:16 AM: -

[jira] [Assigned] (SPARK-10284) Add @since annotation to pyspark.ml.tuning

[ https://issues.apache.org/jira/browse/SPARK-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10284: Assignee: (was: Apache Spark) > Add @since annotation to pyspark.ml.tuning > -

[jira] [Commented] (SPARK-10284) Add @since annotation to pyspark.ml.tuning

[ https://issues.apache.org/jira/browse/SPARK-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738459#comment-14738459 ] Apache Spark commented on SPARK-10284: -- User 'yu-iskw' has created a pull request fo

[jira] [Assigned] (SPARK-10284) Add @since annotation to pyspark.ml.tuning

[ https://issues.apache.org/jira/browse/SPARK-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10284: Assignee: Apache Spark > Add @since annotation to pyspark.ml.tuning >

[jira] [Updated] (SPARK-10529) When creating multiple HiveContext objects in one jvm, jdbc connections to metastore cann't be released and it may cause PermGen OutOfMemoryError.

[ https://issues.apache.org/jira/browse/SPARK-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZhengYaofeng updated SPARK-10529: - Attachment: IsolatedClientLoader.scala > When creating multiple HiveContext objects in one jvm, j

[jira] [Updated] (SPARK-10529) When creating multiple HiveContext objects in one jvm, jdbc connections to metastore cann't be released and it may cause PermGen OutOfMemoryError.

[ https://issues.apache.org/jira/browse/SPARK-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZhengYaofeng updated SPARK-10529: - Flags: Patch > When creating multiple HiveContext objects in one jvm, jdbc connections to > meta

[jira] [Commented] (SPARK-10525) Add Python example for VectorSlicer to user guide

[ https://issues.apache.org/jira/browse/SPARK-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738439#comment-14738439 ] Yanbo Liang commented on SPARK-10525: - OK, very glad to do that. > Add Python exampl

[jira] [Assigned] (SPARK-10283) Add @since annotation to pyspark.ml.regression

[ https://issues.apache.org/jira/browse/SPARK-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10283: Assignee: Apache Spark > Add @since annotation to pyspark.ml.regression >

[jira] [Commented] (SPARK-10283) Add @since annotation to pyspark.ml.regression

[ https://issues.apache.org/jira/browse/SPARK-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738433#comment-14738433 ] Apache Spark commented on SPARK-10283: -- User 'yu-iskw' has created a pull request fo

[jira] [Assigned] (SPARK-10283) Add @since annotation to pyspark.ml.regression

[ https://issues.apache.org/jira/browse/SPARK-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10283: Assignee: (was: Apache Spark) > Add @since annotation to pyspark.ml.regression > -

[jira] [Commented] (SPARK-10510) Add documentation for how to register a custom Kryo serializer in Spark

[ https://issues.apache.org/jira/browse/SPARK-10510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738404#comment-14738404 ] Johannes Günther commented on SPARK-10510: -- If I understand It correctly from re

[jira] [Comment Edited] (SPARK-10510) Add documentation for how to register a custom Kryo serializer in Spark

[ https://issues.apache.org/jira/browse/SPARK-10510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738404#comment-14738404 ] Johannes Günther edited comment on SPARK-10510 at 9/10/15 8:34 AM:

[jira] [Assigned] (SPARK-10282) Add @since annotation to pyspark.ml.recommendation

[ https://issues.apache.org/jira/browse/SPARK-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10282: Assignee: (was: Apache Spark) > Add @since annotation to pyspark.ml.recommendation > -

[jira] [Commented] (SPARK-10282) Add @since annotation to pyspark.ml.recommendation

[ https://issues.apache.org/jira/browse/SPARK-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738394#comment-14738394 ] Apache Spark commented on SPARK-10282: -- User 'yu-iskw' has created a pull request fo

[jira] [Assigned] (SPARK-10282) Add @since annotation to pyspark.ml.recommendation

[ https://issues.apache.org/jira/browse/SPARK-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10282: Assignee: Apache Spark > Add @since annotation to pyspark.ml.recommendation >

[jira] [Commented] (SPARK-10251) Some internal spark classes are not registered with kryo

[ https://issues.apache.org/jira/browse/SPARK-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738396#comment-14738396 ] Reynold Xin commented on SPARK-10251: - I think that's possible -- do you want to subm

[jira] [Commented] (SPARK-10251) Some internal spark classes are not registered with kryo

[ https://issues.apache.org/jira/browse/SPARK-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738390#comment-14738390 ] Marius Soutier commented on SPARK-10251: Any chance for a backport to 1.4.2? > S

[jira] [Commented] (SPARK-10281) Add @since annotation to pyspark.ml.clustering

[ https://issues.apache.org/jira/browse/SPARK-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738386#comment-14738386 ] Apache Spark commented on SPARK-10281: -- User 'yu-iskw' has created a pull request fo

[jira] [Assigned] (SPARK-10281) Add @since annotation to pyspark.ml.clustering

[ https://issues.apache.org/jira/browse/SPARK-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10281: Assignee: Apache Spark > Add @since annotation to pyspark.ml.clustering >

[jira] [Assigned] (SPARK-10281) Add @since annotation to pyspark.ml.clustering

[ https://issues.apache.org/jira/browse/SPARK-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10281: Assignee: (was: Apache Spark) > Add @since annotation to pyspark.ml.clustering > -

[jira] [Commented] (SPARK-10280) Add @since annotation to pyspark.ml.classification

[ https://issues.apache.org/jira/browse/SPARK-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738368#comment-14738368 ] Apache Spark commented on SPARK-10280: -- User 'yu-iskw' has created a pull request fo

[jira] [Assigned] (SPARK-10280) Add @since annotation to pyspark.ml.classification

[ https://issues.apache.org/jira/browse/SPARK-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10280: Assignee: (was: Apache Spark) > Add @since annotation to pyspark.ml.classification > -

[jira] [Assigned] (SPARK-10280) Add @since annotation to pyspark.ml.classification

[ https://issues.apache.org/jira/browse/SPARK-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10280: Assignee: Apache Spark > Add @since annotation to pyspark.ml.classification >

[jira] [Assigned] (SPARK-10279) Add @since annotation to pyspark.mllib.util

[ https://issues.apache.org/jira/browse/SPARK-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10279: Assignee: (was: Apache Spark) > Add @since annotation to pyspark.mllib.util >

[jira] [Assigned] (SPARK-10279) Add @since annotation to pyspark.mllib.util

[ https://issues.apache.org/jira/browse/SPARK-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10279: Assignee: Apache Spark > Add @since annotation to pyspark.mllib.util > ---

[jira] [Commented] (SPARK-10531) AppId is set as AppName in status rest api

[ https://issues.apache.org/jira/browse/SPARK-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738343#comment-14738343 ] Apache Spark commented on SPARK-10531: -- User 'zjffdu' has created a pull request for

[jira] [Commented] (SPARK-10279) Add @since annotation to pyspark.mllib.util

[ https://issues.apache.org/jira/browse/SPARK-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738344#comment-14738344 ] Apache Spark commented on SPARK-10279: -- User 'yu-iskw' has created a pull request fo

[jira] [Commented] (SPARK-9899) JSON/Parquet writing on retry or speculation broken with direct output committer

[ https://issues.apache.org/jira/browse/SPARK-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738328#comment-14738328 ] Apache Spark commented on SPARK-9899: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-10531) AppId is set as AppName in status rest api

[ https://issues.apache.org/jira/browse/SPARK-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738314#comment-14738314 ] Apache Spark commented on SPARK-10531: -- User 'zjffdu' has created a pull request for

[jira] [Assigned] (SPARK-10531) AppId is set as AppName in status rest api

[ https://issues.apache.org/jira/browse/SPARK-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10531: Assignee: Apache Spark > AppId is set as AppName in status rest api >

[jira] [Assigned] (SPARK-10531) AppId is set as AppName in status rest api

[ https://issues.apache.org/jira/browse/SPARK-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10531: Assignee: (was: Apache Spark) > AppId is set as AppName in status rest api > -

[jira] [Updated] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10528: -- Target Version/s: (was: 1.5.0) Priority: Minor (was: Major) [~beloblotskiy] have a look

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738303#comment-14738303 ] Sean Owen commented on SPARK-10528: --- I think the problem is that it's not executable? T

[jira] [Updated] (SPARK-9790) [YARN] Expose in WebUI if NodeManager is the reason why executors were killed.

[ https://issues.apache.org/jira/browse/SPARK-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9790: - Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > [YARN] Expose in WebUI if NodeMa

<    1   2   3