[jira] [Commented] (SPARK-3711) Optimize where in clause filter queries

2014-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150987#comment-14150987 ] Apache Spark commented on SPARK-3711: - User 'saucam' has created a pull request for

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

2014-09-28 Thread Larry Xiao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Shepherd: (was: ankurdave) GraphX graph partitioning strategy --

[jira] [Resolved] (SPARK-3699) sbt console tasks don't clean up SparkContext

2014-09-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3699. Resolution: Fixed Fix Version/s: (was: 1.1.1) 1.2.0 sbt console

[jira] [Created] (SPARK-3712) add a new UpdateDStream to update a rdd dynamically

2014-09-28 Thread uncleGen (JIRA)
uncleGen created SPARK-3712: --- Summary: add a new UpdateDStream to update a rdd dynamically Key: SPARK-3712 URL: https://issues.apache.org/jira/browse/SPARK-3712 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3420) Using Sphinx to generate API docs for PySpark

2014-09-28 Thread cocoatomo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151073#comment-14151073 ] cocoatomo commented on SPARK-3420: -- Thank you for the comment. Yes, I am interested in

[jira] [Commented] (SPARK-3712) add a new UpdateDStream to update a rdd dynamically

2014-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151075#comment-14151075 ] Apache Spark commented on SPARK-3712: - User 'uncleGen' has created a pull request for

[jira] [Comment Edited] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2014-09-28 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151017#comment-14151017 ] Guoqiang Li edited comment on SPARK-1405 at 9/28/14 12:05 PM: --

[jira] [Created] (SPARK-3713) Use JSON to serialize DataType

2014-09-28 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3713: - Summary: Use JSON to serialize DataType Key: SPARK-3713 URL: https://issues.apache.org/jira/browse/SPARK-3713 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-3713) Use JSON to serialize DataType

2014-09-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3713: -- Issue Type: Improvement (was: Bug) Use JSON to serialize DataType --

[jira] [Commented] (SPARK-3713) Use JSON to serialize DataType

2014-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151106#comment-14151106 ] Apache Spark commented on SPARK-3713: - User 'liancheng' has created a pull request for

[jira] [Created] (SPARK-3714) Spark workflow scheduler

2014-09-28 Thread Egor Pakhomov (JIRA)
Egor Pakhomov created SPARK-3714: Summary: Spark workflow scheduler Key: SPARK-3714 URL: https://issues.apache.org/jira/browse/SPARK-3714 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-3677) Scalastyle is never applyed to the sources under yarn/common

2014-09-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3677: -- Description: When we run sbt -Pyarn scalastyle or mvn package, scalastyle is not applied to the

[jira] [Updated] (SPARK-3677) Scalastyle is never applyed to the sources under yarn/common

2014-09-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3677: -- Description: When we run sbt -Pyarn scalastyle or mvn package, scalastyle is not applied to the

[jira] [Commented] (SPARK-2548) JavaRecoverableWordCount is missing

2014-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151138#comment-14151138 ] Apache Spark commented on SPARK-2548: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-3685) Spark's local dir scheme is not configurable

2014-09-28 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151148#comment-14151148 ] Matthew Farrellee commented on SPARK-3685: -- i'm skeptical. what would be the

[jira] [Commented] (SPARK-3522) Make spark-ec2 verbosity configurable

2014-09-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151158#comment-14151158 ] Nicholas Chammas commented on SPARK-3522: - [~pwendell] [~shivaram] - Does this

[jira] [Updated] (SPARK-3522) Make spark-ec2 verbosity configurable

2014-09-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3522: Description: When launching a cluster, {{spark-ec2}} spits out a lot of stuff that feels

[jira] [Updated] (SPARK-3479) Have Jenkins show which tests failed in his GitHub messages

2014-09-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3479: Description: A nice thing to do for starters would be to report which category of tests

[jira] [Commented] (SPARK-3714) Spark workflow scheduler

2014-09-28 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151211#comment-14151211 ] Mridul Muralidharan commented on SPARK-3714: Have you tried using oozie for

[jira] [Commented] (SPARK-1040) Collect as Map throws a casting exception when run on a JavaPairRDD object

2014-09-28 Thread Pulkit Bhuwalka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151231#comment-14151231 ] Pulkit Bhuwalka commented on SPARK-1040: The github link above is not funcitonal

[jira] [Comment Edited] (SPARK-1040) Collect as Map throws a casting exception when run on a JavaPairRDD object

2014-09-28 Thread Pulkit Bhuwalka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151231#comment-14151231 ] Pulkit Bhuwalka edited comment on SPARK-1040 at 9/28/14 9:36 PM:

[jira] [Commented] (SPARK-3274) Spark Streaming Java API reports java.lang.ClassCastException when calling collectAsMap on JavaPairDStream

2014-09-28 Thread Pulkit Bhuwalka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151233#comment-14151233 ] Pulkit Bhuwalka commented on SPARK-3274: SparkConf sparkConf = new

[jira] [Created] (SPARK-3715) [Docs]Minor typo

2014-09-28 Thread WangTaoTheTonic (JIRA)
WangTaoTheTonic created SPARK-3715: -- Summary: [Docs]Minor typo Key: SPARK-3715 URL: https://issues.apache.org/jira/browse/SPARK-3715 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-3715) [Docs]Minor typo

2014-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151285#comment-14151285 ] Apache Spark commented on SPARK-3715: - User 'WangTaoTheTonic' has created a pull

[jira] [Created] (SPARK-3716) Change partitionStrategy to utilize PartitionStrategy.fromString(_) to match edgeStorageLevel and vertexStorageLevel syntax in Analytics.scala

2014-09-28 Thread Benjamin Piering (JIRA)
Benjamin Piering created SPARK-3716: --- Summary: Change partitionStrategy to utilize PartitionStrategy.fromString(_) to match edgeStorageLevel and vertexStorageLevel syntax in Analytics.scala Key: SPARK-3716

[jira] [Resolved] (SPARK-3715) [Docs]Minor typo

2014-09-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3715. - Resolution: Fixed Fix Version/s: 1.1.1 1.2.0 Issue resolved by

[jira] [Commented] (SPARK-3716) Change partitionStrategy to utilize PartitionStrategy.fromString(_) to match edgeStorageLevel and vertexStorageLevel syntax in Analytics.scala

2014-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151303#comment-14151303 ] Apache Spark commented on SPARK-3716: - User 'NamelessAnalyst' has created a pull

[jira] [Reopened] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

2014-09-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-1021: This was reverted due to the commit breaking correlationoptimizer14

[jira] [Commented] (SPARK-3343) Support for CREATE TABLE AS SELECT that specifies the format

2014-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151323#comment-14151323 ] Apache Spark commented on SPARK-3343: - User 'chenghao-intel' has created a pull

[jira] [Commented] (SPARK-3522) Make spark-ec2 verbosity configurable

2014-09-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151348#comment-14151348 ] Shivaram Venkataraman commented on SPARK-3522: -- It would be good, but I think

[jira] [Commented] (SPARK-3685) Spark's local dir scheme is not configurable

2014-09-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151350#comment-14151350 ] Patrick Wendell commented on SPARK-3685: [~andrewor14] changing the use of local

[jira] [Updated] (SPARK-1545) Add Random Forest algorithm to MLlib

2014-09-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1545: - Assignee: Joseph K. Bradley (was: Manish Amde) Add Random Forest algorithm to MLlib

[jira] [Resolved] (SPARK-1545) Add Random Forest algorithm to MLlib

2014-09-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1545. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2435

[jira] [Commented] (SPARK-3685) Spark's local dir scheme is not configurable

2014-09-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151372#comment-14151372 ] Andrew Or commented on SPARK-3685: -- [~farrellee] One of the concerns for SPARK-3174 is

[jira] [Updated] (SPARK-3685) Spark's local dir should accept only local paths

2014-09-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3685: - Summary: Spark's local dir should accept only local paths (was: Spark's local dir scheme is not

[jira] [Updated] (SPARK-3685) Spark's local dir should accept only local paths

2014-09-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3685: - Component/s: Spark Core Spark's local dir should accept only local paths