[jira] [Updated] (SPARK-9215) Implement WAL-free Kinesis receiver that give at-least once guarantee

2015-07-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9215: - Description: https://docs.google.com/document/d/1k0dl270EnK7uExrsCE7jYw7PYx0YC935uBcxn3p0f58/edit?

[jira] [Created] (SPARK-9215) Implement WAL-free Kinesis receiver that give at-least once guarantee

2015-07-21 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9215: Summary: Implement WAL-free Kinesis receiver that give at-least once guarantee Key: SPARK-9215 URL: https://issues.apache.org/jira/browse/SPARK-9215 Project: Spark

[jira] [Updated] (SPARK-9066) Improve cartesian performance

2015-07-21 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-9066: Description: Currently, for CartesianProduct, if right plan partition record number are small than left par

[jira] [Updated] (SPARK-9066) Improve cartesian performance

2015-07-21 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-9066: Description: Currently, for CartesianProduct, if right plan partition record number are small than left par

[jira] [Resolved] (SPARK-6281) Support incremental updates for Graph

2015-07-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6281. -- Resolution: Won't Fix > Support incremental updates for Graph > - >

[jira] [Resolved] (SPARK-5352) Add getPartitionStrategy in Graph

2015-07-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5352. -- Resolution: Won't Fix > Add getPartitionStrategy in Graph > - > >

[jira] [Resolved] (SPARK-5450) Add APIs to save a graph as a SequenceFile and load it

2015-07-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5450. -- Resolution: Won't Fix > Add APIs to save a graph as a SequenceFile and load it > ---

[jira] [Updated] (SPARK-9210) checkValidAggregateExpression() throws exceptions with bad error messages

2015-07-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9210: - Priority: Trivial (was: Minor) > checkValidAggregateExpression() throws exceptions with bad error message

[jira] [Updated] (SPARK-9137) Unified label verification for Classifier

2015-07-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9137: --- Description: We should to check label valid before training model for ml.classification such as Logist

[jira] [Updated] (SPARK-9137) Unified label verification for Classifier

2015-07-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9137: --- Summary: Unified label verification for Classifier (was: Unified label verification for Predictor) >

[jira] [Commented] (SPARK-9195) RDD/Storage metrics don't update cached partition counts when executors are removed/lost

2015-07-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634783#comment-14634783 ] Sean Owen commented on SPARK-9195: -- Just linking the JIRAs to record I suspect it's the s

[jira] [Resolved] (SPARK-9197) Cached RDD partitions are lost when executors are dynamically deallocated

2015-07-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9197. -- Resolution: Duplicate > Cached RDD partitions are lost when executors are dynamically deallocated >

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634761#comment-14634761 ] Yu Ishikawa commented on SPARK-9121: Actually, we could get rid of the warnings. But i

[jira] [Assigned] (SPARK-9214) support ml.NaiveBayes for Python

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9214: --- Assignee: (was: Apache Spark) > support ml.NaiveBayes for Python > --

[jira] [Commented] (SPARK-9214) support ml.NaiveBayes for Python

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634759#comment-14634759 ] Apache Spark commented on SPARK-9214: - User 'yanboliang' has created a pull request fo

[jira] [Assigned] (SPARK-9214) support ml.NaiveBayes for Python

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9214: --- Assignee: Apache Spark > support ml.NaiveBayes for Python >

[jira] [Assigned] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9121: --- Assignee: Apache Spark > Get rid of the warnings about `no visible global function definition

[jira] [Assigned] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9121: --- Assignee: (was: Apache Spark) > Get rid of the warnings about `no visible global function

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634751#comment-14634751 ] Apache Spark commented on SPARK-9121: - User 'yu-iskw' has created a pull request for t

[jira] [Created] (SPARK-9214) support ml.NaiveBayes for Python

2015-07-21 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-9214: -- Summary: support ml.NaiveBayes for Python Key: SPARK-9214 URL: https://issues.apache.org/jira/browse/SPARK-9214 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9197) Cached RDD partitions are lost when executors are dynamically deallocated

2015-07-21 Thread Kostas Sakellis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634748#comment-14634748 ] Kostas Sakellis commented on SPARK-9197: I think this is a duplicate of: https://i

[jira] [Resolved] (SPARK-8875) Shuffle code cleanup: remove BlockStoreShuffleFetcher class

2015-07-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8875. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7268 [https://github.com/

[jira] [Updated] (SPARK-9199) Upgrade Tachyon dependency to 0.7.0

2015-07-21 Thread Haoyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoyuan Li updated SPARK-9199: -- Assignee: Calvin Jia > Upgrade Tachyon dependency to 0.7.0 > --- > >

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634733#comment-14634733 ] Yu Ishikawa commented on SPARK-9121: Ah, I could avoid the warnings to call {{expect_e

[jira] [Resolved] (SPARK-9173) UnionPushDown should also support Intersect and Except in addition to Union

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9173. Resolution: Fixed Assignee: Yijie Shen Fix Version/s: 1.5.0 > UnionPushDown should a

[jira] [Comment Edited] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634716#comment-14634716 ] Yu Ishikawa edited comment on SPARK-9121 at 7/21/15 7:54 AM: -

[jira] [Resolved] (SPARK-8230) complex function: size

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8230. Resolution: Fixed Assignee: Pedro Rodriguez (was: Cheng Hao) Fix Version/s: 1.5.0 >

[jira] [Resolved] (SPARK-8255) string function: regexp_extract

2015-07-21 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8255. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7468 [https://github.com/

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634716#comment-14634716 ] Yu Ishikawa commented on SPARK-9121: Even though I had changed the code as follows, th

[jira] [Resolved] (SPARK-8256) string function: regexp_replace

2015-07-21 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8256. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7468 [https://github.com/

[jira] [Commented] (SPARK-9162) Implement code generation for ScalaUDF

2015-07-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634671#comment-14634671 ] Josh Rosen commented on SPARK-9162: --- Marking this as a blocker of SPARK-8850, the ticket

[jira] [Assigned] (SPARK-8850) Turn unsafe mode on by default

2015-07-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-8850: - Assignee: Josh Rosen > Turn unsafe mode on by default > -- > >

[jira] [Assigned] (SPARK-8906) Move all internal data source related classes out of sources package

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-8906: -- Assignee: Reynold Xin > Move all internal data source related classes out of sources package >

[jira] [Assigned] (SPARK-8906) Move all internal data source related classes out of sources package

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8906: --- Assignee: Apache Spark > Move all internal data source related classes out of sources package

[jira] [Assigned] (SPARK-8906) Move all internal data source related classes out of sources package

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8906: --- Assignee: (was: Apache Spark) > Move all internal data source related classes out of sour

[jira] [Commented] (SPARK-8906) Move all internal data source related classes out of sources package

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634655#comment-14634655 ] Apache Spark commented on SPARK-8906: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-9213) Improve regular expression performance (via joni)

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634652#comment-14634652 ] Reynold Xin commented on SPARK-9213: I think hbase/presto both use joni. We can look a

[jira] [Resolved] (SPARK-9100) DataFrame reader/writer shortcut methods for ORC

2015-07-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-9100. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7444 [https://github.com/

[jira] [Updated] (SPARK-9154) Implement code generation for StringFormat

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9154: --- Assignee: Tarek Auel > Implement code generation for StringFormat > --

[jira] [Updated] (SPARK-9152) Implement code generation for Like and RLike

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9152: --- Assignee: Liang-Chi Hsieh > Implement code generation for Like and RLike > ---

[jira] [Updated] (SPARK-9165) Implement code generation for CreateArray, CreateStruct, and CreateNamedStruct

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9165: --- Assignee: Yijie Shen > Implement code generation for CreateArray, CreateStruct, and CreateNamedStruct

[jira] [Assigned] (SPARK-8850) Turn unsafe mode on by default

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8850: --- Assignee: Apache Spark > Turn unsafe mode on by default > -- > >

[jira] [Assigned] (SPARK-8850) Turn unsafe mode on by default

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8850: --- Assignee: (was: Apache Spark) > Turn unsafe mode on by default >

[jira] [Commented] (SPARK-8850) Turn unsafe mode on by default

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634630#comment-14634630 ] Apache Spark commented on SPARK-8850: - User 'JoshRosen' has created a pull request for

<    1   2   3