[jira] [Created] (SPARK-7261) Change default log level to WARN in the REPL

2015-04-29 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7261: -- Summary: Change default log level to WARN in the REPL Key: SPARK-7261 URL: https://issues.apache.org/jira/browse/SPARK-7261 Project: Spark Issue Type: Im

[jira] [Resolved] (SPARK-6529) Word2Vec transformer

2015-04-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6529. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5596 [https://githu

[jira] [Created] (SPARK-7260) Support changing Spark's log level programatically

2015-04-29 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7260: -- Summary: Support changing Spark's log level programatically Key: SPARK-7260 URL: https://issues.apache.org/jira/browse/SPARK-7260 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-7224) Mock repositories for testing with --packages

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7224: --- Assignee: Burak Yavuz (was: Apache Spark) > Mock repositories for testing with --packages >

[jira] [Assigned] (SPARK-7224) Mock repositories for testing with --packages

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7224: --- Assignee: Apache Spark (was: Burak Yavuz) > Mock repositories for testing with --packages >

[jira] [Updated] (SPARK-7222) Added mathematical derivation in comment and compressed the model to LinearRegression with ElasticNet

2015-04-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7222: - Assignee: DB Tsai > Added mathematical derivation in comment and compressed the model to > Linear

[jira] [Commented] (SPARK-7224) Mock repositories for testing with --packages

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520353#comment-14520353 ] Apache Spark commented on SPARK-7224: - User 'brkyvz' has created a pull request for th

[jira] [Resolved] (SPARK-7222) Added mathematical derivation in comment and compressed the model to LinearRegression with ElasticNet

2015-04-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7222. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5767 [https://githu

[jira] [Commented] (SPARK-7259) VectorIndexer: do not preserve non-ML metadata in output

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520343#comment-14520343 ] Apache Spark commented on SPARK-7259: - User 'jkbradley' has created a pull request for

[jira] [Assigned] (SPARK-7259) VectorIndexer: do not preserve non-ML metadata in output

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7259: --- Assignee: Joseph K. Bradley (was: Apache Spark) > VectorIndexer: do not preserve non-ML meta

[jira] [Assigned] (SPARK-7259) VectorIndexer: do not preserve non-ML metadata in output

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7259: --- Assignee: Apache Spark (was: Joseph K. Bradley) > VectorIndexer: do not preserve non-ML meta

[jira] [Created] (SPARK-7259) VectorIndexer: do not preserve non-ML metadata in output

2015-04-29 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7259: Summary: VectorIndexer: do not preserve non-ML metadata in output Key: SPARK-7259 URL: https://issues.apache.org/jira/browse/SPARK-7259 Project: Spark

[jira] [Updated] (SPARK-7250) computeInverse for RowMatrix

2015-04-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7250: - Priority: Minor (was: Major) Interesting question, whether this API is supposed to be a general-purpose

[jira] [Commented] (SPARK-7255) spark.streaming.kafka.maxRetries not documented

2015-04-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520325#comment-14520325 ] Sean Owen commented on SPARK-7255: -- You can ask on the mailing list if it's a question, f

[jira] [Updated] (SPARK-6763) CountMinSketch

2015-04-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6763: - Description: Count-min sketch to estimate frequencies: http://en.wikipedia.org/wiki/Count%E2%80%93

[jira] [Updated] (SPARK-6763) CountMinSketch

2015-04-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6763: - Summary: CountMinSketch (was: Most frequent values) > CountMinSketch > -- > >

[jira] [Created] (SPARK-7258) spark.ml API taking Graph instead of DataFrame

2015-04-29 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7258: Summary: spark.ml API taking Graph instead of DataFrame Key: SPARK-7258 URL: https://issues.apache.org/jira/browse/SPARK-7258 Project: Spark Issue Ty

[jira] [Created] (SPARK-7257) Find nearest neighbor satisfying predicate

2015-04-29 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7257: Summary: Find nearest neighbor satisfying predicate Key: SPARK-7257 URL: https://issues.apache.org/jira/browse/SPARK-7257 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7255) spark.streaming.kafka.maxRetries not documented

2015-04-29 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520266#comment-14520266 ] Benjamin Fradet commented on SPARK-7255: Otherwise, I'd be glad to add it to the d

[jira] [Created] (SPARK-7256) Add Graph abstraction which uses DataFrame

2015-04-29 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7256: Summary: Add Graph abstraction which uses DataFrame Key: SPARK-7256 URL: https://issues.apache.org/jira/browse/SPARK-7256 Project: Spark Issue Type:

[jira] [Created] (SPARK-7255) spark.streaming.kafka.maxRetries not documented

2015-04-29 Thread Benjamin Fradet (JIRA)
Benjamin Fradet created SPARK-7255: -- Summary: spark.streaming.kafka.maxRetries not documented Key: SPARK-7255 URL: https://issues.apache.org/jira/browse/SPARK-7255 Project: Spark Issue Type:

[jira] [Updated] (SPARK-7254) Extend PIC to handle Graphs directly

2015-04-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7254: - Component/s: GraphX > Extend PIC to handle Graphs directly > -

[jira] [Commented] (SPARK-7111) Add a tracker to track the direct (receiver-less) streams

2015-04-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520241#comment-14520241 ] Tathagata Das commented on SPARK-7111: -- My thought in general about this is that its

[jira] [Created] (SPARK-7254) Extend PIC to handle Graphs directly

2015-04-29 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7254: Summary: Extend PIC to handle Graphs directly Key: SPARK-7254 URL: https://issues.apache.org/jira/browse/SPARK-7254 Project: Spark Issue Type: New Fe

[jira] [Commented] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

2015-04-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520232#comment-14520232 ] Andrew Or commented on SPARK-7233: -- [~preeze] would you like to submit a patch for this?

[jira] [Commented] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

2015-04-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520211#comment-14520211 ] Andrew Or commented on SPARK-7233: -- Yes, it can be a static field since that part is pret

[jira] [Updated] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7233: --- Priority: Critical (was: Major) > ClosureCleaner#clean blocks concurrent job submitter thread

[jira] [Updated] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7233: --- Target Version/s: 1.4.0 > ClosureCleaner#clean blocks concurrent job submitter threads > -

[jira] [Commented] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520202#comment-14520202 ] Patrick Wendell commented on SPARK-7233: Thanks this is a great find. As a simple

[jira] [Updated] (SPARK-7237) Many user provided closures are not actually cleaned

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7237: --- Component/s: Spark Core > Many user provided closures are not actually cleaned > -

[jira] [Comment Edited] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520170#comment-14520170 ] Jacek Lewandowski edited comment on SPARK-7169 at 4/29/15 8:33 PM: -

[jira] [Commented] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520170#comment-14520170 ] Jacek Lewandowski commented on SPARK-7169: -- https://github.com/apache/spark/pull/

[jira] [Resolved] (SPARK-6629) cancelJobGroup() may not work for jobs whose job groups are inherited from parent threads

2015-04-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-6629. -- Resolution: Fixed Fix Version/s: 1.4.0 > cancelJobGroup() may not work for jobs whose job

[jira] [Assigned] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7169: --- Assignee: (was: Apache Spark) > Allow to specify metrics configuration more flexibly > --

[jira] [Commented] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520157#comment-14520157 ] Apache Spark commented on SPARK-7169: - User 'jacek-lewandowski' has created a pull req

[jira] [Assigned] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7169: --- Assignee: Apache Spark > Allow to specify metrics configuration more flexibly > -

[jira] [Created] (SPARK-7253) Add example of belief propagation with GraphX

2015-04-29 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7253: Summary: Add example of belief propagation with GraphX Key: SPARK-7253 URL: https://issues.apache.org/jira/browse/SPARK-7253 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-6752) Allow StreamingContext to be recreated from checkpoint and existing SparkContext

2015-04-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-6752. -- Resolution: Fixed > Allow StreamingContext to be recreated from checkpoint and existing > Spark

[jira] [Commented] (SPARK-7076) Binary processing compact tuple representation

2015-04-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520117#comment-14520117 ] Reynold Xin commented on SPARK-7076: I was going to post a design doc, but I realized

[jira] [Updated] (SPARK-7139) Allow received block metadata to be saved to WAL and recovered on driver failure

2015-04-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7139: - Description: The received API allows arbitrary metadata to be added for each block. However that

[jira] [Resolved] (SPARK-7056) Make the WriteAheadLog pluggable

2015-04-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7056. -- Resolution: Fixed Fix Version/s: 1.4.0 > Make the WriteAheadLog pluggable > -

[jira] [Updated] (SPARK-7237) Many user provided closures are not actually cleaned

2015-04-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7237: - Description: It appears that many operations throughout Spark actually do not actually clean the closures

[jira] [Updated] (SPARK-7237) Many user provided closures are not actually cleaned

2015-04-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7237: - Description: It appears that many operations throughout Spark actually do not actually clean the closures

[jira] [Commented] (SPARK-7237) Many user provided closures are not actually cleaned

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520090#comment-14520090 ] Apache Spark commented on SPARK-7237: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-7237) Many user provided closures are not actually cleaned

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7237: --- Assignee: Apache Spark (was: Andrew Or) > Many user provided closures are not actually clean

[jira] [Assigned] (SPARK-7237) Many user provided closures are not actually cleaned

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7237: --- Assignee: Andrew Or (was: Apache Spark) > Many user provided closures are not actually clean

[jira] [Created] (SPARK-7252) Add support for creating new Hive and HBase delegation tokens

2015-04-29 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-7252: --- Summary: Add support for creating new Hive and HBase delegation tokens Key: SPARK-7252 URL: https://issues.apache.org/jira/browse/SPARK-7252 Project: Spark

[jira] [Updated] (SPARK-7237) Many user provided closures are not actually cleaned

2015-04-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7237: - Summary: Many user provided closures are not actually cleaned (was: Many closures are not actually cleane

[jira] [Updated] (SPARK-7022) PySpark is missing ParamGridBuilder

2015-04-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7022: - Shepherd: Xiangrui Meng > PySpark is missing ParamGridBuilder > --

[jira] [Created] (SPARK-7251) Perform sequential scan when iterating over entries in BytesToBytesMap

2015-04-29 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-7251: - Summary: Perform sequential scan when iterating over entries in BytesToBytesMap Key: SPARK-7251 URL: https://issues.apache.org/jira/browse/SPARK-7251 Project: Spark

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520058#comment-14520058 ] Patrick Wendell commented on SPARK-7230: I think this is a good idea. We should ex

[jira] [Assigned] (SPARK-7250) computeInverse for RowMatrix

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7250: --- Assignee: Apache Spark > computeInverse for RowMatrix > > >

[jira] [Commented] (SPARK-7250) computeInverse for RowMatrix

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520053#comment-14520053 ] Apache Spark commented on SPARK-7250: - User 'SpyderRiverA' has created a pull request

[jira] [Assigned] (SPARK-7250) computeInverse for RowMatrix

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7250: --- Assignee: (was: Apache Spark) > computeInverse for RowMatrix > --

[jira] [Updated] (SPARK-7250) computeInverse for RowMatrix

2015-04-29 Thread Stephanie Rivera (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephanie Rivera updated SPARK-7250: Component/s: MLlib > computeInverse for RowMatrix > > >

[jira] [Created] (SPARK-7250) computeInverse for RowMatrix

2015-04-29 Thread Stephanie Rivera (JIRA)
Stephanie Rivera created SPARK-7250: --- Summary: computeInverse for RowMatrix Key: SPARK-7250 URL: https://issues.apache.org/jira/browse/SPARK-7250 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-7250) computeInverse for RowMatrix

2015-04-29 Thread Stephanie Rivera (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520049#comment-14520049 ] Stephanie Rivera commented on SPARK-7250: - Pull request pending > computeInverse

[jira] [Reopened] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-04-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-6197: -- > handle json parse exception for eventlog file not finished writing >

[jira] [Commented] (SPARK-7076) Binary processing compact tuple representation

2015-04-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520027#comment-14520027 ] Reynold Xin commented on SPARK-7076: The pull request description itself is actually a

[jira] [Created] (SPARK-7249) Updated Hadoop dependencies due to inconsistency in the versions

2015-04-29 Thread JIRA
Favio Vázquez created SPARK-7249: Summary: Updated Hadoop dependencies due to inconsistency in the versions Key: SPARK-7249 URL: https://issues.apache.org/jira/browse/SPARK-7249 Project: Spark

[jira] [Updated] (SPARK-7240) Covariance for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7240: - Description: This JIRA is for computing stable covariance between two columns. The method `cov` s

[jira] [Updated] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-04-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6197: - Labels: backport-needed (was: ) > handle json parse exception for eventlog file not finished writing > -

[jira] [Updated] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-04-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6197: - Target Version/s: 1.3.1, 1.4.0 > handle json parse exception for eventlog file not finished writing > ---

[jira] [Updated] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-04-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6197: - Fix Version/s: (was: 1.3.1) > handle json parse exception for eventlog file not finished writing > --

[jira] [Created] (SPARK-7247) Add Pandas' shift method to the Dataframe API

2015-04-29 Thread Olivier Girardot (JIRA)
Olivier Girardot created SPARK-7247: --- Summary: Add Pandas' shift method to the Dataframe API Key: SPARK-7247 URL: https://issues.apache.org/jira/browse/SPARK-7247 Project: Spark Issue Type:

[jira] [Created] (SPARK-7248) Random number generators for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7248: Summary: Random number generators for DataFrames Key: SPARK-7248 URL: https://issues.apache.org/jira/browse/SPARK-7248 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-7245) Spearman correlation for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7245: - Assignee: (was: Xiangrui Meng) > Spearman correlation for DataFrames > ---

[jira] [Created] (SPARK-7246) Rank for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7246: Summary: Rank for DataFrames Key: SPARK-7246 URL: https://issues.apache.org/jira/browse/SPARK-7246 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-29 Thread Pedro Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1452#comment-1452 ] Pedro Rodriguez commented on SPARK-5556: What are thoughts on implementation?It lo

[jira] [Commented] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519983#comment-14519983 ] Jacek Lewandowski commented on SPARK-7169: -- [~jerryshao] unfortunately you are wr

[jira] [Created] (SPARK-7245) Spearman correlation for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7245: Summary: Spearman correlation for DataFrames Key: SPARK-7245 URL: https://issues.apache.org/jira/browse/SPARK-7245 Project: Spark Issue Type: Sub-task

[jira] [Closed] (SPARK-7238) Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.5.0

2015-04-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Favio Vázquez closed SPARK-7238. Resolution: Won't Fix > Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.5.0 > --

[jira] [Created] (SPARK-7244) Find vertex sequences satisfying predicates

2015-04-29 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7244: Summary: Find vertex sequences satisfying predicates Key: SPARK-7244 URL: https://issues.apache.org/jira/browse/SPARK-7244 Project: Spark Issue Type:

[jira] [Created] (SPARK-7243) Contingency table for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7243: Summary: Contingency table for DataFrames Key: SPARK-7243 URL: https://issues.apache.org/jira/browse/SPARK-7243 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7075) Project Tungsten: Improving Physical Execution and Memory Management

2015-04-29 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519956#comment-14519956 ] Imran Rashid commented on SPARK-7075: - everything sounds awesome, but can we see desig

[jira] [Created] (SPARK-7242) Frequent items for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7242: Summary: Frequent items for DataFrames Key: SPARK-7242 URL: https://issues.apache.org/jira/browse/SPARK-7242 Project: Spark Issue Type: Sub-task Co

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFoundException with Kryo, Guava 14

2015-04-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519940#comment-14519940 ] ASF GitHub Bot commented on SPARK-6069: --- GitHub user pferrel opened a pull request:

[jira] [Updated] (SPARK-7241) Pearson correlation for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7241: - Description: This JIRA is for computing the Pearson linear correlation for two numerical columns

[jira] [Updated] (SPARK-7240) Covariance for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7240: - Description: This JIRA is for computing stable covariance between two columns. The method `cov` s

[jira] [Created] (SPARK-7241) Pearson correlation for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7241: Summary: Pearson correlation for DataFrames Key: SPARK-7241 URL: https://issues.apache.org/jira/browse/SPARK-7241 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7214) Unrolling never evicts blocks when MemoryStore is nearly full

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519915#comment-14519915 ] Apache Spark commented on SPARK-7214: - User 'woggle' has created a pull request for th

[jira] [Assigned] (SPARK-7214) Unrolling never evicts blocks when MemoryStore is nearly full

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7214: --- Assignee: (was: Apache Spark) > Unrolling never evicts blocks when MemoryStore is nearly

[jira] [Assigned] (SPARK-7214) Unrolling never evicts blocks when MemoryStore is nearly full

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7214: --- Assignee: Apache Spark > Unrolling never evicts blocks when MemoryStore is nearly full >

[jira] [Updated] (SPARK-7226) Support math functions in R DataFrame

2015-04-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7226: - Priority: Critical (was: Major) > Support math functions in R DataFrame > ---

[jira] [Updated] (SPARK-7226) Support math functions in R DataFrame

2015-04-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7226: - Affects Version/s: 1.4.0 > Support math functions in R DataFrame > ---

[jira] [Updated] (SPARK-7227) Support fillna / dropna in R DataFrame

2015-04-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7227: - Priority: Critical (was: Major) > Support fillna / dropna in R DataFrame > --

[jira] [Updated] (SPARK-5645) Track local bytes read for shuffles - update UI

2015-04-29 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-5645: -- Fix Version/s: 1.3.0 Assignee: Kay Ousterhout (was: Kostas Sakellis) > Track local byt

[jira] [Updated] (SPARK-7236) AkkaUtils askWithReply sleeps indefinitely when a timeout exception is thrown

2015-04-29 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-7236: Description: When {{AkkaUtils.askWithReply}} gets a TimeoutException, the default parameters {{maxA

[jira] [Resolved] (SPARK-5645) Track local bytes read for shuffles - update UI

2015-04-29 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-5645. --- Resolution: Fixed > Track local bytes read for shuffles - update UI >

[jira] [Commented] (SPARK-7076) Binary processing compact tuple representation

2015-04-29 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519910#comment-14519910 ] Imran Rashid commented on SPARK-7076: - can you post a design doc please? > Binary pro

[jira] [Comment Edited] (SPARK-7236) AkkaUtils askWithReply sleeps indefinitely when a timeout exception is thrown

2015-04-29 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519862#comment-14519862 ] Bryan Cutler edited comment on SPARK-7236 at 4/29/15 6:38 PM: --

[jira] [Created] (SPARK-7240) Covariance for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7240: Summary: Covariance for DataFrames Key: SPARK-7240 URL: https://issues.apache.org/jira/browse/SPARK-7240 Project: Spark Issue Type: Sub-task Compon

[jira] [Created] (SPARK-7239) Statistic functions for DataFrames

2015-04-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7239: Summary: Statistic functions for DataFrames Key: SPARK-7239 URL: https://issues.apache.org/jira/browse/SPARK-7239 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-7217) Add configuration to disable stopping of SparkContext when StreamingContext.stop()

2015-04-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519889#comment-14519889 ] Tathagata Das commented on SPARK-7217: -- I am not sure what you are referring to. I ju

[jira] [Commented] (SPARK-7236) AkkaUtils askWithReply sleeps indefinitely when a timeout exception is thrown

2015-04-29 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519862#comment-14519862 ] Bryan Cutler commented on SPARK-7236: - According to git blame, it looks like the defau

[jira] [Updated] (SPARK-6267) Python API for IsotonicRegression

2015-04-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6267: - Assignee: Yanbo Liang > Python API for IsotonicRegression > --

[jira] [Assigned] (SPARK-7238) Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.5.0

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7238: --- Assignee: Apache Spark > Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.

[jira] [Commented] (SPARK-7238) Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.5.0

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519853#comment-14519853 ] Apache Spark commented on SPARK-7238: - User 'FavioVazquez' has created a pull request

[jira] [Assigned] (SPARK-7238) Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.5.0

2015-04-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7238: --- Assignee: (was: Apache Spark) > Upgrade protobuf-java (com.google.protobuf) version from

[jira] [Created] (SPARK-7238) Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.5.0

2015-04-29 Thread JIRA
Favio Vázquez created SPARK-7238: Summary: Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.5.0 Key: SPARK-7238 URL: https://issues.apache.org/jira/browse/SPARK-7238 Project: Spark

<    1   2   3   4   >