[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-08 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203316#comment-14203316 ] Lianhui Wang commented on SPARK-2468: - ok, thanks.[~adav] i will try to do as you say.

[jira] [Created] (SPARK-4305) yarn-alpha profile won't build due to network/yarn module

2014-11-08 Thread Sean Owen (JIRA)
Sean Owen created SPARK-4305: Summary: yarn-alpha profile won't build due to network/yarn module Key: SPARK-4305 URL: https://issues.apache.org/jira/browse/SPARK-4305 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4305) yarn-alpha profile won't build due to network/yarn module

2014-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203331#comment-14203331 ] Apache Spark commented on SPARK-4305: - User 'srowen' has created a pull request for

[jira] [Resolved] (SPARK-899) Outdated Bagel documentation

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-899. - Resolution: Won't Fix Trawling old issues again... I assume this is a WontFix because GraphX has

[jira] [Resolved] (SPARK-952) Python version of Gaussian Mixture Model

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-952. - Resolution: Duplicate I assume this is superseded, if anything, by SPARK-3588 Python version of Gaussian

[jira] [Resolved] (SPARK-951) Gaussian Mixture Model

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-951. - Resolution: Duplicate Duplicate of I assume this is superseded, if anything, by SPARK-3588 Gaussian

[jira] [Resolved] (SPARK-956) The Spark python program for Lasso

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-956. - Resolution: Won't Fix I assume this is WontFix as there was no followup. Spark has L1 regularization

[jira] [Resolved] (SPARK-954) One repeated sampling, and I am not sure if it is correct.

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-954. - Resolution: Won't Fix From the discussion, and later ones about guarantees of determinism in RDDs, sounds

[jira] [Resolved] (SPARK-976) WikipediaPageRand doesn't work anymore

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-976. - Resolution: Won't Fix I assume this is also WontFix as it is a Bagel example. WikipediaPageRand doesn't

[jira] [Resolved] (SPARK-987) Cannot start workers successfully with hadoop 2.2.0

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-987. - Resolution: Not a Problem This just looks like a classic version mismatch between client and server. The

[jira] [Resolved] (SPARK-819) netty: ChannelInboundByteHandlerAdapter no longer exist in 4.0.3.Final

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-819. - Resolution: Fixed This must have been fixed along the way, as the class ChannelInboundByteHandlerAdapter

[jira] [Resolved] (SPARK-905) Not able to run Job on remote machine

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-905. - Resolution: Cannot Reproduce This looks like something that was either long since fixed, or just a matter

[jira] [Resolved] (SPARK-1074) JavaPairRDD as Object File

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1074. -- Resolution: Not a Problem Am I right in thinking that if you want to save a JavaPairRDD to HDFS, you

[jira] [Commented] (SPARK-1227) Diagnostics for ClassificationRegression

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203354#comment-14203354 ] Sean Owen commented on SPARK-1227: -- Is this still relevant now that conventional

[jira] [Resolved] (SPARK-1196) val variables not available within RDD map on cluster app; are on shell or local

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1196. -- Resolution: Cannot Reproduce val variables not available within RDD map on cluster app; are on shell

[jira] [Commented] (SPARK-1344) Scala API docs for top methods

2014-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203370#comment-14203370 ] Apache Spark commented on SPARK-1344: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-971) Link to Confluence wiki from project website / documentation

2014-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203372#comment-14203372 ] Apache Spark commented on SPARK-971: User 'srowen' has created a pull request for this

[jira] [Closed] (SPARK-1267) Add a pip installer for PySpark

2014-11-08 Thread Prabin Banka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabin Banka closed SPARK-1267. --- Resolution: Unresolved Closing this PR for now. Add a pip installer for PySpark

[jira] [Updated] (SPARK-1509) add zipWithIndex zipWithUniqueId methods to java api

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1509: - Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) add zipWithIndex zipWithUniqueId

[jira] [Resolved] (SPARK-1509) add zipWithIndex zipWithUniqueId methods to java api

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1509. -- Resolution: Fixed This was actually fixed in about 1.1 add zipWithIndex zipWithUniqueId methods to

[jira] [Resolved] (SPARK-1530) Streaming UI test can hang indefinitely

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1530. -- Resolution: Fixed I assume this got fixed along the way, either by [~tdas]'s changes or

[jira] [Resolved] (SPARK-1229) train on array (in addition to RDD)

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1229. -- Resolution: Not a Problem If I may be so bold: generally, you train on lots of data, so an RDD makes

[jira] [Commented] (SPARK-1887) Update Contributors Guide with useful data from past threads

2014-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203409#comment-14203409 ] Sean Owen commented on SPARK-1887: -- [~sujeetv] do you plan to work on this? you just need

[jira] [Created] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

2014-11-08 Thread Varadharajan (JIRA)
Varadharajan created SPARK-4306: --- Summary: LogisticRegressionWithLBFGS support for PySpark MLlib Key: SPARK-4306 URL: https://issues.apache.org/jira/browse/SPARK-4306 Project: Spark Issue

[jira] [Comment Edited] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

2014-11-08 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203480#comment-14203480 ] Varadharajan edited comment on SPARK-4306 at 11/8/14 4:01 PM: --

[jira] [Commented] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

2014-11-08 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203480#comment-14203480 ] Varadharajan commented on SPARK-4306: - Please assign this task to me.

[jira] [Updated] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

2014-11-08 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varadharajan updated SPARK-4306: Issue Type: New Feature (was: Task) LogisticRegressionWithLBFGS support for PySpark MLlib

[jira] [Commented] (SPARK-2624) Datanucleus jars not accessible in yarn-cluster mode

2014-11-08 Thread Jim Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203631#comment-14203631 ] Jim Lim commented on SPARK-2624: Line 223 in

[jira] [Updated] (SPARK-4301) StreamingContext should not allow start() to be called after calling stop()

2014-11-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4301: - Affects Version/s: (was: 1.2.0) 1.0.1 StreamingContext should not

[jira] [Resolved] (SPARK-4301) StreamingContext should not allow start() to be called after calling stop()

2014-11-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4301. -- Resolution: Fixed StreamingContext should not allow start() to be called after calling stop()

[jira] [Updated] (SPARK-4301) StreamingContext should not allow start() to be called after calling stop()

2014-11-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4301: - Fix Version/s: 1.2.0 1.1.1 StreamingContext should not allow start() to be

[jira] [Updated] (SPARK-4301) StreamingContext should not allow start() to be called after calling stop()

2014-11-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4301: - Fix Version/s: 1.0.3 StreamingContext should not allow start() to be called after calling stop()

[jira] [Commented] (SPARK-3821) Develop an automated way of creating Spark images (AMI, Docker, and others)

2014-11-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203757#comment-14203757 ] Shivaram Venkataraman commented on SPARK-3821: -- [~nchammas] Thanks for

[jira] [Created] (SPARK-4307) Initialize FileDescriptor lazily in FileRegion

2014-11-08 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-4307: -- Summary: Initialize FileDescriptor lazily in FileRegion Key: SPARK-4307 URL: https://issues.apache.org/jira/browse/SPARK-4307 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4307) Initialize FileDescriptor lazily in FileRegion

2014-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203778#comment-14203778 ] Apache Spark commented on SPARK-4307: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-2213) Sort Merge Join

2014-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203783#comment-14203783 ] Apache Spark commented on SPARK-2213: - User 'Ishiihara' has created a pull request for

[jira] [Commented] (SPARK-3821) Develop an automated way of creating Spark images (AMI, Docker, and others)

2014-11-08 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203786#comment-14203786 ] Nicholas Chammas commented on SPARK-3821: - Thanks for the feedback [~shivaram].