[GitHub] incubator-spark pull request: Clean up and added a few java api me...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/402#issuecomment-35062669 Merged build triggered.

[GitHub] incubator-spark pull request: Clean up and added a few java api me...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/402#issuecomment-35062670 Merged build started.

[GitHub] incubator-spark pull request: Adding an option to persist Spark RD...

2014-02-13 Thread alig
Github user alig commented on the pull request: https://github.com/apache/incubator-spark/pull/468#issuecomment-35061768 Agree. Let's put it like this: - Must have: what you suggested that covers the config integrated into existing docs etc - Nice to have: in addition to above

[GitHub] incubator-spark pull request: SPARK-1063 Add .sortBy(f) method on ...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/508#issuecomment-35061377 Merged build finished.

[GitHub] incubator-spark pull request: SPARK-1063 Add .sortBy(f) method on ...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/508#issuecomment-35061379 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12715/

[GitHub] incubator-spark pull request: Clean up and added a few java api me...

2014-02-13 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/incubator-spark/pull/402#issuecomment-35061165 yes ofcourse ! On Fri, Feb 14, 2014 at 12:34 PM, Reynold Xin wrote: > Great. @ScrapCodes can you mark th

[GitHub] incubator-spark pull request: Clean up and added a few java api me...

2014-02-13 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/incubator-spark/pull/402#issuecomment-35061130 Great. @ScrapCodes can you mark the scala *With's as deprecated in 1.0.0, and remove the java apis from this pr?

[GitHub] incubator-spark pull request: Clean up and added a few java api me...

2014-02-13 Thread markhamstra
Github user markhamstra commented on the pull request: https://github.com/apache/incubator-spark/pull/402#issuecomment-35061086 It's what I'd be inclined to do. I think there is a need for something with a higher-level of abstraction than mapPartitions/mapPartitionsWithIndex t

[GitHub] incubator-spark pull request: SPARK-1063 Add .sortBy(f) method on ...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/508#issuecomment-35060222 Merged build started.

[GitHub] incubator-spark pull request: SPARK-1063 Add .sortBy(f) method on ...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/508#issuecomment-35060221 Merged build triggered.

[GitHub] incubator-spark pull request: SPARK-1063 Add .sortBy(f) method on ...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/508#issuecomment-35059728 Merged build finished.

[GitHub] incubator-spark pull request: SPARK-1063 Add .sortBy(f) method on ...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/508#issuecomment-35059729 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12714/

[GitHub] incubator-spark pull request: SPARK-1063 Add .sortBy(f) method on ...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/508#issuecomment-35059686 Merged build started.

[GitHub] incubator-spark pull request: SPARK-1063 Add .sortBy(f) method on ...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/508#issuecomment-35059685 Merged build triggered.

[GitHub] incubator-spark pull request: [Application-UI] Reporting waiting s...

2014-02-13 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/incubator-spark/pull/123#issuecomment-35059482 ping @kayousterhout

[GitHub] incubator-spark pull request: Clean up and added a few java api me...

2014-02-13 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/incubator-spark/pull/402#issuecomment-35059461 I agree with you. I actually think we should consider deprecating them for Scala as well. The same sentiment is also echoed by @markhamstra who initially wrote this

[GitHub] incubator-spark pull request: [Application-UI] Reporting waiting s...

2014-02-13 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/incubator-spark/pull/123#issuecomment-35059439 ping !

[GitHub] incubator-spark pull request: Clean up and added a few java api me...

2014-02-13 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/incubator-spark/pull/402#issuecomment-35059415 Honestly @rxin, I have started to feel these "With" functions are less useful for java. Someone can easily write them if he needs on top of any map/filter/fla

[GitHub] incubator-spark pull request: Add subtractByKey to the JavaPairRDD...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/600#issuecomment-35058869 Merged build finished.

[GitHub] incubator-spark pull request: Add subtractByKey to the JavaPairRDD...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/600#issuecomment-35058870 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12713/

[GitHub] incubator-spark pull request: Add subtractByKey to the JavaPairRDD...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/600#issuecomment-35058812 Merged build triggered.

[GitHub] incubator-spark pull request: Add subtractByKey to the JavaPairRDD...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/600#issuecomment-35058813 Merged build started.

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread jyotiska
Github user jyotiska commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35058781 @JoshRosen, I think when the traceback function doesn't return the callsite info, it simply returns "I'm lost!". Handled that case in this commit. Can you ask J

[GitHub] incubator-spark pull request: Add subtractByKey to the JavaPairRDD...

2014-02-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/600#issuecomment-35058750 Jenkins, test this please.

[GitHub] incubator-spark pull request: Adding an option to persist Spark RD...

2014-02-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/468#issuecomment-35058467 Hey @alig re your comment about the documentation - it might make more sense to integrate Tachyon in the existing pages that cover storage and provisioning (I m

[GitHub] incubator-spark pull request: Adding an option to persist Spark RD...

2014-02-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/468#issuecomment-35058261 Hey @RongGu I did a pretty thorough review - thanks for adding this! In the code I put a bunch of lower level comments. Here is some high level feedback

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35058209 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12712/

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35058208 Merged build finished.

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35056796 Merged build triggered.

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35056797 Merged build started.

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35056776 Jenkins, test this please.

[GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...

2014-02-13 Thread MLnick
Github user MLnick commented on the pull request: https://github.com/apache/incubator-spark/pull/575#issuecomment-35055610 Originally sent this to dev list not github - the autopsy emails are a bit confusing on mobile :) @fommil @mengxr I think it's always worth

Re: [GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...

2014-02-13 Thread Nick Pentreath
@fommil @mengxr I think it's always worth a shot at a license change. Scikit learn devs have been successful before in getting such things over the line. Assuming we can make that happen, what do folks think about MTJ vs Breeze vs JBLAS + commons-math since these seem like the viable alternativ

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread jyotiska
Github user jyotiska commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35054785 Jenkins, test this please.

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread jyotiska
Github user jyotiska commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35054777 I think this is good to go. Can I ask Jenkins to test this?

[GitHub] incubator-spark pull request: Add subtractByKey to the JavaPairRDD...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/600#issuecomment-35051869 Can one of the admins verify this patch?

[GitHub] incubator-spark pull request: Add subtractByKey to the JavaPairRDD...

2014-02-13 Thread punya
GitHub user punya opened a pull request: https://github.com/apache/incubator-spark/pull/600 Add subtractByKey to the JavaPairRDD wrapper You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/incubator-spark subtractByKey-java A

[GitHub] incubator-spark pull request: [SPARK-1090] improvement on spark_sh...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/599#issuecomment-35049082 Can one of the admins verify this patch?

[GitHub] incubator-spark pull request: [SPARK-1090] improvement on spark_sh...

2014-02-13 Thread CodingCat
GitHub user CodingCat opened a pull request: https://github.com/apache/incubator-spark/pull/599 [SPARK-1090] improvement on spark_shell (help information, configure memory) spark-shell should print help information about parameters and should allow user to configure exe memory t

Re: Fast Serialization

2014-02-13 Thread Reynold Xin
The perf difference between that and Kryo is pretty small according to their own benchmark. However, if they can provide better compatibility than Kryo, we should definitely give it a shot! Would you like to do some testing? On Thu, Feb 13, 2014 at 12:27 AM, Evan Chan wrote: > Any interest in

[GitHub] incubator-spark pull request: Update spark_ec2 to use 0.9.0 by def...

2014-02-13 Thread shivaram
Github user shivaram closed the pull request at: https://github.com/apache/incubator-spark/pull/598

[GitHub] incubator-spark pull request: Added parquetFileAsJSON to read Parq...

2014-02-13 Thread laserson
Github user laserson commented on the pull request: https://github.com/apache/incubator-spark/pull/576#issuecomment-35040314 Yes, that's a much better suggestion. Thanks!

[GitHub] incubator-spark pull request: Added parquetFileAsJSON to read Parq...

2014-02-13 Thread velvia
Github user velvia commented on the pull request: https://github.com/apache/incubator-spark/pull/576#issuecomment-35039082 Uri, What you can do is, in Scala, have an implicit conversion to your own class, effectively extending SparkContext yourself. We do this for our own

[GitHub] incubator-spark pull request: Adding an option to persist Spark RD...

2014-02-13 Thread alig
Github user alig commented on the pull request: https://github.com/apache/incubator-spark/pull/468#issuecomment-35038876 @RongGu @haoyuan Please also add a new file called ```tachyon.md``` in docs similar to this: https://github.com/apache/incubator-spark/blob/master/docs/ec2-scrip

[GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...

2014-02-13 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/incubator-spark/pull/575#issuecomment-35038739 @fommil I don't quite understand what "roll their own" means exactly here. I didn't propose to re-implement one or half linear algebra library in the PR. For the

[GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...

2014-02-13 Thread fommil
Github user fommil commented on the pull request: https://github.com/apache/incubator-spark/pull/575#issuecomment-35036443 @mengxr and someone decided to roll their own instead of talking to me, why? I've had previous discussions with Apache about the MTJ license and I said we could p

[GitHub] incubator-spark pull request: Update spark_ec2 to use 0.9.0 by def...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/598#issuecomment-35036331 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12711/

[GitHub] incubator-spark pull request: Update spark_ec2 to use 0.9.0 by def...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/598#issuecomment-35036329 Merged build finished.

[GitHub] incubator-spark pull request: Added parquetFileAsJSON to read Parq...

2014-02-13 Thread laserson
Github user laserson closed the pull request at: https://github.com/apache/incubator-spark/pull/576

[GitHub] incubator-spark pull request: Added parquetFileAsJSON to read Parq...

2014-02-13 Thread laserson
Github user laserson commented on the pull request: https://github.com/apache/incubator-spark/pull/576#issuecomment-35035595 Yes, I have since thought about it more and agree that this would actually be a bad idea. No need to add additional dependencies on other specific file formats

[GitHub] incubator-spark pull request: Update spark_ec2 to use 0.9.0 by def...

2014-02-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/598#issuecomment-35034124 @shivaram sorry for being lame and not doing this earlier... appreciate you sending a PR.

[GitHub] incubator-spark pull request: Added parquetFileAsJSON to read Parq...

2014-02-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/576#issuecomment-35034019 Hey there - this is interesting but I don't think it's something that we should put inside of SparkContext. It's nice code as an example thought for other peopl

[GitHub] incubator-spark pull request: Update spark_ec2 to use 0.9.0 by def...

2014-02-13 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/incubator-spark/pull/598#issuecomment-35033971 Thanks! Merged.

[GitHub] incubator-spark pull request: Update spark_ec2 to use 0.9.0 by def...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/598#issuecomment-35033671 Merged build triggered.

[GitHub] incubator-spark pull request: Update spark_ec2 to use 0.9.0 by def...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/598#issuecomment-35033672 Merged build started.

[GitHub] incubator-spark pull request: Update spark_ec2 to use 0.9.0 by def...

2014-02-13 Thread shivaram
GitHub user shivaram opened a pull request: https://github.com/apache/incubator-spark/pull/598 Update spark_ec2 to use 0.9.0 by default Backports change from branch-0.9 You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/incuba

[GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...

2014-02-13 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/incubator-spark/pull/575#issuecomment-35030774 @fommil MTJ use LGPL. See http://www.apache.org/legal/resolved.html

[GitHub] incubator-spark pull request: SPARK-1088: Create a script for runn...

2014-02-13 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/incubator-spark/pull/593#issuecomment-35029540 Closing since it's been merged.

[GitHub] incubator-spark pull request: SPARK-1088: Create a script for runn...

2014-02-13 Thread rxin
Github user rxin closed the pull request at: https://github.com/apache/incubator-spark/pull/593

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35028748 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12710/

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35028747 Merged build finished.

[GitHub] incubator-spark pull request: Add c3 instance types to Spark EC2

2014-02-13 Thread chrisavl
Github user chrisavl closed the pull request at: https://github.com/apache/incubator-spark/pull/595

[GitHub] incubator-spark pull request: add onExecutorsStopped to event list...

2014-02-13 Thread tsdeng
Github user tsdeng closed the pull request at: https://github.com/apache/incubator-spark/pull/596

[GitHub] incubator-spark pull request: add event listener when executors ar...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/597#issuecomment-35025992 Can one of the admins verify this patch?

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35026001 Merged build started.

[GitHub] incubator-spark pull request: Graph primitives2

2014-02-13 Thread semihsalihoglu
Github user semihsalihoglu commented on the pull request: https://github.com/apache/incubator-spark/pull/580#issuecomment-35026015 Just to clarify, here's what happened exactly. I had forgotten to delete those comments before committing the first time by mistake. Then I fixed them and

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35026000 Merged build triggered.

[GitHub] incubator-spark pull request: Added extra description on ValueErro...

2014-02-13 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-35025658 Jenkins, test this please.

[GitHub] incubator-spark pull request: add event listener when executors ar...

2014-02-13 Thread tsdeng
GitHub user tsdeng opened a pull request: https://github.com/apache/incubator-spark/pull/597 add event listener when executors are stopped, for sending back final stats add onExecutorStopped event handler. So when master command a shutdown, the executors can send the final messag

[GitHub] incubator-spark pull request: Graph primitives2

2014-02-13 Thread semihsalihoglu
Github user semihsalihoglu commented on the pull request: https://github.com/apache/incubator-spark/pull/580#issuecomment-35025243 GraphOpsSuite.scala? Are you looking at the version of the last commits? The first commit had some stuff, which I deleted. I don't see them anymore.

[GitHub] incubator-spark pull request: Add c3 instance types to Spark EC2

2014-02-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/595#issuecomment-35024028 I put this in master in addition to branch 0.9

[GitHub] incubator-spark pull request: Add c3 instance types to Spark EC2

2014-02-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/595#issuecomment-35023676 Merged, thanks

[GitHub] incubator-spark pull request: Add c3 instance types to Spark EC2

2014-02-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/595#issuecomment-35023583 LGTM as well... I'll merge this thanks!

[GitHub] incubator-spark pull request: add onExecutorsStopped to event list...

2014-02-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/596#issuecomment-35023537 Hey @tsdeng - this request is against branch 0.8, but this is a feature and not a bug fix, so this should be against master.

[GitHub] incubator-spark pull request: Graph primitives2

2014-02-13 Thread Mistobaan
Github user Mistobaan commented on the pull request: https://github.com/apache/incubator-spark/pull/580#issuecomment-35022812 I see a bunch of commented tests in the patch ...

[GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...

2014-02-13 Thread dlwh
Github user dlwh commented on the pull request: https://github.com/apache/incubator-spark/pull/575#issuecomment-35021161 @fommil :-) Sorry to undersell. Breeze also has CSCMatrix support, but that's not entirely finished. On Thu, Feb 13, 2014 at 12:14 PM

[GitHub] incubator-spark pull request: Graph primitives2

2014-02-13 Thread semihsalihoglu
Github user semihsalihoglu commented on the pull request: https://github.com/apache/incubator-spark/pull/580#issuecomment-35020911 I see. OK, I downloaded scalastyle and fixed the style problems. Can we try again? Thank you, semih On Thu, Feb 13, 2014

[GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...

2014-02-13 Thread fommil
Github user fommil commented on the pull request: https://github.com/apache/incubator-spark/pull/575#issuecomment-35020661 @dlwh tracks? I thought I conclusively showed that there was zero impact to go native ;-) BTW, MTJ has sparse matrix support... and I also maintain it. What probl

[GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...

2014-02-13 Thread dlwh
Github user dlwh commented on the pull request: https://github.com/apache/incubator-spark/pull/575#issuecomment-35020275 I can cut a release this weekend. We wrap @fommil's netlib-java ( https://github.com/fommil/netlib-java), whose performance tracks with C pretty well. jblas i

[GitHub] incubator-spark pull request: add onExecutorsStopped to event list...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/596#issuecomment-35018960 Can one of the admins verify this patch?

[GitHub] incubator-spark pull request: add onExecutorsStopped to event list...

2014-02-13 Thread tsdeng
GitHub user tsdeng opened a pull request: https://github.com/apache/incubator-spark/pull/596 add onExecutorsStopped to event listeners for getting final stats add onExecutorStopped event handler. So when master command a shutdown, the executors can send the final message reporti

[GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...

2014-02-13 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/incubator-spark/pull/575#issuecomment-35018212 @MLnick MTJ is not an option because of its license.

[GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...

2014-02-13 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/incubator-spark/pull/575#issuecomment-35017848 @shivaram @srowen @giyengar Thanks for keeping the discussion running! @shivaram The requirement is to add sparse data support in all existing MLlib algor

[GitHub] incubator-spark pull request: Add c3 instance types to Spark EC2

2014-02-13 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/incubator-spark/pull/595#issuecomment-35017225 LGTM - I wasn't able to figure out if c3 instances were pvm or hvm -- The EC2 wizard seem to suggest they are both, so I think this should be fine.

Re: Adding my wiki user id (hsaputra) as contributors in Apache Spark confluence wiki space

2014-02-13 Thread Andy Konwinski
Great. I'm glad it worked. You're welcome. On Thu, Feb 13, 2014 at 11:26 AM, Henry Saputra wrote: > Cool, whatever you just did allow me to have edit access to the wiki =) > > Thanks a lot Andy! > > - Henry > > On Thu, Feb 13, 2014 at 11:12 AM, Andy Konwinski > wrote: > > Henry, > > > > I just

[GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...

2014-02-13 Thread MLnick
Github user MLnick commented on the pull request: https://github.com/apache/incubator-spark/pull/575#issuecomment-35015689 I guess we should discuss on the JIRA ideally, but most of the discussion seems to be here. So I'll comment here. I've chimed in before in the original PR

Re: Adding my wiki user id (hsaputra) as contributors in Apache Spark confluence wiki space

2014-02-13 Thread Henry Saputra
Cool, whatever you just did allow me to have edit access to the wiki =) Thanks a lot Andy! - Henry On Thu, Feb 13, 2014 at 11:12 AM, Andy Konwinski wrote: > Henry, > > I just gave you all of the permissions I know how to give. Let me know if > that does the trick. > > Andy > > > On Thu, Feb 13,

Re: Adding my wiki user id (hsaputra) as contributors in Apache Spark confluence wiki space

2014-02-13 Thread Andy Konwinski
Henry, I just gave you all of the permissions I know how to give. Let me know if that does the trick. Andy On Thu, Feb 13, 2014 at 10:35 AM, Patrick Wendell wrote: > Hey Henry, > > Ya unfortunately I have no idea how to do this! > > On Thu, Feb 13, 2014 at 9:54 AM, Mayur Rustagi > wrote: > >

[GitHub] incubator-spark pull request: Add c3 instance types to Spark EC2

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/595#issuecomment-35013735 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12709/

[GitHub] incubator-spark pull request: Add c3 instance types to Spark EC2

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/595#issuecomment-35013734 Merged build finished.

[GitHub] incubator-spark pull request: Add c3 instance types to Spark EC2

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/595#issuecomment-35010869 Merged build started.

[GitHub] incubator-spark pull request: Add c3 instance types to Spark EC2

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/595#issuecomment-35010866 Merged build triggered.

[GitHub] incubator-spark pull request: Add c3 instance types to Spark EC2

2014-02-13 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/incubator-spark/pull/595#issuecomment-35010761 Jenkins, test this please

Re: Adding my wiki user id (hsaputra) as contributors in Apache Spark confluence wiki space

2014-02-13 Thread Patrick Wendell
Hey Henry, Ya unfortunately I have no idea how to do this! On Thu, Feb 13, 2014 at 9:54 AM, Mayur Rustagi wrote: > I can help out here as well. I am trying to develop docs around setting up > Spark, Streaming and Shark, currently doing it on my wiki ( > docs.sigmoidanalytics.com). Would love to

[GitHub] incubator-spark pull request: Adding an option to persist Spark RD...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/468#issuecomment-35008285 Merged build started.

[GitHub] incubator-spark pull request: Adding an option to persist Spark RD...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/468#issuecomment-35008314 Merged build finished.

[GitHub] incubator-spark pull request: Adding an option to persist Spark RD...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/468#issuecomment-35008284 Merged build triggered.

[GitHub] incubator-spark pull request: Adding an option to persist Spark RD...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/468#issuecomment-35008316 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12708/

[GitHub] incubator-spark pull request: Adding an option to persist Spark RD...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/468#issuecomment-35007813 Merged build started.

[GitHub] incubator-spark pull request: Adding an option to persist Spark RD...

2014-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/468#issuecomment-35007851 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12707/

  1   2   >