Re: Signal/Noise Ratio

2014-02-20 Thread Henry Saputra
Daniel Gruno from ASF infra mentioned this when adding Github plugin to dev@ list support : "We may, in the future, add the possibility to filter out certain comments from being relayed to the ML (such as jenkins workflows etc), but this will all depend on how this initial phase goes along." Looks

Re: [DISCUSS] Necessity of Maven *and* SBT Build in Spark

2014-02-20 Thread Henry Saputra
Thanks for bringing back the build systems discussions, Patrick. There was a long discussion way back before Spark joining ASF and as I remember there has not been clear "winner" between using sbt or maven. Maven makes it easier to publish the artifacts to Nexus repository, not sure if sbt can do

Re: Adding my wiki user id (hsaputra) as contributors in Apache Spark confluence wiki space

2014-02-13 Thread Henry Saputra
>> > h <https://twitter.com/mayur_rustagi>ttp://www.sigmoidanalytics.com >> > https://twitter.com/mayur_rustagi >> > >> > >> > >> > On Thu, Feb 13, 2014 at 8:28 AM, Henry Saputra > >wrote: >> > >> >> HI Andy, >&

Adding my wiki user id (hsaputra) as contributors in Apache Spark confluence wiki space

2014-02-13 Thread Henry Saputra
HI Andy, Could you or someone with space admin role in the Spark wiki [1] kindly help to add my userid "hsaputra" as collaborators to edit/ add new content in the Spark wiki space? I believe Andy's userid was granted the space admin to the wiki. Thank you, - Henry [1] https://cwiki.apache.or

Re: [TODO] Document the release process for Apache Spark

2014-02-12 Thread Henry Saputra
11:28 PM, Henry Saputra > wrote: >> Cool! Thanks Patrick. >> >> Looks good to me. Just one small recommendation about "Get Access to >> Apache Nexus for Publishing Artifacts", as I remember you need to file >> INFRA ticket for your Apache id [1] to get

Re: Could someone with karma to add my userid hsaputra so I could assign issue in https://spark-project.atlassian.net?

2014-02-11 Thread Henry Saputra
Thanks Reynold! =) - Henry On Tue, Feb 11, 2014 at 3:05 PM, Reynold Xin wrote: > I added you to the dev list on jira for spark. > > > On Tue, Feb 11, 2014 at 2:58 PM, Henry Saputra wrote: > >> Hi Guys, >> >> With ASF JIRA still in transfer mode, could someone wi

Could someone with karma to add my userid hsaputra so I could assign issue in https://spark-project.atlassian.net?

2014-02-11 Thread Henry Saputra
Hi Guys, With ASF JIRA still in transfer mode, could someone with permission to add my userid "hsaputra" in https://spark-project.atlassian.net so I could assign issues and resolve them myself? CC @pwendell or @rxin Thanks, - Henry

Re: Proposal for JIRA and Pull Request Policy

2014-02-11 Thread Henry Saputra
+1 to the proposal On Thursday, February 6, 2014, Patrick Wendell wrote: > As a break out from the other thread. I'd like to propose two > guidelines for pull requests. These guidelines are to make things > easier to track for developers and users, and to help organize the > large number of PR's

Proposal for JIRA and Pull Request Policy

2014-02-11 Thread Henry Saputra
The ASF infra support all Hadoop and it's community projects CI requests, as well as other ASF projects. >From my experience with other ASF projects the Jenkins support has been great. And also ASF infra is accepting help if you guys think you could spare time and knowledge. Henry On Tuesday, F

Re: [VOTE] Graduation of Apache Spark from the Incubator

2014-02-10 Thread Henry Saputra
+1 (binding) - Henry On Mon, Feb 10, 2014 at 8:27 PM, Chris Mattmann wrote: > Hi Everyone, > > This is a new VOTE to decide if Apache Spark should graduate > from the Incubator. Please VOTE on the resolution pasted below > the ballot. I'll leave this VOTE open for at least 72 hours. > > Thanks!

Re: [SUMMARY] Proposal for Spark Release Strategy

2014-02-08 Thread Henry Saputra
ng that I know how >> to set it up. >> >> >>> On Feb 8, 2014, at 2:57 PM, Henry Saputra wrote: >>> >>> Patrick, do you know if there is a way to check if a Github PR's >>> subject/ title contains JIRA number and will raise warning by the >&

Re: [TODO] Document the release process for Apache Spark

2014-02-08 Thread Henry Saputra
#x27;ve already keep pretty thorough >>> docs on this I just need to migrate them to the wiki. I've created a >>> JIRA here: >>> >>> https://spark-project.atlassian.net/browse/SPARK-1066 >>> >>> - Patrick >>> >>> On Fri, Feb

Re: [SUMMARY] Proposal for Spark Release Strategy

2014-02-08 Thread Henry Saputra
it up. > > > > > >> On Feb 8, 2014, at 2:57 PM, Henry Saputra > >> > > wrote: > >> > >> Patrick, do you know if there is a way to check if a Github PR's > >> subject/ title contains JIRA number and will raise warning by the > >

Re: [SUMMARY] Proposal for Spark Release Strategy

2014-02-08 Thread Henry Saputra
Patrick, do you know if there is a way to check if a Github PR's subject/ title contains JIRA number and will raise warning by the Jenkins? - Henry On Sat, Feb 8, 2014 at 12:56 PM, Patrick Wendell wrote: > Hey All, > > Thanks for everyone who participated in this thread. I've distilled > feedbac

Re: [GitHub] incubator-spark pull request:

2014-02-07 Thread Henry Saputra
I am with Chris on this one. These github notifications are similar to JIRA updates that in most ASF projects are sent to dev@ list, and these are valid messages that contributors in the project should concern about. Especially the PPMCs (which willl be PMCs hopefully soon) need to know about the

Re: Is it possible to grant the edit permission to the issue report?

2014-02-07 Thread Henry Saputra
Hi Nan Zhu, Are you talking about JIRA or Github pull request? - Henry On Fri, Feb 7, 2014 at 11:50 AM, Nan Zhu wrote: > Hi, all > > Sometimes, you report an issue, you try to fix by yourself, then you found > that the involved scope of the code base was not understood correctly, or > your de

Re: [TODO] Document the release process for Apache Spark

2014-02-07 Thread Henry Saputra
> JIRA here: > > https://spark-project.atlassian.net/browse/SPARK-1066 > > - Patrick > > On Fri, Feb 7, 2014 at 11:35 AM, Henry Saputra > wrote: >> Hi Patrick, >> >> As part of the unofficial checklist for graduation, we need to have a >> documented steps t

[TODO] Document the release process for Apache Spark

2014-02-07 Thread Henry Saputra
Hi Patrick, As part of the unofficial checklist for graduation, we need to have a documented steps to make a release. As the first and so far the only RE for Apache Spark, I would like to ask for your help to document the steps to release. This will help other member to do the release and take tu

Fwd: Github pull request hooks

2014-02-07 Thread Henry Saputra
FYI good news :) -- Forwarded message -- From: *Jake Farrell* Date: Friday, February 7, 2014 Subject: Github pull request hooks To: "gene...@incubator.apache.org" I just wanted to follow up on my previous comments about the Github webhooks not posting comments, Daniel Gruno and

Re: Is there any way to make a quick test on some pre-commit code?

2014-02-06 Thread Henry Saputra
+1 On Thu, Feb 6, 2014 at 10:46 PM, Patrick Wendell wrote: > We should document this on the wiki! > > On Thu, Feb 6, 2014 at 10:37 PM, Mridul Muralidharan wrote: >> This is neat, thanks Reynold ! >> >> Regards, >> Mridul >> >> On Fri, Feb 7, 2014 at 6:20 AM, Reynold Xin wrote: >>> You can do >>

Discussion on strategy or roadmap should happen on dev@ list

2014-02-06 Thread Henry Saputra
ctly to “dev" versus creating another list for “issues”? I guess we can > try “dev” for a while and let people decide if it gets too spammy. We’ll > just have to advertise it in advance. > > Matei > > On Feb 6, 2014, at 9:55 AM, Henry Saputra wrote: > > > HI Matei, yeah

Re: Proposal for Spark Release Strategy

2014-02-06 Thread Henry Saputra
Thanks Patick to initiate the discussion about next road map for Apache Spark. I am +1 for 0.10.0 for next version. It will give us as community some time to digest the process and the vision and make adjustment accordingly. Release a 1.0.0 is a huge milestone and if we do need to break API some

Re: Discussion on strategy or roadmap should happen on dev@ list

2014-02-06 Thread Henry Saputra
ussion, and mirrored to either > the “dev” list or an “issues” list. > > Matei > > On Feb 5, 2014, at 2:49 PM, Henry Saputra wrote: > >> Hi Guys, >> >> Just friendly reminder, some of you guys may work closely or >> collaborate outside the dev@ list a

Discussion on strategy or roadmap should happen on dev@ list

2014-02-05 Thread Henry Saputra
Hi Guys, Just friendly reminder, some of you guys may work closely or collaborate outside the dev@ list and sometimes it is easier. But, as part of Apache Software Foundation project, any decision or outcome that could or will be implemented in the Apache Spark need to happen in the dev@ list as w

Re: Not closing the merged PRs anymore from Spark github mirror?

2014-02-03 Thread Henry Saputra
st week, and a regression there > was PRs are no longer closed automatically. > > I believe he has fixed it. Patrick will also write an email about the > details of that script soon. > > > > > > On Mon, Feb 3, 2014 at 11:24 AM, Henry Saputra wrote: > >> Seems like

Not closing the merged PRs anymore from Spark github mirror?

2014-02-03 Thread Henry Saputra
Seems like some merged PRs by Reynold and Patrick did not close the PR automatically anymore? - Henry

Fwd: [RESULT] [VOTE] Release Apache Spark 0.9.0-incubating (rc5)

2014-02-01 Thread Henry Saputra
you to everyone who voted. Totals: +1: Matei Zaharia Andy Konwinski Henry Saputra* Jean-Baptiste Onofré* Patrick Wendell Patrick Hunt* 0: -1: * = binding Thanks to all those who voted. - Patrick On Thu, Jan 30, 2014 at 7:18 PM, Patrick Hunt > wrote: > The status page is updated and it

Re: ApacheCon

2014-01-30 Thread Henry Saputra
I believe Cos was planning to submit one about Spark and Shark in real prod. Similar to what he did for Spark summit. But more talks are better =) - Henry On Thu, Jan 30, 2014 at 11:08 AM, Evan Chan wrote: > I might have missed it earlier, but is anybody planning to present at > ApacheCon? I t

Re: [DISCUSS] Graduating as a TLP

2014-01-23 Thread Henry Saputra
+1 for graduation and propose Matei as VP candidate. - Henry On Thu, Jan 23, 2014 at 2:45 PM, Matei Zaharia wrote: > Hi folks, > > We’ve been working on the transition to Apache for a while, and our last > shepherd’s report says the following: > > > Spark > > Alan Cabrera

Re: Config properties broken in master

2014-01-23 Thread Henry Saputra
Cool thanks, appreciate it =) - Henry On Thu, Jan 23, 2014 at 10:06 AM, Mridul Muralidharan wrote: > Yeah, it is in my TODO to test latest RC - unfortunately, the test > setup is slightly busy running other things. > > Regards, > Mridul > > On Thu, Jan 23, 2014 at 10

Re: Config properties broken in master

2014-01-23 Thread Henry Saputra
Hi Mridul, Would you mind help to vet the latest 0.9 RC 4 candidate to make sure the fixes are included since you raised the issues in prev RC? Thanks, Henry On Sun, Jan 19, 2014 at 10:33 AM, Mridul Muralidharan wrote: > Oh great, just saw the PR from Matei ... for some odd reason, the dev > m

Re: [VOTE] Release Apache Spark 0.9.0-incubating (rc4) [new thread]

2014-01-22 Thread Henry Saputra
Would love to hear from Mridul to verify the fixes for problems he saw are in. On Tuesday, January 21, 2014, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark > (incubating) version 0.9.0. > > A draft of the release notes along with the changes file is att

Re: [VOTE] Release Apache Spark 0.9.0-incubating (rc4) [new thread]

2014-01-22 Thread Henry Saputra
Notice and license files ok No exec files ok Sig and hashes looks good Compiled and tests +1 On Tuesday, January 21, 2014, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark > (incubating) version 0.9.0. > > A draft of the release notes along with the chan

Re: [VOTE] Release Apache Spark 0.9.0-incubating (rc3)

2014-01-19 Thread Henry Saputra
Jan 19, 2014 at 9:57 PM, Henry Saputra > wrote: >> Hi Patrick, quick question, where are you planning to add the release notes? >> I dont think it is part of the source, is it? >> >> - Henry >> >> On Sun, Jan 19, 2014 at 8:41 PM, Patrick Wendell wrote: >&g

Re: [VOTE] Release Apache Spark 0.9.0-incubating (rc3)

2014-01-19 Thread Henry Saputra
Hi Patrick, quick question, where are you planning to add the release notes? I dont think it is part of the source, is it? - Henry On Sun, Jan 19, 2014 at 8:41 PM, Patrick Wendell wrote: > Attempting to attach the release notes again (I think it may have been > blocked previously due to not havi

Re: [VOTE] Release Apache Spark 0.9.0-incubating (rc1)

2014-01-16 Thread Henry Saputra
NOTICE and LICENSE look good. No more executable binaries/jars packaged with source - good. Hashes look good. Signatures look good. Untar and run sbt compile, assembly, test. Run some examples in local and ran ok. +1 - Henry On Wed, Jan 15, 2014 at 5:48 PM, Patrick Wendell wrote: > Please vo

Re: Terminology: "worker" vs "slave"

2014-01-04 Thread Henry Saputra
+1 for worker =) On Thu, Jan 2, 2014 at 10:45 PM, Patrick Wendell wrote: > Ya we've been trying to standardize on the terminology here (see glossary): > > http://spark.incubator.apache.org/docs/latest/cluster-overview.html > > I think "slave" actually isn't mentioned here at all - but references

Re: Incubator PMC/Board report for Jan 2014 ([ppmc])

2014-01-01 Thread Henry Saputra
infrastructure so > that we avoid confusing developers and users, and the sooner we do this the > better, as it will get more and more disruptive over time. > > Matei > > On Jan 1, 2014, at 2:51 AM, Henry Saputra wrote: > >> Thanks Matei, will try to solicit help

Re: Incubator PMC/Board report for Jan 2014 ([ppmc])

2013-12-31 Thread Henry Saputra
ee if we can get some help with that, since I think we have at least > one version that is importable. If you know anyone who can do this please > point them to https://issues.apache.org/jira/browse/INFRA-6419. > > Matei > > On Dec 31, 2013, at 7:46 PM, Henry Saputra > > &

Re: Incubator PMC/Board report for Jan 2014 ([ppmc])

2013-12-31 Thread Henry Saputra
Any volunteer to write up the report for Spark? - Henry On Wed, Dec 25, 2013 at 6:15 AM, Marvin wrote: > > > Dear podling, > > This email was sent by an automated system on behalf of the Apache Incubator > PMC. > It is an initial reminder to give you plenty of time to prepare your quarterly > b

Re: Spark 0.8.1 Released

2013-12-20 Thread Henry Saputra
ralidharan, Sundeep Narravula, Kay Ousterhout, Nick Pentreath, Imran > Rashid, Ahir Reddy, Josh Rosen, Henry Saputra, Jerry Shao, Mingfei > Shi, Andre Schumacher, Karthik Tunga, Patrick Wendell, Neal Wiggins, > Andrew Xia, Reynold Xin, Matei Zaharia, and Wu Zeming > > - Patrick

Re: Scala 2.10 Merge

2013-12-17 Thread Henry Saputra
W00t :) On Thursday, December 12, 2013, Patrick Wendell wrote: > Hi Developers, > > In the next few days we are planning to merge Scala 2.10 support into > Spark. For those that haven't been following this, Prashant Sharma has been > maintaining the scala-2.10 branch of Spark for several months.

Re: [VOTE] Release Apache Spark 0.8.1-incubating (rc4)

2013-12-14 Thread Henry Saputra
Yeah seems like it. He was ok with our prev release. Let's wait for his reply On Saturday, December 14, 2013, Patrick Wendell wrote: > Henry - from that thread it looks like sebb's concern was something > different than this. > > On Sat, Dec 14, 2013 at 11:08 AM, Henry Sa

Re: [VOTE] Release Apache Spark 0.8.1-incubating (rc4)

2013-12-14 Thread Henry Saputra
te thread explaining that we are only voting on > the source. > > - Patrick > > On Sat, Dec 14, 2013 at 10:40 AM, Henry Saputra > wrote: >> Actually we should be fine putting the binaries there as long as the >> VOTE is for the source. >> >> Let's ver

Re: [VOTE] Release Apache Spark 0.8.1-incubating (rc4)

2013-12-14 Thread Henry Saputra
Actually we should be fine putting the binaries there as long as the VOTE is for the source. Let's verify with sebb in the general@ list about his concern. - Henry On Sat, Dec 14, 2013 at 10:31 AM, Henry Saputra wrote: > Hi Patrick, as sebb has mentioned let's move the bina

Re: [VOTE] Release Apache Spark 0.8.1-incubating (rc4)

2013-12-14 Thread Henry Saputra
Hi Patrick, as sebb has mentioned let's move the binaries from the voting directory in your people.apache.org directory. ASF release voting is for source code and not binaries, and technically we provide binaries for convenience. And add link to the KEYS location in the dist[1] to let verify signa

Re: [VOTE] Release Apache Spark 0.8.1-incubating (rc3)

2013-12-09 Thread Henry Saputra
Thanks for catching the problems, Patrick and Raymond. - Henry On Mon, Dec 9, 2013 at 10:40 PM, Patrick Wendell wrote: > I'm going to -1 this now because we had two issues reported today. > They were reported off the list so I'm summarizing here: > > (1) Raymond Liu found an issue with the Maven

Re: [DISCUSS] About the [VOTE] Release Apache Spark 0.8.1-incubating (rc1)

2013-12-08 Thread Henry Saputra
ust pointing people to the file? > > - Patrick > > On Sun, Dec 8, 2013 at 11:37 AM, Henry Saputra > wrote: > > HI Spark devs, > > > > I have modified the Subject to avoid polluting the VOTE thread since > > it related to more info how and which commits merge

[DISCUSS] About the [VOTE] Release Apache Spark 0.8.1-incubating (rc1)

2013-12-08 Thread Henry Saputra
HI Spark devs, I have modified the Subject to avoid polluting the VOTE thread since it related to more info how and which commits merge back to 0.8.* branch. Please respond to the previous question to this thread. Technically the CHANGES.txt [1] file should describe the changes in a particular re

Re: Documenting the release process for Apache Spark

2013-11-08 Thread Henry Saputra
ve someone else do the > 0.9.0 release (perhaps wishful thinking!). > > - Patrick > > On Thu, Nov 7, 2013 at 12:09 PM, Henry Saputra > wrote: >> Hi Patrick, >> >> Did you end up writing up the steps you were taking to generate the >> Apache Spark release to

Documenting the release process for Apache Spark

2013-11-07 Thread Henry Saputra
Hi Patrick, Did you end up writing up the steps you were taking to generate the Apache Spark release to provide help to the next Apache Spark RE? I remember you were trying to create one after we released 0.8 Thanks, - Henry

Re: Documentation of Java API and PySpark internals

2013-10-23 Thread Henry Saputra
Thanks Josh, this is really great! +1 - Henry On Wed, Oct 23, 2013 at 8:57 PM, Josh Rosen wrote: > I've created two new pages on the Spark wiki to document the internals of > the Java and Python APIs: > > https://cwiki.apache.org/confluence/display/SPARK/Java+API+Internals > https://cwiki.apach

Re: Code Review

2013-10-16 Thread Henry Saputra
Yes it is =) Please submit pull request against https://github.com/apache/incubator-spark ASF git mirror in GitHub. Here is the link to "How to contribute" wiki page by Matei: https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark - Henry On Wed, Oct 16, 2013 at 10:23 PM, karth

Re: Incubator PMC/Board report for Oct 2013 ([ppmc])

2013-10-06 Thread Henry Saputra
Thanks Matei, I also have signed off the Spark - Henry On Sun, Oct 6, 2013 at 6:44 PM, Matei Zaharia wrote: > Hey folks, sorry for the delay, but I've now written a report at > https://wiki.apache.org/incubator/October2013. I saw Dave Fisher, who was > assigned to oversee the project, already

Re: Spark 0.8.0: bits need to come from ASF infrastructure

2013-09-26 Thread Henry Saputra
Yes, mirroring from CDN technically the same but we want to make sure users know the link come from ASF domain =) So we need to update the http://spark.incubator.apache.org/releases/spark-release-0-8-0.html link to download src and binary distributions. - Henry On Wed, Sep 25, 2013 at 4:08 PM, P

Re: Spark 0.8.0: bits need to come from ASF infrastructure

2013-09-25 Thread Henry Saputra
Was there announcement that 0.8 artifact had been pushed to http://www.apache.org/dist/incubator/spark ? I thought the link should points to http://www.apache.org/dist/incubator/spark/spark-0.8.0-incubating/spark-0.8.0-incubating.tgz - Henry On Wed, Sep 25, 2013 at 3:24 PM, Roman Shaposhnik wr

Re: Project name conflict heads-up

2013-09-23 Thread Henry Saputra
Yeah, Chris created one for Apache Spark: https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-36 On Mon, Sep 23, 2013 at 9:57 AM, Roman Shaposhnik wrote: > Hi! > > While testing Spark as part of the Bigtop I've come > across the following conflict on Debian-based systems: > > $ apt-cache show

Re: [RESULT] [VOTE] Release Apache Spark 0.8.0-incubating (RC6)

2013-09-20 Thread Henry Saputra
* Henry Saputra* (* indicates IPMC) Since Spark is under ASF incubator we need to send another VOTE to general@i.a.o list. >From the ASF release management page: " It is Apache policy that all releases be formally approved by the responsible PMC. In the case of the incubator, the I

Re: [RESULT] [VOTE] Release Apache Spark 0.8.0-incubating (RC6)

2013-09-20 Thread Henry Saputra
nd an email to general@ shortly. I didn't realize > that this vote technically counts as passing according to those rules > (since plenty of PPMC gave +1). > > On Fri, Sep 20, 2013 at 1:30 PM, Henry Saputra > wrote: >> Thanks to Patrick for driving the first Apache Spark re

Re: [VOTE] Release Apache Spark 0.8.0-incubating (RC6)

2013-09-20 Thread Henry Saputra
not include > -RCX... would that be preferable or would that necessitate another > vote? > > - Patrick > > On Fri, Sep 20, 2013 at 6:39 AM, Henry Saputra > > > wrote: > > The RC should be just the directory where the artifact live but the final > > name should o

[VOTE] Release Apache Spark 0.8.0-incubating (RC6)

2013-09-20 Thread Henry Saputra
The RC should be just the directory where the artifact live but the final name should omit the RCxx Hmm not sure if IPMCs will be picky about this but should not be blocker to release. - Henry On Thu, Sep 19, 2013 at 8:17 PM, Patrick Wendell > wrote: > Hey Roman, > > We can do this in the future

Re: [VOTE] Release Apache Spark 0.8.0-incubating (RC6)

2013-09-20 Thread Henry Saputra
Signature looks good Hashes good License and notice exists Build and run tests and looks good +1 binding On Tuesday, September 17, 2013, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark > (incubating) version 0.8.0. This will be the first incubator releas

Re: [VOTE] Release Apache Spark 0.8.0-incubating (RC6)

2013-09-19 Thread Henry Saputra
I think Chris was saying the VOTE should be made against ASF git repo directly: https://git-wip-us.apache.org/repos/asf?p=incubator-spark.git;a=tag;h=ca69992d3b82124795d16e8e0d76a50fe10435f9 - Henry On Thu, Sep 19, 2013 at 7:25 PM, Patrick Wendell wrote: > Hey Chris the tag in github is 3b85a8

Re: Mentors: question about Apache GitHub mirrors

2013-09-18 Thread Henry Saputra
Ah yes it should be #github, too many times typing INFRA, sorry Roman. - Henry On Wed, Sep 18, 2013 at 10:43 AM, Roman Shaposhnik wrote: > On Wed, Sep 18, 2013 at 10:32 AM, Henry Saputra > wrote: >> Looks like we need to stop by at INFRA chat room > > Like I said -- I don

Re: [VOTE] Release Apache Spark 0.8.0-incubating (RC6)

2013-09-18 Thread Henry Saputra
Mark, so I assume we are getting +1 from you? ;) On Tue, Sep 17, 2013 at 1:26 PM, Mark Hamstra wrote: > There are a few nits left to pick: 'sbt/sbt publish-local' isn't generating > correct POM files because of the way the exclusions are defined in > SparkBuild.scala using wildcards; looks like

Re: [VOTE] Release Apache Spark 0.8.0-incubating (RC6)

2013-09-18 Thread Henry Saputra
Patrick, dont forget to officially cast your own vote. On Tue, Sep 17, 2013 at 2:03 AM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark > (incubating) version 0.8.0. This will be the first incubator release for > Spark in Apache. > > The tag to be voted o

Re: Mentors: question about Apache GitHub mirrors

2013-09-18 Thread Henry Saputra
Looks like we need to stop by at INFRA chat room - Henry On Mon, Sep 16, 2013 at 10:43 PM, Roman Shaposhnik wrote: > Hi! > > Update -- turns out all of my connection to GitHub left :-( > (I guess its the valley -- people move around quickly). > > The best advice I got is to pop up on #github and

Re: git commit: Hard code scala version in pom files.

2013-09-16 Thread Henry Saputra
Agree with this. POM file reflects the state of the project at a particular moment so it is metadata of the project but should be treated as part of source code. - Henry On Sun, Sep 15, 2013 at 9:30 PM, Konstantin Boudnik wrote: > Guys, > > actually, POM files are artifacts metadata. Hence, IMO

Re: [VOTE] Release Apache Spark 0.8.0-incubating (RC4)

2013-09-15 Thread Henry Saputra
Looks like this VOTE thread has been cancelled. Patrick has sent VOTE for RC5 in separate thread. - Henry On Saturday, September 14, 2013, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark > (incubating) version 0.8.0. This will be the first incubator rel

Re: Maven SCM trouble

2013-09-12 Thread Henry Saputra
t; >> On Wed, Sep 11, 2013 at 10:31 PM, Mark Hamstra >wrote: > >> > >>> Yes, exactly. If I comment out the reference to the parent Apache pom, > >>> then the buildnumber plugin works correctly. Similarly if I leave the > >>> parent Apache p

Re: Maven SCM trouble

2013-09-11 Thread Henry Saputra
Hi Mark, But the spark main pom.xml contains element that should override from the parent pom.xml. Are you saying the pom.xml from parent Apache pom.xml overrides the Spark definition instead? On Wed, Sep 11, 2013 at 3:04 PM, Mark Hamstra wrote: > I'm in the process of trying to build Apa

Re: Good tips about doing a release as Apache incubator podling

2013-09-09 Thread Henry Saputra
of the components of the release. > > Andy > > > On Mon, Sep 9, 2013 at 9:52 AM, Henry Saputra wrote: > >> Marvin put a good checklist to help getting VOTES from IPMC in >> genera@incubator.a.o list. >> >> Just want to forward this to Spark co

Good tips about doing a release as Apache incubator podling

2013-09-09 Thread Henry Saputra
Marvin put a good checklist to help getting VOTES from IPMC in genera@incubator.a.o list. Just want to forward this to Spark community. - Henry -- Forwarded message -- From: Marvin Humphrey Date: Mon, Sep 9, 2013 at 9:22 AM Subject: [DISCUSS] Release of Apache Allura (incubatin

Re: Spark 0.8.0-incubating RC2

2013-09-07 Thread Henry Saputra
HI Patrick, I ran the Apache RAT tool as shown at http://creadur.apache.org/rat/apache-rat/index.html: java -jar apache-rat-0.10.jar ~/Downloads/spark-0.8.0-src-incubating-RC2 However we should add maven plugin to Spark pom.xml to support integrated RAT check as part of CI later. - Henry On Sa

Re: Spark 0.8.0-incubating RC2

2013-09-07 Thread Henry Saputra
Hey Matei, travel safely. I saw it was in the LICENSE but the reason why I am asking bc the package name is changed for the repl code so I was wondering if we need to slap additional ASF header. On Saturday, September 7, 2013, Matei Zaharia wrote: > Hi Henry, > > > For example some in repl direc

Re: Spark 0.8.0-incubating RC2

2013-09-07 Thread Henry Saputra
HI Patrick and all, Here are my inputs and from my experience as release engineer for one of incubating podling release before: 1. I only see source artifacts in Patrick's p.a.o URL. I assume the pre-built ones will also be published with hash and signed? 2. For every ASF release, we need designat

Re: Spark 0.8.0-incubating RC2

2013-09-06 Thread Henry Saputra
Hi Cos, I just replied to your pull request to bump to 0.9-SNAPSHOT versioning =) I think new development pulls should be made against ASF git repo. The repo is open for pull requests now. - Henry On Fri, Sep 6, 2013 at 3:03 PM, Konstantin Boudnik wrote: > Guys, > > how about switching master

Re: Spark 0.8.0-incubating RC2

2013-09-06 Thread Henry Saputra
eptember 6, 2013 2:14 PM > To: jpluser > Cc: "dev@spark.incubator.apache.org" , > Henry Saputra > Subject: Re: Spark 0.8.0-incubating RC2 > >>Thanks Chris - also it appears that my key has now been added to this >>file: >> >>http://people.apache.org/k

Re: Spark 0.8.0-incubating RC2

2013-09-06 Thread Henry Saputra
HI Patrick, yeah feedback is coming. A bit swamped going to weekend, sorry about it =( And yeah the key should be added to groups later when LDAP sync happen. - Henry On Fri, Sep 6, 2013 at 1:56 PM, Patrick Wendell wrote: > Hey Chris, Henry... do you guys have feedback here? This was based > la

Re: Google Groups: You've been added to Spark Developers

2013-09-05 Thread Henry Saputra
Matei, I saw your test emails to Spark developer google group list but they did not show up in the ASF dev@ list. On Friday, August 30, 2013, Matei Zaharia (Google Groups) wrote: > Testing cross-posting to Apache. > > About this group: > > Developer list for the Spark cluster computing framework

Re: apache/incubator-spark repo ready to use?

2013-09-04 Thread Henry Saputra
rote: > > > On Tue, Sep 3, 2013 at 11:50 PM, Henry Saputra > > > > wrote: > >> Matei, I think it would be better to freeze the pull requests against > >> mesos:spark GitHub repo and make announcement to start making pull > >> request against apache/incubator-spark. > > > > +1. That would make a lot of sense. > > > > Thanks, > > Roman. > >

Re: Incubator PMC/Board report for Sep 2013 ([ppmc])

2013-09-04 Thread Henry Saputra
+1 Thanks Matei. Will sign off EOD if no more comments or updates. - Henry On Wednesday, September 4, 2013, Matei Zaharia wrote: > Hi guys, > > I've written a draft update at > https://wiki.apache.org/incubator/September2013#preview. Let me know how > it looks. > > Matei > > On Sep 1, 2013, at

Re: apache/incubator-spark repo ready to use?

2013-09-04 Thread Henry Saputra
; http://spark.incubator.apache.org/docs/latest/contributing-to-spark.html. > That's what most people read, so we need to update that. > > Matei > > On Sep 4, 2013, at 10:06 AM, Henry Saputra > > > wrote: > > > Lets stick it to the wiki for now. Some ASF projects also put their how >

Re: apache/incubator-spark repo ready to use?

2013-09-03 Thread Henry Saputra
+1 =) On Tue, Sep 3, 2013 at 11:35 PM, Matei Zaharia wrote: >> "The plan"? Can we do that now? If I'm putting together a pull request >> for post-0.8, is there any reason to wait to fork >> apache/incubator-spark? > > Nope, go for it. It would be great if people started doing this now. > > Mate

Re: apache/incubator-spark repo ready to use?

2013-09-03 Thread Henry Saputra
Matei, I think it would be better to freeze the pull requests against mesos:spark GitHub repo and make announcement to start making pull request against apache/incubator-spark. We did the announcement for mailing lists move but I think we need to do formal repo transition announcement too. - Henr

Re: [Licensing check] Spark 0.8.0-incubating RC1

2013-09-03 Thread Henry Saputra
hub pull > requests. Is there any particular reason we want to do that? > > > On Wed, Sep 4, 2013 at 11:01 AM, Henry Saputra >wrote: > > > Thanks Guys. > > > > In other ASF projects I also allow people to attach the git diff to the > > JIRA itself (on

Re: [Licensing check] Spark 0.8.0-incubating RC1

2013-09-03 Thread Henry Saputra
> and correct me if I'm wrong. > > > > > > > > > > -- Joyce > > > > > > On Tue, Sep 3, 2013 at 6:18 PM, Henry Saputra >wrote: > > > >> So looks like we need to manually resolve the Github pull requests. > >> > >

Re: [Licensing check] Spark 0.8.0-incubating RC1

2013-09-03 Thread Henry Saputra
So looks like we need to manually resolve the Github pull requests. Or, does github automatically know that a particular merge to ASF git repo is associated to a GitHub pull request? - Henry On Tue, Sep 3, 2013 at 1:38 PM, Matei Zaharia wrote: > Yup, the plan is as follows: > > - Make pull req

Re: [Licensing check] Spark 0.8.0-incubating RC1

2013-09-02 Thread Henry Saputra
Hi Matei, Are we "locking" pull requests to github repo by tomorrow? Meaning no more push to GitHub repo for Spark. >From your email seems like there will be more potential pull requests for github repo to be merged back to ASF Git repo. - Henry On Monday, September 2, 2013, Matei Zaharia wrote

Re: Add me to the mailing list

2013-08-31 Thread Henry Saputra
HI Cesar, To subscribe please send blank email to dev-subscr...@spark.incubator.apache.org Thanks, Henry On Sat, Aug 31, 2013 at 4:10 PM, Cesar Arevalo wrote: > Add me to the mailing list >

Re: Error while building spark-0.7.3

2013-08-30 Thread Henry Saputra
Including Spark's dev@ list to get more potential audience building Spark from source. - Henry On Fri, Aug 30, 2013 at 1:39 PM, Marek Wiewiorka wrote: > Hi All, > I came across an error while building spark-0.7.3 from sources. It seems > to be a problem with a broken link to javax.servlet.orbi

Re: Keeping users mailing list with Google groups

2013-08-24 Thread Henry Saputra
ears here on this list and can be replied to and kept > in context here at the ASF. > > Cheers, > Chris > > > > -Original Message- > From: Henry Saputra > Reply-To: "dev@spark.incubator.apache.org" > > Date: Tuesday, August 20, 2013 1:55 PM >

Re: Website: WOW

2013-08-24 Thread Henry Saputra
Yep, totally agree with Chris. Good job guys =) - Henry On Fri, Aug 23, 2013 at 9:06 PM, Matei Zaharia wrote: > Thanks Chris! We're still working on it and hopefully we'll have some > improvements over the old one soon too. > > Matei > > On Aug 23, 2013, at 8:56 PM, Chris Mattmann wrote: > >

Re: Keeping users mailing list with Google groups

2013-08-20 Thread Henry Saputra
che.org/foundation/public-archives.html > > I'm sure more senior ASF folks will chime in (if not -- I'll ping them ;-)) > but I'll be -0 on this (even though, again, I totally understand > the motivation). > > Thanks, > Roman. > > > On Tue, Aug 20, 2013

Re: Important: Changes to Spark's build system on master branch

2013-08-20 Thread Henry Saputra
t #838 > (https://github.com/mesos/spark/pull/838). The Apache-hosted > repository at https://git-wip-us.apache.org/repos/asf/incubator-spark.git > does not appear to have these changes. > > -Jey > > On Tue, Aug 20, 2013 at 10:02 PM, Henry Saputra > wrote: > > Hi Jey, ju

Re: Important: Changes to Spark's build system on master branch

2013-08-20 Thread Henry Saputra
Hi Jey, just want to clarify that the changes happen to master branch in the github and not the Apache git repository? Thanks, Henry On Tue, Aug 20, 2013 at 8:39 PM, Jey Kottalam wrote: > The master branch of Spark has been updated with PR #838, which > changes aspects of Spark's interface to

Re: Keeping users mailing list with Google groups

2013-08-20 Thread Henry Saputra
Andy > > > On Tue, Aug 20, 2013 at 12:52 PM, Mark Hamstra >wrote: > > > Is Google groups email formatting completely compatible with Apache > lists? > > > > > > > > On Tue, Aug 20, 2013 at 11:43 AM, Henry Saputra > >wrote: > > > &g

Re: Keeping users mailing list with Google groups

2013-08-20 Thread Henry Saputra
13 at 11:37 AM, Matei Zaharia wrote: > Hi Henry, > > I'd be happy to do this as long as Apache is okay with it! It will save a > lot of hassle for our users. Does it basically just require subscribing > user@spark.i.a.o to the Google Group? > > Matei > > On Aug

Keeping users mailing list with Google groups

2013-08-20 Thread Henry Saputra
Hi Guys, I am thinking about keeping the users list with Google groups and mirror the messages to user@spark.i.a.o. This way users can communicate via Google groups forum style rather than Apache mailing list, Most developers contributing to Spark have to use Apache way to communicate but as for

Re: Incubator PMC/Board report for Aug 2013 ([ppmc])

2013-08-08 Thread Henry Saputra
LGTM. I have signed off the report. Thanks Matei - Henry On Wed, Aug 7, 2013 at 2:52 PM, Matei Zaharia wrote: > Ah, good idea. I've added that in. > > Matei > > On Aug 7, 2013, at 2:32 PM, Henry Saputra wrote: > > > Thanks Matei > > > > One question

  1   2   >