Re: Hoya Proposal

2014-03-10 Thread Steve Loughran
We're doing some redesign and need to get some more progress on that before putting the proposal out -otherwise people wouldn't get a current view of what's being built. -steve On 5 March 2014 01:07, Roman Shaposhnik r...@apache.org wrote: Steve, I am just wondering: are you in a position

Re: Hoya Proposal

2014-03-04 Thread Roman Shaposhnik
Steve, I am just wondering: are you in a position to move forward with the proposal at this point or are you still mulling over the feedback? Thanks, Roman. On Wed, Jan 8, 2014 at 7:08 AM, Steve Loughran ste...@hortonworks.com wrote: I'm starting to put together the incubation proposal for

Re: Hoya Proposal

2014-02-05 Thread Steve Loughran
not yet, but that should be the goal. It's already a hadoop-cliuster-ready app, so all that is needed is patching the configs for the target cluster (filesystem, ZK, security) and building up the commands to exec On 2 February 2014 17:55, Edward J. Yoon edwardy...@apache.org wrote: Hi, Hoya

Re: Hoya Proposal

2014-02-02 Thread Edward J. Yoon
Hi, Hoya looks nice. 5. Help migrate more distributed applications into YARN clusters - such as Apache HAMA. BTW, this means that HAMA can be deployed on YARN cluster using HOYA without implement separate YARN application? On Wed, Jan 22, 2014 at 6:42 PM, Steve Loughran

Re: Hoya Proposal

2014-01-22 Thread Steve Loughran
thanks Jakob - we haven't had a vote yet though, still discussing the proposal On 22 January 2014 06:57, Jakob Homan jgho...@gmail.com wrote: HOYA looks like a useful bit of code,which if squinted at appropriately, might, sorta be able to be implemented with another useful bit of code

Re: Hoya Proposal

2014-01-21 Thread Chris Riccomini
Hey Guys, I'd like to +1 non-binding Hoya (or whatever you want to call it). It's going to be really useful for the YARN ecosystem to have a project like this out there, and it makes a lot of sense to put it in Apache. Hopefully we can move past the naming stuff, and get the project in. Cheers,

Re: Hoya Proposal

2014-01-21 Thread Jakob Homan
HOYA looks like a useful bit of code,which if squinted at appropriately, might, sorta be able to be implemented with another useful bit of code already in the incubator. But could just as well be independent. Let's let HOYA in and see where the communities that develop around it and Twill want to

Re: Hoya Proposal

2014-01-20 Thread Tommaso Teofili
I just can speak for the Hama-to-Yarn use case (with my newbie hat on) and it seems Hoya may be really helpful as the entry point to address it as it provides a set of simple and useful tools. For the sake of the names I think Hoya would be good (while Hyena would not). Just my 0.02 cents,

Re: Hoya Proposal

2014-01-17 Thread Steve Loughran
On 16 January 2014 12:41, Tommaso Teofili tommaso.teof...@gmail.com wrote: Hi all, @Steve I'm curious to know if also Apache Hama may leverage Hoya to be deployed on YARN. If you are going to make a 100% commit to running in YARN -which, if you aren't ready yet, Hama should be able to do in

Re: Hoya Proposal

2014-01-17 Thread Steve Loughran
Andreas, to me, Twill is a library, a convenience library, that one can use to write Yarn apps. Hoya aims to provide a general framework using which one can take existing apps (HBase/Accumulo to start with), and make them run well in a Yarn cluster, without intruding at all into the App

Re: Hoya Proposal

2014-01-17 Thread Bernd Fondermann
Very informative explanation. I've got a better understanding of the proposal now. I suggest that a remark like this is added to the Hoya proposal, so this part of the discussion becomes part of the vote on the proposal.The proposal's Known Risk section lacks a Relationships with Other Apache

Re: Hoya Proposal

2014-01-17 Thread Steve Loughran
On 17 January 2014 10:10, Bernd Fondermann bernd.fonderm...@gmail.comwrote: Very informative explanation. I've got a better understanding of the proposal now. I suggest that a remark like this is added to the Hoya proposal, so this part of the discussion becomes part of the vote

Re: Hoya Proposal

2014-01-17 Thread Bernd Fondermann
On Fri, Jan 17, 2014 at 1:13 PM, Steve Loughran ste...@hortonworks.com wrote: On 17 January 2014 10:10, Bernd Fondermann bernd.fonderm...@gmail.comwrote: (side note: When a project graduates, a PMC is established and tasked with a specific task. Two PMCs cannot have the same task. Therefore,

Re: Hoya Proposal

2014-01-17 Thread Bertrand Delacretaz
On Wed, Jan 15, 2014 at 1:57 AM, lars hofhansl la...@apache.org wrote: ...I should we shouldn't rule out a name just because the English pronunciation is similar to another project. Will people really confuse Apache Hyena and Apache Jena?... At this early stage it's very easy to switch names,

Re: Hoya Proposal

2014-01-17 Thread Andreas Neumann
Deveraj, all these features that you list are not only useful for existing applications but also for applications developed with Twill. But I agree that the initial focus of the projects is different, and we should keep talking in the future abut possible convergence. -Andreas. On Fri, Jan 17,

Re: Hoya Proposal

2014-01-16 Thread Enis Söztutar
+1 -I'd really like input from the HBase and Accumulo teams as they are the first apps we're trying to work with. Great, please add me as a mentor than. There is another animal named Nyala (

Re: Hoya Proposal

2014-01-16 Thread Tommaso Teofili
Hi all, @Steve I'm curious to know if also Apache Hama may leverage Hoya to be deployed on YARN. If yes, that'd hopefully bring some more people involved from Hama as well. My 0.02 cents, Tommaso 2014/1/14 Enis Söztutar enis@gmail.com +1 -I'd really like input from the HBase and

Re: Hoya Proposal

2014-01-16 Thread Andreas Neumann
I do see a lot of value in all the features of Hoya, and I am not trying to discredit it. Yet I do think that most of these features are actually already in Twill or would be great additions to Twill, and sooner or later will be implemented in Twill, implying even greater overlap. I am not sure

Re: Hoya Proposal

2014-01-16 Thread Devaraj Das
Andreas, to me, Twill is a library, a convenience library, that one can use to write Yarn apps. Hoya aims to provide a general framework using which one can take existing apps (HBase/Accumulo to start with), and make them run well in a Yarn cluster, without intruding at all into the App internals.

Re: Hoya Proposal

2014-01-15 Thread Steve Loughran
On 15 January 2014 02:13, Andreas Neumann a...@apache.org wrote: I see. So is Hoya limited to HBase and Accumulo? Or is it open for any other type of existing application? If so, won't it have some common abstraction that is shared by all of them? That is where I see the similarity with

Re: Hoya Proposal

2014-01-15 Thread Bernd Fondermann
I think that Andreas has a valid point. With the description you are giving here, there seems to be much more overlap with the Twill podling than I initially anticipated. In the Hoya proposal, I'd like to learn about how it compares to Twill and why it makes sense to start another such podling

Re: Hoya Proposal

2014-01-15 Thread Josh Elser
I wanted to weigh in on some of Steve's thoughts, I'm actually really excited about being able to leverage Hoya inside of Accumulo itself. We presently have a few system tests that rely on manual set up, which can be frustrating to deal with on a beefy boxes (running multiple Accumulo procs on a

Re: Hoya Proposal

2014-01-14 Thread Steve Loughran
I'd put more in common with Helix than twill -twill is for building YARN apps, Hoya focused on deploying existing apps into YARN containers. It's a lot more minimal than Helix -it doesn't run its own code in any of the containers other than the AM On 14 January 2014 03:33, Andreas Neumann

Re: Hoya Proposal

2014-01-14 Thread Bernd Fondermann
Which languages are they? I would expect the english pronounciation would be relevant, where Hyena (see http://en.wiktionary.org/wiki/hyena) is quite different from Jena. Bernd On Mon, Jan 13, 2014 at 9:25 PM, Bertrand Delacretaz bdelacre...@apache.org wrote: On Mon, Jan 13, 2014 at 5:36

Re: Hoya Proposal

2014-01-14 Thread Andy Seaborne
As a project name Jena has been in use for the project for about 13 years now. 1.0 was 9 Jan 2001. A mere 983K (zipped). The discussion is about Hyena for Hoya. Andy On 13/01/14 23:38, sebb wrote: Jenny ? On 13 January 2014 22:21, Ted Dunning ted.dunn...@gmail.com wrote: Too

Re: Hoya Proposal

2014-01-14 Thread Steve Loughran
I don't this is something to worry about much -Hoya is good too, lots of things outlive their acroynms. SOAP, for example On 14 January 2014 12:03, Andy Seaborne a...@apache.org wrote: As a project name Jena has been in use for the project for about 13 years now. 1.0 was 9 Jan 2001. A mere

Re: Hoya Proposal

2014-01-14 Thread lars hofhansl
@incubator.apache.org Sent: Tuesday, January 14, 2014 4:03 AM Subject: Re: Hoya Proposal As a project name Jena has been in use for the project for about 13 years now.  1.0 was 9 Jan 2001.  A mere 983K (zipped). The discussion is about Hyena for Hoya.     Andy On 13/01/14 23:38, sebb wrote: Jenny

Re: Hoya Proposal

2014-01-14 Thread Andreas Neumann
I see. So is Hoya limited to HBase and Accumulo? Or is it open for any other type of existing application? If so, won't it have some common abstraction that is shared by all of them? That is where I see the similarity with Twill. Whereas, if it is a separate effort for each existing application,

Re: Hoya Proposal

2014-01-13 Thread Steve Loughran
On 9 January 2014 21:55, Enis Söztutar enis@gmail.com wrote: Proposal looks good. Let me know if you need any additional help in mentors. Enis +1 -I'd really like input from the HBase and Accumulo teams as they are the first apps we're trying to work with. On that note, I know we've

Re: Hoya Proposal

2014-01-13 Thread Bertrand Delacretaz
On Mon, Jan 13, 2014 at 3:33 PM, Steve Loughran ste...@hortonworks.com wrote: ...What do people think about a project name Hyena? It's close enough, lives in the savannah... I think it's too close to http://jena.apache.org/ -Bertrand

Re: Hoya Proposal

2014-01-13 Thread Marvin Humphrey
On Mon, Jan 13, 2014 at 6:33 AM, Steve Loughran ste...@hortonworks.com wrote: On that note, I know we've used the acronym hoya, HBase on YARN, but it is already a bit out of date. What do people think about a project name Hyena? It's close enough, lives in the savannah... Based on Google

Re: Hoya Proposal

2014-01-13 Thread Bernd Fondermann
+1 Bernd On Mon, Jan 13, 2014 at 4:44 PM, Jean-Baptiste Onofré j...@nanthrax.netwrote: +1 for Hyena. Regards JB On 01/13/2014 03:33 PM, Steve Loughran wrote: On 9 January 2014 21:55, Enis Söztutar enis@gmail.com wrote: Proposal looks good. Let me know if you need any

Re: Hoya Proposal

2014-01-13 Thread Steve Loughran
On 10 January 2014 09:54, Jean-Baptiste Onofré j...@nanthrax.net wrote: Hi Steve, can I help during the week end ? Regards JB I'm just running the post-rename tests now; functional test runner came first... -steve On 01/10/2014 10:31 AM, Steve Loughran wrote: I'm going to do the

Re: Hoya Proposal

2014-01-13 Thread Dave Fisher
On Jan 13, 2014, at 6:33 AM, Steve Loughran wrote: On 9 January 2014 21:55, Enis Söztutar enis@gmail.com wrote: Proposal looks good. Let me know if you need any additional help in mentors. Enis +1 -I'd really like input from the HBase and Accumulo teams as they are the first

Re: Hoya Proposal

2014-01-13 Thread Bertrand Delacretaz
On Mon, Jan 13, 2014 at 5:36 PM, Bertrand Delacretaz bdelacre...@apache.org wrote: On Mon, Jan 13, 2014 at 3:33 PM, Steve Loughran ste...@hortonworks.com wrote: ...What do people think about a project name Hyena? It's close enough, lives in the savannah... I think it's too close to

Re: Hoya Proposal

2014-01-13 Thread larry mccay
I agree with Marvin. Either works fine. The original meaning of Hoya doesn't have to continue to be acknowledged. On Mon, Jan 13, 2014 at 12:02 PM, Marvin Humphrey mar...@rectangular.comwrote: On Mon, Jan 13, 2014 at 6:33 AM, Steve Loughran ste...@hortonworks.com wrote: On that note, I

Re: Hoya Proposal

2014-01-13 Thread Andy Seaborne
On 13/01/14 20:25, Bertrand Delacretaz wrote: On Mon, Jan 13, 2014 at 5:36 PM, Bertrand Delacretaz bdelacre...@apache.org wrote: On Mon, Jan 13, 2014 at 3:33 PM, Steve Loughran ste...@hortonworks.com wrote: ...What do people think about a project name Hyena? It's close enough, lives in the

Re: Hoya Proposal

2014-01-13 Thread sebb
Jenny ? On 13 January 2014 22:21, Ted Dunning ted.dunn...@gmail.com wrote: Too many people will read that as Jena, the city in Thuringia. https://en.wikipedia.org/wiki/Jena -1 On Mon, Jan 13, 2014 at 1:57 PM, Andy Seaborne a...@apache.org wrote: On 13/01/14 20:25, Bertrand Delacretaz

Re: Hoya Proposal

2014-01-13 Thread Andrew Purtell
There isn't anything in the same domain named Hoya that I am aware of. One can get to Hoya from other avenues - it is a county and city in Germany; or it is the genus for several hundred tropical plants. According to http://en.wikipedia.org/wiki/Hoya, hoya flowers grow in a configuration referred

Re: Hoya Proposal

2014-01-13 Thread larry mccay
Hoya - Hadoop Oriented Yarn Applications. :) As Andrew indicates - stick with Hoya. On Mon, Jan 13, 2014 at 7:18 PM, Andrew Purtell apurt...@apache.org wrote: There isn't anything in the same domain named Hoya that I am aware of. One can get to Hoya from other avenues - it is a county and

Re: Hoya Proposal

2014-01-13 Thread Andreas Neumann
Hi Steve, Hoya has a lot of good ideas. How do think it relates to Twill (recently incubated at http://twill.incubator.apache.org/)? I feel that there is a lot of overlap in what both projects are trying to achieve. Do you think they complement each other? Is there opportunity for collaboration,

Re: Hoya Proposal

2014-01-10 Thread Steve Loughran
I'm going to do the rename over the w/end, I just need to get a functional tests branch in, because merge-over-renames is one of those things you don't want to have to do. On 9 January 2014 17:29, Alejandro Abdelnur t...@cloudera.com wrote: argh, gmail trying to be extra smart collapsed his

Re: Hoya Proposal

2014-01-10 Thread Enis Söztutar
Proposal looks good. Let me know if you need any additional help in mentors. Enis On Thu, Jan 9, 2014 at 9:29 AM, Alejandro Abdelnur t...@cloudera.comwrote: argh, gmail trying to be extra smart collapsed his comment on that and i missed. sorry thx Alejandro (phone typing) On Jan 9,

Re: Hoya Proposal

2014-01-10 Thread Jean-Baptiste Onofré
Hi Steve, can I help during the week end ? Regards JB On 01/10/2014 10:31 AM, Steve Loughran wrote: I'm going to do the rename over the w/end, I just need to get a functional tests branch in, because merge-over-renames is one of those things you don't want to have to do. On 9 January 2014

Re: Hoya Proposal

2014-01-09 Thread Steve Loughran
no its wrong, it should all be under org.apache.hoya. I had the hadoop prefix so that I could perhaps put it straight into the hadoop code as another tools module -no need for incubation. But as the actual providers and all tests are related to the deployment of hbase and accumulo, it really

Re: Hoya Proposal

2014-01-09 Thread Steve Loughran
thanks, that's a great offer -lovely to have some management oversight from others. I've put your name down On 8 January 2014 15:18, Jean-Baptiste Onofré j...@nanthrax.net wrote: Hi Steve, it looks interesting. It's a kind of advanced provisioning for Hadoop cluster. I see some potential

Re: Hoya Proposal

2014-01-09 Thread Jean-Baptiste Onofré
Hi Steve, Awesome, thanks. Regards JB On 01/09/2014 10:20 AM, Steve Loughran wrote: thanks, that's a great offer -lovely to have some management oversight from others. I've put your name down On 8 January 2014 15:18, Jean-Baptiste Onofré j...@nanthrax.net wrote: Hi Steve, it looks

Re: Hoya Proposal

2014-01-09 Thread Henry Saputra
Ah yes, I missed the additional hadoop in the path. Close enough :) On Thursday, January 9, 2014, Steve Loughran wrote: no its wrong, it should all be under org.apache.hoya. I had the hadoop prefix so that I could perhaps put it straight into the hadoop code as another tools module -no need

Re: Hoya Proposal

2014-01-09 Thread Alejandro Abdelnur
Mmmh, if i recall correctly this has come up in the past with other projects and it was decided against it. Could you please check with the hadoop folks about it? Thx On Jan 9, 2014, at 1:19 AM, Steve Loughran ste...@hortonworks.com wrote: no its wrong, it should all be under

Re: Hoya Proposal

2014-01-09 Thread Benson Margulies
If you can work out a plan to do this directly in Hadoop, there's no need for the incubator. You just build and and contribute it in cahoots with them, and earn commit over there as you go. On Thu, Jan 9, 2014 at 11:14 AM, Alejandro Abdelnur t...@cloudera.com wrote: Mmmh, if i recall correctly

Re: Hoya Proposal

2014-01-09 Thread Alejandro Abdelnur
I may have not been clear enough, I was referring to using 'org.apache.hadoop' as package prefix for a project other than hadoop. Thanks On Thu, Jan 9, 2014 at 8:36 AM, Benson Margulies bimargul...@gmail.comwrote: If you can work out a plan to do this directly in Hadoop, there's no need for

Re: Hoya Proposal

2014-01-09 Thread larry mccay
Hi Alejandro - I believe that Steve has already acknowledged that a package rename is required and that the project is likely not appropriate for Hadoop proper. thanks, --larry On Thu, Jan 9, 2014 at 11:46 AM, Alejandro Abdelnur t...@cloudera.comwrote: I may have not been clear enough, I

Re: Hoya Proposal

2014-01-09 Thread Jean-Baptiste Onofré
Steve did already indeed. Regards JB On 01/09/2014 06:23 PM, larry mccay wrote: Hi Alejandro - I believe that Steve has already acknowledged that a package rename is required and that the project is likely not appropriate for Hadoop proper. thanks, --larry On Thu, Jan 9, 2014 at 11:46 AM,

Re: Hoya Proposal

2014-01-09 Thread Alejandro Abdelnur
argh, gmail trying to be extra smart collapsed his comment on that and i missed. sorry thx Alejandro (phone typing) On Jan 9, 2014, at 9:23, larry mccay lmc...@apache.org wrote: Hi Alejandro - I believe that Steve has already acknowledged that a package rename is required and that the

Hoya Proposal

2014-01-08 Thread Steve Loughran
I'm starting to put together the incubation proposal for Hoya: a tool to dynamically deploy applications such as HBase or Accumulo on YARN https://wiki.apache.org/incubator/HoyaProposal It does already work to the extent that it can bring up either application, run different clusters of

Re: Hoya Proposal

2014-01-08 Thread Jean-Baptiste Onofré
Hi Steve, it looks interesting. It's a kind of advanced provisioning for Hadoop cluster. I see some potential interesting work together with other projects. I would be please to be mentor on Hoya. Regards JB On 01/08/2014 04:08 PM, Steve Loughran wrote: I'm starting to put together the

Re: Hoya Proposal

2014-01-08 Thread Henry Saputra
I like how the initial code already put under org.apache.hadoop.hoya with correct ASF header =) - Henry On Wed, Jan 8, 2014 at 7:08 AM, Steve Loughran ste...@hortonworks.com wrote: I'm starting to put together the incubation proposal for Hoya: a tool to dynamically deploy applications such