Re: [PROPOSAL] Weave for Apache Incubator
Andreas Neumann wrote: Thank you for the feedback, it looks like the name Twill is appealing enough. I will update the proposal with the new name. I would also like to put the proposal on the incubator wiki (at https://wiki.apache.org/incubator/TwillProposal), can you please give me the privileges? (my user name is AndreasNeumann) Added you to ContributorsGroup. -David Thanks, -Andreas. - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [PROPOSAL] Weave for Apache Incubator
Thanks David, and the proposal is now on the wiki. On Thu, Nov 7, 2013 at 12:43 AM, David Crossley cross...@apache.org wrote: Andreas Neumann wrote: Thank you for the feedback, it looks like the name Twill is appealing enough. I will update the proposal with the new name. I would also like to put the proposal on the incubator wiki (at https://wiki.apache.org/incubator/TwillProposal), can you please give me the privileges? (my user name is AndreasNeumann) Added you to ContributorsGroup. -David Thanks, -Andreas. - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [PROPOSAL] Weave for Apache Incubator
On Tue, Nov 5, 2013 at 6:26 PM, Henry Saputra henry.sapu...@gmail.com wrote: I think Twill fits well with what Weave project trying to do with Hadoop and still in the spirit of the original weave name. Indeed! Twill is a pretty good name for a project like this. Thanks, Roman. - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [PROPOSAL] Weave for Apache Incubator
Thank you for the feedback, it looks like the name Twill is appealing enough. I will update the proposal with the new name. I would also like to put the proposal on the incubator wiki (at https://wiki.apache.org/incubator/TwillProposal), can you please give me the privileges? (my user name is AndreasNeumann) Thanks, -Andreas. On Wed, Nov 6, 2013 at 1:47 PM, Roman Shaposhnik r...@apache.org wrote: On Tue, Nov 5, 2013 at 6:26 PM, Henry Saputra henry.sapu...@gmail.com wrote: I think Twill fits well with what Weave project trying to do with Hadoop and still in the spirit of the original weave name. Indeed! Twill is a pretty good name for a project like this. Thanks, Roman. - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [PROPOSAL] Weave for Apache Incubator
Hi Andrei, thanks for offering, we are happy about any help we can get. On Mon, Nov 4, 2013 at 10:43 AM, Andrei Savu as...@apache.org wrote: IMO it's a good idea to keep this a separate project - the same way we have Curator for ZooKeeper. If you are looking for one more mentor I'm happy to help. -- Andrei Savu On Sun, Nov 3, 2013 at 11:21 PM, Roman Shaposhnik r...@apache.org wrote: Have you guys considered contributing this code directly to Hadoop? From what you are describing it sounds like a developer friendly library wrapped around YARN (along the lines of kitten: https://github.com/jwills/kitten). Thanks, Roman. On Tue, Oct 29, 2013 at 12:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of YARN, and Weave uses Apache Zookeeper, HDFS, Kafka, and other Apache software (see the External Dependencies section). Current Status == Weave was initially developed at Continuuity. The Weave codebase is currently hosted in a public repository at github.com, which will seed the Apache git repository. Meritocracy --- Our intent with this incubator proposal is to start building a diverse developer community around Weave following the Apache meritocracy model. Since Weave was initially developed in early 2013, we have had fast adoption and contributions within Continuuity. We are looking forward to new contributors. We wish to build a community based on Apache's meritocracy principles, working with those who contribute significantly to the project and welcoming them to be committers both during the incubation process and beyond. Community - Weave is currently being used internally at Continuuity and is at the core of our products. We hope to extend our contributor base significantly and we will invite all who are interested in simplifying the development of distributed applications to participate. Core Developers
Re: [PROPOSAL] Weave for Apache Incubator
Regarding the naming issue, we understand that Weave may be problematic, so we did a little bit of searching for a new name. Here is a list of name candidates in order of our preference: - Tartan - Sisal - Twill Do these ring a bell or raise concerns? A quick search did not bring up any open source projects named Tartan, but there appear to be some non-Apache projects named Sisal and Twill. I am not sure how unique a project name has to be, it is really hard to find something that does not exist at all... On Wed, Oct 30, 2013 at 11:28 AM, David Nalley da...@gnsa.us wrote: On Tue, Oct 29, 2013 at 6:14 PM, Upayavira u...@odoko.co.uk wrote: And Apache Wave too (which is what I first saw before I read the title more carefully). Upayavira On Tue, Oct 29, 2013, at 09:12 PM, Matt Benson wrote: Hi, I am concerned about potential confusion with Apache Commons Weaver [1]. So it might also be a trademark related issue. Weave has a TM registration pending from Intuit in the software space. There's also OIC Weave - which is data visualization software. No judgement - just things to consider and weigh (and that will need to be dealt with when you handle the podling name search) --David - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [PROPOSAL] Weave for Apache Incubator
I mentioned this offline to others too. We've had lots of discussions in the past about contrib projects overall in Hadoop and we moved away from there. The same started happening with YARN, and we took a stand that YARN shouldn't run into the same umbrella issue. You can see the JIRA discussions on Paas On YARN etc for more context. As for Weave, it represents a good programming model (threads) alongside MR and so deserves its own home IMO. Thanks, +Vinod On Nov 3, 2013, at 11:21 PM, Roman Shaposhnik wrote: Have you guys considered contributing this code directly to Hadoop? From what you are describing it sounds like a developer friendly library wrapped around YARN (along the lines of kitten: https://github.com/jwills/kitten). Thanks, Roman. On Tue, Oct 29, 2013 at 12:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of YARN, and Weave uses Apache Zookeeper, HDFS, Kafka, and other Apache software (see the External Dependencies section). Current Status == Weave was initially developed at Continuuity. The Weave codebase is currently hosted in a public repository at github.com, which will seed the Apache git repository. Meritocracy --- Our intent with this incubator proposal is to start building a diverse developer community around Weave following the Apache meritocracy model. Since Weave was initially developed in early 2013, we have had fast adoption and contributions within Continuuity. We are looking forward to new contributors. We wish to build a community based on Apache's meritocracy principles, working with those who contribute significantly to the project and welcoming them to be committers both during the incubation process and beyond. Community - Weave is currently being used internally at Continuuity and is at the core of our products. We hope to extend our contributor base significantly and we will invite all who are interested in simplifying the development of distributed applications to participate. Core Developers --- Weave is currently being developed by five engineers at Continuuity: Terence
Re: [PROPOSAL] Weave for Apache Incubator
I think Twill fits well with what Weave project trying to do with Hadoop and still in the spirit of the original weave name. Other than name, the proposal looks good. Looking forward to the VOTE thread. - Henry On Tue, Nov 5, 2013 at 3:18 PM, Andreas Neumann a...@apache.org wrote: Regarding the naming issue, we understand that Weave may be problematic, so we did a little bit of searching for a new name. Here is a list of name candidates in order of our preference: - Tartan - Sisal - Twill Do these ring a bell or raise concerns? A quick search did not bring up any open source projects named Tartan, but there appear to be some non-Apache projects named Sisal and Twill. I am not sure how unique a project name has to be, it is really hard to find something that does not exist at all... On Wed, Oct 30, 2013 at 11:28 AM, David Nalley da...@gnsa.us wrote: On Tue, Oct 29, 2013 at 6:14 PM, Upayavira u...@odoko.co.uk wrote: And Apache Wave too (which is what I first saw before I read the title more carefully). Upayavira On Tue, Oct 29, 2013, at 09:12 PM, Matt Benson wrote: Hi, I am concerned about potential confusion with Apache Commons Weaver [1]. So it might also be a trademark related issue. Weave has a TM registration pending from Intuit in the software space. There's also OIC Weave - which is data visualization software. No judgement - just things to consider and weigh (and that will need to be dealt with when you handle the podling name search) --David - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [PROPOSAL] Weave for Apache Incubator
Currently Weave has dependencies on libraries like Kafka, logback, asm, etc, that might not be good idea to added all those as the core Hadoop dependencies. Thanks, Terence On Sun, Nov 3, 2013 at 11:21 PM, Roman Shaposhnik r...@apache.org wrote: Have you guys considered contributing this code directly to Hadoop? From what you are describing it sounds like a developer friendly library wrapped around YARN (along the lines of kitten: https://github.com/jwills/kitten). Thanks, Roman. On Tue, Oct 29, 2013 at 12:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of YARN, and Weave uses Apache Zookeeper, HDFS, Kafka, and other Apache software (see the External Dependencies section). Current Status == Weave was initially developed at Continuuity. The Weave codebase is currently hosted in a public repository at github.com, which will seed the Apache git repository. Meritocracy --- Our intent with this incubator proposal is to start building a diverse developer community around Weave following the Apache meritocracy model. Since Weave was initially developed in early 2013, we have had fast adoption and contributions within Continuuity. We are looking forward to new contributors. We wish to build a community based on Apache's meritocracy principles, working with those who contribute significantly to the project and welcoming them to be committers both during the incubation process and beyond. Community - Weave is currently being used internally at Continuuity and is at the core of our products. We hope to extend our contributor base significantly and we will invite all who are interested in simplifying the development of distributed applications to participate. Core Developers --- Weave is currently being developed by five engineers at Continuuity: Terence Yim, Andreas Neumann, Gary Helmling, Poorna Chandra and Albert Shau. Terence Yim is an Apache committer for Helix, Andreas is an Apache committer and PMC member for Oozie, and Gary
Re: [PROPOSAL] Weave for Apache Incubator
IMO it's a good idea to keep this a separate project - the same way we have Curator for ZooKeeper. If you are looking for one more mentor I'm happy to help. -- Andrei Savu On Sun, Nov 3, 2013 at 11:21 PM, Roman Shaposhnik r...@apache.org wrote: Have you guys considered contributing this code directly to Hadoop? From what you are describing it sounds like a developer friendly library wrapped around YARN (along the lines of kitten: https://github.com/jwills/kitten). Thanks, Roman. On Tue, Oct 29, 2013 at 12:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of YARN, and Weave uses Apache Zookeeper, HDFS, Kafka, and other Apache software (see the External Dependencies section). Current Status == Weave was initially developed at Continuuity. The Weave codebase is currently hosted in a public repository at github.com, which will seed the Apache git repository. Meritocracy --- Our intent with this incubator proposal is to start building a diverse developer community around Weave following the Apache meritocracy model. Since Weave was initially developed in early 2013, we have had fast adoption and contributions within Continuuity. We are looking forward to new contributors. We wish to build a community based on Apache's meritocracy principles, working with those who contribute significantly to the project and welcoming them to be committers both during the incubation process and beyond. Community - Weave is currently being used internally at Continuuity and is at the core of our products. We hope to extend our contributor base significantly and we will invite all who are interested in simplifying the development of distributed applications to participate. Core Developers --- Weave is currently being developed by five engineers at Continuuity: Terence Yim, Andreas Neumann, Gary Helmling, Poorna Chandra and Albert Shau. Terence Yim is an Apache committer for Helix, Andreas is an Apache committer and PMC member for Oozie, and Gary
Re: [PROPOSAL] Weave for Apache Incubator
Have you guys considered contributing this code directly to Hadoop? From what you are describing it sounds like a developer friendly library wrapped around YARN (along the lines of kitten: https://github.com/jwills/kitten). Thanks, Roman. On Tue, Oct 29, 2013 at 12:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of YARN, and Weave uses Apache Zookeeper, HDFS, Kafka, and other Apache software (see the External Dependencies section). Current Status == Weave was initially developed at Continuuity. The Weave codebase is currently hosted in a public repository at github.com, which will seed the Apache git repository. Meritocracy --- Our intent with this incubator proposal is to start building a diverse developer community around Weave following the Apache meritocracy model. Since Weave was initially developed in early 2013, we have had fast adoption and contributions within Continuuity. We are looking forward to new contributors. We wish to build a community based on Apache's meritocracy principles, working with those who contribute significantly to the project and welcoming them to be committers both during the incubation process and beyond. Community - Weave is currently being used internally at Continuuity and is at the core of our products. We hope to extend our contributor base significantly and we will invite all who are interested in simplifying the development of distributed applications to participate. Core Developers --- Weave is currently being developed by five engineers at Continuuity: Terence Yim, Andreas Neumann, Gary Helmling, Poorna Chandra and Albert Shau. Terence Yim is an Apache committer for Helix, Andreas is an Apache committer and PMC member for Oozie, and Gary Helmling is an Apache committer and PMC member for HBase. Poorna Chandra and Albert Shau have made many contributions to Weave. Alignment - The ASF is the natural choice to host the Weave project as its goal of encouraging community-driven open source projects fits with our vision for Weave. Additionally, many other projects with which we are familiar
Re: [PROPOSAL] Weave for Apache Incubator
Marvin, I agree that building a diverse community and users and committers will the greatest challenge for Weave (or what it will be named). One of main motivations for open-sourcing Weave is that it will benefit from the variety of use cases that will emerge outside of our office, and will eventually lead to more versatile and mature technology. We have already received interest from several people outside of Continuuity who wish to use and improve Weave, and we believe that a diverse community can be built. We will do our best to emphasize community and avoid closed-door decisions. -Andreas. On Tue, Oct 29, 2013 at 9:03 PM, Marvin Humphrey mar...@rectangular.comwrote: On Tue, Oct 29, 2013 at 12:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. Leaving aside the naming issues, the proposal is well crafted and you already have three experienced Mentors on board; I don't have any substantive suggestions. The one thing that jumps out is the homogenaity of the initial committer list, which will be an important challenge during incubation. With all five of the initial committers in the same office, it will be vital to emphasize communicating on the dev list so that potential contributors never feel as though they've been left out of the loop. (I'm reminded of Aurora, which entered incubation with 7 Twitter employees as the initial committers[1].) Marvin Humphrey [1] http://wiki.apache.org/incubator/AuroraProposal http://markmail.org/message/nzjqackh2n63skiz - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [PROPOSAL] Weave for Apache Incubator
Knit, crochet, macrame? Though, honestly, pulling lower-level components together into higher-level ones sounds a little like granny squares... Don On Wed, Oct 30, 2013 at 1:53 AM, Andreas Neumann a...@apache.org wrote: Pardon my ignorance, I just looked it up and realized that warp and weft are indeed related to weaving, so they might work. I do have the impression, though, that most people would associate Warp with the speed of light and not with weaving. -Andreas. On Wed, Oct 30, 2013 at 1:41 AM, Andreas Neumann a...@apache.org wrote: Thanks for pointing out these similarities; we were not aware of Commons Weaver. Given that Weaver is a sub-project of Commons, would the similarity be tolerable? Also, since Weave and Wave are pronounced quite differently, I am hoping that they are perceived as different enough. The name Weave is motivated from the name of YARN - it takes the complexity out of yarn by weaving it into a simple pattern. Warp and Weft don't really convey this meaning. If the concern about the name similarity is really strong, we will try to find another name, and we are open to suggestions. But please do also consider the motivation for this naming. Thanks On Tue, Oct 29, 2013 at 7:54 PM, sebb seb...@gmail.com wrote: In which case, maybe consider the related words: Apache Warp Apache Weft Just a thought. On 29 October 2013 22:14, Upayavira u...@odoko.co.uk wrote: And Apache Wave too (which is what I first saw before I read the title more carefully). Upayavira On Tue, Oct 29, 2013, at 09:12 PM, Matt Benson wrote: Hi, I am concerned about potential confusion with Apache Commons Weaver [1]. Matt [1] https://commons.apache.org/proper/commons-weaver/ On Tue, Oct 29, 2013 at 2:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of
Re: [PROPOSAL] Weave for Apache Incubator
Random lurker project name suggestion: yarnbomb - see http://en.m.wikipedia.org/wiki/Yarn_bombing /me relurking Steve On Oct 30, 2013 2:00 PM, Donald Whytock dwhyt...@apache.org wrote: Knit, crochet, macrame? Though, honestly, pulling lower-level components together into higher-level ones sounds a little like granny squares... Don On Wed, Oct 30, 2013 at 1:53 AM, Andreas Neumann a...@apache.org wrote: Pardon my ignorance, I just looked it up and realized that warp and weft are indeed related to weaving, so they might work. I do have the impression, though, that most people would associate Warp with the speed of light and not with weaving. -Andreas. On Wed, Oct 30, 2013 at 1:41 AM, Andreas Neumann a...@apache.org wrote: Thanks for pointing out these similarities; we were not aware of Commons Weaver. Given that Weaver is a sub-project of Commons, would the similarity be tolerable? Also, since Weave and Wave are pronounced quite differently, I am hoping that they are perceived as different enough. The name Weave is motivated from the name of YARN - it takes the complexity out of yarn by weaving it into a simple pattern. Warp and Weft don't really convey this meaning. If the concern about the name similarity is really strong, we will try to find another name, and we are open to suggestions. But please do also consider the motivation for this naming. Thanks On Tue, Oct 29, 2013 at 7:54 PM, sebb seb...@gmail.com wrote: In which case, maybe consider the related words: Apache Warp Apache Weft Just a thought. On 29 October 2013 22:14, Upayavira u...@odoko.co.uk wrote: And Apache Wave too (which is what I first saw before I read the title more carefully). Upayavira On Tue, Oct 29, 2013, at 09:12 PM, Matt Benson wrote: Hi, I am concerned about potential confusion with Apache Commons Weaver [1]. Matt [1] https://commons.apache.org/proper/commons-weaver/ On Tue, Oct 29, 2013 at 2:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will
Re: [PROPOSAL] Weave for Apache Incubator
On Tue, Oct 29, 2013 at 6:14 PM, Upayavira u...@odoko.co.uk wrote: And Apache Wave too (which is what I first saw before I read the title more carefully). Upayavira On Tue, Oct 29, 2013, at 09:12 PM, Matt Benson wrote: Hi, I am concerned about potential confusion with Apache Commons Weaver [1]. So it might also be a trademark related issue. Weave has a TM registration pending from Intuit in the software space. There's also OIC Weave - which is data visualization software. No judgement - just things to consider and weigh (and that will need to be dealt with when you handle the podling name search) --David - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[PROPOSAL] Weave for Apache Incubator
I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of YARN, and Weave uses Apache Zookeeper, HDFS, Kafka, and other Apache software (see the External Dependencies section). Current Status == Weave was initially developed at Continuuity. The Weave codebase is currently hosted in a public repository at github.com, which will seed the Apache git repository. Meritocracy --- Our intent with this incubator proposal is to start building a diverse developer community around Weave following the Apache meritocracy model. Since Weave was initially developed in early 2013, we have had fast adoption and contributions within Continuuity. We are looking forward to new contributors. We wish to build a community based on Apache's meritocracy principles, working with those who contribute significantly to the project and welcoming them to be committers both during the incubation process and beyond. Community - Weave is currently being used internally at Continuuity and is at the core of our products. We hope to extend our contributor base significantly and we will invite all who are interested in simplifying the development of distributed applications to participate. Core Developers --- Weave is currently being developed by five engineers at Continuuity: Terence Yim, Andreas Neumann, Gary Helmling, Poorna Chandra and Albert Shau. Terence Yim is an Apache committer for Helix, Andreas is an Apache committer and PMC member for Oozie, and Gary Helmling is an Apache committer and PMC member for HBase. Poorna Chandra and Albert Shau have made many contributions to Weave. Alignment - The ASF is the natural choice to host the Weave project as its goal of encouraging community-driven open source projects fits with our vision for Weave. Additionally, many other projects with which we are familiar and expect Weave to integrate with, such as ZooKeeper, YARN, HDFS, log4j, and others mentioned in the External Dependencies section are Apache projects, and Weave will benefit by close proximity to them. Known Risks === Orphaned Products - There is very little risk of Weave being orphaned, as it is a key part of Continuuity’s products. The core Weave developers plan to continue
Re: [PROPOSAL] Weave for Apache Incubator
Hi, I am concerned about potential confusion with Apache Commons Weaver [1]. Matt [1] https://commons.apache.org/proper/commons-weaver/ On Tue, Oct 29, 2013 at 2:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of YARN, and Weave uses Apache Zookeeper, HDFS, Kafka, and other Apache software (see the External Dependencies section). Current Status == Weave was initially developed at Continuuity. The Weave codebase is currently hosted in a public repository at github.com, which will seed the Apache git repository. Meritocracy --- Our intent with this incubator proposal is to start building a diverse developer community around Weave following the Apache meritocracy model. Since Weave was initially developed in early 2013, we have had fast adoption and contributions within Continuuity. We are looking forward to new contributors. We wish to build a community based on Apache's meritocracy principles, working with those who contribute significantly to the project and welcoming them to be committers both during the incubation process and beyond. Community - Weave is currently being used internally at Continuuity and is at the core of our products. We hope to extend our contributor base significantly and we will invite all who are interested in simplifying the development of distributed applications to participate. Core Developers --- Weave is currently being developed by five engineers at Continuuity: Terence Yim, Andreas Neumann, Gary Helmling, Poorna Chandra and Albert Shau. Terence Yim is an Apache committer for Helix, Andreas is an Apache committer and PMC member for Oozie, and Gary Helmling is an Apache committer and PMC member for HBase. Poorna Chandra and Albert Shau have made many contributions to Weave. Alignment - The ASF is the natural choice to host the Weave project as its goal of encouraging community-driven open source projects fits with our vision for Weave. Additionally, many other projects with which we are familiar and expect Weave to integrate with, such as ZooKeeper, YARN, HDFS, log4j, and others mentioned in
Re: [PROPOSAL] Weave for Apache Incubator
And Apache Wave too (which is what I first saw before I read the title more carefully). Upayavira On Tue, Oct 29, 2013, at 09:12 PM, Matt Benson wrote: Hi, I am concerned about potential confusion with Apache Commons Weaver [1]. Matt [1] https://commons.apache.org/proper/commons-weaver/ On Tue, Oct 29, 2013 at 2:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of YARN, and Weave uses Apache Zookeeper, HDFS, Kafka, and other Apache software (see the External Dependencies section). Current Status == Weave was initially developed at Continuuity. The Weave codebase is currently hosted in a public repository at github.com, which will seed the Apache git repository. Meritocracy --- Our intent with this incubator proposal is to start building a diverse developer community around Weave following the Apache meritocracy model. Since Weave was initially developed in early 2013, we have had fast adoption and contributions within Continuuity. We are looking forward to new contributors. We wish to build a community based on Apache's meritocracy principles, working with those who contribute significantly to the project and welcoming them to be committers both during the incubation process and beyond. Community - Weave is currently being used internally at Continuuity and is at the core of our products. We hope to extend our contributor base significantly and we will invite all who are interested in simplifying the development of distributed applications to participate. Core Developers --- Weave is currently being developed by five engineers at Continuuity: Terence Yim, Andreas Neumann, Gary Helmling, Poorna Chandra and Albert Shau. Terence Yim is an Apache committer for Helix, Andreas is an Apache committer and PMC member for Oozie, and Gary Helmling is an Apache committer and PMC member for HBase. Poorna Chandra and Albert Shau have made many contributions to Weave. Alignment - The ASF is the natural choice to host the
Re: [PROPOSAL] Weave for Apache Incubator
In which case, maybe consider the related words: Apache Warp Apache Weft Just a thought. On 29 October 2013 22:14, Upayavira u...@odoko.co.uk wrote: And Apache Wave too (which is what I first saw before I read the title more carefully). Upayavira On Tue, Oct 29, 2013, at 09:12 PM, Matt Benson wrote: Hi, I am concerned about potential confusion with Apache Commons Weaver [1]. Matt [1] https://commons.apache.org/proper/commons-weaver/ On Tue, Oct 29, 2013 at 2:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of YARN, and Weave uses Apache Zookeeper, HDFS, Kafka, and other Apache software (see the External Dependencies section). Current Status == Weave was initially developed at Continuuity. The Weave codebase is currently hosted in a public repository at github.com, which will seed the Apache git repository. Meritocracy --- Our intent with this incubator proposal is to start building a diverse developer community around Weave following the Apache meritocracy model. Since Weave was initially developed in early 2013, we have had fast adoption and contributions within Continuuity. We are looking forward to new contributors. We wish to build a community based on Apache's meritocracy principles, working with those who contribute significantly to the project and welcoming them to be committers both during the incubation process and beyond. Community - Weave is currently being used internally at Continuuity and is at the core of our products. We hope to extend our contributor base significantly and we will invite all who are interested in simplifying the development of distributed applications to participate. Core Developers --- Weave is currently being developed by five engineers at Continuuity: Terence Yim, Andreas Neumann, Gary Helmling, Poorna Chandra and Albert Shau. Terence Yim is an Apache committer for Helix, Andreas is an Apache committer and PMC member for Oozie, and Gary Helmling is an Apache committer and PMC member for
Re: [PROPOSAL] Weave for Apache Incubator
On Tue, Oct 29, 2013 at 12:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. Leaving aside the naming issues, the proposal is well crafted and you already have three experienced Mentors on board; I don't have any substantive suggestions. The one thing that jumps out is the homogenaity of the initial committer list, which will be an important challenge during incubation. With all five of the initial committers in the same office, it will be vital to emphasize communicating on the dev list so that potential contributors never feel as though they've been left out of the loop. (I'm reminded of Aurora, which entered incubation with 7 Twitter employees as the initial committers[1].) Marvin Humphrey [1] http://wiki.apache.org/incubator/AuroraProposal http://markmail.org/message/nzjqackh2n63skiz - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [PROPOSAL] Weave for Apache Incubator
Thanks for pointing out these similarities; we were not aware of Commons Weaver. Given that Weaver is a sub-project of Commons, would the similarity be tolerable? Also, since Weave and Wave are pronounced quite differently, I am hoping that they are perceived as different enough. The name Weave is motivated from the name of YARN - it takes the complexity out of yarn by weaving it into a simple pattern. Warp and Weft don't really convey this meaning. If the concern about the name similarity is really strong, we will try to find another name, and we are open to suggestions. But please do also consider the motivation for this naming. Thanks On Tue, Oct 29, 2013 at 7:54 PM, sebb seb...@gmail.com wrote: In which case, maybe consider the related words: Apache Warp Apache Weft Just a thought. On 29 October 2013 22:14, Upayavira u...@odoko.co.uk wrote: And Apache Wave too (which is what I first saw before I read the title more carefully). Upayavira On Tue, Oct 29, 2013, at 09:12 PM, Matt Benson wrote: Hi, I am concerned about potential confusion with Apache Commons Weaver [1]. Matt [1] https://commons.apache.org/proper/commons-weaver/ On Tue, Oct 29, 2013 at 2:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of YARN, and Weave uses Apache Zookeeper, HDFS, Kafka, and other Apache software (see the External Dependencies section). Current Status == Weave was initially developed at Continuuity. The Weave codebase is currently hosted in a public repository at github.com, which will seed the Apache git repository. Meritocracy --- Our intent with this incubator proposal is to start building a diverse developer community around Weave following the Apache meritocracy model. Since Weave was initially developed in early 2013, we have had fast adoption and contributions within Continuuity. We are looking forward to new contributors. We wish to build a community
Re: [PROPOSAL] Weave for Apache Incubator
Pardon my ignorance, I just looked it up and realized that warp and weft are indeed related to weaving, so they might work. I do have the impression, though, that most people would associate Warp with the speed of light and not with weaving. -Andreas. On Wed, Oct 30, 2013 at 1:41 AM, Andreas Neumann a...@apache.org wrote: Thanks for pointing out these similarities; we were not aware of Commons Weaver. Given that Weaver is a sub-project of Commons, would the similarity be tolerable? Also, since Weave and Wave are pronounced quite differently, I am hoping that they are perceived as different enough. The name Weave is motivated from the name of YARN - it takes the complexity out of yarn by weaving it into a simple pattern. Warp and Weft don't really convey this meaning. If the concern about the name similarity is really strong, we will try to find another name, and we are open to suggestions. But please do also consider the motivation for this naming. Thanks On Tue, Oct 29, 2013 at 7:54 PM, sebb seb...@gmail.com wrote: In which case, maybe consider the related words: Apache Warp Apache Weft Just a thought. On 29 October 2013 22:14, Upayavira u...@odoko.co.uk wrote: And Apache Wave too (which is what I first saw before I read the title more carefully). Upayavira On Tue, Oct 29, 2013, at 09:12 PM, Matt Benson wrote: Hi, I am concerned about potential confusion with Apache Commons Weaver [1]. Matt [1] https://commons.apache.org/proper/commons-weaver/ On Tue, Oct 29, 2013 at 2:53 PM, Andreas Neumann a...@apache.org wrote: I would like to propose Weave, an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications, as an Apache Incubator podling. The proposal is included in plain text. I would also like to put this on the wiki, but I appear to lack privileges to create pages. What do I need to do to get permission? -Andreas. Abstract Weave is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Proposal Weave is a set of libraries that reduces the complexity of developing distributed applications. It exposes the distributed capabilities of Apache Hadoop® YARN via a simple and intuitive programming model similar to Java threads. Weave also has built-in capabilities required by many distributed applications, such as real-time application logs and metrics collection, application lifecycle management, and network service discovery. Background == Hadoop YARN is a generic cluster resource manager that supports any type of distributed application. However, YARN’s interfaces are too low level for rapid application development. It requires a great deal of boilerplate code even for a simple application, creating a high ramp up cost that can turn developers away. Weave is designed to improve this situation with a programming model that makes running distributed applications as easy as running Java threads. With the abstraction provided by Weave, applications can be executed in process threads during development and unit testing and then be deployed to a YARN cluster without any modifications. Weave also has built-in support for real-time application logs and metrics collection, delegation token renewal, application lifecycle management, and network service discovery. This greatly reduces the pain that developers face when developing, debugging, deploying and monitoring distributed applications. Weave is not a replacement for YARN, it’s a framework that operates on top of YARN. Rationale = Developers who write YARN applications typically find themselves implementing the same (or similar) boilerplate code over and over again for every application. It makes sense to distill this common code into a reusable set of libraries that is perpetually maintained and improved by a diverse community of developers. Weave’s simple thread-like programming model will enable many Java programmers to develop distributed applications. We believe that this simplicity will attract developers who would otherwise be discouraged by complexity, and many new use cases will emerge for the usage of YARN. Incubating Weave as an Apache project makes sense because Weave is a framework built on top of YARN, and Weave uses Apache Zookeeper, HDFS, Kafka, and other Apache software (see the External Dependencies section). Current Status == Weave was initially developed at Continuuity. The Weave codebase is currently hosted in a public repository at github.com, which will seed the Apache git repository. Meritocracy --- Our
