Hi Gour, As user of slider (in production), it would be great to have some idea on timelines so to plan to switch from "classic slider" to hadoop branch. Given that hadoop version of branch itself will be not be a stable / battle tested and that "slider classic" development is slowing down (for right reasons) to move to yarn; the transition period is challenge for slider users.
Not sure if this topic belongs to the apache report but wanted to raise as is important for user community Thanks, Manoj On Wed, Nov 2, 2016 at 9:49 AM, Gour Saha <gs...@hortonworks.com> wrote: > Josh, Billie, > Thank you for reviewing the draft. > > Billie, I will make the change as you suggested. Should I also explicitly > mention that the funtests have not been moved yet and needs to be > converted to Java before we do so? > > -Gour > > On 11/2/16, 8:22 AM, "Billie Rinaldi" <billie.rina...@gmail.com> wrote: > > >Thanks for the draft, Gour. This looks good. The only part I would change > >is this: "As a result, portions like Slider Core, Application Master, > >Client and Tests had been rolled into Apache Hadoop YARN as module(s)." It > >isn't clear whether it includes the funtests or not, and all the slider > >code is in a single module in YARN. I'd suggest "As a result, the Slider > >Core module (including Application Master, Client and Java unit tests) has > >been rolled into an Apache Hadoop YARN feature branch as a > >hadoop-yarn-slider-core module." > > > >On Tue, Nov 1, 2016 at 6:44 PM, Gour Saha <gs...@hortonworks.com> wrote: > > > >> Please review and provide feedback on the draft below. > >> > >> ========================================================= > >> Slider > >> > >> Slider is a collection of tools and technologies to package, deploy, and > >> manage long running applications on Apache Hadoop YARN clusters. > >> > >> Slider has been incubating since 2014-04-29. > >> > >> Three most important issues to address in the move towards graduation: > >> > >> 1. Apache Slider community/PPMC has voted to move portions of Slider > >>into > >> Apache Hadoop YARN as modules. It is possible that the remaining > >>pieces > >> will be moved at a later point in time or become obsolete or evolve > >>to > >> work closely with YARN. Slider PPMC will decide what makes the most > >> sense as we progress through this exciting time. > >> 2. Getting more external users > >> 3. Growth of a diverse set of developers/committers/PMC members is also > >> crucial towards the final state of Slider > >> > >> Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be > >>aware > >> of? > >> > >> No. > >> > >> How has the community developed since the last report? > >> > >> The Apache Hadoop YARN community/PMC and Apache Slider community/PPMC > >> had decided to move portions of Slider into YARN, to make fast and > >> significant > >> progress on: YARN-4692 - [Umbrella] Simplified and first-class support > >>for > >> services in YARN. As a result, portions like Slider Core, Application > >> Master, > >> Client and Tests had been rolled into Apache Hadoop YARN as module(s). > >> This effort is being captured in: YARN-5079 : Native YARN framework > >>layer > >> for services. All the migrations are happening in a branch (namely > >> yarn-native-services) created of off Hadoop trunk. As a result of this, > >> we are already seeing interest in the Hadoop committers/PMC, who have > >> started to contribute and submit patches to Slider. > >> > >> In order to support existing users of Slider, and to provide seamless > >> migration, there will be sufficient overlap between the time when a > >>stable > >> state of long running services support is available in some future > >>version > >> of YARN and the time till an independent Slider release is available. > >>The > >> community/PPMC will also determine the future state of Slider as we > >> navigate through these changes. > >> > >> The discussions on the Slider and YARN community DLs can be viewed here > >>- > >> > >> https://s.apache.org/0hoh > >> https://s.apache.org/MncV > >> > >> For the benefit of those who would like to use Slider Core from the > >> Hadoop codebase, but continue to use classic Slider Agent and legacy > >> app-packages, a new branch (yarn-native-services) has been created > >> in classic Slider repo. This branch retains only the Agent (python) code > >> and the App Packages. It adds Slider Core module as a Hadoop > >> dependency. This allows users to consume the latest of Slider Core. > >> Future classic Slider releases can be made purely off of this branch. > >> > >> Additionally an effort is being made to create an agent-less provider > >>for > >> legacy app-packages, which could help users to completely migrate to > >> Hadoop codebase for creating long-running services with Slider. > >>Expectation > >> from app-package owners would be to make minor modification of their > >> packages. Primary changes would be to shed the dependency on python > >> Agent code, effectively making packages much simpler than what they > >> look like today in classic Slider. > >> > >> How has the project developed since the last report? > >> > >> There has been fewer bug fixes on the classic Slider side as most of > >> the focus has been on developing features on native YARN services in > >> the Hadoop codebase. Work continues on support for complex services > >> (assemblies) and agent-less applications in Slider. The efforts on > >>Slider > >> Core will continue in the new services branch created in YARN. Few > >> key features which were merged to classic Slider as well were - > >> SLIDER-875 - Ability to create an Uber application package with > >> capability to deploy and manage as a single business app, and > >> SLIDER-1107 - Generate app configuration files in AM. Several issues > >> identified by Coverity scans were resolved as well. Additionally few > >> patches were contributed by the community fixing functional and > >> performance issues. Slider community plans to ship a release in the > >> next quarter with all these features and bug fixes. > >> > >> Date of last release: > >> > >> 2016-06-28 slider-0.91.0-incubating > >> > >> When were the last committers or PMC members elected? > >> > >> 2015-07-07: Yu (Thomas) Liu > >> > >> > >
