Good question, unless we got strong demand from the community to include it and contributors have bandwidth to do it, making new experiment framework work with YARN is a lower priority comparing to running on K8s. Even items are dockerized, but implementation still different, and deploy Submarine server on YARN needs a lot of net-new works in addition to support K8s.
We will not remove/deprecate existing YARN support, so anybody uses 0.3.0 release can continue. Thanks, Wangda On Thu, Apr 30, 2020 at 7:06 PM Zhankun Tang <[email protected]> wrote: > Thanks Wangda for the proposal. It LGTM. > One doubt for running experiment on YARN. Will it be included? > > BR, > Zhankun > > Wei-Chiu Chuang <[email protected]>于2020年5月1日 周五上午2:18写道： > > > Looks good to me. Thanks! > > > > Yes we need security to call a 1.0 GA > > > > On Wed, Apr 29, 2020 at 9:58 PM Wangda Tan <[email protected]> wrote: > > > > > Hi dev, > > > > > > Here's a WIP proposal of Submarine task breakdown: > > > > > > > > > > > > https://docs.google.com/spreadsheets/d/19g9RCxQEPE74CsOHK-nAf5UO32sFCCP4jCJB3RuFivE/edit#gid=0 > > > > > > *Please comment to add your thoughts. Some highlights: * > > > > > > - We will do release every two months (release cadence) > > > - Target to release 0.4.0 by end of May, which experiments submission > > > functionalities. > > > - (Jul) 0.5.0 will include UI and internal implementation for > > > notebook/experiment/environment. > > > - (Sep) Will do 1.0.0 (GA) release, will include more end to end > logics, > > > comprehensive docs, must-to-have security-related features/guidances. > > > - (Nov) 1.1.0 release, consider to include model management. > > > > > > Thoughts? > > > > > > Thanks, > > > Wangda > > > > > >
