Curious -- I see mini-0.5.0-RC1 and RC0 docker images, however, the operator, server, database and jupyter-notebook docker images are all tagged version 0.5.0. Was this intentional?
I kept getting disk full error trying to pull the RC1 minisubmarine image: docker pull apache/submarine:mini-0.5.0-RC1 failed to register layer: Error processing tar file(exit status 1): write /home/yarn/submarine/tf2-venv/lib/python3.6/site-packages/tensorflow_core/python/_pywrap_tensorflow_internal.so: no space left on device I've already run docker system prune to remove unnecessary volumes and images, and my local disk has more than 200GB of space. After the release, we should update the release information in the Apache system: https://reporter.apache.org/addrelease.html?submarine (I believe the access is restricted to PMCs) The docker images should be regarded as convenience binary, and our vote is for the source code. So if you need to update the images, no need to bote again. On Sun, Oct 25, 2020 at 12:46 PM Wei-Chiu Chuang <[email protected]> wrote: > Not a blocker, but I do notice our doc has lots of "TODO" and "FIXME" and > then realized our doc is a WIP from SUBMARINE-518. > I'd like to find a time to contribute to the docs later. > > On Thu, Oct 22, 2020 at 4:16 AM Kevin Su <[email protected]> wrote: > >> Hi folks, >> >> >> Thanks to everyone's help on this release. Special thanks to Wangda, >> >> Zhankun, Xun, Wei-Chiu, Wanqiang, Ryan, Manikandan, and JohnTing! >> >> I've created a release candidate (RC1) for submarine 0.5.0. The >> highlighted >> >> features are as follows: >> >> 1. Submarine Experiments: Redefined the experiment spec, sync up code from >> Git, it could be https and ssh >> >> 2. Predefined experiment template: Register A experiment template and >> submit related parameter to run an experiment using Rest API >> >> 3. Environment profile: Users could easily manage their docker image and >> conda environment >> >> 4. Jupyter Notebook: Spawn a jupyter notebook using Rest API, and execute >> ML code on K8s, or submit an experiment to submarine server >> >> 5. Submarine Workbench UI: CRUD Experiment, Environment, Notebook through >> the UI >> >> The RC tag in git is here: >> https://github.com/apache/submarine/releases/tag/release-0.5.0-RC1 >> The RC release artifacts are available at: >> http://home.apache.org/~pingsutw/submarine-0.5.0-RC1 >> >> The mini-submarine image is here: >> >> https://hub.docker.com/layers/apache/submarine/mini-0.5.0-RC1/images/sha256-b8bc864a9a6409361de96d93e467c6458c96f6d2d85c74639a201b1c1b9af3a0?context=explore >> >> The server image is here: >> >> https://hub.docker.com/layers/apache/submarine/server-0.5.0/images/sha256-3c197696a773cebf3409acc5ed89504e9f56240a1748b107031bf32a4ba79e40?context=explore >> >> The database image is here: >> >> https://hub.docker.com/layers/apache/submarine/database-0.5.0/images/sha256-fcf72289e0aa46e83fc8e65c8aca79be4bba96ec9813d54568e5679925cdc94f?context=explore >> >> The Jupyter Notebook image is here: >> >> https://hub.docker.com/layers/apache/submarine/jupyter-notebook-0.5.0/images/sha256-1e05cdd3c814063b3cac9de12bdecd70475d38d708c06794c2d3b55ef97de82a?context=explore >> >> The Maven staging repository is here: >> https://repository.apache.org/content/repositories/orgapachesubmarine-1015 >> >> My public key is here: >> https://dist.apache.org/repos/dist/release/submarine/KEYS >> >> *This vote will run for 7 days, ending on Oct 29, 2020, at 11:59 pm PST.* >> >> For the testing, I have verified the >> >> 1. Build from source, Run the mnist on Hadoop >> >> 2. Example with mini-submarine(both local and remote mode) >> >> 3. Verified the experiment operations to K8s by Submarine Server REST and >> PySubmarine. >> >> 4. Workbench UI (experiment, environment, notebook) >> >> 5. HTTP sync code in the experiment >> >> 6. Environment profile REST API >> >> 7. Notebook REST API >> >> >> Please follow the document to test these features. >> * >> https://github.com/apache/submarine/tree/master/dev-support/mini-submarine >> * https://github.com/apache/submarine/blob/master/docs/user-guide-home.md >> >> My +1 to start. Thanks! >> >> BR, >> Kevin Su >> >
