[jira] [Updated] (SUBMARINE-338) Enable integration tests in travis

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-338:
---
Target Version: 0.4.0

> Enable integration tests in travis
> --
>
> Key: SUBMARINE-338
> URL: https://issues.apache.org/jira/browse/SUBMARINE-338
> Project: Apache Submarine
>  Issue Type: Bug
>  Components: E2E Test
>Affects Versions: 0.3.0
>Reporter: Zac Zhou
>Assignee: Zac Zhou
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> There are some issues in current integration tests.
>  # Submarine server has used angular frontend already by default. The 
> integration tests are supposed to adjust according to this change. 
>  # To run integration tests, we need to install firefox browser and start 
> submarine server in advance. 
>  # To run integration tests, we need to use the command of "mvn verify" 
> instead of "mvn test".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-342) Upgrade Dockerfiles in Docs and dev-support folders to user Ubuntu 18+

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-342:
---
Target Version: 0.4.0

> Upgrade Dockerfiles in  Docs and dev-support folders to user Ubuntu 18+
> ---
>
> Key: SUBMARINE-342
> URL: https://issues.apache.org/jira/browse/SUBMARINE-342
> Project: Apache Submarine
>  Issue Type: Improvement
>  Components: Doc, Mini Submarine
>Reporter: Keqiu Hu
>Priority: Major
> Fix For: 0.3.0
>
>
> We have quite a couple Dockerfiles built from Ubuntu 16 base images. In newer 
> version of TensorFlow (1.14+), it was built with glibc 2.25+ and no longer 
> compatible with Ubuntu 16 images. We need to examine and upgrade all 
> Dockefile to use a Ubuntu 18+ image.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-224) [Umbrella] Submarine Server

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-224:
---
Target Version: 0.4.0

> [Umbrella] Submarine Server
> ---
>
> Key: SUBMARINE-224
> URL: https://issues.apache.org/jira/browse/SUBMARINE-224
> Project: Apache Submarine
>  Issue Type: New Feature
>  Components: Backend Server
>Reporter: Wanqiang Ji
>Priority: Major
>
> This is an umbrella JIRA that covers the submarine-server module. It provides 
> REST APIs to accept the generic job spec and manages jobs.
> Design doc: 
> [https://docs.google.com/document/d/1vCjt2z3DoagfeaVQV0nfyWqSYLymoP53rDcPcz-YcSc]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-202) submarine core need to support MXNet

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-202:
---
Target Version: 0.4.0

> submarine core need to support MXNet
> 
>
> Key: SUBMARINE-202
> URL: https://issues.apache.org/jira/browse/SUBMARINE-202
> Project: Apache Submarine
>  Issue Type: Bug
>Reporter: Zac Zhou
>Assignee: Zac Zhou
>Priority: Major
>
> Submarine core checks the machine learning framework types which must be 
> tensorflow or PyTorch,  MXNet is supported by tony. Submarine core should 
> enable MXNet as well. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-230) [Umbrella] Submarine Interpreter Module

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-230:
---
Target Version: 0.4.0  (was: 0.3.0)

Bulk update due to releasing 0.3.0. Please change it back if you think this is 
a blocker.

> [Umbrella] Submarine Interpreter Module
> ---
>
> Key: SUBMARINE-230
> URL: https://issues.apache.org/jira/browse/SUBMARINE-230
> Project: Apache Submarine
>  Issue Type: New Feature
>  Components: Workbench Interpreter
>Reporter: Liu Xun
>Assignee: Liu Xun
>Priority: Major
>
> Because the user needs to write code and execution in the workbench (such as 
> executing Python, Spark sql), in order to avoid user resource competition and 
> code security control when the user executes the code, Workbench will create 
> a Docker container for each user, User can write code in own container, bind 
> the Github account for code version management, execute python and spark 
> programs.
> 2. Interpreter
> Submarine provides multi-language execution for notebooks in workbench 
> through interpreters in a variety of programming languages (for example, 
> python interpreter, spark interpreter).
> 2.1 Interpreter execution flow
> 1. The user enters the code in the workbench notebook and clicks the execute 
> button. First the workbench server starts the interpreter process.
> 2. The workbench server sends the user's code to the interpreter process via 
> the interface for execution, and gets the execution result, returning to the 
> workbench notebook for display.
> Design doc: 
> https://docs.google.com/document/d/1LJc5hRTWfIs6K5f7vMgGC_FUizeQf-qqiWICqO8SoR8/edit#



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-245) [Umbrella] Submarine Commons

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-245:
---
Target Version: 0.4.0  (was: 0.3.0)

Bulk update due to releasing 0.3.0. Please change it back if you think this is 
a blocker.

> [Umbrella] Submarine Commons
> 
>
> Key: SUBMARINE-245
> URL: https://issues.apache.org/jira/browse/SUBMARINE-245
> Project: Apache Submarine
>  Issue Type: New Feature
>  Components: Commons
>Reporter: Wanqiang Ji
>Assignee: Liu Xun
>Priority: Major
>
> We need the *submarine-commons* module to put the multiple common packages.
> 1. Each submodule in commons is some of the most basic modules in submarine.
> 2. Each submodule in commons can be referenced to each other.
> 3. But other modules of submarine will not be introduced, resulting in 
> circular references.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-320) Integrate apache ranger in submarine metastore module

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-320:
---
Target Version: 0.4.0  (was: 0.3.0)

Bulk update due to releasing 0.3.0. Please change it back if you think this is 
a blocker.

> Integrate apache ranger in submarine metastore module
> -
>
> Key: SUBMARINE-320
> URL: https://issues.apache.org/jira/browse/SUBMARINE-320
> Project: Apache Submarine
>  Issue Type: Sub-task
>  Components: Commons
>Reporter: Liu Xun
>Assignee: qiwei huang
>Priority: Major
>
> The submarine commons metastore module now provides meta services through the 
> REST interface through the metastore integrated with Hive.
> Now you need to integrate the apache ranger in the submarine commons 
> metastore module. When the user accesses the REST interface, check whether 
> the user has access to the meta.
> For example, when a user executes show database / table, only the database / 
> table to which the user has permissions can be returned.
> Apache ranger is divided into three parts: ranger-server, ranger-mysql and 
> ranger-plugin.
> 1. ranger-server.jar provides the function of setting permissions. We can 
> save the user's permissions to the ranger-mysql database through 
> ranger-server.jar.
> 2. ranger-mysql uses the ranger table structure.
> 3. The ranger-plugin obtains permissions through the interface of the 
> ranger-server.
> 4. ranger-plugin.jar is integrated in the submarine commons metastore module. 
> When users access metadata through the submarine commons metastore interface, 
> they must first pass the ranger-plugin.jar check or filter permissions.
> 5. We should need ranger-server and ranger-hive-plugin, the ranger mysql 
> database. These 3 parts.
> {color:red}Please note that we only integrate the jar package of ranger, not 
> start the service process of ranger.{color}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-184) PyTorch support for Tensorboard in yarnservice-runtime

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-184:
---
Target Version: 0.4.0  (was: 0.3.0)

Bulk update due to releasing 0.3.0. Please change it back if you think this is 
a blocker.

> PyTorch support for Tensorboard in yarnservice-runtime
> --
>
> Key: SUBMARINE-184
> URL: https://issues.apache.org/jira/browse/SUBMARINE-184
> Project: Apache Submarine
>  Issue Type: Improvement
>Reporter: Kevin Su
>Assignee: Kevin Su
>Priority: Major
>
> PyTorch 1.1 announced support for TensorBoard.
> [https://pytorch.org/docs/stable/tensorboard.html]
> [https://github.com/pytorch/pytorch/releases]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-299) Write a 'submarine' shell script

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-299:
---
Target Version: 0.4.0  (was: 0.3.0)

Bulk update due to releasing 0.3.0. Please change it back if you think this is 
a blocker.

> Write a 'submarine' shell script
> 
>
> Key: SUBMARINE-299
> URL: https://issues.apache.org/jira/browse/SUBMARINE-299
> Project: Apache Submarine
>  Issue Type: Improvement
>Reporter: Ryan Lo
>Assignee: Ryan Lo
>Priority: Minor
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Write a shell script file called "submarine" under "${SUBMARINE_HOME}/bin" 
> use case:
> {code:java}
> $SUBMARINE_HOME/bin/submarine job run --name tf-job-001 \
>  --framework tensorflow \
>  --verbose \
>  --input_path "" \
>  --num_workers 2 \
>  --worker_resources memory=1G,vcores=1 \
>  --num_ps 1 \
>  --ps_resources memory=1G,vcores=1 \
>  --worker_launch_cmd "myvenv.zip/venv/bin/python mnist_distributed.py --steps 
> 2 --data_dir /tmp/data --working_dir /tmp/mode" \
>  --ps_launch_cmd "myvenv.zip/venv/bin/python mnist_distributed.py --steps 2 
> --data_dir /tmp/data --working_dir /tmp/mode" \
>  --insecure \
>  --conf 
> tony.containers.resources=path-to/myvenv.zip#archive,path-to/mnist_distributed.py,path-to/tony-cli-0.3.13-all.jar{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-261) Add exception class in module common utils

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-261:
---
Target Version: 0.4.0  (was: 0.3.0)

Bulk update due to releasing 0.3.0. Please change it back if you think this is 
a blocker.

> Add exception class in module common utils
> --
>
> Key: SUBMARINE-261
> URL: https://issues.apache.org/jira/browse/SUBMARINE-261
> Project: Apache Submarine
>  Issue Type: Improvement
>  Components: Commons
>Reporter: Zac Zhou
>Assignee: Zac Zhou
>Priority: Major
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Add several exception classes for submarine modules.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-323) Submarine release scripts

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-323:
---
Target Version: 0.4.0  (was: 0.3.0)

Bulk update due to releasing 0.3.0. Please change it back if you think this is 
a blocker.

> Submarine release scripts
> -
>
> Key: SUBMARINE-323
> URL: https://issues.apache.org/jira/browse/SUBMARINE-323
> Project: Apache Submarine
>  Issue Type: New Feature
>  Components: CI/CD
>Reporter: Zhankun Tang
>Assignee: Zhankun Tang
>Priority: Major
>
> Automate steps of making a release for release manager. It should do at least 
> the following:
>  # Generate source tarball, binary tarball with the licence and sign them.
>  # Upload the submarine jars to maven central repo
>  # Upload artifacts to apache dist server
> It's better if it can support Jira cleanup, source code branching/tagging, 
> submarine SDK repo uploading. etc.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-25) [Submarine] Manage submarine's docker image with docker hub

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-25?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-25:
--
Target Version: 0.4.0  (was: 0.3.0)

Bulk update due to releasing 0.3.0. Please change it back if you think this is 
a blocker.

> [Submarine] Manage submarine's docker image with docker hub
> ---
>
> Key: SUBMARINE-25
> URL: https://issues.apache.org/jira/browse/SUBMARINE-25
> Project: Apache Submarine
>  Issue Type: New Feature
>  Components: Mini Submarine
>Reporter: Xun Liu
>Assignee: Liu Xun
>Priority: Major
>
> Currently the deep learning algorithm file is packaged into the docker image 
> file.
> In the formal use of the deep learning system, the algorithm files are 
> generally divided into the following ways:
> 1. The fixed algorithm will be made into a separate docker image, which is 
> convenient for maintenance and testing. Image files with different algorithms 
> built in are managed by mirrored warehouse.
> 2. We also need to dynamically pass in algorithm scripts so that algorithm 
> developers can test and run algorithm scripts without packaging.
> 3. In addition, submarine needs to support different deep learning frameworks 
> in the future.
> We need to manage the image that submarine needs to use through the docker 
> hub. And we need to develop some specifications to manage these images.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Updated] (SUBMARINE-342) Upgrade Dockerfiles in Docs and dev-support folders to user Ubuntu 18+

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang updated SUBMARINE-342:
---
Fix Version/s: (was: 0.3.0)

> Upgrade Dockerfiles in  Docs and dev-support folders to user Ubuntu 18+
> ---
>
> Key: SUBMARINE-342
> URL: https://issues.apache.org/jira/browse/SUBMARINE-342
> Project: Apache Submarine
>  Issue Type: Improvement
>  Components: Doc, Mini Submarine
>Reporter: Keqiu Hu
>Priority: Major
>
> We have quite a couple Dockerfiles built from Ubuntu 16 base images. In newer 
> version of TensorFlow (1.14+), it was built with glibc 2.25+ and no longer 
> compatible with Ubuntu 16 images. We need to examine and upgrade all 
> Dockefile to use a Ubuntu 18+ image.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[Submarine Release Plan] Submarine-0.3.0

2020-01-15 Thread Zhankun Tang
Hi folks,

Thanks for everyone's hard work! We are ready for a new Submarine 0.3.0
release!
Apache Submarine 0.3.0 is the first release after the spin-off from Apache
Hadoop. It is a very good starting point for us.

This release will consist of 187 fixes[1]. Among them, there're three
features worth mentioning:
1. Mini-submarine. The easiest way to play with the submarine. We'll
provide the official apache repo docker images.
2. Submarine on k8s. The basic TF job submission to K8s through
submarine-server
3. Cluster mode job submission to YARN. The CLI now supports a new "remote"
option to let the submarine-server submit a job.

The release plan:
*Code Freezing Date: 15th Jan 2020*
*Release Date: 21th Jan 2020*

Please feel free to share your insights on this. Thanks!

[1] https://s.apache.org/i2dys

BR,
Zhankun


[jira] [Assigned] (SUBMARINE-265) Change hadoop-submarine to submarine in the repo

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang reassigned SUBMARINE-265:
--

Assignee: Zhankun Tang  (was: Kevin Su)

> Change hadoop-submarine to submarine in the repo
> 
>
> Key: SUBMARINE-265
> URL: https://issues.apache.org/jira/browse/SUBMARINE-265
> Project: Apache Submarine
>  Issue Type: Bug
>Reporter: Kevin Su
>Assignee: Zhankun Tang
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.3.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The repo have changed name to apache/submarine
> we should update the name in README and code to avoid ci error



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Assigned] (SUBMARINE-265) Change hadoop-submarine to submarine in the repo

2020-01-15 Thread Zhankun Tang (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhankun Tang reassigned SUBMARINE-265:
--

Assignee: Kevin Su  (was: Zhankun Tang)

> Change hadoop-submarine to submarine in the repo
> 
>
> Key: SUBMARINE-265
> URL: https://issues.apache.org/jira/browse/SUBMARINE-265
> Project: Apache Submarine
>  Issue Type: Bug
>Reporter: Kevin Su
>Assignee: Kevin Su
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.3.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The repo have changed name to apache/submarine
> we should update the name in README and code to avoid ci error



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



Re: [Submarine Release Plan] Submarine-0.3.0

2020-01-15 Thread Sunil Govindan
Kudos! Thanks all for helping in this release.

- Sunil

On Wed, Jan 15, 2020 at 3:56 PM Zhankun Tang  wrote:

> Hi folks,
>
> Thanks for everyone's hard work! We are ready for a new Submarine 0.3.0
> release!
> Apache Submarine 0.3.0 is the first release after the spin-off from Apache
> Hadoop. It is a very good starting point for us.
>
> This release will consist of 187 fixes[1]. Among them, there're three
> features worth mentioning:
> 1. Mini-submarine. The easiest way to play with the submarine. We'll
> provide the official apache repo docker images.
> 2. Submarine on k8s. The basic TF job submission to K8s through
> submarine-server
> 3. Cluster mode job submission to YARN. The CLI now supports a new "remote"
> option to let the submarine-server submit a job.
>
> The release plan:
> *Code Freezing Date: 15th Jan 2020*
> *Release Date: 21th Jan 2020*
>
> Please feel free to share your insights on this. Thanks!
>
> [1] https://s.apache.org/i2dys
>
> BR,
> Zhankun
>


[GitHub] [submarine] asfgit closed pull request #150: SUBMARINE-336. Add a Pytorch example in mini-submarine

2020-01-15 Thread GitBox
asfgit closed pull request #150: SUBMARINE-336. Add a Pytorch example in 
mini-submarine
URL: https://github.com/apache/submarine/pull/150
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Work logged] (SUBMARINE-336) PyTorch example in mini-submarine

2020-01-15 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-336?focusedWorklogId=372348=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-372348
 ]

ASF GitHub Bot logged work on SUBMARINE-336:


Author: ASF GitHub Bot
Created on: 15/Jan/20 14:29
Start Date: 15/Jan/20 14:29
Worklog Time Spent: 10m 
  Work Description: asfgit commented on pull request #150: SUBMARINE-336. 
Add a Pytorch example in mini-submarine
URL: https://github.com/apache/submarine/pull/150
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 372348)
Time Spent: 20m  (was: 10m)

> PyTorch example in mini-submarine
> -
>
> Key: SUBMARINE-336
> URL: https://issues.apache.org/jira/browse/SUBMARINE-336
> Project: Apache Submarine
>  Issue Type: Sub-task
>Reporter: Kevin Su
>Assignee: Ryan Lo
>Priority: Trivial
>  Labels: pull-request-available
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> There is only a TensorFlow example in mini-submarine. we should add a PyTorch 
> example.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Work logged] (SUBMARINE-338) Enable integration tests in travis

2020-01-15 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-338?focusedWorklogId=372384=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-372384
 ]

ASF GitHub Bot logged work on SUBMARINE-338:


Author: ASF GitHub Bot
Created on: 15/Jan/20 15:52
Start Date: 15/Jan/20 15:52
Worklog Time Spent: 10m 
  Work Description: asfgit commented on pull request #146: SUBMARINE-338. 
Enable integration tests in travis.
URL: https://github.com/apache/submarine/pull/146
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 372384)
Time Spent: 20m  (was: 10m)

> Enable integration tests in travis
> --
>
> Key: SUBMARINE-338
> URL: https://issues.apache.org/jira/browse/SUBMARINE-338
> Project: Apache Submarine
>  Issue Type: Bug
>  Components: E2E Test
>Affects Versions: 0.3.0
>Reporter: Zac Zhou
>Assignee: Zac Zhou
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> There are some issues in current integration tests.
>  # Submarine server has used angular frontend already by default. The 
> integration tests are supposed to adjust according to this change. 
>  # To run integration tests, we need to install firefox browser and start 
> submarine server in advance. 
>  # To run integration tests, we need to use the command of "mvn verify" 
> instead of "mvn test".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[GitHub] [submarine] asfgit closed pull request #146: SUBMARINE-338. Enable integration tests in travis.

2020-01-15 Thread GitBox
asfgit closed pull request #146: SUBMARINE-338. Enable integration tests in 
travis.
URL: https://github.com/apache/submarine/pull/146
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Resolved] (SUBMARINE-338) Enable integration tests in travis

2020-01-15 Thread Liu Xun (Jira)


 [ 
https://issues.apache.org/jira/browse/SUBMARINE-338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Liu Xun resolved SUBMARINE-338.
---
Fix Version/s: 0.3.0
   Resolution: Fixed

Issue resolved by pull request 146
[https://github.com/apache/submarine/pull/146]

> Enable integration tests in travis
> --
>
> Key: SUBMARINE-338
> URL: https://issues.apache.org/jira/browse/SUBMARINE-338
> Project: Apache Submarine
>  Issue Type: Bug
>  Components: E2E Test
>Affects Versions: 0.3.0
>Reporter: Zac Zhou
>Assignee: Zac Zhou
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.3.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> There are some issues in current integration tests.
>  # Submarine server has used angular frontend already by default. The 
> integration tests are supposed to adjust according to this change. 
>  # To run integration tests, we need to install firefox browser and start 
> submarine server in advance. 
>  # To run integration tests, we need to use the command of "mvn verify" 
> instead of "mvn test".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Created] (SUBMARINE-344) Add submarine site dockerfile

2020-01-15 Thread Liu Xun (Jira)
Liu Xun created SUBMARINE-344:
-

 Summary: Add submarine site dockerfile
 Key: SUBMARINE-344
 URL: https://issues.apache.org/jira/browse/SUBMARINE-344
 Project: Apache Submarine
  Issue Type: Sub-task
  Components: Doc
Reporter: Liu Xun
Assignee: Kai-Hsun Chen


Now the official website of submarine is at: 
https://github.com/apache/submarine-site.git
Use jekyll to convert markdown documents into html files,
Show it on submarine.apache.org.

Now jekyll's service is running through docker. We need to add an image 
apache/submairne:site-0.3.0-SNAPSHOT for developing the official website. This 
docker needs to meet the following requirements.
1. This docker has built-in jekyll service, we can use the docker image here as 
our base image. If possible, I recommend using jekyll/jekyll:minimal, because 
the mirror volume is relatively small.
2. We need to follow the git component in submairne:site-0.3.0-SNAPSHOT, so 
that we can use the git clone command directly in the container

git clone https://github.com/apache/submarine-site.git
git checkout master
Allow the maintenance staff to modify the complete in the container, generate 
html files through jekyll,
Upload the markdown file to the master branch and the html file to the asf-site 
branch.

3. Just like submarine-cicd,
https://github.com/apache/submarine/tree/master/dev-support/cicd#docker-mode
It can support setting the git account and password as the container's startup 
command through the docker environment variable, and running this container 
will allow git to log in with a username and password.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org



[jira] [Created] (SUBMARINE-343) Update /docs/workbench/HowToRun.md due to new docker images

2020-01-15 Thread Kai-Hsun Chen (Jira)
Kai-Hsun Chen created SUBMARINE-343:
---

 Summary: Update /docs/workbench/HowToRun.md due to new docker 
images
 Key: SUBMARINE-343
 URL: https://issues.apache.org/jira/browse/SUBMARINE-343
 Project: Apache Submarine
  Issue Type: Improvement
  Components: Cloud-native Deployment
Reporter: Kai-Hsun Chen
Assignee: Kai-Hsun Chen


Because the new docker images are available now, the document needs to be 
modified. The document (/docs/workbench/HowToRun.md) includes information about 
how to launch the workbench via the new docker images and the information about 
how to switch between different workbench versions(version Vue & version 
Angular). 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org