[jira] [Updated] (SUBMARINE-76) Create factory class to produce either TensorFlow or PyTorch service spec for Native Service
[ https://issues.apache.org/jira/browse/SUBMARINE-76?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-76: Target Version: (was: 0.4.0) > Create factory class to produce either TensorFlow or PyTorch service spec for > Native Service > > > Key: SUBMARINE-76 > URL: https://issues.apache.org/jira/browse/SUBMARINE-76 > Project: Apache Submarine > Issue Type: Improvement > Components: YARN-native-service >Reporter: Szilard Nemeth >Priority: Minor > > In YarnServiceJobSubmitter#submitJob, we submit either a TF / PyTorch job > based on the Service spec. > The code could be improved by creating a factory class to produce the service > spec as the 2 types of Service specs are having very similar dependencies. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-53) Generate Service spec + launch script for distributed PyTorch learning job
[ https://issues.apache.org/jira/browse/SUBMARINE-53?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-53: Target Version: (was: 0.4.0) > Generate Service spec + launch script for distributed PyTorch learning job > -- > > Key: SUBMARINE-53 > URL: https://issues.apache.org/jira/browse/SUBMARINE-53 > Project: Apache Submarine > Issue Type: Sub-task > Components: YARN-native-service >Reporter: Szilard Nemeth >Priority: Major > > More info here: https://pytorch.org/tutorials/intermediate/dist_tuto.html -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-75) Add tests to HadoopEnvironmentSetup class
[ https://issues.apache.org/jira/browse/SUBMARINE-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-75: Target Version: (was: 0.4.0) > Add tests to HadoopEnvironmentSetup class > - > > Key: SUBMARINE-75 > URL: https://issues.apache.org/jira/browse/SUBMARINE-75 > Project: Apache Submarine > Issue Type: Improvement > Components: Commons >Reporter: Szilard Nemeth >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Commented] (SUBMARINE-81) Add documentation about YAML config parser with example config
[ https://issues.apache.org/jira/browse/SUBMARINE-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074955#comment-17074955 ] Wangda Tan commented on SUBMARINE-81: - [~adam.antal], are you still working on this, or plan to working on this in the short term? If no, can you remove target version? Trying to cleanup old JIRAs. > Add documentation about YAML config parser with example config > -- > > Key: SUBMARINE-81 > URL: https://issues.apache.org/jira/browse/SUBMARINE-81 > Project: Apache Submarine > Issue Type: Bug > Components: Doc >Reporter: Szilard Nemeth >Assignee: Adam Antal >Priority: Major > > YAML parser was added but there's no example documentation of a valid > configuration. > We need to fix this! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Commented] (SUBMARINE-77) Create a builder class for NS Component
[ https://issues.apache.org/jira/browse/SUBMARINE-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074956#comment-17074956 ] Wangda Tan commented on SUBMARINE-77: - [~adam.antal], are you still working on this, or plan to working on this in the short term? If no, can you remove target version? Trying to cleanup old JIRAs. > Create a builder class for NS Component > --- > > Key: SUBMARINE-77 > URL: https://issues.apache.org/jira/browse/SUBMARINE-77 > Project: Apache Submarine > Issue Type: Improvement > Components: Commons >Reporter: Szilard Nemeth >Assignee: Adam Antal >Priority: Major > > In TensorFlowPsComponent#createComponent, we create a component object. > According to [~adam.antal]'s comment given on one of my resolved jiras, this > method shouts for a builder that builds the Component object. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Commented] (SUBMARINE-148) [Umbrella] Submarine-sdk tracking
[ https://issues.apache.org/jira/browse/SUBMARINE-148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074953#comment-17074953 ] Wangda Tan commented on SUBMARINE-148: -- [~pingsutw], could you check [~weichiu]'s comment above? > [Umbrella] Submarine-sdk tracking > - > > Key: SUBMARINE-148 > URL: https://issues.apache.org/jira/browse/SUBMARINE-148 > Project: Apache Submarine > Issue Type: New Feature > Components: SDK >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Major > > The submarine-sdk support Python, Scala, R language for algorithm > development, The SDK is provided to help developers use submarine's internal > data caching, data exchange, and task tracking to more efficiently improve > the development and execution of machine learning tasks. > > pysubmarine *tracking* module is a python API for logging parameters, code > versions, metrics > 1. Add the sumbrine-sdk/pysubmarine module. > 2. pysubmarine supports mysql/HDFS in two ways to store metric data. > Priority to do mysql, in order to performance requires python to directly > write mysql data, do not take the submarine-sever RESTful interface. > 3. Add metric, param instance to the submarine-server database and rest > 4. Add Metric tracking ui to submarine-web > 5. Add a metric graphical display to submarine-web -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Commented] (SUBMARINE-98) [Umbrella] Submarine web page
[ https://issues.apache.org/jira/browse/SUBMARINE-98?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074954#comment-17074954 ] Wangda Tan commented on SUBMARINE-98: - [~liuxun323], is it still target for 0.4.0? If no, we can move this JIRA and its children to 0.5.0+? > [Umbrella] Submarine web page > - > > Key: SUBMARINE-98 > URL: https://issues.apache.org/jira/browse/SUBMARINE-98 > Project: Apache Submarine > Issue Type: New Feature > Components: Workbench Web >Reporter: Xun Liu >Assignee: Hao Zhou >Priority: Major > Labels: submarine-external-repo > > Submarine can be managed via submarine web: > 1. Support multi-user and multi-role > 2. Support for allocation management of server resources > 3. Support data development, algorithm development, and model launch through > notebook > 4. Support workflow workflow orchestration > 5. Support service monitoring after the model goes online -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Commented] (SUBMARINE-184) PyTorch support for Tensorboard in yarnservice-runtime
[ https://issues.apache.org/jira/browse/SUBMARINE-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074952#comment-17074952 ] Wangda Tan commented on SUBMARINE-184: -- [~pingsutw], is it sometime we target for 0.4.0? If no, can you move it to future release or just remove the target version? > PyTorch support for Tensorboard in yarnservice-runtime > -- > > Key: SUBMARINE-184 > URL: https://issues.apache.org/jira/browse/SUBMARINE-184 > Project: Apache Submarine > Issue Type: Improvement >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Major > > PyTorch 1.1 announced support for TensorBoard. > [https://pytorch.org/docs/stable/tensorboard.html] > [https://github.com/pytorch/pytorch/releases] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Commented] (SUBMARINE-225) [Umbrella] Submarine Client
[ https://issues.apache.org/jira/browse/SUBMARINE-225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074951#comment-17074951 ] Wangda Tan commented on SUBMARINE-225: -- [~jiwq], do we still need this JIRA given we have SUBMARINE-224 already? If we don't need this, can you close this ticket and its child as dup? > [Umbrella] Submarine Client > --- > > Key: SUBMARINE-225 > URL: https://issues.apache.org/jira/browse/SUBMARINE-225 > Project: Apache Submarine > Issue Type: New Feature > Components: Backend Server >Reporter: Wanqiang Ji >Priority: Major > > Maybe we can used the SC in the JIRA summary field to mark the task related > to submarine client. Such as [SC] Create the submarine-client module. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Commented] (SUBMARINE-180) [Umbrella] Submarine E2E Test Framework
[ https://issues.apache.org/jira/browse/SUBMARINE-180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074949#comment-17074949 ] Wangda Tan commented on SUBMARINE-180: -- Set assignee to unassigned since it has multiple assignees under the JIRA. Reopened this ticket to set the target version to 0.4.0 as there're remaining tasks > [Umbrella] Submarine E2E Test Framework > --- > > Key: SUBMARINE-180 > URL: https://issues.apache.org/jira/browse/SUBMARINE-180 > Project: Apache Submarine > Issue Type: New Feature >Reporter: Xun Liu >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > This is New Submarine Module. > In order to guarantee the quality of submarine software, we need to provide > an end-to-end testing framework, in which at least the following functions > are included: > 1. Simulate all user WEB operations in submarine workbench through firefox > version 31. (We can refer to the end-to-end test method of the Apache > Zeppelin. > [https://github.com/apache/zeppelin/tree/master/zeppelin-integration] > 2. In the submarine-inter module, the WEB simulator simulates the operation > of the web front end to ensure the correctness of all web front-end > operations in the submarine-workbench. > 3. Create a submarine machine learning run cluster through docker and perform > algorithm testing on all the machine learning frameworks we provide. It may > be a bit difficult to achieve this, and you can consider implementing it > later. > In Travis CI, the end-to-end test framework will be triggered. Only through > all E2E tests can the newly submitted code be guaranteed to be merged into > the code repository without breaking the functionality of the original system. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-180) [Umbrella] Submarine E2E Test Framework
[ https://issues.apache.org/jira/browse/SUBMARINE-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-180: - Component/s: E2E Test > [Umbrella] Submarine E2E Test Framework > --- > > Key: SUBMARINE-180 > URL: https://issues.apache.org/jira/browse/SUBMARINE-180 > Project: Apache Submarine > Issue Type: New Feature > Components: E2E Test >Reporter: Xun Liu >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > This is New Submarine Module. > In order to guarantee the quality of submarine software, we need to provide > an end-to-end testing framework, in which at least the following functions > are included: > 1. Simulate all user WEB operations in submarine workbench through firefox > version 31. (We can refer to the end-to-end test method of the Apache > Zeppelin. > [https://github.com/apache/zeppelin/tree/master/zeppelin-integration] > 2. In the submarine-inter module, the WEB simulator simulates the operation > of the web front end to ensure the correctness of all web front-end > operations in the submarine-workbench. > 3. Create a submarine machine learning run cluster through docker and perform > algorithm testing on all the machine learning frameworks we provide. It may > be a bit difficult to achieve this, and you can consider implementing it > later. > In Travis CI, the end-to-end test framework will be triggered. Only through > all E2E tests can the newly submitted code be guaranteed to be merged into > the code repository without breaking the functionality of the original system. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Reopened] (SUBMARINE-180) [Umbrella] Submarine E2E Test Framework
[ https://issues.apache.org/jira/browse/SUBMARINE-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened SUBMARINE-180: -- > [Umbrella] Submarine E2E Test Framework > --- > > Key: SUBMARINE-180 > URL: https://issues.apache.org/jira/browse/SUBMARINE-180 > Project: Apache Submarine > Issue Type: New Feature >Reporter: Xun Liu >Assignee: Kai-Hsun Chen >Priority: Major > Labels: pull-request-available > Fix For: 0.3.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > This is New Submarine Module. > In order to guarantee the quality of submarine software, we need to provide > an end-to-end testing framework, in which at least the following functions > are included: > 1. Simulate all user WEB operations in submarine workbench through firefox > version 31. (We can refer to the end-to-end test method of the Apache > Zeppelin. > [https://github.com/apache/zeppelin/tree/master/zeppelin-integration] > 2. In the submarine-inter module, the WEB simulator simulates the operation > of the web front end to ensure the correctness of all web front-end > operations in the submarine-workbench. > 3. Create a submarine machine learning run cluster through docker and perform > algorithm testing on all the machine learning frameworks we provide. It may > be a bit difficult to achieve this, and you can consider implementing it > later. > In Travis CI, the end-to-end test framework will be triggered. Only through > all E2E tests can the newly submitted code be guaranteed to be merged into > the code repository without breaking the functionality of the original system. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-180) [Umbrella] Submarine E2E Test Framework
[ https://issues.apache.org/jira/browse/SUBMARINE-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-180: - Fix Version/s: (was: 0.3.0) Target Version: 0.4.0 > [Umbrella] Submarine E2E Test Framework > --- > > Key: SUBMARINE-180 > URL: https://issues.apache.org/jira/browse/SUBMARINE-180 > Project: Apache Submarine > Issue Type: New Feature >Reporter: Xun Liu >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > This is New Submarine Module. > In order to guarantee the quality of submarine software, we need to provide > an end-to-end testing framework, in which at least the following functions > are included: > 1. Simulate all user WEB operations in submarine workbench through firefox > version 31. (We can refer to the end-to-end test method of the Apache > Zeppelin. > [https://github.com/apache/zeppelin/tree/master/zeppelin-integration] > 2. In the submarine-inter module, the WEB simulator simulates the operation > of the web front end to ensure the correctness of all web front-end > operations in the submarine-workbench. > 3. Create a submarine machine learning run cluster through docker and perform > algorithm testing on all the machine learning frameworks we provide. It may > be a bit difficult to achieve this, and you can consider implementing it > later. > In Travis CI, the end-to-end test framework will be triggered. Only through > all E2E tests can the newly submitted code be guaranteed to be merged into > the code repository without breaking the functionality of the original system. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Assigned] (SUBMARINE-180) [Umbrella] Submarine E2E Test Framework
[ https://issues.apache.org/jira/browse/SUBMARINE-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned SUBMARINE-180: Assignee: (was: Kai-Hsun Chen) > [Umbrella] Submarine E2E Test Framework > --- > > Key: SUBMARINE-180 > URL: https://issues.apache.org/jira/browse/SUBMARINE-180 > Project: Apache Submarine > Issue Type: New Feature >Reporter: Xun Liu >Priority: Major > Labels: pull-request-available > Fix For: 0.3.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > This is New Submarine Module. > In order to guarantee the quality of submarine software, we need to provide > an end-to-end testing framework, in which at least the following functions > are included: > 1. Simulate all user WEB operations in submarine workbench through firefox > version 31. (We can refer to the end-to-end test method of the Apache > Zeppelin. > [https://github.com/apache/zeppelin/tree/master/zeppelin-integration] > 2. In the submarine-inter module, the WEB simulator simulates the operation > of the web front end to ensure the correctness of all web front-end > operations in the submarine-workbench. > 3. Create a submarine machine learning run cluster through docker and perform > algorithm testing on all the machine learning frameworks we provide. It may > be a bit difficult to achieve this, and you can consider implementing it > later. > In Travis CI, the end-to-end test framework will be triggered. Only through > all E2E tests can the newly submitted code be guaranteed to be merged into > the code repository without breaking the functionality of the original system. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-351) [Umbrella] Support Job Management (e.g., submission) on YARN by REST APIs
[ https://issues.apache.org/jira/browse/SUBMARINE-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-351: - Summary: [Umbrella] Support Job Management (e.g., submission) on YARN by REST APIs (was: Support Job Management (e.g., submission) on YARN by REST APIs) > [Umbrella] Support Job Management (e.g., submission) on YARN by REST APIs > - > > Key: SUBMARINE-351 > URL: https://issues.apache.org/jira/browse/SUBMARINE-351 > Project: Apache Submarine > Issue Type: New Feature > Components: Backend Server >Reporter: Adrian Hsu >Assignee: Adrian Hsu >Priority: Major > > This JIRA provides REST APIs for YARN to accept the generic job spec and > manages jobs, based on the SUBMARINE-224 (says, the REST APIs for K8s). Also, > this Issue follows the design of Submarine Server > ([https://docs.google.com/document/d/1vCjt2z3DoagfeaVQV0nfyWqSYLymoP53rDcPcz-YcSc/edit]) > provided by SUBMARINE-224. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-370) Add & update some documentation for MXNet
[ https://issues.apache.org/jira/browse/SUBMARINE-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-370: - Labels: document (was: docuentation) > Add & update some documentation for MXNet > - > > Key: SUBMARINE-370 > URL: https://issues.apache.org/jira/browse/SUBMARINE-370 > Project: Apache Submarine > Issue Type: Improvement >Reporter: Ryan Lo >Assignee: Ryan Lo >Priority: Trivial > Labels: document > > Related to SUBMARINE-202. > After it be resolved, we need to add & update some documentation for MXNet > (e.g., "WriteDockerfileMXNet.md", "TonYRuntimeGuide.md" ) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-454) [WEB] Implement frontend of team page in workbench with Angular
[ https://issues.apache.org/jira/browse/SUBMARINE-454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-454: - Component/s: (was: Workbench) Workbench Web > [WEB] Implement frontend of team page in workbench with Angular > --- > > Key: SUBMARINE-454 > URL: https://issues.apache.org/jira/browse/SUBMARINE-454 > Project: Apache Submarine > Issue Type: Sub-task > Components: Workbench Web >Reporter: Wen-Chien,Ruan >Assignee: Wen-Chien,Ruan >Priority: Major > Labels: pull-request-available > Fix For: 0.4.0 > > Time Spent: 10m > Remaining Estimate: 0h > > Implement frontend of team page in workbench with Angular. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Commented] (SUBMARINE-376) [Umbrealla] Submarine python client API
[ https://issues.apache.org/jira/browse/SUBMARINE-376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074945#comment-17074945 ] Wangda Tan commented on SUBMARINE-376: -- [~pingsutw], this umbrella has only one subtask and already completed, do we still need to keep this umbrella open? > [Umbrealla] Submarine python client API > --- > > Key: SUBMARINE-376 > URL: https://issues.apache.org/jira/browse/SUBMARINE-376 > Project: Apache Submarine > Issue Type: New Feature > Components: SDK >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Major > Fix For: 0.4.0 > > > Currently, we use the command line to submit a Submarine job, > it will be helpful to submit a job from python API. > On the server-side, we start a submarine RPC server. > O the client-side, we use *pip* to install python package so that we can > submit/list/delete submarine jobs by gprc. > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Commented] (SUBMARINE-7) Support create models / versions for training result.
[ https://issues.apache.org/jira/browse/SUBMARINE-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074943#comment-17074943 ] Wangda Tan commented on SUBMARINE-7: I think this patch is expired and is not planned to be part of 0.4.0, thus removed 0.4.0 as target version. > Support create models / versions for training result. > -- > > Key: SUBMARINE-7 > URL: https://issues.apache.org/jira/browse/SUBMARINE-7 > Project: Apache Submarine > Issue Type: New Feature > Components: model management >Reporter: Wangda Tan >Assignee: Kevin Su >Priority: Major > Attachments: SUBMARINE-7.005.patch, SUBMARINE-7.v0.patch, > SUBMARINE-7.v1.patch, SUBMARINE-7.v2.patch, SUBMARINE-7.v3.patch, Screenshot > from 2019-07-13 00-28-44.png, Screenshot from 2019-07-13 00-29-54.png > > > As mentioned in > https://docs.google.com/document/d/199J4pB3blqgV9SCNvBbTqkEoQdjoyGMjESV4MktCo0k/edit#heading=h.vkxp9edl11m7, > we should be able to have models/versions for models created by training > algorithm. See design doc for syntax, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-7) Support create models / versions for training result.
[ https://issues.apache.org/jira/browse/SUBMARINE-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-7: --- Target Version: (was: 0.4.0) > Support create models / versions for training result. > -- > > Key: SUBMARINE-7 > URL: https://issues.apache.org/jira/browse/SUBMARINE-7 > Project: Apache Submarine > Issue Type: New Feature > Components: model management >Reporter: Wangda Tan >Assignee: Kevin Su >Priority: Major > Attachments: SUBMARINE-7.005.patch, SUBMARINE-7.v0.patch, > SUBMARINE-7.v1.patch, SUBMARINE-7.v2.patch, SUBMARINE-7.v3.patch, Screenshot > from 2019-07-13 00-28-44.png, Screenshot from 2019-07-13 00-29-54.png > > > As mentioned in > https://docs.google.com/document/d/199J4pB3blqgV9SCNvBbTqkEoQdjoyGMjESV4MktCo0k/edit#heading=h.vkxp9edl11m7, > we should be able to have models/versions for models created by training > algorithm. See design doc for syntax, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-7) Support create models / versions for training result.
[ https://issues.apache.org/jira/browse/SUBMARINE-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-7: --- Summary: Support create models / versions for training result. (was: [Submarine] Support create models / versions for training result. ) > Support create models / versions for training result. > -- > > Key: SUBMARINE-7 > URL: https://issues.apache.org/jira/browse/SUBMARINE-7 > Project: Apache Submarine > Issue Type: New Feature > Components: model management >Reporter: Wangda Tan >Assignee: Kevin Su >Priority: Major > Attachments: SUBMARINE-7.005.patch, SUBMARINE-7.v0.patch, > SUBMARINE-7.v1.patch, SUBMARINE-7.v2.patch, SUBMARINE-7.v3.patch, Screenshot > from 2019-07-13 00-28-44.png, Screenshot from 2019-07-13 00-29-54.png > > > As mentioned in > https://docs.google.com/document/d/199J4pB3blqgV9SCNvBbTqkEoQdjoyGMjESV4MktCo0k/edit#heading=h.vkxp9edl11m7, > we should be able to have models/versions for models created by training > algorithm. See design doc for syntax, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-7) [Submarine] Support create models / versions for training result.
[ https://issues.apache.org/jira/browse/SUBMARINE-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-7: --- Component/s: (was: Commons) model management > [Submarine] Support create models / versions for training result. > -- > > Key: SUBMARINE-7 > URL: https://issues.apache.org/jira/browse/SUBMARINE-7 > Project: Apache Submarine > Issue Type: New Feature > Components: model management >Reporter: Wangda Tan >Assignee: Kevin Su >Priority: Major > Attachments: SUBMARINE-7.005.patch, SUBMARINE-7.v0.patch, > SUBMARINE-7.v1.patch, SUBMARINE-7.v2.patch, SUBMARINE-7.v3.patch, Screenshot > from 2019-07-13 00-28-44.png, Screenshot from 2019-07-13 00-29-54.png > > > As mentioned in > https://docs.google.com/document/d/199J4pB3blqgV9SCNvBbTqkEoQdjoyGMjESV4MktCo0k/edit#heading=h.vkxp9edl11m7, > we should be able to have models/versions for models created by training > algorithm. See design doc for syntax, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-25) Manage submarine's docker image with docker hub
[ https://issues.apache.org/jira/browse/SUBMARINE-25?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-25: Summary: Manage submarine's docker image with docker hub (was: [Submarine] Manage submarine's docker image with docker hub) > Manage submarine's docker image with docker hub > --- > > Key: SUBMARINE-25 > URL: https://issues.apache.org/jira/browse/SUBMARINE-25 > Project: Apache Submarine > Issue Type: New Feature > Components: Mini Submarine >Reporter: Xun Liu >Assignee: Liu Xun >Priority: Major > > Currently the deep learning algorithm file is packaged into the docker image > file. > In the formal use of the deep learning system, the algorithm files are > generally divided into the following ways: > 1. The fixed algorithm will be made into a separate docker image, which is > convenient for maintenance and testing. Image files with different algorithms > built in are managed by mirrored warehouse. > 2. We also need to dynamically pass in algorithm scripts so that algorithm > developers can test and run algorithm scripts without packaging. > 3. In addition, submarine needs to support different deep learning frameworks > in the future. > We need to manage the image that submarine needs to use through the docker > hub. And we need to develop some specifications to manage these images. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-14) [Umbrella] Support using Submarine to submit Pytorch job
[ https://issues.apache.org/jira/browse/SUBMARINE-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved SUBMARINE-14. - Resolution: Done Since the major patch is landed. Closing as "Done". The K8s related works will be handled by SUBMARINE-403 > [Umbrella] Support using Submarine to submit Pytorch job > > > Key: SUBMARINE-14 > URL: https://issues.apache.org/jira/browse/SUBMARINE-14 > Project: Apache Submarine > Issue Type: New Feature > Components: Backend Server, Commons >Reporter: Wangda Tan >Assignee: Szilard Nemeth >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-29) [Submarine] Improve job state check
[ https://issues.apache.org/jira/browse/SUBMARINE-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-29: Resolution: Won't Fix Status: Resolved (was: Patch Available) Closing as won't fix, [~tangzhankun] please reopen if needed. > [Submarine] Improve job state check > --- > > Key: SUBMARINE-29 > URL: https://issues.apache.org/jira/browse/SUBMARINE-29 > Project: Apache Submarine > Issue Type: New Feature > Components: YARN-native-service >Reporter: Zhankun Tang >Assignee: Zhankun Tang >Priority: Major > Attachments: YARN-9077-trunk.001.patch, YARN-9077-trunk.002.patch > > > Since YARN-8488 gets committed, the service state has "SUCCEEDED" statue. We > should check it instead of "STOPPED". -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-456) submarine workbench-web Angular fails intermittently
[ https://issues.apache.org/jira/browse/SUBMARINE-456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated SUBMARINE-456: - Component/s: Workbench Web > submarine workbench-web Angular fails intermittently > > > Key: SUBMARINE-456 > URL: https://issues.apache.org/jira/browse/SUBMARINE-456 > Project: Apache Submarine > Issue Type: Bug > Components: Workbench Web >Reporter: Wei-Chiu Chuang >Assignee: Neo Chien >Priority: Major > Labels: pull-request-available > Fix For: 0.4.0 > > Time Spent: 20m > Remaining Estimate: 0h > > Looks like the test fails quite frequent: > https://travis-ci.org/github/apache/submarine/jobs/666305296?utm_medium=notification_source=github_status > https://travis-ci.org/github/apache/submarine/jobs/666231807?utm_medium=notification_source=github_status -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Work logged] (SUBMARINE-454) [WEB] Implement frontend of team page in workbench with Angular
[ https://issues.apache.org/jira/browse/SUBMARINE-454?focusedWorklogId=415643=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-415643 ] ASF GitHub Bot logged work on SUBMARINE-454: Author: ASF GitHub Bot Created on: 03/Apr/20 18:00 Start Date: 03/Apr/20 18:00 Worklog Time Spent: 10m Work Description: kobe860219 commented on pull request #255: SUBMARINE-454. Implement frontend of team page in workbench with Angular URL: https://github.com/apache/submarine/pull/255 ### What is this PR for? Implement frontend of team page in workbench with Angular ### What type of PR is it? Feature ### Todos ### What is the Jira issue? https://issues.apache.org/jira/browse/SUBMARINE-454 ### How should this be tested? https://travis-ci.org/github/kobe860219/submarine ### Screenshots (if appropriate) https://user-images.githubusercontent.com/48027290/78390800-c59dcd00-7617-11ea-820e-c16f7c8d9b83.png;> https://imgur.com/84kc6WV ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 415643) Remaining Estimate: 0h Time Spent: 10m > [WEB] Implement frontend of team page in workbench with Angular > --- > > Key: SUBMARINE-454 > URL: https://issues.apache.org/jira/browse/SUBMARINE-454 > Project: Apache Submarine > Issue Type: Sub-task > Components: Workbench >Reporter: Wen-Chien,Ruan >Assignee: Wen-Chien,Ruan >Priority: Major > Labels: pull-request-available > Fix For: 0.4.0 > > Time Spent: 10m > Remaining Estimate: 0h > > Implement frontend of team page in workbench with Angular. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
