[jira] [Created] (SUBMARINE-290) Update submainre DEFAULT_RUNTIME_CLASS
kevin su created SUBMARINE-290:
--
Summary: Update submainre DEFAULT_RUNTIME_CLASS
Key: SUBMARINE-290
URL: https://issues.apache.org/jira/browse/SUBMARINE-290
Project: Apache Submarine
Issue Type: Bug
Reporter: kevin su
Assignee: kevin su
Fix For: 0.3.0
After SUBMARINE-255 merged, we rename our runtimes to
{code:java}
org.apache.submarine.server.submitter.yarn.YarnRuntimeFactory
org.apache.submarine.server.submitter.yarnservice.YarnServiceRuntimeFactory{code}
but default in SubmarineConfiguration still is
{code:java}
org.apache.submarine.runtimes.tony.TonyRuntimeFactory
{code}
we also need to update it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Created] (SUBMARINE-296) [SDK] Submarine pipeline example
kevin su created SUBMARINE-296: -- Summary: [SDK] Submarine pipeline example Key: SUBMARINE-296 URL: https://issues.apache.org/jira/browse/SUBMARINE-296 Project: Apache Submarine Issue Type: Task Components: Submarine SDK Reporter: kevin su Assignee: kevin su quick start deep-learning based CTR example of submarine pipeline -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Created] (SUBMARINE-919) Add develop submarine website guide
Kevin Su created SUBMARINE-919: -- Summary: Add develop submarine website guide Key: SUBMARINE-919 URL: https://issues.apache.org/jira/browse/SUBMARINE-919 Project: Apache Submarine Issue Type: Sub-task Reporter: Kevin Su Fix For: 0.6.0 We need to add a develop submarine website guide in https://submarine.apache.org/docs/devDocs/Development#develop-workbench -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-919) Add develop submarine website guide
[ https://issues.apache.org/jira/browse/SUBMARINE-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-919: --- Description: We need to add a develop submarine website guide in [https://submarine.apache.org/docs/devDocs/Development#develop-workbench] * How to build the website * How to launch the website in local * How to add a new page (Need to update https://github.com/apache/submarine/blob/master/website/sidebars.js) was:We need to add a develop submarine website guide in https://submarine.apache.org/docs/devDocs/Development#develop-workbench > Add develop submarine website guide > --- > > Key: SUBMARINE-919 > URL: https://issues.apache.org/jira/browse/SUBMARINE-919 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Kevin Su >Priority: Minor > Fix For: 0.6.0 > > > We need to add a develop submarine website guide in > [https://submarine.apache.org/docs/devDocs/Development#develop-workbench] > * How to build the website > * How to launch the website in local > * How to add a new page (Need to update > https://github.com/apache/submarine/blob/master/website/sidebars.js) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Assigned] (SUBMARINE-919) Add develop submarine website guide
[ https://issues.apache.org/jira/browse/SUBMARINE-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su reassigned SUBMARINE-919: -- Assignee: Kevin Su > Add develop submarine website guide > --- > > Key: SUBMARINE-919 > URL: https://issues.apache.org/jira/browse/SUBMARINE-919 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Minor > Fix For: 0.6.0 > > > We need to add a develop submarine website guide in > [https://submarine.apache.org/docs/devDocs/Development#develop-workbench] > * How to build the website > * How to launch the website in local > * How to add a new page (Need to update > https://github.com/apache/submarine/blob/master/website/sidebars.js) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-851) Dirty notebook status is persisted in DB when notebook operation is failed
[ https://issues.apache.org/jira/browse/SUBMARINE-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-851. Fix Version/s: 0.7.0 Resolution: Fixed Issue resolved by pull request 655 [https://github.com/apache/submarine/pull/655] > Dirty notebook status is persisted in DB when notebook operation is failed > -- > > Key: SUBMARINE-851 > URL: https://issues.apache.org/jira/browse/SUBMARINE-851 > Project: Apache Submarine > Issue Type: Bug > Components: Backend Server >Reporter: Yu-Tang Lin >Assignee: Lisa Chang >Priority: Major > Labels: pull-request-available > Fix For: 0.7.0 > > Attachments: 截圖 2021-06-11 下午10.40.56.png, 截圖 2021-06-11 > 下午10.41.15.png, 截圖 2021-06-11 下午10.41.58.png > > > I hit the debug when I'm trying to do some notebook operation on assigned > namespace, but I forget to create namespace before I execute the operation, > and it cause the failure of create operation, but when I try to redo the > operation, there's alert message jumped out said that there's a duplicate > name notebook. You also can see that there's no notebook list on the UI, that > means user has no way to clean-up the dirty status. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-879) Experiment logs have not displayed
[ https://issues.apache.org/jira/browse/SUBMARINE-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-879. Fix Version/s: 0.7.0 Resolution: Fixed Issue resolved by pull request 631 [https://github.com/apache/submarine/pull/631] > Experiment logs have not displayed > -- > > Key: SUBMARINE-879 > URL: https://issues.apache.org/jira/browse/SUBMARINE-879 > Project: Apache Submarine > Issue Type: Bug >Reporter: Lisa Chang >Assignee: Lisa Chang >Priority: Major > Labels: pull-request-available > Fix For: 0.7.0 > > Attachments: image-2021-06-29-18-34-55-488.png > > > Experiment logs in the workbench have not displayed > !image-2021-06-29-18-34-55-488.png|width=632,height=214! > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-919) Add develop submarine website guide
[ https://issues.apache.org/jira/browse/SUBMARINE-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-919. Fix Version/s: (was: 0.6.0) 0.7.0 Resolution: Fixed Issue resolved by pull request 677 [https://github.com/apache/submarine/pull/677] > Add develop submarine website guide > --- > > Key: SUBMARINE-919 > URL: https://issues.apache.org/jira/browse/SUBMARINE-919 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Minor > Labels: pull-request-available > Fix For: 0.7.0 > > > We need to add a develop submarine website guide in > [https://submarine.apache.org/docs/devDocs/Development#develop-workbench] > * How to build the website > * How to launch the website in local > * How to add a new page (Need to update > https://github.com/apache/submarine/blob/master/website/sidebars.js) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-944) Bump io:commons-io to 2.11
[ https://issues.apache.org/jira/browse/SUBMARINE-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-944: --- Target Version: 0.6.0 > Bump io:commons-io to 2.11 > -- > > Key: SUBMARINE-944 > URL: https://issues.apache.org/jira/browse/SUBMARINE-944 > Project: Apache Submarine > Issue Type: Improvement > Components: Commons >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Major > Fix For: 0.6.0 > > > h5. [CVE-2021-29425|https://github.com/advisories/GHSA-gwrp-pvrq-jmwv] > *Vulnerable versions:* < 2.7 > *Patched version:* 2.7 > In Apache Commons IO before 2.7, When invoking the method > FileNameUtils.normalize with an improper input string, like "//../foo", or > "\..\foo", the result would be the same value, thus possibly providing access > to files in the parent directory, but not further above (thus "limited" path > traversal), if the calling code would use the result to construct a path > value. > [https://github.com/apache/submarine/security/dependabot/pom.xml/commons-io:commons-io/open] > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Created] (SUBMARINE-944) Bump io:commons-io to 2.11
Kevin Su created SUBMARINE-944: -- Summary: Bump io:commons-io to 2.11 Key: SUBMARINE-944 URL: https://issues.apache.org/jira/browse/SUBMARINE-944 Project: Apache Submarine Issue Type: Improvement Components: Commons Reporter: Kevin Su Assignee: Kevin Su Fix For: 0.6.0 h5. [CVE-2021-29425|https://github.com/advisories/GHSA-gwrp-pvrq-jmwv] *Vulnerable versions:* < 2.7 *Patched version:* 2.7 In Apache Commons IO before 2.7, When invoking the method FileNameUtils.normalize with an improper input string, like "//../foo", or "\..\foo", the result would be the same value, thus possibly providing access to files in the parent directory, but not further above (thus "limited" path traversal), if the calling code would use the result to construct a path value. [https://github.com/apache/submarine/security/dependabot/pom.xml/commons-io:commons-io/open] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-946) Remove duplicate tests in GitHub Actions
[ https://issues.apache.org/jira/browse/SUBMARINE-946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-946. Fix Version/s: (was: 0.6.0) 0.7.0 Resolution: Fixed Issue resolved by pull request 688 [https://github.com/apache/submarine/pull/688] > Remove duplicate tests in GitHub Actions > - > > Key: SUBMARINE-946 > URL: https://issues.apache.org/jira/browse/SUBMARINE-946 > Project: Apache Submarine > Issue Type: Sub-task > Components: test >Reporter: KUAN-HSUN-LI >Assignee: KUAN-HSUN-LI >Priority: Major > Labels: pull-request-available > Fix For: 0.7.0 > > > Some test cases are tested in multi jobs. It will make developers confuse > about where is the bug. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-942) Make experiment ID consistent with TFJob and PyTorch Job
[ https://issues.apache.org/jira/browse/SUBMARINE-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-942. Fix Version/s: (was: 0.6.0) 0.7.0 Resolution: Fixed Issue resolved by pull request 683 [https://github.com/apache/submarine/pull/683] > Make experiment ID consistent with TFJob and PyTorch Job > > > Key: SUBMARINE-942 > URL: https://issues.apache.org/jira/browse/SUBMARINE-942 > Project: Apache Submarine > Issue Type: Sub-task > Components: Backend Server, experiment, K8s Submitter, Workbench >Reporter: Kai-Hsun Chen >Assignee: Kai-Hsun Chen >Priority: Major > Labels: pull-request-available > Fix For: 0.7.0 > > > Please refer to the following two JIRA issues. > * > [https://issues.apache.org/jira/projects/SUBMARINE/issues/SUBMARINE-886?filter=reportedbyme] > * > [https://issues.apache.org/jira/projects/SUBMARINE/issues/SUBMARINE-880?filter=reportedbyme] > In this JIRA issue, we need to make the experiment ID consistent with the > name of TFJob and PyTorch Job. The difference is caused by this > [link|https://github.com/apache/submarine/commit/8da9f478de9323dd098d06bbd52afdda3a27ce07#diff-c1cad0951ad3663eb075d964171d74ae94a35bec2b79f8c9894030c0446a6b99R119]. > Update > [ExperimentId.java|https://github.com/apache/submarine/blob/2faebb8efd69833853f62d89b4f1fea1b1718148/submarine-server/server-api/src/main/java/org/apache/submarine/server/api/experiment/ExperimentId.java#L63]. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-945) Create helm chart for submarine operator
[ https://issues.apache.org/jira/browse/SUBMARINE-945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-945. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 684 [https://github.com/apache/submarine/pull/684] > Create helm chart for submarine operator > > > Key: SUBMARINE-945 > URL: https://issues.apache.org/jira/browse/SUBMARINE-945 > Project: Apache Submarine > Issue Type: New Feature >Reporter: Chi-Sheng Liu >Assignee: Chi-Sheng Liu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > Create helm chart for submarine operator -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-951) Revert SUBMARINE-942. Make experiment ID consistent with TFJob and PyTorch Job
[ https://issues.apache.org/jira/browse/SUBMARINE-951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-951: --- Description: The tests in GitHub action are failed. I'm going to revert this commit. > Revert SUBMARINE-942. Make experiment ID consistent with TFJob and PyTorch Job > -- > > Key: SUBMARINE-951 > URL: https://issues.apache.org/jira/browse/SUBMARINE-951 > Project: Apache Submarine > Issue Type: Improvement >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Critical > Fix For: 0.6.0 > > > The tests in GitHub action are failed. I'm going to revert this commit. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Created] (SUBMARINE-951) Revert SUBMARINE-942. Make experiment ID consistent with TFJob and PyTorch Job
Kevin Su created SUBMARINE-951: -- Summary: Revert SUBMARINE-942. Make experiment ID consistent with TFJob and PyTorch Job Key: SUBMARINE-951 URL: https://issues.apache.org/jira/browse/SUBMARINE-951 Project: Apache Submarine Issue Type: Improvement Reporter: Kevin Su Assignee: Kevin Su Fix For: 0.6.0 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-951) Revert SUBMARINE-942. Make experiment ID consistent with TFJob and PyTorch Job
[ https://issues.apache.org/jira/browse/SUBMARINE-951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-951. Resolution: Fixed Issue resolved by pull request 690 [https://github.com/apache/submarine/pull/690] > Revert SUBMARINE-942. Make experiment ID consistent with TFJob and PyTorch Job > -- > > Key: SUBMARINE-951 > URL: https://issues.apache.org/jira/browse/SUBMARINE-951 > Project: Apache Submarine > Issue Type: Improvement >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Critical > Labels: pull-request-available > Fix For: 0.6.0 > > > The tests in GitHub action are failed. I'm going to revert this commit. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Reopened] (SUBMARINE-942) Make experiment ID consistent with TFJob and PyTorch Job
[ https://issues.apache.org/jira/browse/SUBMARINE-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su reopened SUBMARINE-942: > Make experiment ID consistent with TFJob and PyTorch Job > > > Key: SUBMARINE-942 > URL: https://issues.apache.org/jira/browse/SUBMARINE-942 > Project: Apache Submarine > Issue Type: Sub-task > Components: Backend Server, experiment, K8s Submitter, Workbench >Reporter: Kai-Hsun Chen >Assignee: Kai-Hsun Chen >Priority: Major > Labels: pull-request-available > Fix For: 0.7.0 > > > Please refer to the following two JIRA issues. > * > [https://issues.apache.org/jira/projects/SUBMARINE/issues/SUBMARINE-886?filter=reportedbyme] > * > [https://issues.apache.org/jira/projects/SUBMARINE/issues/SUBMARINE-880?filter=reportedbyme] > In this JIRA issue, we need to make the experiment ID consistent with the > name of TFJob and PyTorch Job. The difference is caused by this > [link|https://github.com/apache/submarine/commit/8da9f478de9323dd098d06bbd52afdda3a27ce07#diff-c1cad0951ad3663eb075d964171d74ae94a35bec2b79f8c9894030c0446a6b99R119]. > Update > [ExperimentId.java|https://github.com/apache/submarine/blob/2faebb8efd69833853f62d89b4f1fea1b1718148/submarine-server/server-api/src/main/java/org/apache/submarine/server/api/experiment/ExperimentId.java#L63]. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-938) [User] Modify user documentation
[ https://issues.apache.org/jira/browse/SUBMARINE-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-938. Fix Version/s: 0.7.0 Resolution: Fixed Issue resolved by pull request 678 [https://github.com/apache/submarine/pull/678] > [User] Modify user documentation > > > Key: SUBMARINE-938 > URL: https://issues.apache.org/jira/browse/SUBMARINE-938 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Byron Hsu >Assignee: Byron Hsu >Priority: Major > Labels: pull-request-available > Fix For: 0.7.0 > > > # Delete unimportant information and add critical ones. > # Make the style consistent in the subpages. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-943) add "tag" property into Experiment class
[ https://issues.apache.org/jira/browse/SUBMARINE-943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-943. Fix Version/s: 0.7.0 Resolution: Fixed Issue resolved by pull request 685 [https://github.com/apache/submarine/pull/685] > add "tag" property into Experiment class > > > Key: SUBMARINE-943 > URL: https://issues.apache.org/jira/browse/SUBMARINE-943 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Yu-Tang Lin >Assignee: Yu-Tang Lin >Priority: Minor > Labels: pull-request-available > Fix For: 0.7.0 > > > we would like to add tag property into Experiment class and allow it could be > searched by assigned tag value in the later phase. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Created] (SUBMARINE-962) Delete temporary build artifacts before caching
Kevin Su created SUBMARINE-962: -- Summary: Delete temporary build artifacts before caching Key: SUBMARINE-962 URL: https://issues.apache.org/jira/browse/SUBMARINE-962 Project: Apache Submarine Issue Type: Bug Components: CI/CD Reporter: Kevin Su Assignee: Kevin Su Fix For: 0.6.0 When building the Submarine repo, some of the modules would use outdated packages in ~/.m2/repository/org/apache. We should delete temporary build artifacts before caching -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Created] (SUBMARINE-963) Add SonarCloud config in GA
Kevin Su created SUBMARINE-963: -- Summary: Add SonarCloud config in GA Key: SUBMARINE-963 URL: https://issues.apache.org/jira/browse/SUBMARINE-963 Project: Apache Submarine Issue Type: Improvement Components: CI/CD Reporter: Kevin Su Assignee: Kevin Su we would like to add the Submarine repo to SonarCloud.io, and we need some setups in Github Action workflow. Related to https://issues.apache.org/jira/browse/INFRA-22105 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-928) [Quickstart] Rewrite quickstart guide
[ https://issues.apache.org/jira/browse/SUBMARINE-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-928. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 664 [https://github.com/apache/submarine/pull/664] > [Quickstart] Rewrite quickstart guide > - > > Key: SUBMARINE-928 > URL: https://issues.apache.org/jira/browse/SUBMARINE-928 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Byron Hsu >Assignee: Byron Hsu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-956) Change submarine CRD groupName to "submarine.apache.org"
[ https://issues.apache.org/jira/browse/SUBMARINE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-956. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 691 [https://github.com/apache/submarine/pull/691] > Change submarine CRD groupName to "submarine.apache.org" > > > Key: SUBMARINE-956 > URL: https://issues.apache.org/jira/browse/SUBMARINE-956 > Project: Apache Submarine > Issue Type: Bug >Reporter: Chi-Sheng Liu >Assignee: Chi-Sheng Liu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > Currently, the CRD groupName of submarines is "submarine.k8s.io", we should > change it to "submarine.apache.org" -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-961) Experiment Tag at Predefined Experiment
[ https://issues.apache.org/jira/browse/SUBMARINE-961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-961: --- Attachment: Screenshot from 2021-08-06 17-24-47.png > Experiment Tag at Predefined Experiment > --- > > Key: SUBMARINE-961 > URL: https://issues.apache.org/jira/browse/SUBMARINE-961 > Project: Apache Submarine > Issue Type: New Feature >Reporter: You Ting Wang >Assignee: You Ting Wang >Priority: Major > Attachments: Screenshot from 2021-08-06 17-24-47.png > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Commented] (SUBMARINE-961) Experiment Tag at Predefined Experiment
[ https://issues.apache.org/jira/browse/SUBMARINE-961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17394654#comment-17394654 ] Kevin Su commented on SUBMARINE-961: I think we only need to support users to add the tag when creating an experiment template. we can add tags below the command. We don't need to set "tag" as an experiment template parameter. And we can support users to add a new tag after the experiment is created. !Screenshot from 2021-08-06 17-24-47.png! > Experiment Tag at Predefined Experiment > --- > > Key: SUBMARINE-961 > URL: https://issues.apache.org/jira/browse/SUBMARINE-961 > Project: Apache Submarine > Issue Type: New Feature >Reporter: You Ting Wang >Assignee: You Ting Wang >Priority: Major > Attachments: Screenshot from 2021-08-06 17-24-47.png > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-962) Delete temporary build artifacts before caching
[ https://issues.apache.org/jira/browse/SUBMARINE-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-962. Resolution: Fixed Issue resolved by pull request 695 [https://github.com/apache/submarine/pull/695] > Delete temporary build artifacts before caching > --- > > Key: SUBMARINE-962 > URL: https://issues.apache.org/jira/browse/SUBMARINE-962 > Project: Apache Submarine > Issue Type: Bug > Components: CI/CD >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > When building the Submarine repo, some of the modules would use outdated > packages in ~/.m2/repository/org/apache. > We should delete temporary build artifacts before caching -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-948) Allow experiments to overcommit memory
[ https://issues.apache.org/jira/browse/SUBMARINE-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-948. Resolution: Fixed Issue resolved by pull request 699 [https://github.com/apache/submarine/pull/699] > Allow experiments to overcommit memory > -- > > Key: SUBMARINE-948 > URL: https://issues.apache.org/jira/browse/SUBMARINE-948 > Project: Apache Submarine > Issue Type: Sub-task > Components: Backend Server, experiment, K8s Submitter >Reporter: Kai-Hsun Chen >Assignee: Kai-Hsun Chen >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > The following two pull requests aim to resolve the Out-Of-Memory error. > However, it is very inconvenient for users to predict the actual memory > usage. Thus, using the memory request and memory limit mechanism to allow > overcommitment of memory is helpful for users. > [https://github.com/apache/submarine/pull/621] > [https://github.com/apache/submarine/pull/510] > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-952) add the upper bound of retry counts for TFJob and PytorchJob
[ https://issues.apache.org/jira/browse/SUBMARINE-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-952. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 694 [https://github.com/apache/submarine/pull/694] > add the upper bound of retry counts for TFJob and PytorchJob > - > > Key: SUBMARINE-952 > URL: https://issues.apache.org/jira/browse/SUBMARINE-952 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Yu-Tang Lin >Assignee: Yu-Tang Lin >Priority: Minor > Labels: pull-request-available > Fix For: 0.6.0 > > > The TFJob and PytorchJob will retry when they hit some non-systematic > error(for example, OOM); if the same error shows up continually, the retry > operation will be never-enddng. > To prevent this case happens again, we would like to add *backoffLimit* > configuration both in TFJob and PytorchJob. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-939) Auto Reload in Experiment will reset the checkbox continuously
[ https://issues.apache.org/jira/browse/SUBMARINE-939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-939. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 680 [https://github.com/apache/submarine/pull/680] > Auto Reload in Experiment will reset the checkbox continuously > -- > > Key: SUBMARINE-939 > URL: https://issues.apache.org/jira/browse/SUBMARINE-939 > Project: Apache Submarine > Issue Type: Bug > Components: Workbench >Reporter: You Ting Wang >Assignee: You Ting Wang >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > Auto Reload in Experiment will reset the checkbox continuously -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-955) Add Limit on Experiment Name
[ https://issues.apache.org/jira/browse/SUBMARINE-955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-955. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 692 [https://github.com/apache/submarine/pull/692] > Add Limit on Experiment Name > > > Key: SUBMARINE-955 > URL: https://issues.apache.org/jira/browse/SUBMARINE-955 > Project: Apache Submarine > Issue Type: Bug >Reporter: You Ting Wang >Assignee: You Ting Wang >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > We don't want the name of experiment start with hyphen, so the regex written > in workbench need to be modified. > Also the experiment built from pre-define template should also apply this > regulation. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-911) Fix the bug about deleting notebook
[ https://issues.apache.org/jira/browse/SUBMARINE-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-911. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 689 [https://github.com/apache/submarine/pull/689] > Fix the bug about deleting notebook > --- > > Key: SUBMARINE-911 > URL: https://issues.apache.org/jira/browse/SUBMARINE-911 > Project: Apache Submarine > Issue Type: Bug > Components: Backend Server >Reporter: Lisa Chang >Assignee: Lisa Chang >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > Attachments: image-2021-07-08-12-40-37-710.png > > > !image-2021-07-08-12-40-37-710.png|width=558,height=175! > This notebook still working, but no information at workbench and can not be > deleted. > To reproduce this bug, just restart submarine without delete the notebook. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-953) Submarine-server shouldn't create persistentVolume manually for notebook
[ https://issues.apache.org/jira/browse/SUBMARINE-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-953. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 697 [https://github.com/apache/submarine/pull/697] > Submarine-server shouldn't create persistentVolume manually for notebook > > > Key: SUBMARINE-953 > URL: https://issues.apache.org/jira/browse/SUBMARINE-953 > Project: Apache Submarine > Issue Type: Bug >Reporter: Che-Kuang Chu >Assignee: Che-Kuang Chu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > Source: > [https://github.com/apache/submarine/blob/72be805fc4672f7f29c96cca95e16d59358d4dd2/submarine-server/server-submitter/submitter-k8s/src/main/java/org/apache/submarine/server/submitter/k8s/K8sSubmitter.java#L379] > We can find out that when we create a notebook custom resource, the server > will manually create the persistent volume for it. > However, this made submarine-server has to grant access to persistent volume > resources, which lead to setting cluster roles for the server. > ([https://github.com/apache/submarine/blob/72be805fc4/helm-charts/submarine/templates/rbac.yaml#L61)] > Since the server is in namespace scope, giving it cluster roles is > inappropriate. Besides, this makes multi-tenancy more difficult. > To fix the bug, we can create a *storage class* to dynamically provision > persistent volumes, and submarine-server will only need to deal with > persistent volume claim. > Todos: > * add storageClass > * add persistentVolumeClaim spec to submarine-server > * remove submarine-server createPersistentVolume > * replace clutserrolebinding to rolebinding > * replace clusterrole to role > Ref: > * storage class: > [https://kubernetes.io/docs/concepts/storage/storage-classes/#local] > * notebook-cr spec: [https://www.kubeflow.org/docs/reference/notebook/v1/] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-959) Fix error in submarine-k8s test
[ https://issues.apache.org/jira/browse/SUBMARINE-959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-959. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 703 [https://github.com/apache/submarine/pull/703] > Fix error in submarine-k8s test > --- > > Key: SUBMARINE-959 > URL: https://issues.apache.org/jira/browse/SUBMARINE-959 > Project: Apache Submarine > Issue Type: Bug >Reporter: Lisa Chang >Assignee: Lisa Chang >Priority: Major > Fix For: 0.6.0 > > Attachments: image-2021-08-02-21-50-00-696.png > > > !image-2021-08-02-21-50-00-696.png|width=429,height=187! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Created] (SUBMARINE-967) Running experiments with gang-scheduling
Kevin Su created SUBMARINE-967: -- Summary: Running experiments with gang-scheduling Key: SUBMARINE-967 URL: https://issues.apache.org/jira/browse/SUBMARINE-967 Project: Apache Submarine Issue Type: Improvement Components: K8s Submitter Reporter: Kevin Su Assignee: Kevin Su We should support gang scheduler for experiments, so it allows experiments to run multiple pods at the same time. We could support the volcano and Yunikorn. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-966) Correct the job label selector
[ https://issues.apache.org/jira/browse/SUBMARINE-966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-966. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 704 [https://github.com/apache/submarine/pull/704] > Correct the job label selector > -- > > Key: SUBMARINE-966 > URL: https://issues.apache.org/jira/browse/SUBMARINE-966 > Project: Apache Submarine > Issue Type: Bug > Components: K8s Submitter >Reporter: Lisa Chang >Assignee: Lisa Chang >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > Will reply empty when getting logs now because the selector key 'tf-job-name' > represent to ExperimentId after > [SUBMARINE-880|https://issues.apache.org/jira/browse/SUBMARINE-880], correct > it to get the right response. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-965) Users should not have the privilege to create experiments in different namespaces
[ https://issues.apache.org/jira/browse/SUBMARINE-965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-965. Fix Version/s: (was: 0.7.0) 0.6.0 Resolution: Fixed Issue resolved by pull request 702 [https://github.com/apache/submarine/pull/702] > Users should not have the privilege to create experiments in different > namespaces > - > > Key: SUBMARINE-965 > URL: https://issues.apache.org/jira/browse/SUBMARINE-965 > Project: Apache Submarine > Issue Type: Sub-task > Components: Backend Server, experiment, Workbench Web >Reporter: Kai-Hsun Chen >Assignee: Kai-Hsun Chen >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > In our multi-tenant architecture, users only can create experiments in their > namespaces, but the Submarine workbench enables users to specify namespaces. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-974) How to contributed submarine step 8 is outdated
[ https://issues.apache.org/jira/browse/SUBMARINE-974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-974. Resolution: Fixed Issue resolved by pull request 706 [https://github.com/apache/submarine/pull/706] > How to contributed submarine step 8 is outdated > --- > > Key: SUBMARINE-974 > URL: https://issues.apache.org/jira/browse/SUBMARINE-974 > Project: Apache Submarine > Issue Type: Improvement > Components: Doc >Reporter: KUAN-HSUN-LI >Assignee: KUAN-HSUN-LI >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > How to contributed submarine step 8 is outdated. We are using GitHub Actions > for CI now. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-963) Add SonarCloud config in GA
[ https://issues.apache.org/jira/browse/SUBMARINE-963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-963. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 696 [https://github.com/apache/submarine/pull/696] > Add SonarCloud config in GA > --- > > Key: SUBMARINE-963 > URL: https://issues.apache.org/jira/browse/SUBMARINE-963 > Project: Apache Submarine > Issue Type: Improvement > Components: CI/CD >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > we would like to add the Submarine repo to SonarCloud.io, and we need some > setups in Github Action workflow. > Related to https://issues.apache.org/jira/browse/INFRA-22105 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Created] (SUBMARINE-977) Fix sonarcloud workflow run error
Kevin Su created SUBMARINE-977: -- Summary: Fix sonarcloud workflow run error Key: SUBMARINE-977 URL: https://issues.apache.org/jira/browse/SUBMARINE-977 Project: Apache Submarine Issue Type: Bug Components: CI/CD Reporter: Kevin Su Assignee: Kevin Su Fix For: 0.6.0 https://github.com/apache/submarine/runs/3329896724 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-977) Fix sonarcloud workflow run error
[ https://issues.apache.org/jira/browse/SUBMARINE-977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-977: --- Description: [https://github.com/apache/submarine/runs/3329896724] We should support building the repo with JDK 11 was:https://github.com/apache/submarine/runs/3329896724 > Fix sonarcloud workflow run error > - > > Key: SUBMARINE-977 > URL: https://issues.apache.org/jira/browse/SUBMARINE-977 > Project: Apache Submarine > Issue Type: Bug > Components: CI/CD >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Major > Fix For: 0.6.0 > > > [https://github.com/apache/submarine/runs/3329896724] > We should support building the repo with JDK 11 > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-977) Fix sonarcloud workflow run error
[ https://issues.apache.org/jira/browse/SUBMARINE-977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-977. Resolution: Fixed Issue resolved by pull request 711 [https://github.com/apache/submarine/pull/711] > Fix sonarcloud workflow run error > - > > Key: SUBMARINE-977 > URL: https://issues.apache.org/jira/browse/SUBMARINE-977 > Project: Apache Submarine > Issue Type: Bug > Components: CI/CD >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > [https://github.com/apache/submarine/runs/3329896724] > We should support building the repo with JDK 11 > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Created] (SUBMARINE-980) Upload code coverage to SonarCloud
Kevin Su created SUBMARINE-980: -- Summary: Upload code coverage to SonarCloud Key: SUBMARINE-980 URL: https://issues.apache.org/jira/browse/SUBMARINE-980 Project: Apache Submarine Issue Type: Improvement Components: CI/CD Reporter: Kevin Su We should generate a code coverage report by ourselves, SonarCloud will not help us do that. refer to: [https://github.com/apache/ozone/blob/master/hadoop-ozone/dev-support/checks/coverage.sh] [https://sonarcloud.io/dashboard?id=apache_submarine] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Created] (SUBMARINE-981) Update com.google.guava:guava version
Kevin Su created SUBMARINE-981: -- Summary: Update com.google.guava:guava version Key: SUBMARINE-981 URL: https://issues.apache.org/jira/browse/SUBMARINE-981 Project: Apache Submarine Issue Type: Improvement Components: Commons Reporter: Kevin Su Upgrade com.google.guava:guava to version 30.0-jre or later. h5. [CVE-2020-8908|https://github.com/advisories/GHSA-5mg8-w23w-74h3] low severity *Vulnerable versions:* <= 29.0 *Patched version:* 30.0-jre A temp directory creation vulnerability exist in Guava versions prior to 30.0 allowing an attacker with access to the machine to potentially access data in a temporary directory created by the Guava com.google.common.io.Files.createTempDir(). The permissions granted to the directory created default to the standard unix-like /tmp ones, leaving the files open. We recommend updating Guava to version 30.0 or later, or update to Java 7 or later, or to explicitly change the permissions after the creation of the directory if neither are possible. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-981) Update com.google.guava:guava version
[ https://issues.apache.org/jira/browse/SUBMARINE-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-981: --- Description: Upgrade com.google.guava:guava to version 30.0-jre or later. h5. [CVE-2020-8908|https://github.com/advisories/GHSA-5mg8-w23w-74h3] low severity *Vulnerable versions:* <= 29.0 *Patched version:* 30.0-jre A temp directory creation vulnerability exist in Guava versions prior to 30.0 allowing an attacker with access to the machine to potentially access data in a temporary directory created by the Guava com.google.common.io.Files.createTempDir(). The permissions granted to the directory created default to the standard unix-like /tmp ones, leaving the files open. We recommend updating Guava to version 30.0 or later, or update to Java 7 or later, or to explicitly change the permissions after the creation of the directory if neither are possible. was: Upgrade com.google.guava:guava to version 30.0-jre or later. h5. [CVE-2020-8908|https://github.com/advisories/GHSA-5mg8-w23w-74h3] low severity *Vulnerable versions:* <= 29.0 *Patched version:* 30.0-jre A temp directory creation vulnerability exist in Guava versions prior to 30.0 allowing an attacker with access to the machine to potentially access data in a temporary directory created by the Guava com.google.common.io.Files.createTempDir(). The permissions granted to the directory created default to the standard unix-like /tmp ones, leaving the files open. We recommend updating Guava to version 30.0 or later, or update to Java 7 or later, or to explicitly change the permissions after the creation of the directory if neither are possible. > Update com.google.guava:guava version > -- > > Key: SUBMARINE-981 > URL: https://issues.apache.org/jira/browse/SUBMARINE-981 > Project: Apache Submarine > Issue Type: Improvement > Components: Commons >Reporter: Kevin Su >Priority: Minor > > Upgrade com.google.guava:guava to version 30.0-jre or later. > h5. [CVE-2020-8908|https://github.com/advisories/GHSA-5mg8-w23w-74h3] > low severity > *Vulnerable versions:* <= 29.0 > *Patched version:* 30.0-jre > A temp directory creation vulnerability exist in Guava versions prior to > 30.0 allowing an attacker with access to the machine to potentially access > data in a temporary directory created by the Guava > com.google.common.io.Files.createTempDir(). The permissions granted to the > directory created default to the standard unix-like /tmp ones, leaving the > files open. We recommend updating Guava to version 30.0 or later, or update > to Java 7 or later, or to explicitly change the permissions after the > creation of the directory if neither are possible. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-970) Simplify integration tests' workflow
[ https://issues.apache.org/jira/browse/SUBMARINE-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-970. Fix Version/s: (was: 0.7.0) 0.6.0 Resolution: Fixed Issue resolved by pull request 708 [https://github.com/apache/submarine/pull/708] > Simplify integration tests' workflow > > > Key: SUBMARINE-970 > URL: https://issues.apache.org/jira/browse/SUBMARINE-970 > Project: Apache Submarine > Issue Type: Improvement > Components: CI/CD >Reporter: KUAN-HSUN-LI >Assignee: KUAN-HSUN-LI >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > # reduce execution time > # avoid install submarine twice -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-979) Fix the error in gettingStarted/notebook.md
[ https://issues.apache.org/jira/browse/SUBMARINE-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-979. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 710 [https://github.com/apache/submarine/pull/710] > Fix the error in gettingStarted/notebook.md > --- > > Key: SUBMARINE-979 > URL: https://issues.apache.org/jira/browse/SUBMARINE-979 > Project: Apache Submarine > Issue Type: Bug > Components: Doc >Reporter: Charles Huang >Assignee: Charles Huang >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > Attachments: wrongNotebook.png > > > The first picture is wrong and there are several extra "\" in the document > (only cellphone user can see). > !wrongNotebook.png|width=690,height=460! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-969) Fix the bug in experiment page
[ https://issues.apache.org/jira/browse/SUBMARINE-969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-969. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 713 [https://github.com/apache/submarine/pull/713] > Fix the bug in experiment page > -- > > Key: SUBMARINE-969 > URL: https://issues.apache.org/jira/browse/SUBMARINE-969 > Project: Apache Submarine > Issue Type: Bug >Reporter: Lisa Chang >Assignee: Lisa Chang >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > Attachments: image-2021-08-16-14-15-00-919.png > > > The experiment name is lost. > !image-2021-08-16-14-15-00-919.png|width=465,height=157! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-958) Experiment Tag at Customized Experiment
[ https://issues.apache.org/jira/browse/SUBMARINE-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-958. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 698 [https://github.com/apache/submarine/pull/698] > Experiment Tag at Customized Experiment > --- > > Key: SUBMARINE-958 > URL: https://issues.apache.org/jira/browse/SUBMARINE-958 > Project: Apache Submarine > Issue Type: New Feature > Components: Workbench >Reporter: You Ting Wang >Assignee: You Ting Wang >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-985) Fix limit on the experiment name
[ https://issues.apache.org/jira/browse/SUBMARINE-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-985. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 714 [https://github.com/apache/submarine/pull/714] > Fix limit on the experiment name > > > Key: SUBMARINE-985 > URL: https://issues.apache.org/jira/browse/SUBMARINE-985 > Project: Apache Submarine > Issue Type: Bug > Components: Workbench Web >Reporter: Jhan-Shuo, Liu >Assignee: Jhan-Shuo, Liu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > Attachments: 985.png > > > The hyphens can't be the end of the experiment name. > !985.png|width=513,height=305! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-975) Create storageClass for database, minio, tensorboard to control persistentVolume
[ https://issues.apache.org/jira/browse/SUBMARINE-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-975. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 707 [https://github.com/apache/submarine/pull/707] > Create storageClass for database, minio, tensorboard to control > persistentVolume > > > Key: SUBMARINE-975 > URL: https://issues.apache.org/jira/browse/SUBMARINE-975 > Project: Apache Submarine > Issue Type: Improvement >Reporter: Che-Kuang Chu >Assignee: Che-Kuang Chu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > To create persistent volumes, submarine-operator creates persistent volumes > with different names depending on the namespace (eg. > `submarine-database-pv–default`) > However, we can use storage class to create persistent volumes dynamically > and delete them easily. > This will be implemented only on the submarine operator. Besides, only > minikube support the current storage class provisioner, and volumes can only > be in the host (nfs not supported). > Todos: > - [ ] Add storage class > - [ ] Modify operator to create pvc only > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-954) Experiments and notebooks are still alive after submarine is deleted
[ https://issues.apache.org/jira/browse/SUBMARINE-954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-954. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 705 [https://github.com/apache/submarine/pull/705] > Experiments and notebooks are still alive after submarine is deleted > > > Key: SUBMARINE-954 > URL: https://issues.apache.org/jira/browse/SUBMARINE-954 > Project: Apache Submarine > Issue Type: Bug > Components: Backend Server >Reporter: Che-Kuang Chu >Assignee: Che-Kuang Chu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > After the submarine is down, we can find that the experiment and notebook > pods are still alive in the cluster. > Reproduce steps: > # create submarine > # access to the workbench by port forwarding > # add notebook or experiment from the workbench > # delete submarine > # we can find out that notebooks, tfjobs, pytorchjobs and relating > components are still alive. > To fix the bug, we can maybe add onwerReferences to the created resources. > Reference: > * ownerReference: > *[https://kubernetes.io/docs/concepts/overview/working-with-objects/owners-dependents/]* > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-961) Experiment Tag at Predefined Experiment
[ https://issues.apache.org/jira/browse/SUBMARINE-961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-961. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 701 [https://github.com/apache/submarine/pull/701] > Experiment Tag at Predefined Experiment > --- > > Key: SUBMARINE-961 > URL: https://issues.apache.org/jira/browse/SUBMARINE-961 > Project: Apache Submarine > Issue Type: New Feature >Reporter: You Ting Wang >Assignee: You Ting Wang >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > Attachments: Screenshot from 2021-08-06 17-24-47.png > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-992) Unable to open minio dashboard
[ https://issues.apache.org/jira/browse/SUBMARINE-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-992. Fix Version/s: (was: 0.7.0) 0.6.0 Resolution: Fixed Issue resolved by pull request 716 [https://github.com/apache/submarine/pull/716] > Unable to open minio dashboard > -- > > Key: SUBMARINE-992 > URL: https://issues.apache.org/jira/browse/SUBMARINE-992 > Project: Apache Submarine > Issue Type: Bug > Components: Workbench >Reporter: KUAN-HSUN-LI >Assignee: KUAN-HSUN-LI >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-991) Add the prerequisites of notebook-gpu-env in gettingStarted/notebook.md
[ https://issues.apache.org/jira/browse/SUBMARINE-991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-991. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 718 [https://github.com/apache/submarine/pull/718] > Add the prerequisites of notebook-gpu-env in gettingStarted/notebook.md > --- > > Key: SUBMARINE-991 > URL: https://issues.apache.org/jira/browse/SUBMARINE-991 > Project: Apache Submarine > Issue Type: Improvement > Components: Doc >Reporter: Charles Huang >Assignee: Charles Huang >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > Before using notebook-gpu-env, user should set up gpu environment in > kubernetes. > Here we give an example of Nvidia/k8s-device-plugin. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-978) Add model management database service.
[ https://issues.apache.org/jira/browse/SUBMARINE-978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-978. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 712 [https://github.com/apache/submarine/pull/712] > Add model management database service. > -- > > Key: SUBMARINE-978 > URL: https://issues.apache.org/jira/browse/SUBMARINE-978 > Project: Apache Submarine > Issue Type: Task > Components: model management >Reporter: Jhan-Shuo, Liu >Assignee: Jhan-Shuo, Liu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > Add model registry and model version entities and mappers to support model > service. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-973) Versioning website
[ https://issues.apache.org/jira/browse/SUBMARINE-973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-973. Fix Version/s: (was: 0.7.0) 0.6.0 Resolution: Fixed Issue resolved by pull request 709 [https://github.com/apache/submarine/pull/709] > Versioning website > -- > > Key: SUBMARINE-973 > URL: https://issues.apache.org/jira/browse/SUBMARINE-973 > Project: Apache Submarine > Issue Type: Improvement > Components: Doc >Reporter: KUAN-HSUN-LI >Assignee: KUAN-HSUN-LI >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > Documentation must include version control. API in different versions is not > always available > Resources: > [Versioning | Docusaurus|https://docusaurus.io/docs/versioning] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-990) Add helm templates to support storage class configurations
[ https://issues.apache.org/jira/browse/SUBMARINE-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-990. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 717 [https://github.com/apache/submarine/pull/717] > Add helm templates to support storage class configurations > -- > > Key: SUBMARINE-990 > URL: https://issues.apache.org/jira/browse/SUBMARINE-990 > Project: Apache Submarine > Issue Type: Improvement >Reporter: Che-Kuang Chu >Assignee: Che-Kuang Chu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > From SUBMARINE-975, we can find out that the storage class configurations > (provisioner, reclaim policy, etc) is unchangeable. > By adding helm templates (`_helper.tpl`) and adding more values > (`values.yaml`), we can use `helm install --set storageclass.provisioner=...` > to change the default configurations of the storage class. Therefore, we can > easily set up different configurations on different clusters such as `kind`. > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Created] (SUBMARINE-994) Fix broken link in README
Kevin Su created SUBMARINE-994: -- Summary: Fix broken link in README Key: SUBMARINE-994 URL: https://issues.apache.org/jira/browse/SUBMARINE-994 Project: Apache Submarine Issue Type: Improvement Components: Doc Reporter: Kevin Su Assignee: Kevin Su Attachments: Screenshot from 2021-08-26 14-15-45.png Fix broken link in README !Screenshot from 2021-08-26 14-15-45.png! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-994) Fix broken link in README
[ https://issues.apache.org/jira/browse/SUBMARINE-994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-994. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 721 [https://github.com/apache/submarine/pull/721] > Fix broken link in README > - > > Key: SUBMARINE-994 > URL: https://issues.apache.org/jira/browse/SUBMARINE-994 > Project: Apache Submarine > Issue Type: Improvement > Components: Doc >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Trivial > Labels: pull-request-available > Fix For: 0.6.0 > > Attachments: Screenshot from 2021-08-26 14-15-45.png > > > Fix broken link in README > !Screenshot from 2021-08-26 14-15-45.png! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Assigned] (SUBMARINE-922) Migrate to the next version of Python requests when released
[
https://issues.apache.org/jira/browse/SUBMARINE-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Su reassigned SUBMARINE-922:
--
Assignee: Kevin Su
> Migrate to the next version of Python requests when released
>
>
> Key: SUBMARINE-922
> URL: https://issues.apache.org/jira/browse/SUBMARINE-922
> Project: Apache Submarine
> Issue Type: Bug
>Affects Versions: 0.6.0
>Reporter: Wei-Chiu Chuang
>Assignee: Kevin Su
>Priority: Blocker
>
> See github issue: https://github.com/apache/submarine/issues/661
> Our python code uses requests library which has transitive dependency on a
> GPL lib chardet.
> We're not supposed to make an ASF release knowing there's a GPL transitive
> dependency so this is a blocker for our 0.6.0 release.
> Quickly checked the code, we have two places that use the library. We could
> wait for the new requests or perhaps remove the usage.
> {code}
> find . -name "*.py" | xargs grep "import requests"
> ./submarine-sdk/pysubmarine/submarine/utils/rest_utils.py:import requests
> ./submarine-sdk/pysubmarine/build/lib/submarine/utils/rest_utils.py:import
> requests
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-995) Fix submarine website project name
[ https://issues.apache.org/jira/browse/SUBMARINE-995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-995. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 723 [https://github.com/apache/submarine/pull/723] > Fix submarine website project name > -- > > Key: SUBMARINE-995 > URL: https://issues.apache.org/jira/browse/SUBMARINE-995 > Project: Apache Submarine > Issue Type: Bug > Components: Website >Reporter: KUAN-HSUN-LI >Assignee: KUAN-HSUN-LI >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-922) Migrate to the next version of Python requests when released
[
https://issues.apache.org/jira/browse/SUBMARINE-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Su resolved SUBMARINE-922.
Fix Version/s: 0.6.0
Resolution: Fixed
Issue resolved by pull request 722
[https://github.com/apache/submarine/pull/722]
> Migrate to the next version of Python requests when released
>
>
> Key: SUBMARINE-922
> URL: https://issues.apache.org/jira/browse/SUBMARINE-922
> Project: Apache Submarine
> Issue Type: Bug
>Affects Versions: 0.6.0
>Reporter: Wei-Chiu Chuang
>Assignee: Kevin Su
>Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.6.0
>
>
> See github issue: https://github.com/apache/submarine/issues/661
> Our python code uses requests library which has transitive dependency on a
> GPL lib chardet.
> We're not supposed to make an ASF release knowing there's a GPL transitive
> dependency so this is a blocker for our 0.6.0 release.
> Quickly checked the code, we have two places that use the library. We could
> wait for the new requests or perhaps remove the usage.
> {code}
> find . -name "*.py" | xargs grep "import requests"
> ./submarine-sdk/pysubmarine/submarine/utils/rest_utils.py:import requests
> ./submarine-sdk/pysubmarine/build/lib/submarine/utils/rest_utils.py:import
> requests
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org
For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-901) Tensorflow distributed training example with model management API
[ https://issues.apache.org/jira/browse/SUBMARINE-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-901. Resolution: Fixed > Tensorflow distributed training example with model management API > - > > Key: SUBMARINE-901 > URL: https://issues.apache.org/jira/browse/SUBMARINE-901 > Project: Apache Submarine > Issue Type: Sub-task > Components: model management >Reporter: Yuan-Chia, Chang >Assignee: Liang-Chun, Chen >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > Write a tensorflow distributed training example with model management API(log > param, log metric, load model, update model, delete model, save model) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-869) Add distributive pytorch example
[ https://issues.apache.org/jira/browse/SUBMARINE-869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-869. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 720 [https://github.com/apache/submarine/pull/720] > Add distributive pytorch example > > > Key: SUBMARINE-869 > URL: https://issues.apache.org/jira/browse/SUBMARINE-869 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Liang-Chun, Chen >Assignee: Liang-Chun, Chen >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-997) Redefinition of submarine CRD
[ https://issues.apache.org/jira/browse/SUBMARINE-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-997. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 725 [https://github.com/apache/submarine/pull/725] > Redefinition of submarine CRD > - > > Key: SUBMARINE-997 > URL: https://issues.apache.org/jira/browse/SUBMARINE-997 > Project: Apache Submarine > Issue Type: Improvement >Reporter: Chi-Sheng Liu >Assignee: Chi-Sheng Liu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > Since we use StorageClass to replace PersistentVolume in the operator, we > need to redefine the submarine CRD. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-833) submarine-security does not support ranger 2.1 version
[ https://issues.apache.org/jira/browse/SUBMARINE-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-833: --- Fix Version/s: (was: 0.6.0) 0.7.0 > submarine-security does not support ranger 2.1 version > -- > > Key: SUBMARINE-833 > URL: https://issues.apache.org/jira/browse/SUBMARINE-833 > Project: Apache Submarine > Issue Type: Improvement > Components: Security >Reporter: caozhiqiang >Priority: Critical > Labels: pull-request-available > Fix For: 0.7.0 > > > Now submarine-security/spark-security does not support ranger 2.1. When > compile submarine-spark-security with ranger 2.1, it will report Error: > [ERROR] > /root/submarine/submarine-security/spark-security/src/main/scala/org/apache/submarine/spark/security/RangerSparkPlugin.scala:32: > value getInstance is not a member of object > org.apache.ranger.authorization.hadoop.config.RangerConfiguration > [ERROR] private val rangerConf: RangerConfiguration = > RangerConfiguration.getInstance > [ERROR] ^ > [ERROR] > /root/submarine/submarine-security/spark-security/src/main/scala/org/apache/submarine/spark/security/RangerSparkPlugin.scala:36: > value getInstance is not a member of object > org.apache.ranger.authorization.hadoop.config.RangerConfiguration > [ERROR] lazy val fsScheme: Array[String] = RangerConfiguration.getInstance() > [ERROR] ^ > [ERROR] two errors found > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 31.613 s > [INFO] Finished at: 2021-05-17T11:51:41Z > [INFO] > > [ERROR] Failed to execute goal > net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on > project submarine-spark-security: Execution scala-compile-first of goal > net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.: CompileFailed -> > [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-999) Make the submarine related storage class into one single storage class
[ https://issues.apache.org/jira/browse/SUBMARINE-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-999. Fix Version/s: 0.6.0 Resolution: Fixed Issue resolved by pull request 727 [https://github.com/apache/submarine/pull/727] > Make the submarine related storage class into one single storage class > -- > > Key: SUBMARINE-999 > URL: https://issues.apache.org/jira/browse/SUBMARINE-999 > Project: Apache Submarine > Issue Type: Improvement >Reporter: Che-Kuang Chu >Assignee: Che-Kuang Chu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > There are five storage class in helm charts for submarine (server, database, > tensorboard, mlflow, minio, notebook). > However, they all have the same configurations, so we can just use one > storage class instead. > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-998) NanoID for experiment name
[ https://issues.apache.org/jira/browse/SUBMARINE-998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-998: --- Fix Version/s: 0.7.0 > NanoID for experiment name > -- > > Key: SUBMARINE-998 > URL: https://issues.apache.org/jira/browse/SUBMARINE-998 > Project: Apache Submarine > Issue Type: Bug > Components: Workbench >Reporter: You Ting Wang >Assignee: You Ting Wang >Priority: Major > Fix For: 0.7.0 > > > Nano id uses URL-friendly symbols (A-Za-z0-9_-), but experiment name didn't > accept "_". > So its character set need to be modify with > [nanoid-dictionary|https://github.com/CyberAP/nanoid-dictionary] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-893) Add submarine-operator e2e test case for create/delete submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-893: --- Fix Version/s: 0.6.0 > Add submarine-operator e2e test case for create/delete submarine > > > Key: SUBMARINE-893 > URL: https://issues.apache.org/jira/browse/SUBMARINE-893 > Project: Apache Submarine > Issue Type: New Feature >Reporter: Che-Kuang Chu >Assignee: Che-Kuang Chu >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > Add submarine-operator e2e test case for testing the following: > * Create a submarine CR > * Delete a submarine CR -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-986) Namespace-based multi-tenant submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-986: --- Fix Version/s: 0.7.0 > Namespace-based multi-tenant submarine > -- > > Key: SUBMARINE-986 > URL: https://issues.apache.org/jira/browse/SUBMARINE-986 > Project: Apache Submarine > Issue Type: New Feature >Reporter: Chi-Sheng Liu >Assignee: Chi-Sheng Liu >Priority: Major > Fix For: 0.7.0 > > > After discussion, we decided to implement the multi-tenant feature with > Kubernetes namespaces. We decided to use path-based routing to connect > services in different namespaces. > Tasks: > # Make sure all components work properly in different namespaces > # Configure path-based ingress routing for services across different > namespaces > # Configure RBAC rule and network policies for different namespaces -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-976) Configure path-based ingress routing for services across different namespaces
[ https://issues.apache.org/jira/browse/SUBMARINE-976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-976: --- Fix Version/s: 0.7.0 > Configure path-based ingress routing for services across different namespaces > - > > Key: SUBMARINE-976 > URL: https://issues.apache.org/jira/browse/SUBMARINE-976 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Chi-Sheng Liu >Assignee: Chi-Sheng Liu >Priority: Major > Fix For: 0.7.0 > > > Configure path-based ingress routing for services across different namespaces -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-988) [E2E test] templateIT
[ https://issues.apache.org/jira/browse/SUBMARINE-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-988: --- Fix Version/s: 0.7.0 > [E2E test] templateIT > - > > Key: SUBMARINE-988 > URL: https://issues.apache.org/jira/browse/SUBMARINE-988 > Project: Apache Submarine > Issue Type: New Feature > Components: E2E Test >Reporter: You Ting Wang >Priority: Major > Fix For: 0.7.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-987) Tags display in experiment list
[ https://issues.apache.org/jira/browse/SUBMARINE-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-987: --- Fix Version/s: 0.7.0 > Tags display in experiment list > --- > > Key: SUBMARINE-987 > URL: https://issues.apache.org/jira/browse/SUBMARINE-987 > Project: Apache Submarine > Issue Type: New Feature > Components: Workbench >Reporter: You Ting Wang >Assignee: You Ting Wang >Priority: Major > Fix For: 0.7.0 > > > Tag created when creating an experiment should also display in the list of > experiment . -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-983) Add model service test
[ https://issues.apache.org/jira/browse/SUBMARINE-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-983: --- Target Version: 0.7.0 > Add model service test > -- > > Key: SUBMARINE-983 > URL: https://issues.apache.org/jira/browse/SUBMARINE-983 > Project: Apache Submarine > Issue Type: Task > Components: model management >Reporter: Jhan-Shuo, Liu >Assignee: Jhan-Shuo, Liu >Priority: Major > > Add test of model service and create a test db for it. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-960) Discussion Apache Submarine next
[ https://issues.apache.org/jira/browse/SUBMARINE-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-960: --- Target Version: 0.7.0 > Discussion Apache Submarine next > - > > Key: SUBMARINE-960 > URL: https://issues.apache.org/jira/browse/SUBMARINE-960 > Project: Apache Submarine > Issue Type: Task >Reporter: Zhankun Tang >Priority: Major > > I wrapped up a doc about MLOps and submarine to discuss what's our next > priorities. > [https://docs.google.com/document/d/1UxIOHfe48tyAP2H2tcpZ0VBUq68EMsvwa764EyjIOmg/edit?usp=sharing] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-949) [Umbrella] Refactor and stabilize experiment service in submarine-server
[ https://issues.apache.org/jira/browse/SUBMARINE-949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-949: --- Target Version: 0.7.0 (was: 0.6.0) > [Umbrella] Refactor and stabilize experiment service in submarine-server > > > Key: SUBMARINE-949 > URL: https://issues.apache.org/jira/browse/SUBMARINE-949 > Project: Apache Submarine > Issue Type: Improvement > Components: Backend Server, experiment >Reporter: Kai-Hsun Chen >Assignee: Kai-Hsun Chen >Priority: Major > Fix For: 0.6.0 > > > Now, the experiment service is the most important feature in Apache > Submarine. However, the service is not stable and not user-friendly. For > example, > (1) The frontend workbench cannot reflect the actual experiment status. (ex: > OOM) > (2) The server misses some constraints in Kubernetes Java Client. (ex: If the > experiment name contains the character "_", the k8s java API will throw an > exception.) > (3) Unexpected out-of-memory error: It is very inconvenient for users to > predict the actual memory usage before running the experiment. Thus, using > the memory request and memory limit mechanism to allow overcommitment of > memory is helpful for users. > (4) Allow users to create experiments with the same name, and they can > retrieve these experiments with the name. > (5) Set different tags on experiments to divide them into categories, and > thus users can retrieve these experiments with tags. > (6) The K8sSubmitter will submit an experiment to the Kubernetes cluster when > it is created, no matter how much resource quota is left. > > With these reasons, it is necessary to refactor and stabilize experiment > service in submarine-server. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-929) Update github readme
[ https://issues.apache.org/jira/browse/SUBMARINE-929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-929. Assignee: Kevin Su Resolution: Fixed > Update github readme > > > Key: SUBMARINE-929 > URL: https://issues.apache.org/jira/browse/SUBMARINE-929 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Byron Hsu >Assignee: Kevin Su >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-949) [Umbrella] Refactor and stabilize experiment service in submarine-server
[ https://issues.apache.org/jira/browse/SUBMARINE-949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-949. Resolution: Fixed > [Umbrella] Refactor and stabilize experiment service in submarine-server > > > Key: SUBMARINE-949 > URL: https://issues.apache.org/jira/browse/SUBMARINE-949 > Project: Apache Submarine > Issue Type: Improvement > Components: Backend Server, experiment >Reporter: Kai-Hsun Chen >Assignee: Kai-Hsun Chen >Priority: Major > Fix For: 0.6.0 > > > Now, the experiment service is the most important feature in Apache > Submarine. However, the service is not stable and not user-friendly. For > example, > (1) The frontend workbench cannot reflect the actual experiment status. (ex: > OOM) > (2) The server misses some constraints in Kubernetes Java Client. (ex: If the > experiment name contains the character "_", the k8s java API will throw an > exception.) > (3) Unexpected out-of-memory error: It is very inconvenient for users to > predict the actual memory usage before running the experiment. Thus, using > the memory request and memory limit mechanism to allow overcommitment of > memory is helpful for users. > (4) Allow users to create experiments with the same name, and they can > retrieve these experiments with the name. > (5) Set different tags on experiments to divide them into categories, and > thus users can retrieve these experiments with tags. > (6) The K8sSubmitter will submit an experiment to the Kubernetes cluster when > it is created, no matter how much resource quota is left. > > With these reasons, it is necessary to refactor and stabilize experiment > service in submarine-server. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-723) [Umbrella] Refactor Submarine documents
[ https://issues.apache.org/jira/browse/SUBMARINE-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-723: --- Target Version: 0.6.0 (was: 0.7.0) > [Umbrella] Refactor Submarine documents > --- > > Key: SUBMARINE-723 > URL: https://issues.apache.org/jira/browse/SUBMARINE-723 > Project: Apache Submarine > Issue Type: Improvement > Components: Doc >Reporter: Kevin Su >Priority: Major > Fix For: 0.6.0 > > > Goal: > * Sort documents into three categories (Admin, user, developer) > * Use [https://v2.docusaurus.io/docs/installation] to deploy the Submarine > website > * Remove some outdated and empty documents > * Add more tutorial or example (CTR, SDK, experiment, experiment-template) > * Improve development documentation (How to debug Submarine server) > * Improve admin docs (Deploy Submarine in the production environment) > Preview the website: [https://submarine.apache.org/] > *Feel free to create a Jira ticket under this umbrella issue.* -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-723) [Umbrella] Refactor Submarine documents
[ https://issues.apache.org/jira/browse/SUBMARINE-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-723. Resolution: Fixed > [Umbrella] Refactor Submarine documents > --- > > Key: SUBMARINE-723 > URL: https://issues.apache.org/jira/browse/SUBMARINE-723 > Project: Apache Submarine > Issue Type: Improvement > Components: Doc >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Major > Fix For: 0.6.0 > > > Goal: > * Sort documents into three categories (Admin, user, developer) > * Use [https://v2.docusaurus.io/docs/installation] to deploy the Submarine > website > * Remove some outdated and empty documents > * Add more tutorial or example (CTR, SDK, experiment, experiment-template) > * Improve development documentation (How to debug Submarine server) > * Improve admin docs (Deploy Submarine in the production environment) > Preview the website: [https://submarine.apache.org/] > *Feel free to create a Jira ticket under this umbrella issue.* -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Assigned] (SUBMARINE-723) [Umbrella] Refactor Submarine documents
[ https://issues.apache.org/jira/browse/SUBMARINE-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su reassigned SUBMARINE-723: -- Assignee: Kevin Su > [Umbrella] Refactor Submarine documents > --- > > Key: SUBMARINE-723 > URL: https://issues.apache.org/jira/browse/SUBMARINE-723 > Project: Apache Submarine > Issue Type: Improvement > Components: Doc >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Major > Fix For: 0.6.0 > > > Goal: > * Sort documents into three categories (Admin, user, developer) > * Use [https://v2.docusaurus.io/docs/installation] to deploy the Submarine > website > * Remove some outdated and empty documents > * Add more tutorial or example (CTR, SDK, experiment, experiment-template) > * Improve development documentation (How to debug Submarine server) > * Improve admin docs (Deploy Submarine in the production environment) > Preview the website: [https://submarine.apache.org/] > *Feel free to create a Jira ticket under this umbrella issue.* -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-907) Remove hard-coded namespace from ServeRequest Spec
[ https://issues.apache.org/jira/browse/SUBMARINE-907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-907: --- Target Version: 0.7.0 > Remove hard-coded namespace from ServeRequest Spec > -- > > Key: SUBMARINE-907 > URL: https://issues.apache.org/jira/browse/SUBMARINE-907 > Project: Apache Submarine > Issue Type: Sub-task > Components: experiment >Reporter: Byron Hsu >Assignee: Jhan-Shuo, Liu >Priority: Major > > We should not pass the namespace [in > spec|https://github.com/apache/submarine/blob/master/submarine-server/server-submitter/submitter-k8s/src/main/java/org/apache/submarine/server/submitter/k8s/K8sSubmitter.java#L476]. > Instead, we should consume the namespace from an environment variable (refer > to [this > PR|https://github.com/apache/submarine/commit/654598bdfdab6f63496a02e00cc45f9e5575fc39]). -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-699) Reduce existing Docker images size
[ https://issues.apache.org/jira/browse/SUBMARINE-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-699: --- Fix Version/s: (was: 0.6.0) 0.7.0 > Reduce existing Docker images size > --- > > Key: SUBMARINE-699 > URL: https://issues.apache.org/jira/browse/SUBMARINE-699 > Project: Apache Submarine > Issue Type: Improvement >Reporter: Kai-Hsun Chen >Assignee: Kai-Hsun Chen >Priority: Major > Fix For: 0.7.0 > > > Existing docker images are too large. We need to optimize the Dockerfiles to > reduce images' size. > > Dockerfile in github repo: > https://github.com/apache/submarine/tree/master/dev-support/docker-images?fbclid=IwAR2HtCLn8mcNkpRP24C8vd4W6x2p1xVkPvvpmRjbi0_OeAzwMH2Ub73q7ic -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-184) PyTorch support for Tensorboard in yarnservice-runtime
[ https://issues.apache.org/jira/browse/SUBMARINE-184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-184. Resolution: Won't Fix > PyTorch support for Tensorboard in yarnservice-runtime > -- > > Key: SUBMARINE-184 > URL: https://issues.apache.org/jira/browse/SUBMARINE-184 > Project: Apache Submarine > Issue Type: Improvement >Reporter: Kevin Su >Assignee: Kevin Su >Priority: Major > > PyTorch 1.1 announced support for TensorBoard. > [https://pytorch.org/docs/stable/tensorboard.html] > [https://github.com/pytorch/pytorch/releases] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-756) Submarine Sandbox
[ https://issues.apache.org/jira/browse/SUBMARINE-756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-756: --- Fix Version/s: 0.7.0 > Submarine Sandbox > - > > Key: SUBMARINE-756 > URL: https://issues.apache.org/jira/browse/SUBMARINE-756 > Project: Apache Submarine > Issue Type: New Feature > Components: Mini Submarine >Reporter: Kevin Su >Assignee: Chi-Sheng Liu >Priority: Major > Fix For: 0.7.0 > > > Currently, we need to install *kubectl*, *helm*, *java*, *maven, kind or > minikube* when new users try to install Submarine on the local machine. > [https://submarine.apache.org/docs/] > We could leverage [https://github.com/rancher/k3d] to install k8s and all > other dependencies in a single docker file so that we could use one command > (like *docker run -p 32080 32080 apache/submarine-sandbox:latest*)to launch > the entire submarine cluster. In addition, k3d is more lightweight than > minikube and kind. > This feature will be very useful for development and testing in the future. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-762) [Umbrella] Submarine Environment Refactor
[ https://issues.apache.org/jira/browse/SUBMARINE-762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-762: --- Target Version: 0.6.0 (was: 0.7.0) > [Umbrella] Submarine Environment Refactor > - > > Key: SUBMARINE-762 > URL: https://issues.apache.org/jira/browse/SUBMARINE-762 > Project: Apache Submarine > Issue Type: New Feature > Components: Backend Server, Workbench >Reporter: Kevin Su >Assignee: KUAN-HSUN-LI >Priority: Major > Fix For: 0.6.0 > > > * Support users uploading or dragging the config file to the Workbench > * Support users download the config file from the workbench, so they can > reproduce the same environment in their local PC > * Support parsing pip dependency in submarine server > > Design doc: > [https://docs.google.com/document/d/1ELJKJfMccOy-JlwUpTYa7CptYJeSycLZNhAmps7wufk/edit?usp=sharing] > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-352) REST APIs for POST job submission on YARN
[ https://issues.apache.org/jira/browse/SUBMARINE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-352. Resolution: Won't Fix > REST APIs for POST job submission on YARN > - > > Key: SUBMARINE-352 > URL: https://issues.apache.org/jira/browse/SUBMARINE-352 > Project: Apache Submarine > Issue Type: Sub-task > Components: Backend Server >Reporter: Adrian Hsu >Assignee: Adrian Hsu >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-351) [Umbrella] Support Job Management (e.g., submission) on YARN by REST APIs
[ https://issues.apache.org/jira/browse/SUBMARINE-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-351. Resolution: Won't Fix > [Umbrella] Support Job Management (e.g., submission) on YARN by REST APIs > - > > Key: SUBMARINE-351 > URL: https://issues.apache.org/jira/browse/SUBMARINE-351 > Project: Apache Submarine > Issue Type: New Feature > Components: Backend Server >Reporter: Adrian Hsu >Priority: Major > > this issue is now unassigned. [2020.04.21] > > This JIRA provides REST APIs for YARN to accept the generic job spec and > manages jobs, based on the SUBMARINE-224 (says, the REST APIs for K8s). Also, > this Issue follows the design of Submarine Server > ([https://docs.google.com/document/d/1vCjt2z3DoagfeaVQV0nfyWqSYLymoP53rDcPcz-YcSc/edit]) > provided by SUBMARINE-224. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-762) [Umbrella] Submarine Environment Refactor
[ https://issues.apache.org/jira/browse/SUBMARINE-762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-762. Resolution: Fixed > [Umbrella] Submarine Environment Refactor > - > > Key: SUBMARINE-762 > URL: https://issues.apache.org/jira/browse/SUBMARINE-762 > Project: Apache Submarine > Issue Type: New Feature > Components: Backend Server, Workbench >Reporter: Kevin Su >Assignee: KUAN-HSUN-LI >Priority: Major > Fix For: 0.6.0 > > > * Support users uploading or dragging the config file to the Workbench > * Support users download the config file from the workbench, so they can > reproduce the same environment in their local PC > * Support parsing pip dependency in submarine server > > Design doc: > [https://docs.google.com/document/d/1ELJKJfMccOy-JlwUpTYa7CptYJeSycLZNhAmps7wufk/edit?usp=sharing] > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-354) GET job submission
[ https://issues.apache.org/jira/browse/SUBMARINE-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-354. Resolution: Won't Fix > GET job submission > -- > > Key: SUBMARINE-354 > URL: https://issues.apache.org/jira/browse/SUBMARINE-354 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Adrian Hsu >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Resolved] (SUBMARINE-353) DELETE job submission
[ https://issues.apache.org/jira/browse/SUBMARINE-353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su resolved SUBMARINE-353. Resolution: Won't Fix > DELETE job submission > - > > Key: SUBMARINE-353 > URL: https://issues.apache.org/jira/browse/SUBMARINE-353 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Adrian Hsu >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-988) [E2E test] templateIT
[ https://issues.apache.org/jira/browse/SUBMARINE-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-988: --- Fix Version/s: (was: 0.7.0) Target Version: 0.7.0 > [E2E test] templateIT > - > > Key: SUBMARINE-988 > URL: https://issues.apache.org/jira/browse/SUBMARINE-988 > Project: Apache Submarine > Issue Type: New Feature > Components: E2E Test >Reporter: You Ting Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-998) NanoID for experiment name
[ https://issues.apache.org/jira/browse/SUBMARINE-998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-998: --- Fix Version/s: (was: 0.7.0) Target Version: 0.7.0 > NanoID for experiment name > -- > > Key: SUBMARINE-998 > URL: https://issues.apache.org/jira/browse/SUBMARINE-998 > Project: Apache Submarine > Issue Type: Bug > Components: Workbench >Reporter: You Ting Wang >Assignee: You Ting Wang >Priority: Major > > Nano id uses URL-friendly symbols (A-Za-z0-9_-), but experiment name didn't > accept "_". > So its character set need to be modify with > [nanoid-dictionary|https://github.com/CyberAP/nanoid-dictionary] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-989) Add error message of invalid notebook name
[ https://issues.apache.org/jira/browse/SUBMARINE-989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-989: --- Target Version: 0.6.0 > Add error message of invalid notebook name > -- > > Key: SUBMARINE-989 > URL: https://issues.apache.org/jira/browse/SUBMARINE-989 > Project: Apache Submarine > Issue Type: Bug > Components: Workbench Notebook >Reporter: Jhan-Shuo, Liu >Assignee: Jhan-Shuo, Liu >Priority: Major > Attachments: Screenshot from 2021-08-18 20-43-50.png > > > Add the error message of invalid notebook name in workbench. > !Screenshot from 2021-08-18 20-43-50.png|width=308,height=223! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-989) Add error message of invalid notebook name
[ https://issues.apache.org/jira/browse/SUBMARINE-989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-989: --- Fix Version/s: 0.6.0 > Add error message of invalid notebook name > -- > > Key: SUBMARINE-989 > URL: https://issues.apache.org/jira/browse/SUBMARINE-989 > Project: Apache Submarine > Issue Type: Bug > Components: Workbench Notebook >Reporter: Jhan-Shuo, Liu >Assignee: Jhan-Shuo, Liu >Priority: Major > Fix For: 0.6.0 > > Attachments: Screenshot from 2021-08-18 20-43-50.png > > > Add the error message of invalid notebook name in workbench. > !Screenshot from 2021-08-18 20-43-50.png|width=308,height=223! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-980) Upload code coverage to SonarCloud
[ https://issues.apache.org/jira/browse/SUBMARINE-980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-980: --- Target Version: 0.6.0 (was: 0.7.0) > Upload code coverage to SonarCloud > -- > > Key: SUBMARINE-980 > URL: https://issues.apache.org/jira/browse/SUBMARINE-980 > Project: Apache Submarine > Issue Type: Improvement > Components: CI/CD >Reporter: Kevin Su >Assignee: Lisa Chang >Priority: Major > > We should generate a code coverage report by ourselves, SonarCloud will not > help us do that. > refer to: > [https://github.com/apache/ozone/blob/master/hadoop-ozone/dev-support/checks/coverage.sh] > [https://sonarcloud.io/dashboard?id=apache_submarine] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-980) Upload code coverage to SonarCloud
[ https://issues.apache.org/jira/browse/SUBMARINE-980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-980: --- Fix Version/s: 0.6.0 > Upload code coverage to SonarCloud > -- > > Key: SUBMARINE-980 > URL: https://issues.apache.org/jira/browse/SUBMARINE-980 > Project: Apache Submarine > Issue Type: Improvement > Components: CI/CD >Reporter: Kevin Su >Assignee: Lisa Chang >Priority: Major > Fix For: 0.6.0 > > > We should generate a code coverage report by ourselves, SonarCloud will not > help us do that. > refer to: > [https://github.com/apache/ozone/blob/master/hadoop-ozone/dev-support/checks/coverage.sh] > [https://sonarcloud.io/dashboard?id=apache_submarine] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-1000) Add submarine save model method
[ https://issues.apache.org/jira/browse/SUBMARINE-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-1000: Fix Version/s: (was: 0.7.0) Target Version: 0.7.0 > Add submarine save model method > --- > > Key: SUBMARINE-1000 > URL: https://issues.apache.org/jira/browse/SUBMARINE-1000 > Project: Apache Submarine > Issue Type: New Feature > Components: model management >Reporter: Jhan-Shuo, Liu >Assignee: Jhan-Shuo, Liu >Priority: Major > > Add the submarine save model method. The user can set the environment > variable to choose which saving method he wants to use. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-915) Release 0.6.0
[ https://issues.apache.org/jira/browse/SUBMARINE-915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-915: --- Target Version: 0.6.0 > Release 0.6.0 > - > > Key: SUBMARINE-915 > URL: https://issues.apache.org/jira/browse/SUBMARINE-915 > Project: Apache Submarine > Issue Type: Task >Reporter: Wei-Chiu Chuang >Assignee: Wei-Chiu Chuang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
[jira] [Updated] (SUBMARINE-916) Generate release note
[ https://issues.apache.org/jira/browse/SUBMARINE-916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SUBMARINE-916: --- Target Version: 0.6.0 > Generate release note > - > > Key: SUBMARINE-916 > URL: https://issues.apache.org/jira/browse/SUBMARINE-916 > Project: Apache Submarine > Issue Type: Sub-task >Reporter: Wei-Chiu Chuang >Assignee: Wei-Chiu Chuang >Priority: Major > > We should create a script to generate a release note that lists features, > improvements and bugs fixed in the release. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org For additional commands, e-mail: dev-h...@submarine.apache.org
