[jira] [Commented] (SUBMARINE-84) The environment variable TF_CONFIG hard coded port number "8000" will cause distributed training job's worker fail to start
[ https://issues.apache.org/jira/browse/SUBMARINE-84?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900620#comment-16900620 ] Sunil Govindan commented on SUBMARINE-84: - We have to create an INFRA Jira to identify the jenkins slave from where it pulls a non-related old jar files. cc [~adam.antal] and [~snemeth]. Could we some how get host details, and we can create an INFRA Jira to wipe the m2 repo. > The environment variable TF_CONFIG hard coded port number "8000" will cause > distributed training job's worker fail to start > --- > > Key: SUBMARINE-84 > URL: https://issues.apache.org/jira/browse/SUBMARINE-84 > Project: Hadoop Submarine > Issue Type: Improvement >Reporter: Zhankun Tang >Assignee: kevin su >Priority: Critical > Attachments: SUBMARINE-84.001.patch > > > When there's no network virtualization solution like Calico deployed, the > hard-coded 8000 port conflicts may cause worker/ps container gRPC server > fails to start if they were allocated to one host and use host network. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (SUBMARINE-84) The environment variable TF_CONFIG hard coded port number "8000" will cause distributed training job's worker fail to start
[
https://issues.apache.org/jira/browse/SUBMARINE-84?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900570#comment-16900570
]
Hadoop QA commented on SUBMARINE-84:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 1m
22s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 19m
30s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
18s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 13s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine-yarnservice-runtime {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
15s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 3s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
15s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 12m
35s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
15s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 11s{color}
| {color:red} hadoop-submarine-yarnservice-runtime in the patch failed. {color}
|
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 9s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine-yarnservice-runtime {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 13s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
14s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
13s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 0m 13s{color}
| {color:red} hadoop-submarine-yarnservice-runtime in the patch failed. {color}
|
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
37s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 50m 5s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.1 Server=19.03.1 base:
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/169/artifact/out/Dockerfile
|
| JIRA Issue | SUBMARINE-84 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12976769/SUBMARINE-84.001.patch
|
| Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite
unit shadedclient findbugs checkstyle |
| uname | Linux 7593e4e80c91 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3
08:28:49 UTC 2019
[jira] [Created] (SUBMARINE-111) [WEB] Submarine web Job page
Xun Liu created SUBMARINE-111: - Summary: [WEB] Submarine web Job page Key: SUBMARINE-111 URL: https://issues.apache.org/jira/browse/SUBMARINE-111 Project: Hadoop Submarine Issue Type: Sub-task Reporter: Xun Liu Assignee: Xun Liu A job is a way of running a notebook or JAR either immediately or on a scheduled basis. You can create and run jobs using the UI, the CLI, and by invoking the Jobs API. Similarly, you can monitor job run results in the UI, using the CLI, by querying the API, and through email alerts. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (SUBMARINE-110) [WEB] Submarine web Actuator page
[ https://issues.apache.org/jira/browse/SUBMARINE-110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu resolved SUBMARINE-110. --- Resolution: Fixed > [WEB] Submarine web Actuator page > - > > Key: SUBMARINE-110 > URL: https://issues.apache.org/jira/browse/SUBMARINE-110 > Project: Hadoop Submarine > Issue Type: Sub-task >Reporter: Xun Liu >Assignee: Xun Liu >Priority: Major > Attachments: image-2019-08-06-00-49-46-371.png > > > # Submarine Actuator provide a unified platform for various use cases such as > running production ETL pipelines, streaming analytics, ad-hoc analytics, and > machine learning. > # Submarine has two types of Actuator: interactive and job. You use > interactive Actuator to analyze data collaboratively with interactive > notebooks. You use job Actuator to run fast and robust automated jobs. > > !image-2019-08-06-00-49-46-371.png|width=879,height=704! -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (SUBMARINE-110) [WEB] Submarine web Actuator page
[ https://issues.apache.org/jira/browse/SUBMARINE-110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu updated SUBMARINE-110: -- Description: # Submarine Actuator provide a unified platform for various use cases such as running production ETL pipelines, streaming analytics, ad-hoc analytics, and machine learning. # Submarine has two types of Actuator: interactive and job. You use interactive Actuator to analyze data collaboratively with interactive notebooks. You use job Actuator to run fast and robust automated jobs. !image-2019-08-06-00-49-46-371.png|width=879,height=704! was:!image-2019-08-06-00-49-46-371.png|width=879,height=704! > [WEB] Submarine web Actuator page > - > > Key: SUBMARINE-110 > URL: https://issues.apache.org/jira/browse/SUBMARINE-110 > Project: Hadoop Submarine > Issue Type: Sub-task >Reporter: Xun Liu >Assignee: Xun Liu >Priority: Major > Attachments: image-2019-08-06-00-49-46-371.png > > > # Submarine Actuator provide a unified platform for various use cases such as > running production ETL pipelines, streaming analytics, ad-hoc analytics, and > machine learning. > # Submarine has two types of Actuator: interactive and job. You use > interactive Actuator to analyze data collaboratively with interactive > notebooks. You use job Actuator to run fast and robust automated jobs. > > !image-2019-08-06-00-49-46-371.png|width=879,height=704! -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (SUBMARINE-84) The environment variable TF_CONFIG hard coded port number "8000" will cause distributed training job's worker fail to start
[ https://issues.apache.org/jira/browse/SUBMARINE-84?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevin su updated SUBMARINE-84: -- Attachment: SUBMARINE-84.001.patch Status: Patch Available (was: Open) > The environment variable TF_CONFIG hard coded port number "8000" will cause > distributed training job's worker fail to start > --- > > Key: SUBMARINE-84 > URL: https://issues.apache.org/jira/browse/SUBMARINE-84 > Project: Hadoop Submarine > Issue Type: Improvement >Reporter: Zhankun Tang >Assignee: kevin su >Priority: Critical > Attachments: SUBMARINE-84.001.patch > > > When there's no network virtualization solution like Calico deployed, the > hard-coded 8000 port conflicts may cause worker/ps container gRPC server > fails to start if they were allocated to one host and use host network. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (SUBMARINE-110) [WEB] Submarine web Actuator page
[ https://issues.apache.org/jira/browse/SUBMARINE-110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu updated SUBMARINE-110: -- Attachment: image-2019-08-06-00-49-46-371.png Description: !image-2019-08-06-00-49-46-371.png|width=879,height=704! > [WEB] Submarine web Actuator page > - > > Key: SUBMARINE-110 > URL: https://issues.apache.org/jira/browse/SUBMARINE-110 > Project: Hadoop Submarine > Issue Type: Sub-task >Reporter: Xun Liu >Assignee: Xun Liu >Priority: Major > Attachments: image-2019-08-06-00-49-46-371.png > > > !image-2019-08-06-00-49-46-371.png|width=879,height=704! -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (SUBMARINE-110) [WEB] Submarine web Actuator page
Xun Liu created SUBMARINE-110: - Summary: [WEB] Submarine web Actuator page Key: SUBMARINE-110 URL: https://issues.apache.org/jira/browse/SUBMARINE-110 Project: Hadoop Submarine Issue Type: Sub-task Reporter: Xun Liu Assignee: Xun Liu -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (SUBMARINE-106) [WEB] Submarine web workspace/project page
[ https://issues.apache.org/jira/browse/SUBMARINE-106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu resolved SUBMARINE-106. --- Resolution: Fixed > [WEB] Submarine web workspace/project page > -- > > Key: SUBMARINE-106 > URL: https://issues.apache.org/jira/browse/SUBMARINE-106 > Project: Hadoop Submarine > Issue Type: Sub-task >Reporter: Xun Liu >Assignee: Xun Liu >Priority: Major > Attachments: image-2019-08-05-19-26-32-765.png > > > 1. Add a tab page to the workspace page. > 2. Add a project subpage to the tab page > 3. Display all the user's project on the project page. > 4. By clicking on the project tree directory on the left, the corresponding > file list will be displayed on the right. > > !image-2019-08-05-19-26-32-765.png|width=602,height=486! -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (SUBMARINE-106) [WEB] Submarine web workspace/project page
[ https://issues.apache.org/jira/browse/SUBMARINE-106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu updated SUBMARINE-106: -- Attachment: image-2019-08-05-19-26-32-765.png Description: 1. Add a tab page to the workspace page. 2. Add a project subpage to the tab page 3. Display all the user's project on the project page. 4. By clicking on the project tree directory on the left, the corresponding file list will be displayed on the right. !image-2019-08-05-19-26-32-765.png|width=602,height=486! > [WEB] Submarine web workspace/project page > -- > > Key: SUBMARINE-106 > URL: https://issues.apache.org/jira/browse/SUBMARINE-106 > Project: Hadoop Submarine > Issue Type: Sub-task >Reporter: Xun Liu >Assignee: Xun Liu >Priority: Major > Attachments: image-2019-08-05-19-26-32-765.png > > > 1. Add a tab page to the workspace page. > 2. Add a project subpage to the tab page > 3. Display all the user's project on the project page. > 4. By clicking on the project tree directory on the left, the corresponding > file list will be displayed on the right. > > !image-2019-08-05-19-26-32-765.png|width=602,height=486! -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (SUBMARINE-106) [WEB] Submarine web workspace/project page
[ https://issues.apache.org/jira/browse/SUBMARINE-106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu updated SUBMARINE-106: -- Summary: [WEB] Submarine web workspace/project page (was: [WEB] Submarine web workspace page) > [WEB] Submarine web workspace/project page > -- > > Key: SUBMARINE-106 > URL: https://issues.apache.org/jira/browse/SUBMARINE-106 > Project: Hadoop Submarine > Issue Type: Sub-task >Reporter: Xun Liu >Assignee: Xun Liu >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Assigned] (SUBMARINE-109) [WEB] Submarine LOGO & PageHead & PageFooter
[ https://issues.apache.org/jira/browse/SUBMARINE-109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu reassigned SUBMARINE-109: - Assignee: Xun Liu > [WEB] Submarine LOGO & PageHead & PageFooter > > > Key: SUBMARINE-109 > URL: https://issues.apache.org/jira/browse/SUBMARINE-109 > Project: Hadoop Submarine > Issue Type: Sub-task >Reporter: Xun Liu >Assignee: Xun Liu >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (SUBMARINE-109) [WEB] Submarine LOGO & PageHead & PageFooter
[ https://issues.apache.org/jira/browse/SUBMARINE-109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu resolved SUBMARINE-109. --- Resolution: Fixed > [WEB] Submarine LOGO & PageHead & PageFooter > > > Key: SUBMARINE-109 > URL: https://issues.apache.org/jira/browse/SUBMARINE-109 > Project: Hadoop Submarine > Issue Type: Sub-task >Reporter: Xun Liu >Assignee: Xun Liu >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
