[jira] [Comment Edited] (YARN-8873) [YARN-8811] Add CSI java-based client library
[
https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663141#comment-16663141
]
Weiwei Yang edited comment on YARN-8873 at 10/25/18 3:14 AM:
-
The error [~anu] pointed out in the trunk-commit job seems irrelevant, I saw
similar problems in
[https://builds.apache.org/job/Hadoop-trunk-Commit/15307/consoleText]
[https://builds.apache.org/job/Hadoop-trunk-Commit/15306/consoleText]
Looks like this job is executed on a jenkins slave machine without using a
docker image. From some other log (successful ones) I can see:
{noformat}
Sending build context to Docker daemon 13.82kB
...
---> c5ed970306a4 Step 13/31 : RUN mkdir -p /opt/protobuf-src && curl -L -s -S
https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz
-o /opt/protobuf.tar.gz && tar xzf /opt/protobuf.tar.gz --strip-components 1
-C /opt/protobuf-src && cd /opt/protobuf-src && ./configure
--prefix=/opt/protobuf && make install && cd /root && rm -rf /opt/protobuf-src
{noformat}
that will make sure the build env has correct version of protobuf 2.5.0.
However on the jenkins slave {color:#d04437}*H19*{color}, it seems to the
installed protoc version is 2.6.1, that's why pre-commit jobs were all failing
on this slave.
Apart from this, the issue happened to [~arpitagarwal] seems to be different...
was (Author: cheersyang):
The error [~anu] pointed out in the trunk-commit job seems irrelevant, I saw
similar problems in
[https://builds.apache.org/job/Hadoop-trunk-Commit/15307/consoleText]
[https://builds.apache.org/job/Hadoop-trunk-Commit/15306/consoleText]
Looks like this job is executed on a jenkins slave machine without using a
docker image. From some other log (successful ones) I can see:
{noformat}
Sending build context to Docker daemon 13.82kB
...
---> c5ed970306a4 Step 13/31 : RUN mkdir -p /opt/protobuf-src && curl -L -s -S
https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz
-o /opt/protobuf.tar.gz && tar xzf /opt/protobuf.tar.gz --strip-components 1
-C /opt/protobuf-src && cd /opt/protobuf-src && ./configure
--prefix=/opt/protobuf && make install && cd /root && rm -rf /opt/protobuf-src
{noformat}
that will make sure the build env has correct version of protobuf 2.5.0.
However on the jenkins slave {color:#d04437}*H19*{color}, it seems to the
installed protoc version is 2.6.1, that's why pre-commit jobs were all failing
on this slave.
> [YARN-8811] Add CSI java-based client library
> -
>
> Key: YARN-8873
> URL: https://issues.apache.org/jira/browse/YARN-8873
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Weiwei Yang
>Assignee: Weiwei Yang
>Priority: Major
> Fix For: 3.3.0
>
> Attachments: YARN-8873.001.patch, YARN-8873.002.patch,
> YARN-8873.003.patch, YARN-8873.004.patch, YARN-8873.005.patch,
> YARN-8873.006.patch
>
>
> Build a java-based client to talk to CSI drivers, through CSI gRPC services.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-8873) [YARN-8811] Add CSI java-based client library
[
https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663141#comment-16663141
]
Weiwei Yang edited comment on YARN-8873 at 10/25/18 3:12 AM:
-
The error [~anu] pointed out in the trunk-commit job seems irrelevant, I saw
similar problems in
[https://builds.apache.org/job/Hadoop-trunk-Commit/15307/consoleText]
[https://builds.apache.org/job/Hadoop-trunk-Commit/15306/consoleText]
Looks like this job is executed on a jenkins slave machine without using a
docker image. From some other log (successful ones) I can see:
{noformat}
Sending build context to Docker daemon 13.82kB
...
---> c5ed970306a4 Step 13/31 : RUN mkdir -p /opt/protobuf-src && curl -L -s -S
https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz
-o /opt/protobuf.tar.gz && tar xzf /opt/protobuf.tar.gz --strip-components 1
-C /opt/protobuf-src && cd /opt/protobuf-src && ./configure
--prefix=/opt/protobuf && make install && cd /root && rm -rf /opt/protobuf-src
{noformat}
that will make sure the build env has correct version of protobuf 2.5.0.
However on the jenkins slave {color:#d04437}*H19*{color}, it seems to the
installed protoc version is 2.6.1, that's why pre-commit jobs were all failing
on this slave.
was (Author: cheersyang):
The error [~anu] pointed out in the trunk-commit job seems irrelevant, I saw
similar problems in
[https://builds.apache.org/job/Hadoop-trunk-Commit/15307/consoleText]
[https://builds.apache.org/job/Hadoop-trunk-Commit/15306/consoleText]
Looks like this job is executed on a jenkins slave machine without using a
docker image. From some other log (successful ones) I can see:
{noformat}
Sending build context to Docker daemon 13.82kB
...
---> c5ed970306a4 Step 13/31 : RUN mkdir -p /opt/protobuf-src && curl -L -s -S
https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz
-o /opt/protobuf.tar.gz && tar xzf /opt/protobuf.tar.gz --strip-components 1
-C /opt/protobuf-src && cd /opt/protobuf-src && ./configure
--prefix=/opt/protobuf && make install && cd /root && rm -rf /opt/protobuf-src
{noformat}
that will make sure the build env has correct version of protobuf 2.5.0.
However on the jenkins slave {color:#d04437}*H19*{color}, it seems to the
installed protoc version is 2.6.1, that's why pre-commit jobs were all failing
on this slave.
> [YARN-8811] Add CSI java-based client library
> -
>
> Key: YARN-8873
> URL: https://issues.apache.org/jira/browse/YARN-8873
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Weiwei Yang
>Assignee: Weiwei Yang
>Priority: Major
> Fix For: 3.3.0
>
> Attachments: YARN-8873.001.patch, YARN-8873.002.patch,
> YARN-8873.003.patch, YARN-8873.004.patch, YARN-8873.005.patch,
> YARN-8873.006.patch
>
>
> Build a java-based client to talk to CSI drivers, through CSI gRPC services.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-8873) [YARN-8811] Add CSI java-based client library
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663111#comment-16663111 ] Weiwei Yang edited comment on YARN-8873 at 10/25/18 2:32 AM: - Thanks [~anu], [~arpitagarwal]. I tried on both OSX and centos 7.5, no failure. Strange thing is the error in [https://builds.apache.org/job/Hadoop-trunk-Commit/15290/console] was on hadoop-common, not in hadoop-yarn-csi module, not sure about why ... Let me investigate more, thanks was (Author: cheersyang): Thanks [~anu], [~arpitagarwal]. I tried on both OSX and centos 7.5, no failure. Strange thing is the error in [https://builds.apache.org/job/Hadoop-trunk-Commit/15290/console] was on hadoop-common, not in hadoop-yarn-csi module, not sure about why ... Let me investigate more, thanks > [YARN-8811] Add CSI java-based client library > - > > Key: YARN-8873 > URL: https://issues.apache.org/jira/browse/YARN-8873 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Weiwei Yang >Assignee: Weiwei Yang >Priority: Major > Fix For: 3.3.0 > > Attachments: YARN-8873.001.patch, YARN-8873.002.patch, > YARN-8873.003.patch, YARN-8873.004.patch, YARN-8873.005.patch, > YARN-8873.006.patch > > > Build a java-based client to talk to CSI drivers, through CSI gRPC services. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-8873) [YARN-8811] Add CSI java-based client library
[
https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662700#comment-16662700
]
Arpit Agarwal edited comment on YARN-8873 at 10/24/18 7:09 PM:
---
This patch breaks trunk compilation for me:
{code}
[ERROR] PROTOC FAILED: google/protobuf/wrappers.proto: File not found.
csi.proto: Import "google/protobuf/wrappers.proto" was not found or had errors.
csi.proto:192:5: ".google.protobuf.BoolValue" is not defined.
[ERROR]
/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/src/main/proto/csi.proto
[0:0]: google/protobuf/wrappers.proto: File not found.
csi.proto: Import "google/protobuf/wrappers.proto" was not found or had errors.
csi.proto:192:5: ".google.protobuf.BoolValue" is not defined.
{code}
Anyone else seeing the same?
was (Author: arpitagarwal):
This patch breaks trunk compilation for me:
{code}
[ERROR] PROTOC FAILED: google/protobuf/wrappers.proto: File not found.
csi.proto: Import "google/protobuf/wrappers.proto" was not found or had errors.
csi.proto:192:5: ".google.protobuf.BoolValue" is not defined.
[ERROR]
/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/src/main/proto/csi.proto
[0:0]: google/protobuf/wrappers.proto: File not found.
csi.proto: Import "google/protobuf/wrappers.proto" was not found or had errors.
csi.proto:192:5: ".google.protobuf.BoolValue" is not defined.
{code}
> [YARN-8811] Add CSI java-based client library
> -
>
> Key: YARN-8873
> URL: https://issues.apache.org/jira/browse/YARN-8873
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Weiwei Yang
>Assignee: Weiwei Yang
>Priority: Major
> Fix For: 3.3.0
>
> Attachments: YARN-8873.001.patch, YARN-8873.002.patch,
> YARN-8873.003.patch, YARN-8873.004.patch, YARN-8873.005.patch,
> YARN-8873.006.patch
>
>
> Build a java-based client to talk to CSI drivers, through CSI gRPC services.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
