[jira] [Created] (YETUS-420) Hadoop post commit failure due to Docker unable to build image

2016-06-10 Thread Xiao Chen (JIRA) 
Xiao Chen created YETUS-420:
---

 Summary: Hadoop post commit failure due to Docker unable to build 
image
 Key: YETUS-420
 URL: https://issues.apache.org/jira/browse/YETUS-420
 Project: Yetus
  Issue Type: Bug
Reporter: Xiao Chen


Please see HADOOP-13251:
- It's specific for this jira, my patches on other HADOOP jiras build fine.
- It's persistent, failing since yesterday.
- See below message which I think is the root cause, but I don't know how to 
dig deeper.
{noformat}
Step 26 : RUN apt-get -q install --no-install-recommends -y bats
 ---> Running in 5155f331e37c
Reading package lists...
Building dependency tree...
Reading state information...
The following NEW packages will be installed:
  bats
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 10.6 kB of archives.
After this operation, 70.7 kB of additional disk space will be used.
WARNING: The following packages cannot be authenticated!
  bats
E: There are problems and -y was used without --force-yes
The command '/bin/sh -c apt-get -q install --no-install-recommends -y bats' 
returned a non-zero code: 100

Total Elapsed time:   0m  6s

ERROR: Docker failed to build image.
{noformat}
I can see for the passed ones, step 26 seems to be using cache as well.

Most recent failure is 
[here|https://builds.apache.org/job/PreCommit-HADOOP-Build/9749/console], 
please help to either fix or suggest a workaround.

Thanks!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (YETUS-286) The native build randomly fails with "failed to map segment from shared object"

2016-01-15 Thread Xiao Chen (JIRA) 

[ 
https://issues.apache.org/jira/browse/YETUS-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102796#comment-15102796
 ] 

Xiao Chen commented on YETUS-286:
-

FYI - the above build succeeded! 

> The native build randomly fails with "failed to map segment from shared 
> object"
> ---
>
> Key: YETUS-286
> URL: https://issues.apache.org/jira/browse/YETUS-286
> Project: Yetus
>  Issue Type: Bug
>  Components: Test Patch
>Affects Versions: 0.2.0
>Reporter: Colin Patrick McCabe
>Assignee: Sean Busbey
>Priority: Critical
>
> On Jenkins, the native build seems to intermittently fail with "failed to map 
> segment from shared object."  For example:
> {code}
> [WARNING] /usr/bin/cmake: error while loading shared libraries: libxml2.so.2: 
> failed to map segment from shared object: Permission denied
> {code}
> We have also seen this happen with {{librtmp.so.0}}, {{libcurl.so.4}}, and 
> other native libraries which are dependencies of the thing being built.  
> Basically, there is some random chance any particular native dependency will 
> get "failed to map segment."  When this happens, the native build fails and 
> returns a -1 even if there was no actual problem.  This requires us to re-run 
> Jenkins to get a correct result.  The problem does not seem to reproduce 
> locally.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (YETUS-286) The native build randomly fails with "failed to map segment from shared object"

2016-01-15 Thread Xiao Chen (JIRA) 

[ 
https://issues.apache.org/jira/browse/YETUS-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102637#comment-15102637
 ] 

Xiao Chen commented on YETUS-286:
-

Thanks everyone for the work here!
I've been running into this in HADOOP-12715 twice consecutively this today. I 
just kicked off another build with that same patch at 
https://builds.apache.org/job/PreCommit-HADOOP-Build/8424/ . Hopefully this run 
can help confirm.

> The native build randomly fails with "failed to map segment from shared 
> object"
> ---
>
> Key: YETUS-286
> URL: https://issues.apache.org/jira/browse/YETUS-286
> Project: Yetus
>  Issue Type: Bug
>  Components: Test Patch
>Affects Versions: 0.2.0
>Reporter: Colin Patrick McCabe
>Assignee: Sean Busbey
>Priority: Critical
>
> On Jenkins, the native build seems to intermittently fail with "failed to map 
> segment from shared object."  For example:
> {code}
> [WARNING] /usr/bin/cmake: error while loading shared libraries: libxml2.so.2: 
> failed to map segment from shared object: Permission denied
> {code}
> We have also seen this happen with {{librtmp.so.0}}, {{libcurl.so.4}}, and 
> other native libraries which are dependencies of the thing being built.  
> Basically, there is some random chance any particular native dependency will 
> get "failed to map segment."  When this happens, the native build fails and 
> returns a -1 even if there was no actual problem.  This requires us to re-run 
> Jenkins to get a correct result.  The problem does not seem to reproduce 
> locally.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (YETUS-465) findbugs should not -1 if base branch has warnings when the patch fixes them

2016-10-14 Thread Xiao Chen (JIRA) 

[ 
https://issues.apache.org/jira/browse/YETUS-465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576912#comment-15576912
 ] 

Xiao Chen commented on YETUS-465:
-

Thanks [~aw] for explaining this from both yetus and hadoop pov. Now I for sure 
can remember findbugs warnings are not to be forgiven. :)

> findbugs should not -1 if base branch has warnings when the patch fixes them
> 
>
> Key: YETUS-465
> URL: https://issues.apache.org/jira/browse/YETUS-465
> Project: Yetus
>  Issue Type: Bug
>  Components: Test Patch
>Reporter: Xiao Chen
>
> In HADOOP-13669, the base branch (trunk) has 2 findbugs warnings, and a patch 
> fixes them. But pre-commit returns:
> {noformat}
> -1findbugs0m 26s  hadoop-common-project/hadoop-kms in trunk has 2 
> extant Findbugs warnings.
> {noformat}
> IMO this would be better if it says +1 and (had 2 warnings, fixed).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (YETUS-465) findbugs should not -1 if base branch has warnings when the patch fixes them

2016-10-13 Thread Xiao Chen (JIRA) 
Xiao Chen created YETUS-465:
---

 Summary: findbugs should not -1 if base branch has warnings when 
the patch fixes them
 Key: YETUS-465
 URL: https://issues.apache.org/jira/browse/YETUS-465
 Project: Yetus
  Issue Type: Bug
  Components: Test Patch
Reporter: Xiao Chen


In HADOOP-13669, the base branch (trunk) has 2 findbugs warnings, and a patch 
fixes them. But pre-commit returns:
{noformat}
-1  findbugs0m 26s  hadoop-common-project/hadoop-kms in trunk has 2 
extant Findbugs warnings.
{noformat}

IMO this would be better if it says +1 and (had 2 warnings, fixed).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (YETUS-515) Hadoop branch-2 docker failed to build on pre-commit

2017-06-01 Thread Xiao Chen (JIRA) 
Xiao Chen created YETUS-515:
---

 Summary: Hadoop branch-2 docker failed to build on pre-commit
 Key: YETUS-515
 URL: https://issues.apache.org/jira/browse/YETUS-515
 Project: Yetus
  Issue Type: Bug
Reporter: Xiao Chen


See https://builds.apache.org/job/PreCommit-HDFS-Build/19730

{noformat}
[91mDownloading Oracle Java 7...
[0m[91m--2017-06-01 18:11:15--  
http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
Resolving download.oracle.com (download.oracle.com)... [0m[91m23.61.194.10, 
23.61.194.27
Connecting to download.oracle.com (download.oracle.com)|23.61.194.10|:80... 
[0m[91mconnected.
HTTP request sent, awaiting response... [0m[91m302 Moved Temporarily
Location: 
https://edelivery.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
 [following]
--2017-06-01 18:11:15--  
https://edelivery.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
[0m[91mResolving edelivery.oracle.com (edelivery.oracle.com)... 
[0m[91m23.39.16.136, 2600:1409:a:193::2d3e, 2600:1409:a:183::2d3e
Connecting to edelivery.oracle.com (edelivery.oracle.com)|23.39.16.136|:443... 
[0m[91mconnected.
[0m[91mHTTP request sent, awaiting response... [0m[91m302 Moved Temporarily
Location: 
http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz?AuthParam=1496340795_8500a65b8b8d993603a0478d2cc48600
 [following]
--2017-06-01 18:11:15--  
http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz?AuthParam=1496340795_8500a65b8b8d993603a0478d2cc48600
[0m[91mConnecting to download.oracle.com 
(download.oracle.com)|23.61.194.10|:80... [0m[91mconnected.
HTTP request sent, awaiting response... [0m[91m404 Not Found
[0m[91m2017-06-01 18:11:16 ERROR 404: Not Found.

[0m[91mdownload failed
Oracle JDK 7 is NOT installed.
[0m[91mdpkg: error processing package oracle-java7-installer (--configure):
 subprocess installed post-installation script returned error exit status 1
[0m[91mErrors were encountered while processing:
 oracle-java7-installer
[0m[91mE: Sub-process /usr/bin/dpkg returned an error code (1)
[0mThe command '/bin/sh -c apt-get -q install --no-install-recommends -y 
oracle-java7-installer' returned a non-zero code: 100

Total Elapsed time:   0m 18s

ERROR: Docker failed to build image.
{noformat}

Could anyone help please?



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (YETUS-515) Hadoop branch-2 docker failed to build on pre-commit

2017-06-01 Thread Xiao Chen (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YETUS-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiao Chen resolved YETUS-515.
-
Resolution: Duplicate

Seems the linked jiras should solve this. Closing as a dup... 

> Hadoop branch-2 docker failed to build on pre-commit
> 
>
> Key: YETUS-515
> URL: https://issues.apache.org/jira/browse/YETUS-515
> Project: Yetus
>  Issue Type: Bug
>Reporter: Xiao Chen
>
> See https://builds.apache.org/job/PreCommit-HDFS-Build/19730
> {noformat}
> [91mDownloading Oracle Java 7...
> [0m[91m--2017-06-01 18:11:15--  
> http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
> Resolving download.oracle.com (download.oracle.com)... [0m[91m23.61.194.10, 
> 23.61.194.27
> Connecting to download.oracle.com (download.oracle.com)|23.61.194.10|:80... 
> [0m[91mconnected.
> HTTP request sent, awaiting response... [0m[91m302 Moved Temporarily
> Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
>  [following]
> --2017-06-01 18:11:15--  
> https://edelivery.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
> [0m[91mResolving edelivery.oracle.com (edelivery.oracle.com)... 
> [0m[91m23.39.16.136, 2600:1409:a:193::2d3e, 2600:1409:a:183::2d3e
> Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... [0m[91mconnected.
> [0m[91mHTTP request sent, awaiting response... [0m[91m302 Moved Temporarily
> Location: 
> http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz?AuthParam=1496340795_8500a65b8b8d993603a0478d2cc48600
>  [following]
> --2017-06-01 18:11:15--  
> http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz?AuthParam=1496340795_8500a65b8b8d993603a0478d2cc48600
> [0m[91mConnecting to download.oracle.com 
> (download.oracle.com)|23.61.194.10|:80... [0m[91mconnected.
> HTTP request sent, awaiting response... [0m[91m404 Not Found
> [0m[91m2017-06-01 18:11:16 ERROR 404: Not Found.
> [0m[91mdownload failed
> Oracle JDK 7 is NOT installed.
> [0m[91mdpkg: error processing package oracle-java7-installer (--configure):
>  subprocess installed post-installation script returned error exit status 1
> [0m[91mErrors were encountered while processing:
>  oracle-java7-installer
> [0m[91mE: Sub-process /usr/bin/dpkg returned an error code (1)
> [0mThe command '/bin/sh -c apt-get -q install --no-install-recommends -y 
> oracle-java7-installer' returned a non-zero code: 100
> Total Elapsed time:   0m 18s
> ERROR: Docker failed to build image.
> {noformat}
> Could anyone help please?



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (YETUS-515) Hadoop branch-2 docker failed to build on pre-commit

2017-06-01 Thread Xiao Chen (JIRA) 

[ 
https://issues.apache.org/jira/browse/YETUS-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033446#comment-16033446
 ] 

Xiao Chen commented on YETUS-515:
-

FYI - there was initially INFRA-14261 that causing maven-not-found issues. But 
was instructed from there this docker build issue is project-specific. 
[~eepayne] just asked on there too.

> Hadoop branch-2 docker failed to build on pre-commit
> 
>
> Key: YETUS-515
> URL: https://issues.apache.org/jira/browse/YETUS-515
> Project: Yetus
>  Issue Type: Bug
>Reporter: Xiao Chen
>
> See https://builds.apache.org/job/PreCommit-HDFS-Build/19730
> {noformat}
> [91mDownloading Oracle Java 7...
> [0m[91m--2017-06-01 18:11:15--  
> http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
> Resolving download.oracle.com (download.oracle.com)... [0m[91m23.61.194.10, 
> 23.61.194.27
> Connecting to download.oracle.com (download.oracle.com)|23.61.194.10|:80... 
> [0m[91mconnected.
> HTTP request sent, awaiting response... [0m[91m302 Moved Temporarily
> Location: 
> https://edelivery.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
>  [following]
> --2017-06-01 18:11:15--  
> https://edelivery.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
> [0m[91mResolving edelivery.oracle.com (edelivery.oracle.com)... 
> [0m[91m23.39.16.136, 2600:1409:a:193::2d3e, 2600:1409:a:183::2d3e
> Connecting to edelivery.oracle.com 
> (edelivery.oracle.com)|23.39.16.136|:443... [0m[91mconnected.
> [0m[91mHTTP request sent, awaiting response... [0m[91m302 Moved Temporarily
> Location: 
> http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz?AuthParam=1496340795_8500a65b8b8d993603a0478d2cc48600
>  [following]
> --2017-06-01 18:11:15--  
> http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz?AuthParam=1496340795_8500a65b8b8d993603a0478d2cc48600
> [0m[91mConnecting to download.oracle.com 
> (download.oracle.com)|23.61.194.10|:80... [0m[91mconnected.
> HTTP request sent, awaiting response... [0m[91m404 Not Found
> [0m[91m2017-06-01 18:11:16 ERROR 404: Not Found.
> [0m[91mdownload failed
> Oracle JDK 7 is NOT installed.
> [0m[91mdpkg: error processing package oracle-java7-installer (--configure):
>  subprocess installed post-installation script returned error exit status 1
> [0m[91mErrors were encountered while processing:
>  oracle-java7-installer
> [0m[91mE: Sub-process /usr/bin/dpkg returned an error code (1)
> [0mThe command '/bin/sh -c apt-get -q install --no-install-recommends -y 
> oracle-java7-installer' returned a non-zero code: 100
> Total Elapsed time:   0m 18s
> ERROR: Docker failed to build image.
> {noformat}
> Could anyone help please?



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)