[
https://issues.apache.org/jira/browse/HDDS-2225?focusedWorklogId=322939&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-322939
]
ASF GitHub Bot logged work on HDDS-2225:
----------------------------------------
Author: ASF GitHub Bot
Created on: 03/Oct/19 20:31
Start Date: 03/Oct/19 20:31
Worklog Time Spent: 10m
Work Description: hadoop-yetus commented on issue #1568: HDDS-2225. SCM
fails to start in most unsecure environments due to leftover secure config
URL: https://github.com/apache/hadoop/pull/1568#issuecomment-538115930
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
|:----:|----------:|--------:|:--------|
| 0 | reexec | 305 | Docker mode activated. |
||| _ Prechecks _ |
| +1 | dupname | 0 | No case conflicting files found. |
| 0 | shelldocs | 0 | Shelldocs was not available. |
| 0 | yamllint | 0 | yamllint was not available. |
| +1 | @author | 0 | The patch does not contain any @author tags. |
| -1 | test4tests | 0 | The patch doesn't appear to include any new or
modified tests. Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch. |
||| _ trunk Compile Tests _ |
| -1 | mvninstall | 47 | hadoop-hdds in trunk failed. |
| -1 | mvninstall | 43 | hadoop-ozone in trunk failed. |
| -1 | compile | 24 | hadoop-hdds in trunk failed. |
| -1 | compile | 19 | hadoop-ozone in trunk failed. |
| +1 | mvnsite | 0 | trunk passed |
| +1 | shadedclient | 794 | branch has no errors when building and testing
our client artifacts. |
| -1 | javadoc | 26 | hadoop-hdds in trunk failed. |
| -1 | javadoc | 25 | hadoop-ozone in trunk failed. |
||| _ Patch Compile Tests _ |
| -1 | mvninstall | 39 | hadoop-hdds in the patch failed. |
| -1 | mvninstall | 41 | hadoop-ozone in the patch failed. |
| -1 | compile | 29 | hadoop-hdds in the patch failed. |
| -1 | compile | 24 | hadoop-ozone in the patch failed. |
| -1 | javac | 29 | hadoop-hdds in the patch failed. |
| -1 | javac | 25 | hadoop-ozone in the patch failed. |
| +1 | mvnsite | 0 | the patch passed |
| +1 | shellcheck | 0 | There were no new shellcheck issues. |
| +1 | whitespace | 0 | The patch has no whitespace issues. |
| +1 | shadedclient | 711 | patch has no errors when building and testing
our client artifacts. |
| -1 | javadoc | 27 | hadoop-hdds in the patch failed. |
| -1 | javadoc | 24 | hadoop-ozone in the patch failed. |
||| _ Other Tests _ |
| -1 | unit | 32 | hadoop-hdds in the patch failed. |
| -1 | unit | 30 | hadoop-ozone in the patch failed. |
| +1 | asflicense | 39 | The patch does not generate ASF License warnings. |
| | | 2492 | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | Client=19.03.1 Server=19.03.1 base:
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hadoop/pull/1568 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient shellcheck shelldocs yamllint |
| uname | Linux ba433dd9aeed 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6
11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/hadoop.sh |
| git revision | trunk / 51eaeca |
| Default Java | 1.8.0_222 |
| mvninstall |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/branch-mvninstall-hadoop-hdds.txt
|
| mvninstall |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/branch-mvninstall-hadoop-ozone.txt
|
| compile |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/branch-compile-hadoop-hdds.txt
|
| compile |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/branch-compile-hadoop-ozone.txt
|
| javadoc |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/branch-javadoc-hadoop-hdds.txt
|
| javadoc |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/branch-javadoc-hadoop-ozone.txt
|
| mvninstall |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/patch-mvninstall-hadoop-hdds.txt
|
| mvninstall |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/patch-mvninstall-hadoop-ozone.txt
|
| compile |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/patch-compile-hadoop-hdds.txt
|
| compile |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/patch-compile-hadoop-ozone.txt
|
| javac |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/patch-compile-hadoop-hdds.txt
|
| javac |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/patch-compile-hadoop-ozone.txt
|
| javadoc |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/patch-javadoc-hadoop-hdds.txt
|
| javadoc |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/patch-javadoc-hadoop-ozone.txt
|
| unit |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/patch-unit-hadoop-hdds.txt
|
| unit |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/artifact/out/patch-unit-hadoop-ozone.txt
|
| Test Results |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/testReport/ |
| Max. process+thread count | 448 (vs. ulimit of 5500) |
| modules | C: hadoop-ozone/dist U: hadoop-ozone/dist |
| Console output |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1568/3/console |
| versions | git=2.7.4 maven=3.3.9 shellcheck=0.4.6 |
| Powered by | Apache Yetus 0.10.0 http://yetus.apache.org |
This message was automatically generated.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 322939)
Time Spent: 1.5h (was: 1h 20m)
> SCM fails to start in most unsecure environments due to leftover secure config
> ------------------------------------------------------------------------------
>
> Key: HDDS-2225
> URL: https://issues.apache.org/jira/browse/HDDS-2225
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: docker
> Reporter: Attila Doroszlai
> Assignee: Attila Doroszlai
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> Intermittent failure of {{ozone-recon}} and some other acceptance tests where
> SCM container is not available is caused by leftover secure config in
> {{core-site.xml}}.
> Initially the config file is
> [empty|https://raw.githubusercontent.com/apache/hadoop/trunk/hadoop-hdds/common/src/main/conf/core-site.xml].
> Various test environments populate it with different settings. The problem
> happens when a test does not specify any config for {{core-site.xml}}, in
> which case the previous test's config file is retained.
> {code}
> scm_1 | 2019-10-01 19:42:05 WARN WebAppContext:531 - Failed startup of
> context
> o.e.j.w.WebAppContext@1cc680e{/,file:///tmp/jetty-0.0.0.0-9876-scm-_-any-1272594486261557815.dir/webapp/,UNAVAILABLE}{/scm}
> scm_1 | javax.servlet.ServletException: javax.servlet.ServletException:
> Keytab does not exist: /etc/security/keytabs/HTTP.keytab
> scm_1 | at
> org.apache.hadoop.security.authentication.server.KerberosAuthenticationHandler.init(KerberosAuthenticationHandler.java:188)
> ...
> scm_1 | at
> org.apache.hadoop.hdds.scm.server.StorageContainerManager.start(StorageContainerManager.java:791)
> ...
> scm_1 | Unable to initialize WebAppContext
> scm_1 | 2019-10-01 19:42:05 INFO StorageContainerManagerStarter:51 -
> SHUTDOWN_MSG:
> scm_1 | /************************************************************
> scm_1 | SHUTDOWN_MSG: Shutting down StorageContainerManager at
> 8724df7131bb/192.168.128.6
> scm_1 | ************************************************************/
> {code}
> The problem is intermittent due to ordering of test cases being different in
> different runs. If a secure test is run earlier, more tests are affected.
> If secure tests are run last, the issue does not happen.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
