[
https://issues.apache.org/jira/browse/HDDS-1877?focusedWorklogId=285713&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-285713
]
ASF GitHub Bot logged work on HDDS-1877:
----------------------------------------
Author: ASF GitHub Bot
Created on: 31/Jul/19 12:25
Start Date: 31/Jul/19 12:25
Worklog Time Spent: 10m
Work Description: hadoop-yetus commented on issue #1193: HDDS-1877.
hadoop31-mapreduce fails due to wrong HADOOP_VERSION
URL: https://github.com/apache/hadoop/pull/1193#issuecomment-516826068
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
|:----:|----------:|--------:|:--------|
| 0 | reexec | 580 | Docker mode activated. |
||| _ Prechecks _ |
| +1 | dupname | 0 | No case conflicting files found. |
| 0 | shelldocs | 0 | Shelldocs was not available. |
| +1 | @author | 0 | The patch does not contain any @author tags. |
| -1 | test4tests | 0 | The patch doesn't appear to include any new or
modified tests. Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch. |
||| _ trunk Compile Tests _ |
| +1 | mvninstall | 848 | trunk passed |
| +1 | mvnsite | 0 | trunk passed |
| +1 | shadedclient | 991 | branch has no errors when building and testing
our client artifacts. |
||| _ Patch Compile Tests _ |
| +1 | mvninstall | 595 | the patch passed |
| +1 | mvnsite | 0 | the patch passed |
| +1 | shellcheck | 0 | There were no new shellcheck issues. |
| +1 | whitespace | 0 | The patch has no whitespace issues. |
| +1 | shadedclient | 768 | patch has no errors when building and testing
our client artifacts. |
||| _ Other Tests _ |
| +1 | unit | 117 | hadoop-hdds in the patch passed. |
| +1 | unit | 335 | hadoop-ozone in the patch passed. |
| +1 | asflicense | 47 | The patch does not generate ASF License warnings. |
| | | 4481 | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | Client=19.03.1 Server=19.03.1 base:
https://builds.apache.org/job/hadoop-multibranch/job/PR-1193/1/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hadoop/pull/1193 |
| Optional Tests | dupname asflicense mvnsite unit shellcheck shelldocs |
| uname | Linux 3f66b21d0889 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24
10:55:24 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/hadoop.sh |
| git revision | trunk / d4ab9ae |
| Test Results |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1193/1/testReport/ |
| Max. process+thread count | 306 (vs. ulimit of 5500) |
| modules | C: hadoop-ozone U: hadoop-ozone |
| Console output |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1193/1/console |
| versions | git=2.7.4 maven=3.3.9 shellcheck=0.4.6 |
| Powered by | Apache Yetus 0.10.0 http://yetus.apache.org |
This message was automatically generated.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 285713)
Time Spent: 0.5h (was: 20m)
> hadoop31-mapreduce fails due to wrong HADOOP_VERSION
> ----------------------------------------------------
>
> Key: HDDS-1877
> URL: https://issues.apache.org/jira/browse/HDDS-1877
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: test
> Affects Versions: 0.5.0, 0.4.1
> Reporter: Doroszlai, Attila
> Assignee: Doroszlai, Attila
> Priority: Blocker
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> hadoop31-mapreduce fails with:
> {noformat:title=https://elek.github.io/ozone-ci/byscane/byscane-nightly-gl52x/acceptance/smokeresult/log.html#s1-s2-t2-k2-k2}
> JAR does not exist or is not a normal file:
> /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.2.jar
> {noformat}
> because 3.1 test is being run with {{HADOOP_VERSION=3}}:
> {noformat:title=https://raw.githubusercontent.com/elek/ozone-ci/master/byscane/byscane-nightly-gl52x/acceptance/output.log}
> Creating network "hadoop31_default" with the default driver
> Pulling nm (flokkr/hadoop:3)...
> 3: Pulling from flokkr/hadoop
> Digest:
> sha256:62e3488e64ff8c0406752fc4f263ae2549e04fedf02534469913c496c6a89d78
> Status: Downloaded newer image for flokkr/hadoop:3
> {noformat}
> which has Hadoop 3.2.0 instead of 3.1.2:
> {noformat:title=docker run -it --entrypoint /bin/bash flokkr/hadoop:3 -c 'ls
> -la /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples*'}
> -rw-r--r-- 1 hadoop flokkr 316570 Jan 8 2019
> /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.0.jar
> {noformat}
> {noformat:title=docker run -it --entrypoint /bin/bash flokkr/hadoop:3.1.2 -c
> 'ls -la /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples*'}
> -rw-r--r-- 1 hadoop flokkr 316380 Jan 29 2019
> /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.2.jar
> {noformat}
> This only happens with {{acceptance.sh}}, not when directly using
> {{test-all.sh}}, because the former explicitly defines {{HADOOP_VERSION}}:
> {noformat:title=https://github.com/apache/hadoop/blob/d4ab9aea6f9cbcdcaf48b821e5be04b4e952b133/hadoop-ozone/dev-support/checks/acceptance.sh#L19}
> export HADOOP_VERSION=3
> {noformat}
> so the correct value from {{.env}} file is ignored:
> {noformat:title=https://github.com/apache/hadoop/blob/d4ab9aea6f9cbcdcaf48b821e5be04b4e952b133/hadoop-ozone/dist/src/main/compose/ozone-mr/hadoop31/.env#L21}
> HADOOP_VERSION=3.1.2
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
