[
https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=535349&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535349
]
ASF GitHub Bot logged work on HADOOP-17464:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 13/Jan/21 12:25
Start Date: 13/Jan/21 12:25
Worklog Time Spent: 10m
Work Description: hadoop-yetus commented on pull request #2611:
URL: https://github.com/apache/hadoop/pull/2611#issuecomment-759415506
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 1m 23s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files
found. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain
any @author tags. |
| +1 :green_heart: | | 0m 0s | [test4tests](test4tests) | The patch
appears to include 34 new or modified test files. |
|||| _ trunk Compile Tests _ |
| +0 :ok: | mvndep | 13m 54s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 25m 2s | | trunk passed |
| +1 :green_heart: | compile | 22m 44s | | trunk passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 |
| +1 :green_heart: | compile | 18m 59s | | trunk passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| +1 :green_heart: | checkstyle | 2m 58s | | trunk passed |
| +1 :green_heart: | mvnsite | 6m 35s | | trunk passed |
| +1 :green_heart: | shadedclient | 27m 3s | | branch has no errors
when building and testing our client artifacts. |
| +1 :green_heart: | javadoc | 4m 46s | | trunk passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 |
| +1 :green_heart: | javadoc | 5m 29s | | trunk passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| +0 :ok: | spotbugs | 5m 48s | | Used deprecated FindBugs config;
considering switching to SpotBugs. |
| +0 :ok: | findbugs | 0m 28s | | branch/hadoop-project no findbugs
output file (findbugsXml.xml) |
| -0 :warning: | patch | 6m 6s | | Used diff version of patch file.
Binary files and potentially other changes not applied. Please rebase and
squash commits if necessary. |
|||| _ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 19s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 5m 25s | | the patch passed |
| +1 :green_heart: | compile | 21m 5s | | the patch passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 |
| -1 :x: | javac | 21m 5s |
[/diff-compile-javac-root-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/diff-compile-javac-root-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| root-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 generated 6 new + 2027 unchanged - 5
fixed = 2033 total (was 2032) |
| +1 :green_heart: | compile | 20m 43s | | the patch passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| -1 :x: | javac | 20m 43s |
[/diff-compile-javac-root-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/diff-compile-javac-root-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
| root-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 3 new + 1926
unchanged - 3 fixed = 1929 total (was 1929) |
| -0 :warning: | checkstyle | 2m 53s |
[/diff-checkstyle-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/diff-checkstyle-root.txt)
| root: The patch generated 5 new + 240 unchanged - 9 fixed = 245 total (was
249) |
| +1 :green_heart: | mvnsite | 7m 2s | | the patch passed |
| -1 :x: | whitespace | 0m 0s |
[/whitespace-eol.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/whitespace-eol.txt)
| The patch has 156 line(s) that end in whitespace. Use git apply
--whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply |
| -1 :x: | whitespace | 0m 0s |
[/whitespace-tabs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/whitespace-tabs.txt)
| The patch 2 line(s) with tabs. |
| +1 :green_heart: | xml | 0m 7s | | The patch has no ill-formed XML
file. |
| +1 :green_heart: | shadedclient | 17m 34s | | patch has no errors
when building and testing our client artifacts. |
| -1 :x: | javadoc | 0m 59s |
[/patch-javadoc-hadoop-common-project_hadoop-common-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/patch-javadoc-hadoop-common-project_hadoop-common-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| hadoop-common in the patch failed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04. |
| -1 :x: | javadoc | 0m 31s |
[/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| hadoop-tools_hadoop-compression-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04
with JDK Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 generated 12 new + 0 unchanged
- 0 fixed = 12 total (was 0) |
| -1 :x: | javadoc | 2m 1s |
[/diff-javadoc-javadoc-hadoop-tools-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/diff-javadoc-javadoc-hadoop-tools-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| hadoop-tools-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 generated 12 new + 421 unchanged - 0
fixed = 433 total (was 421) |
| -1 :x: | javadoc | 1m 30s |
[/diff-javadoc-javadoc-hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/diff-javadoc-javadoc-hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
|
hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01
with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 6 new
+ 0 unchanged - 0 fixed = 6 total (was 0) |
| -1 :x: | javadoc | 0m 28s |
[/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
|
hadoop-tools_hadoop-compression-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01
with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 12 new
+ 0 unchanged - 0 fixed = 12 total (was 0) |
| -1 :x: | javadoc | 1m 38s |
[/diff-javadoc-javadoc-hadoop-tools-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/diff-javadoc-javadoc-hadoop-tools-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
| hadoop-tools-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 with
JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 12 new + 596
unchanged - 0 fixed = 608 total (was 596) |
| +0 :ok: | findbugs | 0m 24s | | hadoop-project has no data from
findbugs |
| -1 :x: | findbugs | 6m 33s |
[/new-findbugs-hadoop-tools.html](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/new-findbugs-hadoop-tools.html)
| hadoop-tools generated 4 new + 0 unchanged - 0 fixed = 4 total (was 0) |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 0m 23s | | hadoop-project in the patch
passed. |
| +1 :green_heart: | unit | 9m 9s | | hadoop-common in the patch
passed. |
| -1 :x: | unit | 2m 34s |
[/patch-unit-hadoop-tools_hadoop-compression.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/patch-unit-hadoop-tools_hadoop-compression.txt)
| hadoop-compression in the patch passed. |
| -1 :x: | unit | 71m 36s |
[/patch-unit-hadoop-tools.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/patch-unit-hadoop-tools.txt)
| hadoop-tools in the patch passed. |
| -1 :x: | unit | 129m 33s |
[/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt)
| hadoop-hdfs in the patch passed. |
| +1 :green_heart: | unit | 11m 29s | |
hadoop-mapreduce-client-nativetask in the patch passed. |
| +1 :green_heart: | asflicense | 1m 0s | | The patch does not
generate ASF License warnings. |
| | | 464m 1s | | |
| Reason | Tests |
|-------:|:------|
| FindBugs | module:hadoop-tools |
| | org.apache.hadoop.io.compress.lz4.Lz4Compressor.setInput(byte[], int,
int) may expose internal representation by storing an externally mutable object
into Lz4Compressor.userBuf At Lz4Compressor.java:internal representation by
storing an externally mutable object into Lz4Compressor.userBuf At
Lz4Compressor.java:[line 127] |
| | org.apache.hadoop.io.compress.lz4.Lz4Decompressor.setInput(byte[],
int, int) may expose internal representation by storing an externally mutable
object into Lz4Decompressor.userBuf At Lz4Decompressor.java:internal
representation by storing an externally mutable object into
Lz4Decompressor.userBuf At Lz4Decompressor.java:[line 104] |
| | org.apache.hadoop.io.compress.snappy.SnappyCompressor.setInput(byte[],
int, int) may expose internal representation by storing an externally mutable
object into SnappyCompressor.userBuf At SnappyCompressor.java:internal
representation by storing an externally mutable object into
SnappyCompressor.userBuf At SnappyCompressor.java:[line 92] |
| |
org.apache.hadoop.io.compress.snappy.SnappyDecompressor.setInput(byte[], int,
int) may expose internal representation by storing an externally mutable object
into SnappyDecompressor.userBuf At SnappyDecompressor.java:internal
representation by storing an externally mutable object into
SnappyDecompressor.userBuf At SnappyDecompressor.java:[line 92] |
| Failed junit tests |
hadoop.io.compress.zstd.TestZStandardCompressorDecompressor |
| | hadoop.io.compress.lz4.TestLz4CompressorDecompressor |
| | hadoop.io.compress.zstd.TestZStandardCompressorDecompressor |
| | hadoop.io.compress.lz4.TestLz4CompressorDecompressor |
| | hadoop.streaming.TestStreamingBadRecords |
| | hadoop.tools.dynamometer.TestDynamometerInfra |
| | hadoop.hdfs.server.namenode.ha.TestPipelinesFailover |
| | hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.40 ServerAPI=1.40 base:
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hadoop/pull/2611 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient xml findbugs checkstyle |
| uname | Linux 7503ebc7f895 4.15.0-101-generic #102-Ubuntu SMP Mon May 11
10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 8ec824f2ba4 |
| Default Java | Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| Multi-JDK versions |
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04
/usr/lib/jvm/java-8-openjdk-amd64:Private
Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| Test Results |
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/testReport/ |
| Max. process+thread count | 3053 (vs. ulimit of 5500) |
| modules | C: hadoop-project hadoop-common-project/hadoop-common
hadoop-tools/hadoop-compression hadoop-tools hadoop-hdfs-project/hadoop-hdfs
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask
U: . |
| Console output |
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/3/console |
| versions | git=2.17.1 maven=3.6.0 findbugs=4.0.6 |
| Powered by | Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org |
This message was automatically generated.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 535349)
Time Spent: 2h (was: 1h 50m)
> Create hadoop-compression module
> --------------------------------
>
> Key: HADOOP-17464
> URL: https://issues.apache.org/jira/browse/HADOOP-17464
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: L. C. Hsieh
> Priority: Major
> Labels: pull-request-available
> Time Spent: 2h
> Remaining Estimate: 0h
>
> We added lz4-java, snappy-java dependencies to replace native libs. As per
> the suggestion from the review comments, we better add a hadoop module to
> have these extra dependencies, to avoid messing up the dependencies of user
> application.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
