[
https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=535190&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535190
]
ASF GitHub Bot logged work on HADOOP-17464:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 13/Jan/21 04:14
Start Date: 13/Jan/21 04:14
Worklog Time Spent: 10m
Work Description: hadoop-yetus commented on pull request #2611:
URL: https://github.com/apache/hadoop/pull/2611#issuecomment-759193916
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 0m 30s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 1s | | No case conflicting files
found. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain
any @author tags. |
| +1 :green_heart: | | 0m 0s | [test4tests](test4tests) | The patch
appears to include 34 new or modified test files. |
|||| _ trunk Compile Tests _ |
| +0 :ok: | mvndep | 14m 6s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 21m 7s | | trunk passed |
| +1 :green_heart: | compile | 20m 16s | | trunk passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 |
| +1 :green_heart: | compile | 17m 29s | | trunk passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| +1 :green_heart: | checkstyle | 2m 44s | | trunk passed |
| +1 :green_heart: | mvnsite | 6m 58s | | trunk passed |
| +1 :green_heart: | shadedclient | 25m 34s | | branch has no errors
when building and testing our client artifacts. |
| +1 :green_heart: | javadoc | 5m 23s | | trunk passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 |
| +1 :green_heart: | javadoc | 6m 12s | | trunk passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| +0 :ok: | spotbugs | 5m 41s | | Used deprecated FindBugs config;
considering switching to SpotBugs. |
| +0 :ok: | findbugs | 0m 38s | | branch/hadoop-project no findbugs
output file (findbugsXml.xml) |
| -0 :warning: | patch | 6m 2s | | Used diff version of patch file.
Binary files and potentially other changes not applied. Please rebase and
squash commits if necessary. |
|||| _ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 22s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 5m 36s | | the patch passed |
| +1 :green_heart: | compile | 19m 39s | | the patch passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 |
| -1 :x: | javac | 19m 39s |
[/diff-compile-javac-root-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/diff-compile-javac-root-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| root-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 generated 5 new + 2036 unchanged - 4
fixed = 2041 total (was 2040) |
| +1 :green_heart: | compile | 17m 37s | | the patch passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| -1 :x: | javac | 17m 37s |
[/diff-compile-javac-root-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/diff-compile-javac-root-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
| root-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 3 new + 1933
unchanged - 3 fixed = 1936 total (was 1936) |
| -0 :warning: | checkstyle | 3m 21s |
[/diff-checkstyle-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/diff-checkstyle-root.txt)
| root: The patch generated 4 new + 241 unchanged - 9 fixed = 245 total (was
250) |
| +1 :green_heart: | mvnsite | 7m 50s | | the patch passed |
| -1 :x: | whitespace | 0m 0s |
[/whitespace-eol.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/whitespace-eol.txt)
| The patch has 156 line(s) that end in whitespace. Use git apply
--whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply |
| -1 :x: | whitespace | 0m 0s |
[/whitespace-tabs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/whitespace-tabs.txt)
| The patch 2 line(s) with tabs. |
| +1 :green_heart: | xml | 0m 8s | | The patch has no ill-formed XML
file. |
| +1 :green_heart: | shadedclient | 15m 48s | | patch has no errors
when building and testing our client artifacts. |
| -1 :x: | javadoc | 1m 3s |
[/patch-javadoc-hadoop-common-project_hadoop-common-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/patch-javadoc-hadoop-common-project_hadoop-common-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| hadoop-common in the patch failed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04. |
| -1 :x: | javadoc | 0m 38s |
[/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| hadoop-tools_hadoop-compression-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04
with JDK Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 generated 12 new + 0 unchanged
- 0 fixed = 12 total (was 0) |
| -1 :x: | javadoc | 2m 2s |
[/diff-javadoc-javadoc-hadoop-tools-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/diff-javadoc-javadoc-hadoop-tools-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| hadoop-tools-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 generated 12 new + 421 unchanged - 0
fixed = 433 total (was 421) |
| -1 :x: | javadoc | 1m 39s |
[/diff-javadoc-javadoc-hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/diff-javadoc-javadoc-hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
|
hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01
with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 6 new
+ 0 unchanged - 0 fixed = 6 total (was 0) |
| -1 :x: | javadoc | 0m 38s |
[/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
|
hadoop-tools_hadoop-compression-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01
with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 12 new
+ 0 unchanged - 0 fixed = 12 total (was 0) |
| -1 :x: | javadoc | 1m 45s |
[/diff-javadoc-javadoc-hadoop-tools-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/diff-javadoc-javadoc-hadoop-tools-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
| hadoop-tools-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 with
JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 12 new + 596
unchanged - 0 fixed = 608 total (was 596) |
| +0 :ok: | findbugs | 0m 35s | | hadoop-project has no data from
findbugs |
| -1 :x: | findbugs | 5m 57s |
[/new-findbugs-hadoop-tools.html](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/new-findbugs-hadoop-tools.html)
| hadoop-tools generated 4 new + 0 unchanged - 0 fixed = 4 total (was 0) |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 0m 35s | | hadoop-project in the patch
passed. |
| +1 :green_heart: | unit | 9m 35s | | hadoop-common in the patch
passed. |
| -1 :x: | unit | 2m 16s |
[/patch-unit-hadoop-tools_hadoop-compression.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/patch-unit-hadoop-tools_hadoop-compression.txt)
| hadoop-compression in the patch passed. |
| -1 :x: | unit | 55m 33s |
[/patch-unit-hadoop-tools.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/patch-unit-hadoop-tools.txt)
| hadoop-tools in the patch passed. |
| -1 :x: | unit | 101m 36s |
[/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt)
| hadoop-hdfs in the patch passed. |
| -1 :x: | unit | 10m 42s |
[/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt)
| hadoop-mapreduce-client-nativetask in the patch passed. |
| +1 :green_heart: | asflicense | 1m 12s | | The patch does not
generate ASF License warnings. |
| | | 408m 18s | | |
| Reason | Tests |
|-------:|:------|
| FindBugs | module:hadoop-tools |
| | org.apache.hadoop.io.compress.lz4.Lz4Compressor.setInput(byte[], int,
int) may expose internal representation by storing an externally mutable object
into Lz4Compressor.userBuf At Lz4Compressor.java:internal representation by
storing an externally mutable object into Lz4Compressor.userBuf At
Lz4Compressor.java:[line 127] |
| | org.apache.hadoop.io.compress.lz4.Lz4Decompressor.setInput(byte[],
int, int) may expose internal representation by storing an externally mutable
object into Lz4Decompressor.userBuf At Lz4Decompressor.java:internal
representation by storing an externally mutable object into
Lz4Decompressor.userBuf At Lz4Decompressor.java:[line 104] |
| | org.apache.hadoop.io.compress.snappy.SnappyCompressor.setInput(byte[],
int, int) may expose internal representation by storing an externally mutable
object into SnappyCompressor.userBuf At SnappyCompressor.java:internal
representation by storing an externally mutable object into
SnappyCompressor.userBuf At SnappyCompressor.java:[line 92] |
| |
org.apache.hadoop.io.compress.snappy.SnappyDecompressor.setInput(byte[], int,
int) may expose internal representation by storing an externally mutable object
into SnappyDecompressor.userBuf At SnappyDecompressor.java:internal
representation by storing an externally mutable object into
SnappyDecompressor.userBuf At SnappyDecompressor.java:[line 92] |
| Failed junit tests |
hadoop.io.compress.zstd.TestZStandardCompressorDecompressor |
| | hadoop.io.compress.lz4.TestLz4CompressorDecompressor |
| | hadoop.tools.dynamometer.TestDynamometerInfra |
| | hadoop.io.compress.zstd.TestZStandardCompressorDecompressor |
| | hadoop.io.compress.lz4.TestLz4CompressorDecompressor |
| | hadoop.hdfs.server.namenode.ha.TestBootstrapAliasmap |
| | hadoop.hdfs.server.namenode.TestFSImage |
| | hadoop.mapred.nativetask.compresstest.CompressTest |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.41 ServerAPI=1.41 base:
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hadoop/pull/2611 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient xml findbugs checkstyle |
| uname | Linux 2ffaef69e3e8 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22
16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 724edb03544 |
| Default Java | Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| Multi-JDK versions |
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04
/usr/lib/jvm/java-8-openjdk-amd64:Private
Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| Test Results |
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/testReport/ |
| Max. process+thread count | 4234 (vs. ulimit of 5500) |
| modules | C: hadoop-project hadoop-common-project/hadoop-common
hadoop-tools/hadoop-compression hadoop-tools hadoop-hdfs-project/hadoop-hdfs
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask
U: . |
| Console output |
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/2/console |
| versions | git=2.17.1 maven=3.6.0 findbugs=4.0.6 |
| Powered by | Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org |
This message was automatically generated.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 535190)
Time Spent: 1h 50m (was: 1h 40m)
> Create hadoop-compression module
> --------------------------------
>
> Key: HADOOP-17464
> URL: https://issues.apache.org/jira/browse/HADOOP-17464
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: L. C. Hsieh
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> We added lz4-java, snappy-java dependencies to replace native libs. As per
> the suggestion from the review comments, we better add a hadoop module to
> have these extra dependencies, to avoid messing up the dependencies of user
> application.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
