[
https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=563298&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-563298
]
ASF GitHub Bot logged work on HADOOP-17464:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 09/Mar/21 19:40
Start Date: 09/Mar/21 19:40
Worklog Time Spent: 10m
Work Description: hadoop-yetus removed a comment on pull request #2611:
URL: https://github.com/apache/hadoop/pull/2611#issuecomment-760625516
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 26m 11s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 2s | | No case conflicting files
found. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain
any @author tags. |
| +1 :green_heart: | | 0m 0s | [test4tests](test4tests) | The patch
appears to include 42 new or modified test files. |
|||| _ trunk Compile Tests _ |
| +0 :ok: | mvndep | 32m 54s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 21m 52s | | trunk passed |
| +1 :green_heart: | compile | 21m 11s | | trunk passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 |
| +1 :green_heart: | compile | 18m 12s | | trunk passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| +1 :green_heart: | checkstyle | 3m 1s | | trunk passed |
| +1 :green_heart: | mvnsite | 7m 50s | | trunk passed |
| +1 :green_heart: | shadedclient | 16m 10s | | branch has no errors
when building and testing our client artifacts. |
| +1 :green_heart: | javadoc | 6m 12s | | trunk passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 |
| +1 :green_heart: | javadoc | 6m 54s | | trunk passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| +0 :ok: | spotbugs | 5m 47s | | Used deprecated FindBugs config;
considering switching to SpotBugs. |
| +0 :ok: | findbugs | 0m 48s | | branch/hadoop-project no findbugs
output file (findbugsXml.xml) |
| -0 :warning: | patch | 6m 10s | | Used diff version of patch file.
Binary files and potentially other changes not applied. Please rebase and
squash commits if necessary. |
|||| _ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 25s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 5m 49s | | the patch passed |
| +1 :green_heart: | compile | 19m 38s | | the patch passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 |
| -1 :x: | javac | 19m 38s |
[/diff-compile-javac-root-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/diff-compile-javac-root-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| root-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 generated 5 new + 2036 unchanged - 4
fixed = 2041 total (was 2040) |
| +1 :green_heart: | compile | 17m 38s | | the patch passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| -1 :x: | javac | 17m 38s |
[/diff-compile-javac-root-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/diff-compile-javac-root-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
| root-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 3 new + 1933
unchanged - 3 fixed = 1936 total (was 1936) |
| -0 :warning: | checkstyle | 2m 57s |
[/diff-checkstyle-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/diff-checkstyle-root.txt)
| root: The patch generated 4 new + 241 unchanged - 9 fixed = 245 total (was
250) |
| +1 :green_heart: | mvnsite | 8m 42s | | the patch passed |
| +1 :green_heart: | shellcheck | 0m 0s | | There were no new
shellcheck issues. |
| +1 :green_heart: | shelldocs | 0m 48s | | There were no new
shelldocs issues. |
| -1 :x: | whitespace | 0m 0s |
[/whitespace-eol.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/whitespace-eol.txt)
| The patch has 156 line(s) that end in whitespace. Use git apply
--whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply |
| -1 :x: | whitespace | 0m 0s |
[/whitespace-tabs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/whitespace-tabs.txt)
| The patch 2 line(s) with tabs. |
| +1 :green_heart: | xml | 0m 8s | | The patch has no ill-formed XML
file. |
| +1 :green_heart: | shadedclient | 15m 57s | | patch has no errors
when building and testing our client artifacts. |
| -1 :x: | javadoc | 1m 16s |
[/patch-javadoc-hadoop-common-project_hadoop-common-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/patch-javadoc-hadoop-common-project_hadoop-common-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| hadoop-common in the patch failed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04. |
| -1 :x: | javadoc | 0m 50s |
[/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| hadoop-tools_hadoop-compression-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04
with JDK Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 generated 12 new + 0 unchanged
- 0 fixed = 12 total (was 0) |
| -1 :x: | javadoc | 2m 31s |
[/diff-javadoc-javadoc-hadoop-tools-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/diff-javadoc-javadoc-hadoop-tools-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04.txt)
| hadoop-tools-jdkUbuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04 generated 12 new + 421 unchanged - 0
fixed = 433 total (was 421) |
| -1 :x: | javadoc | 1m 47s |
[/diff-javadoc-javadoc-hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/diff-javadoc-javadoc-hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
|
hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01
with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 6 new
+ 0 unchanged - 0 fixed = 6 total (was 0) |
| -1 :x: | javadoc | 0m 47s |
[/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/diff-javadoc-javadoc-hadoop-tools_hadoop-compression-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
|
hadoop-tools_hadoop-compression-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01
with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 12 new
+ 0 unchanged - 0 fixed = 12 total (was 0) |
| -1 :x: | javadoc | 1m 53s |
[/diff-javadoc-javadoc-hadoop-tools-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/diff-javadoc-javadoc-hadoop-tools-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01.txt)
| hadoop-tools-jdkPrivateBuild-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 with
JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 generated 12 new + 596
unchanged - 0 fixed = 608 total (was 596) |
| +0 :ok: | findbugs | 0m 44s | | hadoop-project has no data from
findbugs |
| -1 :x: | findbugs | 6m 8s |
[/new-findbugs-hadoop-tools.html](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/new-findbugs-hadoop-tools.html)
| hadoop-tools generated 4 new + 0 unchanged - 0 fixed = 4 total (was 0) |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 0m 46s | | hadoop-project in the patch
passed. |
| +1 :green_heart: | unit | 12m 1s | | hadoop-common in the patch
passed. |
| +1 :green_heart: | unit | 2m 23s | | hadoop-compression in the patch
passed. |
| -1 :x: | unit | 55m 52s |
[/patch-unit-hadoop-tools.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/patch-unit-hadoop-tools.txt)
| hadoop-tools in the patch passed. |
| +1 :green_heart: | unit | 99m 38s | | hadoop-hdfs in the patch
passed. |
| +1 :green_heart: | unit | 11m 16s | |
hadoop-mapreduce-client-nativetask in the patch passed. |
| +1 :green_heart: | asflicense | 1m 28s | | The patch does not
generate ASF License warnings. |
| | | 466m 4s | | |
| Reason | Tests |
|-------:|:------|
| FindBugs | module:hadoop-tools |
| | org.apache.hadoop.io.compress.lz4.Lz4Compressor.setInput(byte[], int,
int) may expose internal representation by storing an externally mutable object
into Lz4Compressor.userBuf At Lz4Compressor.java:internal representation by
storing an externally mutable object into Lz4Compressor.userBuf At
Lz4Compressor.java:[line 127] |
| | org.apache.hadoop.io.compress.lz4.Lz4Decompressor.setInput(byte[],
int, int) may expose internal representation by storing an externally mutable
object into Lz4Decompressor.userBuf At Lz4Decompressor.java:internal
representation by storing an externally mutable object into
Lz4Decompressor.userBuf At Lz4Decompressor.java:[line 104] |
| | org.apache.hadoop.io.compress.snappy.SnappyCompressor.setInput(byte[],
int, int) may expose internal representation by storing an externally mutable
object into SnappyCompressor.userBuf At SnappyCompressor.java:internal
representation by storing an externally mutable object into
SnappyCompressor.userBuf At SnappyCompressor.java:[line 92] |
| |
org.apache.hadoop.io.compress.snappy.SnappyDecompressor.setInput(byte[], int,
int) may expose internal representation by storing an externally mutable object
into SnappyDecompressor.userBuf At SnappyDecompressor.java:internal
representation by storing an externally mutable object into
SnappyDecompressor.userBuf At SnappyDecompressor.java:[line 92] |
| Failed junit tests | hadoop.tools.dynamometer.TestDynamometerInfra |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.41 ServerAPI=1.41 base:
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hadoop/pull/2611 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient xml findbugs checkstyle shellcheck shelldocs |
| uname | Linux 3009e92a5c40 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22
16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 630f8ddd2c7 |
| Default Java | Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| Multi-JDK versions |
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.18.04
/usr/lib/jvm/java-8-openjdk-amd64:Private
Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01 |
| Test Results |
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/testReport/ |
| Max. process+thread count | 4703 (vs. ulimit of 5500) |
| modules | C: hadoop-project hadoop-common-project/hadoop-common
hadoop-tools/hadoop-compression hadoop-tools hadoop-hdfs-project/hadoop-hdfs
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask
U: . |
| Console output |
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2611/5/console |
| versions | git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=4.0.6 |
| Powered by | Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org |
This message was automatically generated.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 563298)
Time Spent: 3h 50m (was: 3h 40m)
> Create hadoop-compression module
> --------------------------------
>
> Key: HADOOP-17464
> URL: https://issues.apache.org/jira/browse/HADOOP-17464
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: L. C. Hsieh
> Priority: Major
> Labels: pull-request-available
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
> We added lz4-java, snappy-java dependencies to replace native libs. As per
> the suggestion from the review comments, we better add a hadoop module to
> have these extra dependencies, to avoid messing up the dependencies of user
> application.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
