[
https://issues.apache.org/jira/browse/HDFS-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194043#comment-15194043
]
Kihwal Lee commented on HDFS-9945:
----------------------------------
Pre-commit actually ran:
https://builds.apache.org/job/PreCommit-HDFS-Build/14795/
It didn't post the result probably because of the jira issue at that time.
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| 0 | reexec | 0m 57s | Docker mode activated.
| +1 | @author | 0m 0s | The patch does not contain any @author
| | | | tags.
| +1 | test4tests | 0m 0s | The patch appears to include 1 new or
| | | | modified test files.
| 0 | mvndep | 0m 10s | Maven dependency ordering for branch
| +1 | mvninstall | 6m 51s | trunk passed
| +1 | compile | 1m 18s | trunk passed with JDK v1.8.0_74
| +1 | compile | 1m 21s | trunk passed with JDK v1.7.0_95
| +1 | checkstyle | 0m 33s | trunk passed
| +1 | mvnsite | 1m 27s | trunk passed
| +1 | mvneclipse | 0m 27s | trunk passed
| +1 | findbugs | 3m 37s | trunk passed
| +1 | javadoc | 1m 25s | trunk passed with JDK v1.8.0_74
| +1 | javadoc | 2m 11s | trunk passed with JDK v1.7.0_95
| 0 | mvndep | 0m 9s | Maven dependency ordering for patch
| +1 | mvninstall | 1m 18s | the patch passed
| +1 | compile | 1m 13s | the patch passed with JDK v1.8.0_74
| +1 | cc | 1m 13s | the patch passed
| +1 | javac | 1m 13s | the patch passed
| +1 | compile | 1m 19s | the patch passed with JDK v1.7.0_95
| +1 | cc | 1m 19s | the patch passed
| +1 | javac | 1m 19s | the patch passed
| -1 | checkstyle | 0m 31s | hadoop-hdfs-project: patch generated 4
| | | | new + 538 unchanged - 4 fixed = 542 total
| | | | (was 542)
| +1 | mvnsite | 1m 22s | the patch passed
| +1 | mvneclipse | 0m 22s | the patch passed
| +1 | whitespace | 0m 0s | Patch has no whitespace issues.
| -1 | findbugs | 2m 11s | hadoop-hdfs-project/hadoop-hdfs
| | | | generated 1 new + 0 unchanged - 0 fixed =
| | | | 1 total (was 0)
| +1 | javadoc | 1m 23s | the patch passed with JDK v1.8.0_74
| +1 | javadoc | 2m 8s | the patch passed with JDK v1.7.0_95
| +1 | unit | 0m 49s | hadoop-hdfs-client in the patch passed
| | | | with JDK v1.8.0_74.
| -1 | unit | 55m 54s | hadoop-hdfs in the patch failed with JDK
| | | | v1.8.0_74.
| +1 | unit | 0m 56s | hadoop-hdfs-client in the patch passed
| | | | with JDK v1.7.0_95.
| +1 | unit | 53m 36s | hadoop-hdfs in the patch passed with JDK
| | | | v1.7.0_95.
| +1 | asflicense | 0m 22s | Patch does not generate ASF License
| | | | warnings.
| | | 149m 8s |
\\
\\
|| Reason || Tests ||
| FindBugs | module:hadoop-hdfs-project/hadoop-hdfs |
| | Inconsistent synchronization of
org.apache.hadoop.hdfs.server.datanode.DataXceiver.xceiver; locked 50% of time
Unsynchronized access at DataXceiver.java:50% of time Unsynchronized access at
DataXceiver.java:\[line 222\] |
| JDK v1.8.0_74 Failed junit tests |
hadoop.hdfs.server.namenode.TestFSEditLogLoader |
| | hadoop.hdfs.TestFileAppend |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:0ca8df7 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12792899/HDFS-9945.patch |
| JIRA Issue | HDFS-9945 |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit findbugs checkstyle cc |
| uname | Linux be2432938a57 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed
Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 658ee95 |
| Default Java | 1.7.0_95 |
| Multi-JDK versions | /usr/lib/jvm/java-8-oracle:1.8.0_74
/usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 |
| findbugs | v3.0.0 |
| checkstyle |
https://builds.apache.org/job/PreCommit-HDFS-Build/14795/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project.txt
|
| findbugs |
https://builds.apache.org/job/PreCommit-HDFS-Build/14795/artifact/patchprocess/new-findbugs-hadoop-hdfs-project_hadoop-hdfs.html
|
| unit |
https://builds.apache.org/job/PreCommit-HDFS-Build/14795/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt
|
| unit test logs |
https://builds.apache.org/job/PreCommit-HDFS-Build/14795/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt
|
| JDK v1.7.0_95 Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/14795/testReport/ |
| modules | C: hadoop-hdfs-project/hadoop-hdfs-client
hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/14795/console |
| Powered by | Apache Yetus 0.2.0 http://yetus.apache.org |
> Datanode command for evicting writers
> -------------------------------------
>
> Key: HDFS-9945
> URL: https://issues.apache.org/jira/browse/HDFS-9945
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: datanode
> Reporter: Kihwal Lee
> Assignee: Kihwal Lee
> Attachments: HDFS-9945.patch
>
>
> It will be useful if there is a command to evict writers from a datanode.
> When a set of datanodes are being decommissioned, they can get blocked by
> slow writers at the end. It was rare in the old days since mapred jobs
> didn't last too long, but with many different types of apps running on
> today's YARN cluster, we are often see very long tail in datanode
> decommissioning.
> I propose a new dfsadmin command, {{evictWriters}}, to be added. I initially
> thought about having namenode automatically telling datanodes on
> decommissioning, but realized that having a command is more flexible. E.g.
> users can choose not to do this at all, choose when to evict writers, or
> whether to try multiple times for whatever reasons.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
