[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525220#comment-14525220
]
Hudson commented on HDFS-8229:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #915 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/915/])
HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed
by Surendra Singh Lilhore) (arp: rev 6f541edce0ed64bf316276715c4bc07794ff20ac)
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestLazyPersistFiles.java
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/LazyPersistTestCase.java
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Fix For: 2.8.0
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525288#comment-14525288
]
Hudson commented on HDFS-8229:
--
SUCCESS: Integrated in Hadoop-Hdfs-trunk #2113 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/2113/])
HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed
by Surendra Singh Lilhore) (arp: rev 6f541edce0ed64bf316276715c4bc07794ff20ac)
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/LazyPersistTestCase.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestLazyPersistFiles.java
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Fix For: 2.8.0
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525203#comment-14525203
]
Hudson commented on HDFS-8229:
--
FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #181 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/181/])
HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed
by Surendra Singh Lilhore) (arp: rev 6f541edce0ed64bf316276715c4bc07794ff20ac)
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestLazyPersistFiles.java
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/LazyPersistTestCase.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Fix For: 2.8.0
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525301#comment-14525301
]
Hudson commented on HDFS-8229:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #182 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/182/])
HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed
by Surendra Singh Lilhore) (arp: rev 6f541edce0ed64bf316276715c4bc07794ff20ac)
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestLazyPersistFiles.java
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/LazyPersistTestCase.java
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Fix For: 2.8.0
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525320#comment-14525320
]
Hudson commented on HDFS-8229:
--
SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2131 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2131/])
HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed
by Surendra Singh Lilhore) (arp: rev 6f541edce0ed64bf316276715c4bc07794ff20ac)
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/LazyPersistTestCase.java
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestLazyPersistFiles.java
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Fix For: 2.8.0
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525275#comment-14525275
]
Hudson commented on HDFS-8229:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #172 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/172/])
HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed
by Surendra Singh Lilhore) (arp: rev 6f541edce0ed64bf316276715c4bc07794ff20ac)
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/LazyPersistTestCase.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestLazyPersistFiles.java
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Fix For: 2.8.0
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524457#comment-14524457
]
Hudson commented on HDFS-8229:
--
SUCCESS: Integrated in Hadoop-trunk-Commit #7716 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/7716/])
HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed
by Surendra Singh Lilhore) (arp: rev 6f541edce0ed64bf316276715c4bc07794ff20ac)
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/LazyPersistTestCase.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestLazyPersistFiles.java
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Fix For: 2.8.0
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522879#comment-14522879
]
Hadoop QA commented on HDFS-8229:
-
(!) The patch artifact directory has been removed!
This is a fatal error for test-patch.sh. Aborting.
Jenkins (node H3) information at
https://builds.apache.org/job/PreCommit-HDFS-Build/10501/ may provide some
hints.
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524017#comment-14524017
]
Hadoop QA commented on HDFS-8229:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 14m 46s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 2 new or modified test files. |
| {color:green}+1{color} | javac | 7m 28s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 35s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 24s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 1m 20s | The applied patch generated 2
new checkstyle issues (total was 359, now 360). |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 32s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 32s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 3m 3s | The patch does not introduce
any new Findbugs (version 2.0.3) warnings. |
| {color:green}+1{color} | native | 3m 12s | Pre-build of native portion |
| {color:green}+1{color} | hdfs tests | 164m 32s | Tests passed in hadoop-hdfs.
|
| | | 206m 31s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12729442/HDFS-8229_2.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 279958b |
| checkstyle |
https://builds.apache.org/job/PreCommit-HDFS-Build/10507/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/10507/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/10507/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/10507/console |
This message was automatically generated.
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521145#comment-14521145
]
surendra singh lilhore commented on HDFS-8229:
--
Attached new patch, please review.
In test case I am not using {{getCorruptReplicaBlocksCount()}} API for counting
corrupt blocks because of
[HDFS-8296|https://issues.apache.org/jira/browse/HDFS-8296]
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521577#comment-14521577
]
Hadoop QA commented on HDFS-8229:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 14m 28s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 2 new or modified test files. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | javac | 7m 25s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 33s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 22s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 5m 27s | The applied patch generated 1
additional checkstyle issues. |
| {color:green}+1{color} | install | 1m 30s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 33s | The patch built with
eclipse:eclipse. |
| {color:red}-1{color} | findbugs | 3m 7s | The patch appears to introduce 1
new Findbugs (version 2.0.3) warnings. |
| {color:green}+1{color} | native | 3m 11s | Pre-build of native portion |
| {color:red}-1{color} | hdfs tests | 225m 54s | Tests failed in hadoop-hdfs. |
| | | 271m 34s | |
\\
\\
|| Reason || Tests ||
| FindBugs | module:hadoop-hdfs |
| | Class org.apache.hadoop.hdfs.DataStreamer$LastException is not derived
from an Exception, even though it is named as such At DataStreamer.java:from
an Exception, even though it is named as such At DataStreamer.java:[lines
177-201] |
| Failed unit tests | hadoop.hdfs.server.namenode.TestDeleteRace |
| | hadoop.hdfs.TestClose |
| | hadoop.hdfs.TestDFSClientRetries |
| | hadoop.hdfs.TestQuota |
| | hadoop.hdfs.TestMultiThreadedHflush |
| | hadoop.hdfs.TestDFSOutputStream |
| | hadoop.hdfs.server.namenode.TestSaveNamespace |
| | hadoop.hdfs.server.datanode.TestBlockRecovery |
| | hadoop.cli.TestHDFSCLI |
| | hadoop.hdfs.TestFileLengthOnClusterRestart |
| | hadoop.hdfs.TestCrcCorruption |
| | hadoop.hdfs.server.datanode.fsdataset.impl.TestRbwSpaceReservation |
| Timed out tests |
org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache |
| | org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery |
| | org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer |
| | org.apache.hadoop.hdfs.TestDataTransferProtocol |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12729442/HDFS-8229_2.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / f5b3847 |
| checkstyle |
https://builds.apache.org/job/PreCommit-HDFS-Build/10475/artifact/patchprocess/checkstyle-result-diff.txt
|
| Findbugs warnings |
https://builds.apache.org/job/PreCommit-HDFS-Build/10475/artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/10475/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/10475/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/10475/console |
This message was automatically generated.
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521860#comment-14521860
]
Arpit Agarwal commented on HDFS-8229:
-
+1 for the patch. Thanks for the updates [~surendrasingh].
I kicked off another pre-commit build since previous results look wrong.
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522306#comment-14522306
]
Hadoop QA commented on HDFS-8229:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 14m 25s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 2 new or modified test files. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | javac | 7m 29s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 35s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 22s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 5m 28s | The applied patch generated 1
additional checkstyle issues. |
| {color:green}+1{color} | install | 1m 34s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 31s | The patch built with
eclipse:eclipse. |
| {color:red}-1{color} | findbugs | 3m 7s | The patch appears to introduce 1
new Findbugs (version 2.0.3) warnings. |
| {color:green}+1{color} | native | 3m 12s | Pre-build of native portion |
| {color:red}-1{color} | hdfs tests | 233m 19s | Tests failed in hadoop-hdfs. |
| | | 279m 6s | |
\\
\\
|| Reason || Tests ||
| FindBugs | module:hadoop-hdfs |
| | Class org.apache.hadoop.hdfs.DataStreamer$LastException is not derived
from an Exception, even though it is named as such At DataStreamer.java:from
an Exception, even though it is named as such At DataStreamer.java:[lines
177-201] |
| Failed unit tests | hadoop.hdfs.server.namenode.TestDeleteRace |
| | hadoop.hdfs.TestClose |
| | hadoop.hdfs.TestDFSClientRetries |
| | hadoop.hdfs.TestQuota |
| | hadoop.hdfs.TestMultiThreadedHflush |
| | hadoop.hdfs.TestDFSOutputStream |
| | hadoop.hdfs.server.namenode.TestSaveNamespace |
| | hadoop.hdfs.server.datanode.TestBlockRecovery |
| | hadoop.cli.TestHDFSCLI |
| | hadoop.hdfs.TestFileLengthOnClusterRestart |
| | hadoop.hdfs.TestCrcCorruption |
| | hadoop.hdfs.server.datanode.fsdataset.impl.TestRbwSpaceReservation |
| Timed out tests |
org.apache.hadoop.hdfs.server.namenode.TestNamenodeRetryCache |
| | org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery |
| | org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer |
| | org.apache.hadoop.hdfs.TestDataTransferProtocol |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12729442/HDFS-8229_2.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / de9404f |
| checkstyle |
https://builds.apache.org/job/PreCommit-HDFS-Build/10482/artifact/patchprocess/checkstyle-result-diff.txt
|
| Findbugs warnings |
https://builds.apache.org/job/PreCommit-HDFS-Build/10482/artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/10482/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/10482/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/10482/console |
This message was automatically generated.
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch, HDFS-8229_1.patch, HDFS-8229_2.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520407#comment-14520407
]
Arpit Agarwal commented on HDFS-8229:
-
Thanks for the update [~surendrasingh]. We should also add a check for HA
status. if isHaEnabled() then inActiveState() should be true. Sorry I should
have mentioned that earlier.
Also perhaps we can update the test case to make it more predictable. e.g. stop
DNs, restart just the NN, wait until we see corrupt files and check they are
not deleted.
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch, HDFS-8229_1.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520813#comment-14520813
]
Arpit Agarwal commented on HDFS-8229:
-
Thanks you are right. I missed that part. +1 for the fix.
Do you want to take a shot at updating the test case?
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch, HDFS-8229_1.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520811#comment-14520811
]
surendra singh lilhore commented on HDFS-8229:
--
Thanks [~arpitagarwal] for review. I have one doubt, why we need to check
{{isHaEnabled()}} and {{inActiveState()}} ??
{{LazyPersistFileScrubber}} started by {{startActiveServices()}} and this API
start services for active namenode only. Please correct me if I am wrong.
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch, HDFS-8229_1.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520816#comment-14520816
]
surendra singh lilhore commented on HDFS-8229:
--
Thanks, yes I will update the patch soon..
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch, HDFS-8229_1.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516776#comment-14516776
]
surendra singh lilhore commented on HDFS-8229:
--
[~arpitagarwal] thanks for review and suggestion. I have attached new patch,
Please review.
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch, HDFS-8229_1.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.
[
https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514528#comment-14514528
]
Arpit Agarwal commented on HDFS-8229:
-
Thank you for reporting this [~surendrasingh], good catch.
A better fix is to check is to avoid deleting until the NN is out of safe mode.
LAZY_PERSIST file gets deleted after NameNode restart.
--
Key: HDFS-8229
URL: https://issues.apache.org/jira/browse/HDFS-8229
Project: Hadoop HDFS
Issue Type: Bug
Components: HDFS
Affects Versions: 2.6.0
Reporter: surendra singh lilhore
Assignee: surendra singh lilhore
Attachments: HDFS-8229.patch
{code}
2015-04-20 10:26:55,180 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Removing lazyPersist
file /LAZY_PERSIST/smallfile with no replicas.
{code}
After namenode restart and before DN's registration if
{{LazyPersistFileScrubber}} will run then it will delete Lazy persist file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
