Hi All,
In one of our hadoop cluster we faced CheckSum file Corruption, due to which
appending to the file failed.
If any one of you faced this problem earlier, please share your experiences.
We are using hadoop 0.20.1 with append feature.
Scenario:
===
1. Created the file,
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/970/changes
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-PB-Build/6/
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-PB-Build/6/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 15126 lines...]
[INFO] Deleting
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/183/changes
Changes:
[harsh] svn merge -c 1295061. Merge HADOOP-7940 into branch-0.23. (Csaba Miklos
via harsh).
[vinodkv] MAPREDUCE-3931. Changed PB implementation of LocalResource to take
locks so that race conditions don't fail tasks
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1882/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 9390 lines...]
[INFO] Executing tasks
main:
[
https://issues.apache.org/jira/browse/HDFS-1103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsz Wo (Nicholas), SZE resolved HDFS-1103.
--
Resolution: Invalid
As explained by Hairong, this is invalid. Please feel free
[
https://issues.apache.org/jira/browse/HDFS-3027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron T. Myers resolved HDFS-3027.
--
Resolution: Fixed
Fix Version/s: HA branch (HDFS-1623)
Hadoop Flags: Reviewed
Error (failed to close file) when uploading large file + kill active NN +
manual failover
-
Key: HDFS-3031
URL: https://issues.apache.org/jira/browse/HDFS-3031
[
https://issues.apache.org/jira/browse/HDFS-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsz Wo (Nicholas), SZE resolved HDFS-2253.
--
Resolution: Duplicate
Duplicate HDFS-663.
Create a benchmark
Lease renewer tries forever even if renewal is not possible
---
Key: HDFS-3032
URL: https://issues.apache.org/jira/browse/HDFS-3032
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron T. Myers resolved HDFS-2979.
--
Resolution: Fixed
Fix Version/s: HA branch (HDFS-1623)
Hadoop Flags: Reviewed
Hello HDFS devs,
The four JIRAs I mentioned below have all now been committed to the HA
branch. We've been running through the test plans posted on HDFS-1623 for
the last week.
The only thing that's been discovered in the interim on the branch that
should perhaps be considered a blocker for the
+1 as well.
My latest tests after applying the performance fixes indicate that
there is no statistically significant performance regression between
trunk and HA, even in tests designed to stress test the worst case
code paths. The fixes should be committed today or tomorrow, but don't
need to
[
https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon reopened HDFS-2979:
---
This patch seems to have made some tests fail (I noticed with TestFileAppend2).
It seems to be trying to
Hi,
The HA build has been unstable since Feb 13. In particular, HttpFS failed in
the latest build (#92). On the other hand, the latest trunk HDFS build (#970)
is stable. Could we stabilize the HA build before merging?
Nicholas
---
Latest HA Build (#92):
On Wed, Feb 29, 2012 at 4:32 PM, Tsz Wo Sze szets...@yahoo.com wrote:
Latest HA Build (#92):
https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Hdfs-HAbranch-build/92/console
[INFO]
[INFO] Apache Hadoop HDFS SUCCESS [8:34.652s]
[INFO] Apache Hadoop
[
https://issues.apache.org/jira/browse/HDFS-3023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-3023.
---
Resolution: Fixed
Fix Version/s: HA branch (HDFS-1623)
Target Version/s: HA branch
HA: MiniDFSCluster should configure conf with actual address of NN in case of
non-federated, non-HA cluster
---
Key: HDFS-3033
URL:
[
https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron T. Myers resolved HDFS-2979.
--
Resolution: Fixed
Thanks Todd. I've filed HDFS-3033 to address these failures.
Hi Todd,
Then, why the trunk build did not suffer such problem?
Nicholas
From: Todd Lipcon t...@cloudera.com
To: hdfs-dev@hadoop.apache.org; Tsz Wo Sze szets...@yahoo.com
Sent: Wednesday, February 29, 2012 4:36 PM
Subject: Re: Merging the HA branch to
On Wed, Feb 29, 2012 at 5:01 PM, Tsz Wo Sze szets...@yahoo.com wrote:
Hi Todd,
Then, why the trunk build did not suffer such problem?
Bad luck? Looks like a network blip - failure to download something
from archive.apache.org.
Todd
From: Todd Lipcon
[
https://issues.apache.org/jira/browse/HDFS-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon resolved HDFS-3010.
---
Resolution: Fixed
With the recent patches committed to the HA branch, performance is now
comparable.
Anyway, could we get a stable build before merging?
Nicholas
From: Todd Lipcon t...@cloudera.com
To: hdfs-dev@hadoop.apache.org; Tsz Wo Sze szets...@yahoo.com
Sent: Wednesday, February 29, 2012 5:04 PM
Subject: Re: Merging the HA branch to trunk - Wednesday,
I am +1 on merging this to trunk.
On Feb 29, 2012, at 4:03 PM, Todd Lipcon t...@cloudera.com wrote:
+1 as well.
My latest tests after applying the performance fixes indicate that
there is no statistically significant performance regression between
trunk and HA, even in tests designed to
I think it is better if you start a fresh voting thread. I almost missed
this given originally it was a discussion thread, perhaps others too.
Thanks
+Vinod
On Wed, Feb 29, 2012 at 5:42 PM, Suresh Srinivas sur...@hortonworks.comwrote:
I am +1 on merging this to trunk.
On Feb 29, 2012, at
[
https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron T. Myers reopened HDFS-2979:
--
On second thought, I'm going to revert this change and fix the issue with NN
conf mutation by
27 matches
Mail list logo
