[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-3875:
-
Attachment: (was: hdfs-3875.trunk.with.test.patch.txt)
Issue handling checksum errors in write
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-3875:
-
Attachment: (was: hdfs-3875.trunk.no.test.patch.txt)
Issue handling checksum errors in write
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-3875:
-
Attachment: hdfs-3875.branch-0.23.with.test.patch.txt
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-3875:
-
Attachment: hdfs-3875.trunk.with.test.patch.txt
hdfs-3875.trunk.no.test.patch.txt
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13507907#comment-13507907
]
Kihwal Lee commented on HDFS-3875:
--
Again, the test is a bit invasive as it requires
[
https://issues.apache.org/jira/browse/HDFS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13507927#comment-13507927
]
Hudson commented on HDFS-3680:
--
Integrated in Hadoop-Yarn-trunk #53 (See
[
https://issues.apache.org/jira/browse/HDFS-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13507928#comment-13507928
]
Hudson commented on HDFS-4213:
--
Integrated in Hadoop-Yarn-trunk #53 (See
[
https://issues.apache.org/jira/browse/HDFS-4242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13507950#comment-13507950
]
Hudson commented on HDFS-4242:
--
Integrated in Hadoop-Hdfs-0.23-Build #452 (See
[
https://issues.apache.org/jira/browse/HDFS-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13507952#comment-13507952
]
Hudson commented on HDFS-4254:
--
Integrated in Hadoop-Hdfs-0.23-Build #452 (See
[
https://issues.apache.org/jira/browse/HDFS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13507957#comment-13507957
]
Hudson commented on HDFS-3680:
--
Integrated in Hadoop-Hdfs-trunk #1243 (See
[
https://issues.apache.org/jira/browse/HDFS-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13507958#comment-13507958
]
Hudson commented on HDFS-4213:
--
Integrated in Hadoop-Hdfs-trunk #1243 (See
[
https://issues.apache.org/jira/browse/HDFS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13507968#comment-13507968
]
Hudson commented on HDFS-3680:
--
Integrated in Hadoop-Mapreduce-trunk #1274 (See
[
https://issues.apache.org/jira/browse/HDFS-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13507969#comment-13507969
]
Hudson commented on HDFS-4213:
--
Integrated in Hadoop-Mapreduce-trunk #1274 (See
Harsh J created HDFS-4255:
-
Summary: Useless stacktrace shown in DN when there's an error
writing a block
Key: HDFS-4255
URL: https://issues.apache.org/jira/browse/HDFS-4255
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-4255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13507974#comment-13507974
]
Harsh J commented on HDFS-4255:
---
Fuller log, taken from a test case where we stop a DN after
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-3875:
-
Status: Patch Available (was: Open)
Issue handling checksum errors in write pipeline
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508006#comment-13508006
]
Hadoop QA commented on HDFS-3875:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508011#comment-13508011
]
Daryn Sharp commented on HDFS-4248:
---
Odd, I was having some renames rewrite paths to nest
[
https://issues.apache.org/jira/browse/HDFS-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated HDFS-4246:
--
Attachment: HDFS-4246.patch
Attached a patch that implements this. The new behavior is to expire the
elements
[
https://issues.apache.org/jira/browse/HDFS-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J reassigned HDFS-4246:
-
Assignee: Harsh J
The exclude node list should be more forgiving, for each output stream
[
https://issues.apache.org/jira/browse/HDFS-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated HDFS-4246:
--
Target Version/s: 3.0.0
Status: Patch Available (was: Open)
The exclude node list should be
[
https://issues.apache.org/jira/browse/HDFS-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated HDFS-4246:
--
Affects Version/s: 2.0.0-alpha
The exclude node list should be more forgiving, for each output stream
[
https://issues.apache.org/jira/browse/HDFS-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508013#comment-13508013
]
Daryn Sharp commented on HDFS-4247:
---
I'll remove the synch and commit, but will this
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508014#comment-13508014
]
Kihwal Lee commented on HDFS-3875:
--
There is something missing in the latest patch that
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-3875:
-
Attachment: hdfs-3875.trunk.no.test.patch.txt
hdfs-3875.trunk.with.test.patch.txt
[
https://issues.apache.org/jira/browse/HDFS-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp updated HDFS-4247:
--
Resolution: Fixed
Fix Version/s: 0.23.6
2.0.3-alpha
3.0.0
[
https://issues.apache.org/jira/browse/HDFS-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508017#comment-13508017
]
Hudson commented on HDFS-4247:
--
Integrated in Hadoop-trunk-Commit #3080 (See
Suresh Srinivas created HDFS-4256:
-
Summary: Support for concatenation of files into a single file in
branch-1
Key: HDFS-4256
URL: https://issues.apache.org/jira/browse/HDFS-4256
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508025#comment-13508025
]
Harsh J commented on HDFS-4256:
---
HDFS-222 has a requirement that all files's block lengths be
[
https://issues.apache.org/jira/browse/HDFS-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508033#comment-13508033
]
Kihwal Lee commented on HDFS-4248:
--
Since the leases are used to track all
[
https://issues.apache.org/jira/browse/HDFS-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508035#comment-13508035
]
Daryn Sharp commented on HDFS-4248:
---
bq. As for what happens to the leases after renaming
[
https://issues.apache.org/jira/browse/HDFS-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508038#comment-13508038
]
Hadoop QA commented on HDFS-4246:
-
{color:green}+1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508041#comment-13508041
]
Hadoop QA commented on HDFS-3875:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508048#comment-13508048
]
Tsz Wo (Nicholas), SZE commented on HDFS-4247:
--
... but will this cause any
[
https://issues.apache.org/jira/browse/HDFS-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsz Wo (Nicholas), SZE updated HDFS-4248:
-
Description: Renames of directories may incorrectly remove the paths in
leases
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508057#comment-13508057
]
Suresh Srinivas commented on HDFS-3875:
---
kihwal, I will review the patch shortly and
Harsh J created HDFS-4257:
-
Summary: The ReplaceDatanodeOnFailure policies could have a
forgiving option
Key: HDFS-4257
URL: https://issues.apache.org/jira/browse/HDFS-4257
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated HDFS-4257:
--
Description:
Similar question has previously come over HDFS-3091 and friends, but the
essential problem is:
[
https://issues.apache.org/jira/browse/HDFS-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508071#comment-13508071
]
Daryn Sharp commented on HDFS-4248:
---
Thanks Nicholas. If you decide it's reasonable,
[
https://issues.apache.org/jira/browse/HDFS-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508073#comment-13508073
]
Tsz Wo (Nicholas), SZE commented on HDFS-4248:
--
Sure, I will commit the patch
[
https://issues.apache.org/jira/browse/HDFS-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsz Wo (Nicholas), SZE updated HDFS-4248:
-
Hadoop Flags: Reviewed
+1
I tried various rename cases and the patch passed all
[
https://issues.apache.org/jira/browse/HDFS-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508084#comment-13508084
]
Hudson commented on HDFS-4248:
--
Integrated in Hadoop-trunk-Commit #3081 (See
[
https://issues.apache.org/jira/browse/HDFS-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsz Wo (Nicholas), SZE updated HDFS-4257:
-
Assignee: Tsz Wo (Nicholas), SZE
Issue Type: New Feature (was: Bug)
Harsh,
[
https://issues.apache.org/jira/browse/HDFS-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsz Wo (Nicholas), SZE updated HDFS-4248:
-
Resolution: Fixed
Fix Version/s: 0.23.6
Status: Resolved (was:
[
https://issues.apache.org/jira/browse/HDFS-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508098#comment-13508098
]
Tsz Wo (Nicholas), SZE commented on HDFS-4248:
--
{quote}
As for what happens
Tsz Wo (Nicholas), SZE created HDFS-4258:
Summary: Rename of Being Written Files
Key: HDFS-4258
URL: https://issues.apache.org/jira/browse/HDFS-4258
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508132#comment-13508132
]
Suresh Srinivas commented on HDFS-4256:
---
bq. HDFS-222 has a requirement that all
[
https://issues.apache.org/jira/browse/HDFS-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508133#comment-13508133
]
Suresh Srinivas commented on HDFS-4249:
---
Andrew, sounds like a good idea. We should
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508134#comment-13508134
]
Tsz Wo (Nicholas), SZE commented on HDFS-3875:
--
Hi Kihwal,
In a client write
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508136#comment-13508136
]
Kihwal Lee commented on HDFS-3875:
--
Whether it returns or throws an exception the result
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508138#comment-13508138
]
Kihwal Lee commented on HDFS-3875:
--
Also, checksumError is set true before returning, so
[
https://issues.apache.org/jira/browse/HDFS-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508143#comment-13508143
]
Harsh J commented on HDFS-4257:
---
Thanks for the comment Nicholas!
I feel having an
Harsh J created HDFS-4259:
-
Summary: Improve pipeline DN replacement failure message
Key: HDFS-4259
URL: https://issues.apache.org/jira/browse/HDFS-4259
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated HDFS-4259:
--
Description:
The current message shown is something such as below:
bq. Failed to add a datanode. User may turn
[
https://issues.apache.org/jira/browse/HDFS-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J reassigned HDFS-4259:
-
Assignee: Harsh J
Improve pipeline DN replacement failure message
[
https://issues.apache.org/jira/browse/HDFS-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated HDFS-4259:
--
Attachment: HDFS-4259.patch
Here's a patch that changes it to:
bq. Failed to replace a bad datanode on the
[
https://issues.apache.org/jira/browse/HDFS-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated HDFS-4259:
--
Target Version/s: 3.0.0
Improve pipeline DN replacement failure message
[
https://issues.apache.org/jira/browse/HDFS-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated HDFS-4259:
--
Status: Patch Available (was: Open)
Improve pipeline DN replacement failure message
[
https://issues.apache.org/jira/browse/HDFS-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508145#comment-13508145
]
Harsh J commented on HDFS-4256:
---
Suresh,
Thanks for commenting back!
bq. I also think
[
https://issues.apache.org/jira/browse/HDFS-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508170#comment-13508170
]
Harsh J commented on HDFS-3598:
---
How about formally adding this into FileSystem API and then
[
https://issues.apache.org/jira/browse/HDFS-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508180#comment-13508180
]
Hadoop QA commented on HDFS-4259:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508186#comment-13508186
]
Tsz Wo (Nicholas), SZE commented on HDFS-3875:
--
If you have already well
62 matches
Mail list logo
