[jira] [Updated] (HDFS-6579) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

2014-06-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6579: Fix Version/s: (was: 2.4.1) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

[jira] [Commented] (HDFS-6578) add toString method to DatanodeStorage etc for easier debugging

2014-06-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039930#comment-14039930 ] Arpit Agarwal commented on HDFS-6578: - Hi [~yzhangal], bq. _BlockManager.processReport

[jira] [Commented] (HDFS-6587) Bug in TestBPOfferService blocks the trunk build

2014-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040338#comment-14040338 ] Arpit Agarwal commented on HDFS-6587: - +1 for the patch. I will commit it shortly.

[jira] [Updated] (HDFS-6587) Bug in TestBPOfferService blocks the trunk build

2014-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6587: Priority: Major (was: Blocker) Bug in TestBPOfferService blocks the trunk build

[jira] [Comment Edited] (HDFS-6587) Bug in TestBPOfferService blocks the trunk build

2014-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040345#comment-14040345 ] Arpit Agarwal edited comment on HDFS-6587 at 6/23/14 2:04 AM: --

[jira] [Commented] (HDFS-6587) Bug in TestBPOfferService blocks the trunk build

2014-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040345#comment-14040345 ] Arpit Agarwal commented on HDFS-6587: - I am hitting an issue with subversion right now,

[jira] [Updated] (HDFS-6587) Bug in TestBPOfferService can cause test failure

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6587: Summary: Bug in TestBPOfferService can cause test failure (was: Bug in TestBPOfferService blocks

[jira] [Updated] (HDFS-6587) Bug in TestBPOfferService can cause test failure

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6587: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Target

[jira] [Updated] (HDFS-6587) Bug in TestBPOfferService can cause test failure

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6587: Component/s: test Bug in TestBPOfferService can cause test failure

[jira] [Updated] (HDFS-6587) Bug in TestBPOfferService can cause test failure

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6587: Affects Version/s: 2.4.0 Bug in TestBPOfferService can cause test failure

[jira] [Updated] (HDFS-6587) Bug in TestBPOfferService can cause test failure

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6587: Labels: (was: patch) Bug in TestBPOfferService can cause test failure

[jira] [Updated] (HDFS-6579) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6579: Assignee: Jinghui Wang Hadoop Flags: Reviewed Status: Patch Available (was: Open)

[jira] [Commented] (HDFS-6578) add toString method to DatanodeStorage etc for easier debugging

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041338#comment-14041338 ] Arpit Agarwal commented on HDFS-6578: - Your original understanding was correct. i.e.

[jira] [Updated] (HDFS-6578) add toString method to DatanodeStorage etc for easier debugging

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6578: Issue Type: Improvement (was: Bug) add toString method to DatanodeStorage etc for easier

[jira] [Updated] (HDFS-6578) add toString method to DatanodeStorage for easier debugging

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6578: Summary: add toString method to DatanodeStorage for easier debugging (was: add toString method to

[jira] [Updated] (HDFS-6578) add toString method to DatanodeStorage for easier debugging

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6578: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Target

[jira] [Commented] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-06-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046451#comment-14046451 ] Arpit Agarwal commented on HDFS-6441: - HDFS-6133 excludes by file path, whereas this

[jira] [Commented] (HDFS-6670) Archival Storage: Add block storage policy

2014-07-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14060992#comment-14060992 ] Arpit Agarwal commented on HDFS-6670: - +1 for the latest patch. Archival Storage: Add

[jira] [Commented] (HDFS-6340) DN can't finalize upgrade

2014-07-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062480#comment-14062480 ] Arpit Agarwal commented on HDFS-6340: - You can manually delete the 'previous' directory

[jira] [Commented] (HDFS-6699) Secure Windows DFS read when client co-located on nodes with data (short-circuit reads)

2014-07-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065208#comment-14065208 ] Arpit Agarwal commented on HDFS-6699: - Hi Remus, an alternative approach you may have

[jira] [Commented] (HDFS-6699) Secure Windows DFS read when client co-located on nodes with data (short-circuit reads)

2014-07-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065536#comment-14065536 ] Arpit Agarwal commented on HDFS-6699: - Locking down the named mapping should be easy

[jira] [Commented] (HDFS-6700) BlockPlacementPolicy shoud choose storage but not datanode for deletion

2014-07-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066576#comment-14066576 ] Arpit Agarwal commented on HDFS-6700: - +1 for the patch. One caveat - NN storage map

[jira] [Created] (HDFS-6708) StorageType should be encoded in the block token

2014-07-18 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6708: --- Summary: StorageType should be encoded in the block token Key: HDFS-6708 URL: https://issues.apache.org/jira/browse/HDFS-6708 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6708) StorageType should be encoded in the block token

2014-07-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6708: Description: HDFS-6702 is adding support for file creation based on StorageType. The client acts

[jira] [Updated] (HDFS-6708) StorageType should be encoded in the block token

2014-07-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6708: Description: HDFS-6702 is adding support for file creation based on StorageType. The block token

[jira] [Commented] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-19 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067595#comment-14067595 ] Arpit Agarwal commented on HDFS-6441: - Thanks [~szetszwo]! I would have preferred to

[jira] [Comment Edited] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-19 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067595#comment-14067595 ] Arpit Agarwal edited comment on HDFS-6441 at 7/19/14 5:21 PM: --

[jira] [Created] (HDFS-6712) Document HDFS Multihoming Settings

2014-07-19 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6712: --- Summary: Document HDFS Multihoming Settings Key: HDFS-6712 URL: https://issues.apache.org/jira/browse/HDFS-6712 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6712) Document HDFS Multihoming Settings

2014-07-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6712: Status: Patch Available (was: Open) Document HDFS Multihoming Settings

[jira] [Updated] (HDFS-6712) Document HDFS Multihoming Settings

2014-07-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6712: Attachment: HDFS-6712.01.patch Document HDFS Multihoming Settings

[jira] [Updated] (HDFS-6712) Document HDFS Multihoming Settings

2014-07-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6712: Attachment: (was: HDFS-6712.01.patch) Document HDFS Multihoming Settings

[jira] [Updated] (HDFS-6712) Document HDFS Multihoming Settings

2014-07-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6712: Attachment: HDFS-6712.02.patch Document HDFS Multihoming Settings

[jira] [Commented] (HDFS-6702) DFSClient should create blocks using StorageType

2014-07-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069760#comment-14069760 ] Arpit Agarwal commented on HDFS-6702: - Hi [~szetszwo], #for {{writeBlock}}, why do we

[jira] [Comment Edited] (HDFS-6702) DFSClient should create blocks using StorageType

2014-07-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069760#comment-14069760 ] Arpit Agarwal edited comment on HDFS-6702 at 7/22/14 3:20 AM: --

[jira] [Commented] (HDFS-6712) Document HDFS Multihoming Settings

2014-07-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069789#comment-14069789 ] Arpit Agarwal commented on HDFS-6712: - The failure is unrelated. Document HDFS

[jira] [Commented] (HDFS-6702) DFSClient should create blocks using StorageType

2014-07-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069809#comment-14069809 ] Arpit Agarwal commented on HDFS-6702: - bq. If we choose (a) then the index of targets

[jira] [Commented] (HDFS-6702) DFSClient should create blocks using StorageType

2014-07-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070471#comment-14070471 ] Arpit Agarwal commented on HDFS-6702: - Thanks Nicholas! DFSClient should create

[jira] [Updated] (HDFS-6712) Document HDFS Multihoming Settings

2014-07-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6712: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Status: Resolved

[jira] [Comment Edited] (HDFS-6712) Document HDFS Multihoming Settings

2014-07-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070845#comment-14070845 ] Arpit Agarwal edited comment on HDFS-6712 at 7/22/14 8:34 PM: --

[jira] [Commented] (HDFS-6708) StorageType should be encoded in the block token

2014-07-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071270#comment-14071270 ] Arpit Agarwal commented on HDFS-6708: - Hi Nicholas, I think it is fine to have this as

[jira] [Commented] (HDFS-6686) Archival Storage: Use fallback storage types

2014-07-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071394#comment-14071394 ] Arpit Agarwal commented on HDFS-6686: - Hi Nicholas, took a look at the patch. Also have

[jira] [Commented] (HDFS-6719) org.apache.hadoop.fs.TestDFVariations.testMount failed intermittently because specified path doesn't exist

2014-07-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14072061#comment-14072061 ] Arpit Agarwal commented on HDFS-6719: - Nitpick, test_root need not be static. Also if

[jira] [Commented] (HDFS-6719) org.apache.hadoop.fs.TestDFVariations.testMount failed intermittently because specified path doesn't exist

2014-07-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14072129#comment-14072129 ] Arpit Agarwal commented on HDFS-6719: - Sorry I missed that, +1 for the patch. Will

[jira] [Updated] (HDFS-6719) TestDFVariations.testMount fails intermittently

2014-07-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6719: Summary: TestDFVariations.testMount fails intermittently (was:

[jira] [Commented] (HDFS-6742) Support sorting datanode list on the new NN webUI

2014-07-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073444#comment-14073444 ] Arpit Agarwal commented on HDFS-6742: - Hi Ming, I noticed you filed a number of Jiras

[jira] [Commented] (HDFS-6742) Support sorting datanode list on the new NN webUI

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074662#comment-14074662 ] Arpit Agarwal commented on HDFS-6742: - Thanks Ming! Support sorting datanode list on

[jira] [Commented] (HDFS-6752) Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074694#comment-14074694 ] Arpit Agarwal commented on HDFS-6752: - +1 for the patch. Avoid Address bind errors in

[jira] [Commented] (HDFS-6752) Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074758#comment-14074758 ] Arpit Agarwal commented on HDFS-6752: - Thanks for fixing this [~vinayrpet]. Since it

[jira] [Updated] (HDFS-6752) Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6752: Target Version/s: 2.5.0 Fix Version/s: (was: 2.6.0) 2.5.0

[jira] [Updated] (HDFS-6752) Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6752: Affects Version/s: 3.0.0 Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

[jira] [Commented] (HDFS-6752) Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074763#comment-14074763 ] Arpit Agarwal commented on HDFS-6752: - Merged to branch-2.5 as r1613492. Avoid

[jira] [Updated] (HDFS-6752) Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6752: Affects Version/s: 2.4.1 Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

[jira] [Updated] (HDFS-6752) Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6752: Component/s: test Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

[jira] [Updated] (HDFS-6752) Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6752: Release Note: (was: Merged to branch-2.5 as r1613492.) Avoid Address bind errors in

[jira] [Commented] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074853#comment-14074853 ] Arpit Agarwal commented on HDFS-6756: - Hi Juan, are you seeing any specific instance

[jira] [Commented] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074969#comment-14074969 ] Arpit Agarwal commented on HDFS-6756: - Did you figure out which specific RPC call? Was

[jira] [Comment Edited] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074969#comment-14074969 ] Arpit Agarwal edited comment on HDFS-6756 at 7/25/14 9:37 PM: --

[jira] [Commented] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075023#comment-14075023 ] Arpit Agarwal commented on HDFS-6756: - HDFS-5153 Default ipc.maximum.data.length

[jira] [Commented] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075051#comment-14075051 ] Arpit Agarwal commented on HDFS-6756: - Possible but unlikely in the near future at

[jira] [Created] (HDFS-6758) block writer should pass the expected block size to DataXceiverServer

2014-07-25 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6758: --- Summary: block writer should pass the expected block size to DataXceiverServer Key: HDFS-6758 URL: https://issues.apache.org/jira/browse/HDFS-6758 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6758) block writer should pass the expected block size to DataXceiverServer

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6758: Description: DataXceiver initializes the block size to the default block size for the cluster.

[jira] [Commented] (HDFS-6750) The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale

2014-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075124#comment-14075124 ] Arpit Agarwal commented on HDFS-6750: - +1 for the patch. iiuc the added call to

[jira] [Commented] (HDFS-6762) hadoop-hdfs build fails at module-javadocs

2014-07-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076720#comment-14076720 ] Arpit Agarwal commented on HDFS-6762: - I have not seen any build issues on a

[jira] [Updated] (HDFS-6685) Archival Storage: Update Balancer to preserve storage type of replicas

2014-07-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6685: Status: Patch Available (was: Open) Archival Storage: Update Balancer to preserve storage type of

[jira] [Updated] (HDFS-6758) block writer should pass the expected block size to DataXceiverServer

2014-07-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6758: Attachment: HDFS-6758.01.patch Correct. Attached patch adds a new optional parameter to

[jira] [Updated] (HDFS-6758) block writer should pass the expected block size to DataXceiverServer

2014-07-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6758: Status: Patch Available (was: Open) block writer should pass the expected block size to

[jira] [Updated] (HDFS-6768) TestBlockRecovery should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Description: TestBlockRecovery uses hard-coded port numbers making it susceptible to 'port in use'

[jira] [Created] (HDFS-6768) TestBlockRecovery should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6768: --- Summary: TestBlockRecovery should use ephemeral ports Key: HDFS-6768 URL: https://issues.apache.org/jira/browse/HDFS-6768 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6769) TestRefreshCallQueue should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6769: --- Summary: TestRefreshCallQueue should use ephemeral ports Key: HDFS-6769 URL: https://issues.apache.org/jira/browse/HDFS-6769 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6769) TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6769: Summary: TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports (was:

[jira] [Updated] (HDFS-6769) TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6769: Description: TestRefreshCallQueue and TestGenericRefresh use the same hard-coded port number

[jira] [Commented] (HDFS-6758) block writer should pass the expected block size to DataXceiverServer

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078145#comment-14078145 ] Arpit Agarwal commented on HDFS-6758: - All test failures are unrelated. #

[jira] [Updated] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Summary: TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

[jira] [Resolved] (HDFS-6769) TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6769. - Resolution: Duplicate TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

[jira] [Updated] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Description: TestBlockRecovery uses hard-coded port numbers making it susceptible to 'port in use'

[jira] [Comment Edited] (HDFS-6758) block writer should pass the expected block size to DataXceiverServer

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078145#comment-14078145 ] Arpit Agarwal edited comment on HDFS-6758 at 7/29/14 6:40 PM: --

[jira] [Work started] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6768 started by Arpit Agarwal. TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

[jira] [Assigned] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-6768: --- Assignee: Arpit Agarwal TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh

[jira] [Updated] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Attachment: HDFS-6758.01.patch TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh

[jira] [Updated] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Status: Open (was: Patch Available) TestBlockRecovery, TestRefreshCallQueue and

[jira] [Updated] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Attachment: HDFS-6768.01.patch TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh

[jira] [Updated] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Status: Patch Available (was: In Progress) TestBlockRecovery, TestRefreshCallQueue and

[jira] [Updated] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Status: Patch Available (was: Open) TestBlockRecovery, TestRefreshCallQueue and

[jira] [Updated] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Attachment: (was: HDFS-6758.01.patch) TestBlockRecovery, TestRefreshCallQueue and

[jira] [Commented] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078515#comment-14078515 ] Arpit Agarwal commented on HDFS-6768: - The test failures are unrelated.

[jira] [Comment Edited] (HDFS-6685) Archival Storage: Update Balancer to preserve storage type of replicas

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078563#comment-14078563 ] Arpit Agarwal edited comment on HDFS-6685 at 7/29/14 11:08 PM:

[jira] [Commented] (HDFS-6685) Archival Storage: Update Balancer to preserve storage type of replicas

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078563#comment-14078563 ] Arpit Agarwal commented on HDFS-6685: - If the Balancer is an older version than the DNs

[jira] [Commented] (HDFS-6685) Archival Storage: Update Balancer to preserve storage type of replicas

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078572#comment-14078572 ] Arpit Agarwal commented on HDFS-6685: - Also, just a heads up. The eventual merge with

[jira] [Commented] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078574#comment-14078574 ] Arpit Agarwal commented on HDFS-6772: - Interesting find. Do you have any numbers for

[jira] [Commented] (HDFS-788) Datanode behaves badly when one disk is very low on space

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078649#comment-14078649 ] Arpit Agarwal commented on HDFS-788: From a cursory look I don't think it is fixed.

[jira] [Updated] (HDFS-6768) Fix a few unit tests that use hard-coded port numbers

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Summary: Fix a few unit tests that use hard-coded port numbers (was: TestBlockRecovery,

[jira] [Updated] (HDFS-6768) Fix a few unit tests that use hard-coded port numbers

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Target

[jira] [Commented] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079826#comment-14079826 ] Arpit Agarwal commented on HDFS-6441: - Benoy, couple of minor issues with your latest

[jira] [Work started] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6794 started by Arpit Agarwal. Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

[jira] [Assigned] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-6794: --- Assignee: Arpit Agarwal Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

[jira] [Updated] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Description: Post HDFS-2832, BlockManager methods can be updated to accept DatanodeStorageInfo

[jira] [Created] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6794: --- Summary: Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor Key: HDFS-6794 URL: https://issues.apache.org/jira/browse/HDFS-6794 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Status: Patch Available (was: In Progress) Update NN to use DatanodeStorageInfo instead of

[jira] [Updated] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Attachment: HDFS-6794.01.patch Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

[jira] [Updated] (HDFS-6794) Update BlockManager to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Summary: Update BlockManager to use DatanodeStorageInfo instead of DatanodeDescriptor (was: Update

  1   2   3   4   5   6   7   8   9   10   >