[jira] [Updated] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

2016-11-21 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11152: - Status: Patch Available (was: Open) > Start erasure coding policy ID number from 1 instead of 0 to void

[jira] [Updated] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

2016-11-21 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11152: - Attachment: HDFS-11152-v1.patch Initial patch > Start erasure coding policy ID number from 1 instead of

[jira] [Commented] (HDFS-11091) Implement a getTrashRoot that does not fall-back

2016-11-21 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685990#comment-15685990 ] Yuanbo Liu commented on HDFS-11091: --- [~zhz] Sorry to interrupt. I've read your discussion in HDFS-9799.

[jira] [Updated] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-21 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10994: - Attachment: HDFS-10994-v4.patch Rebase patch > Support an XOR policy XOR-2-1-64k in HDFS >

[jira] [Comment Edited] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-21 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685936#comment-15685936 ] Wei Zhou edited comment on HDFS-10885 at 11/22/16 7:26 AM: --- Hi, [~rakeshr],

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-21 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685936#comment-15685936 ] Wei Zhou commented on HDFS-10885: - Hi, [~rakeshr], sorry for the late response sincerely! I was on travel

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-11-21 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685882#comment-15685882 ] Manikandan R commented on HDFS-10918: - Hi [~xiaochen], Looks like my earlier mvn clean also didn't

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-11-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685857#comment-15685857 ] Xiao Chen commented on HDFS-10918: -- Hi [~maniraj...@gmail.com], Thanks for reporting this. Could you

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-11-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685846#comment-15685846 ] Wei-Chiu Chuang commented on HDFS-11160: the test failures are related to the change in v001

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685844#comment-15685844 ] Rakesh R commented on HDFS-11164: - Presently {{DataXceiver#copyBlock}} block is having the

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685810#comment-15685810 ] Hadoop QA commented on HDFS-11160: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-21 Thread Rakesh R (JIRA)
Rakesh R created HDFS-11164: --- Summary: Mover should avoid unnecessary retries if the block is pinned Key: HDFS-11164 URL: https://issues.apache.org/jira/browse/HDFS-11164 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11112) Journal Nodes should refuse to format non-empty directories

2016-11-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685797#comment-15685797 ] Wei-Chiu Chuang commented on HDFS-2: IIUC, JNStorage#format may be called when starting

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-11-21 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685759#comment-15685759 ] Manikandan R commented on HDFS-10918: - I recently pulled code from git and facing maven build errors.

[jira] [Created] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2016-11-21 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-11163: - Summary: Mover should move the file blocks to default storage once policy is unset Key: HDFS-11163 URL: https://issues.apache.org/jira/browse/HDFS-11163

[jira] [Comment Edited] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-11-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685648#comment-15685648 ] Wei-Chiu Chuang edited comment on HDFS-11160 at 11/22/16 4:35 AM: -- Attach

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-11-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11160: --- Status: Patch Available (was: Open) > VolumeScanner reports write-in-progress replicas as

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-11-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11160: --- Attachment: HDFS-11160.001.patch Attach my simple fix in v001 patch. In v001 fix,

[jira] [Commented] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685645#comment-15685645 ] Hadoop QA commented on HDFS-7578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685635#comment-15685635 ] Hadoop QA commented on HDFS-11154: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

2016-11-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685572#comment-15685572 ] Yongjun Zhang commented on HDFS-7578: - Hi [~brandonli], thanks for your earlier work here, I found the

[jira] [Updated] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

2016-11-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7578: Attachment: HDFS-7578.004.patch > NFS WRITE and COMMIT responses should always use the channel

[jira] [Commented] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685504#comment-15685504 ] Hadoop QA commented on HDFS-11154: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685502#comment-15685502 ] Hadoop QA commented on HDFS-7578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685493#comment-15685493 ] Hadoop QA commented on HDFS-7578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

2016-11-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7578: Status: Open (was: Patch Available) > NFS WRITE and COMMIT responses should always use the channel

[jira] [Updated] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

2016-11-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7578: Status: Patch Available (was: Open) > NFS WRITE and COMMIT responses should always use the channel

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10903: --- Fix Version/s: 3.0.0-alpha2 2.8.0 > Replace config key literal strings with config

[jira] [Updated] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10566: --- Fix Version/s: 3.0.0-alpha2 > Submit plan request should throw exception if Datanode is in

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10558: --- Fix Version/s: 3.0.0-alpha2 > DiskBalancer: Print the full path to plan file >

[jira] [Updated] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10910: --- Fix Version/s: 3.0.0-alpha2 > HDFS Erasure Coding doc should state its currently supported erasure

[jira] [Commented] (HDFS-10941) Improve BlockManager#processMisReplicatesAsync log

2016-11-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685382#comment-15685382 ] Brahma Reddy Battula commented on HDFS-10941: - [~zhz] looks chnages.txt not update for this

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10892: --- Fix Version/s: 3.0.0-alpha2 2.8.0 > Add unit tests for HDFS command 'dfs -tail'

[jira] [Updated] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10998: --- Fix Version/s: 3.0.0-alpha2 2.8.0 > Add unit tests for HDFS command 'dfsadmin

[jira] [Updated] (HDFS-10843) Update space quota when a UC block is completed rather than committed.

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10843: --- Summary: Update space quota when a UC block is completed rather than committed. (was: Quota Feature

[jira] [Updated] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10843: --- Fix Version/s: 3.0.0-alpha2 > Quota Feature Cached Size != Computed Size When Block Committed But Not

[jira] [Updated] (HDFS-11038) DiskBalancer: support running multiple commands in single test

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11038: --- Fix Version/s: 3.0.0-alpha2 > DiskBalancer: support running multiple commands in single test >

[jira] [Updated] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11154: -- Attachment: HDFS-11154-HDFS-7240.005.patch The compilation error was caused by missing recent updates

[jira] [Commented] (HDFS-10176) WebHdfs LISTSTATUS does not offer any sorting

2016-11-21 Thread Lucas Lustosa Madureira (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685217#comment-15685217 ] Lucas Lustosa Madureira commented on HDFS-10176: Greetings I gave it a try on resolving

[jira] [Commented] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685149#comment-15685149 ] Hadoop QA commented on HDFS-11154: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685146#comment-15685146 ] Anu Engineer commented on HDFS-11154: - [~vagarychen] Thanks for updating the patch. +1, pending

[jira] [Updated] (HDFS-10633) DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10633: --- Fix Version/s: 3.0.0-alpha2 > DiskBalancer : Add the description for the new setting >

[jira] [Updated] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10584: --- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > Allow long-running Mover

[jira] [Commented] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2016-11-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685075#comment-15685075 ] Zhe Zhang commented on HDFS-10702: -- Thanks for the discussion Ming, Sean, Andrew. bq. Refreshing the

[jira] [Updated] (HDFS-10425) Clean up NNStorage and TestSaveNamespace

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10425: --- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > Clean up NNStorage and

[jira] [Updated] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8915: -- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 >

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9696: -- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > Garbage snapshot records

[jira] [Updated] (HDFS-10639) Fix typos in HDFSDiskbalancer.md

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10639: --- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > Fix typos in

[jira] [Updated] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10598: --- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > DiskBalancer does not

[jira] [Updated] (HDFS-10588) False alarm in datanode log - ERROR - Disk Balancer is not enabled

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10588: --- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > False alarm in datanode log

[jira] [Updated] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10650: --- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > DFSClient#mkdirs and

[jira] [Updated] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11154: -- Attachment: HDFS-11154-HDFS-7240.004.patch Thanks [~anu] for the follow up comments. Uploaded v004

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685038#comment-15685038 ] Andrew Wang commented on HDFS-11096: I talked with [~kasha] about compatibility generally offline,

[jira] [Commented] (HDFS-10966) Enhance Dispatcher logic on deciding when to give up a source DataNode

2016-11-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685016#comment-15685016 ] Zhe Zhang commented on HDFS-10966: -- Thanks much Kihwal! > Enhance Dispatcher logic on deciding when to

[jira] [Commented] (HDFS-10966) Enhance Dispatcher logic on deciding when to give up a source DataNode

2016-11-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685014#comment-15685014 ] Kihwal Lee commented on HDFS-10966: --- Committed to branch-2.7. Thanks for working on this [~mwagner] and

[jira] [Updated] (HDFS-10966) Enhance Dispatcher logic on deciding when to give up a source DataNode

2016-11-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10966: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10966) Enhance Dispatcher logic on deciding when to give up a source DataNode

2016-11-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685011#comment-15685011 ] Kihwal Lee commented on HDFS-10966: --- The 2.7 patch looks good. > Enhance Dispatcher logic on deciding

[jira] [Commented] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684990#comment-15684990 ] Anu Engineer commented on HDFS-11154: - You are right it is not a proper scenario. It is a hypothetical

[jira] [Comment Edited] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684943#comment-15684943 ] Chen Liang edited comment on HDFS-11154 at 11/21/16 10:33 PM: -- Thanks [~anu]

[jira] [Commented] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684943#comment-15684943 ] Chen Liang commented on HDFS-11154: --- Thanks [~anu] for coming up with this scenario! I haven't thought

[jira] [Comment Edited] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684862#comment-15684862 ] Anu Engineer edited comment on HDFS-11154 at 11/21/16 10:05 PM: bq. The

[jira] [Comment Edited] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684862#comment-15684862 ] Anu Engineer edited comment on HDFS-11154 at 11/21/16 10:04 PM: bq. The

[jira] [Commented] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684862#comment-15684862 ] Anu Engineer commented on HDFS-11154: - bq. The operations calling into StorageManager are already

[jira] [Commented] (HDFS-10966) Enhance Dispatcher logic on deciding when to give up a source DataNode

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684840#comment-15684840 ] Hadoop QA commented on HDFS-10966: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684815#comment-15684815 ] Chen Liang commented on HDFS-11154: --- Thanks [~anu] for the comments! bq. 1. Wondering if we need a lock

[jira] [Updated] (HDFS-10681) DiskBalancer: query command should report Plan file path apart from PlanID

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10681: --- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > DiskBalancer: query command

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10682: --- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > Replace FsDatasetImpl object

[jira] [Updated] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10763: --- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > Open files can leak

[jira] [Updated] (HDFS-10725) Caller context should always be constructed by a builder

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10725: --- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > Caller context should always

[jira] [Updated] (HDFS-10773) BlockSender should not synchronize on the dataset object

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10773: --- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > BlockSender should not

[jira] [Commented] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684607#comment-15684607 ] Anu Engineer commented on HDFS-11154: - Thank you for implementing this feature. It looks quite good

[jira] [Commented] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684562#comment-15684562 ] Hadoop QA commented on HDFS-11154: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11145) Implement getTrashRoot() for ViewFileSystem

2016-11-21 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684461#comment-15684461 ] Manoj Govindassamy commented on HDFS-11145: --- Above unit test failures are not related to the

[jira] [Updated] (HDFS-10966) Enhance Dispatcher logic on deciding when to give up a source DataNode

2016-11-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10966: - Attachment: HDFS-10966-branch-2.7.00.patch Thanks [~kihwal] for the final review! Attaching branch-2.7

[jira] [Created] (HDFS-11162) Block Storage : add command line tool

2016-11-21 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11162: - Summary: Block Storage : add command line tool Key: HDFS-11162 URL: https://issues.apache.org/jira/browse/HDFS-11162 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11154: -- Attachment: HDFS-11154-HDFS-7240.003.patch fix the findbug warnings on encoding in v003 patches. >

[jira] [Comment Edited] (HDFS-4015) Safemode should count and report orphaned blocks

2016-11-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684329#comment-15684329 ] Anu Engineer edited comment on HDFS-4015 at 11/21/16 6:30 PM: -- bq. Should this

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2016-11-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684329#comment-15684329 ] Anu Engineer commented on HDFS-4015: bq. Should this be marked as incompatible change? I think we can

[jira] [Commented] (HDFS-8028) TestNNHandlesBlockReportPerStorage/TestNNHandlesCombinedBlockReport Failed after patched HDFS-7704

2016-11-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684159#comment-15684159 ] Wei-Chiu Chuang commented on HDFS-8028: --- [~redvine] you are right about it. The test fails after

[jira] [Commented] (HDFS-10966) Enhance Dispatcher logic on deciding when to give up a source DataNode

2016-11-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684079#comment-15684079 ] Kihwal Lee commented on HDFS-10966: --- I've committed this to trunk through branch-2.8. Please provide a

[jira] [Commented] (HDFS-10966) Enhance Dispatcher logic on deciding when to give up a source DataNode

2016-11-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684048#comment-15684048 ] Hudson commented on HDFS-10966: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10868 (See

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-11-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684022#comment-15684022 ] Arpit Agarwal commented on HDFS-9668: - [~jingcheng...@intel.com], yes please go ahead if you want to

[jira] [Commented] (HDFS-10966) Enhance Dispatcher logic on deciding when to give up a source DataNode

2016-11-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683978#comment-15683978 ] Kihwal Lee commented on HDFS-10966: --- +1 > Enhance Dispatcher logic on deciding when to give up a source

[jira] [Commented] (HDFS-11101) TestDFSShell#testMoveWithTargetPortEmpty fails intermittently

2016-11-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683736#comment-15683736 ] Hudson commented on HDFS-11101: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10867 (See

[jira] [Resolved] (HDFS-9896) WebHDFS API may return invalid JSON

2016-11-21 Thread Alexander Shorin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Shorin resolved HDFS-9896. Resolution: Fixed Fix Version/s: 2.7.3 > WebHDFS API may return invalid JSON >

[jira] [Commented] (HDFS-9896) WebHDFS API may return invalid JSON

2016-11-21 Thread Alexander Shorin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683702#comment-15683702 ] Alexander Shorin commented on HDFS-9896: [~lucaslm] Hey! Nice report! Seems like issue is indeed

[jira] [Updated] (HDFS-11101) TestDFSShell#testMoveWithTargetPortEmpty fails intermittently

2016-11-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11101: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Comment Edited] (HDFS-4439) umask-mode does not support 4-digit umask value

2016-11-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683461#comment-15683461 ] Brahma Reddy Battula edited comment on HDFS-4439 at 11/21/16 12:51 PM:

[jira] [Resolved] (HDFS-4439) umask-mode does not support 4-digit umask value

2016-11-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-4439. Resolution: Duplicate Marking as duplicate, as it's duplicated by HDFS-10945 and

[jira] [Reopened] (HDFS-4439) umask-mode does not support 4-digit umask value

2016-11-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reopened HDFS-4439: > umask-mode does not support 4-digit umask value >

[jira] [Commented] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-11-21 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683203#comment-15683203 ] Nandakumar commented on HDFS-10206: --- New [^HDFS-10206.001.patch] has been uploaded. The logic is

[jira] [Updated] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-11-21 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-10206: -- Attachment: HDFS-10206.001.patch > getBlockLocations might not sort datanodes properly by distance >

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2016-11-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683168#comment-15683168 ] Vinayakumar B commented on HDFS-4015: - Should this be marked as incompatible change? Earlier "dfsadmin