[jira] [Commented] (HDFS-11117) Refactor striped file tests to allow flexibly test erasure coding policy

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15676051#comment-15676051 ] Hadoop QA commented on HDFS-7: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11153) RPC Client detect address changed should reconnect immediately

2016-11-17 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-11153: Attachment: HDFS-1153.001.patch > RPC Client detect address changed should reconnect immediately >

[jira] [Created] (HDFS-11155) VolumeScanner should report the latest generation stamp of a bad replica

2016-11-17 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11155: -- Summary: VolumeScanner should report the latest generation stamp of a bad replica Key: HDFS-11155 URL: https://issues.apache.org/jira/browse/HDFS-11155 Project:

[jira] [Comment Edited] (HDFS-11117) Refactor striped file tests to allow flexibly test erasure coding policy

2016-11-17 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675845#comment-15675845 ] SammiChen edited comment on HDFS-7 at 11/18/16 5:34 AM: Refactor

[jira] [Updated] (HDFS-11117) Refactor striped file tests to allow flexibly test erasure coding policy

2016-11-17 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7: - Attachment: HDFS-7-v5.patch Fix all reasonable style issues > Refactor striped file tests to allow

[jira] [Commented] (HDFS-11126) Ozone: Add small file support RPC

2016-11-17 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675804#comment-15675804 ] Jitendra Nath Pandey commented on HDFS-11126: - +1, looks good to me. > Ozone: Add small file

[jira] [Commented] (HDFS-11153) RPC Client detect address changed should reconnect immediately

2016-11-17 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675579#comment-15675579 ] DENG FEI commented on HDFS-11153: - [~kihwal] In the case ,it's should reconnect irrespective of retry

[jira] [Commented] (HDFS-11075) Provide a tool to help covert existing file of default 3x replication to EC striped layout

2016-11-17 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675495#comment-15675495 ] SammiChen commented on HDFS-11075: -- Thanks [~demongaorui] ! Do you want to share any thoughts on task

[jira] [Updated] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-11-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10673: - Fix Version/s: (was: 2.9.0) > Optimize FSPermissionChecker's internal path usage >

[jira] [Commented] (HDFS-11134) Fix bind exception threw in TestRenameWhileOpen

2016-11-17 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675357#comment-15675357 ] Yiqun Lin commented on HDFS-11134: -- Thanks [~brahmareddy] for the final commit and thanks for the others.

[jira] [Commented] (HDFS-11140) Directory Scanner should log startup message time correctly

2016-11-17 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675351#comment-15675351 ] Yiqun Lin commented on HDFS-11140: -- Thanks [~xyao] for the review, the failed test is not related. Feel

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675342#comment-15675342 ] Anu Engineer commented on HDFS-11138: - Let us keep the map for time being. We can revisit this later.

[jira] [Comment Edited] (HDFS-11138) Block Storage : add block storage server

2016-11-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675319#comment-15675319 ] Chen Liang edited comment on HDFS-11138 at 11/18/16 12:55 AM: -- Thanks [~anu]

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675319#comment-15675319 ] Chen Liang commented on HDFS-11138: --- Thanks [~anu] for the comments! Again here are some thoughts I had

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Component/s: datanode > Send back HAState along with NamespaceInfo during a versionRequest as an

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675206#comment-15675206 ] Anu Engineer commented on HDFS-11138: - [~vagarychen] Thanks for updating the patch. Overall it is

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675208#comment-15675208 ] Mingliang Liu commented on HDFS-11094: -- +1 Some comments: # Is it possible to add a unit test for

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675154#comment-15675154 ] Chen Liang commented on HDFS-11138: --- The findbug warnings are for the protobuf-generated classes. The

[jira] [Commented] (HDFS-11133) Ozone: Add allocateContainer RPC

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675107#comment-15675107 ] Hadoop QA commented on HDFS-11133: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11154: -- Attachment: HDFS-11154-HDFS-7240.001.patch > Block Storage : store server state to persistent storage >

[jira] [Created] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-17 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11154: - Summary: Block Storage : store server state to persistent storage Key: HDFS-11154 URL: https://issues.apache.org/jira/browse/HDFS-11154 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11133) Ozone: Add allocateContainer RPC

2016-11-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11133: Status: Patch Available (was: Open) > Ozone: Add allocateContainer RPC >

[jira] [Updated] (HDFS-11108) Ozone: use containers with the state machine

2016-11-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11108: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674751#comment-15674751 ] Hadoop QA commented on HDFS-11138: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11108) Ozone: use containers with the state machine

2016-11-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674716#comment-15674716 ] Anu Engineer commented on HDFS-11108: - most test failures are not related to this patch. One test

[jira] [Commented] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2016-11-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674644#comment-15674644 ] Andrew Wang commented on HDFS-10702: bq. IIUC, if a client issues a read with a "stale bound" which is

[jira] [Updated] (HDFS-11138) Block Storage : add block storage server

2016-11-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11138: -- Attachment: HDFS-11138-HDFS-7240.004.patch fix the javac issue. The findbug warnings are for the

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674360#comment-15674360 ] Rakesh R commented on HDFS-10368: - [~andrew.wang], I've got a better jenkins report. Please review this

[jira] [Commented] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-11-17 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674317#comment-15674317 ] Ming Ma commented on HDFS-10206: bq. that is why getDistanceUsingNetworkLocation is called only when the

[jira] [Commented] (HDFS-11151) [SPS]: Handle unable to choose target node for the required storage type by StoragePolicySatisfier

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674054#comment-15674054 ] Hadoop QA commented on HDFS-11151: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11146) Excess replicas will not be deleted until all storages's FBR received after failover

2016-11-17 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674031#comment-15674031 ] Brahma Reddy Battula commented on HDFS-11146: - [~kihwal] thanks for taking look. bq.NN could

[jira] [Commented] (HDFS-11146) Excess replicas will not be deleted until all storages's FBR received after failover

2016-11-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673862#comment-15673862 ] Kihwal Lee commented on HDFS-11146: --- NN could tell datanodes to send FBR in a heartbeat response. This

[jira] [Commented] (HDFS-11134) Fix bind exception threw in TestRenameWhileOpen

2016-11-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673847#comment-15673847 ] Hudson commented on HDFS-11134: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10853 (See

[jira] [Commented] (HDFS-11153) RPC Client detect address changed should reconnect immediately

2016-11-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673846#comment-15673846 ] Kihwal Lee commented on HDFS-11153: --- You can enable this through config. Here is an example: {noformat}

[jira] [Updated] (HDFS-11134) Fix bind exception threw in TestRenameWhileOpen

2016-11-17 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11134: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11151) [SPS]: Handle unable to choose target node for the required storage type by StoragePolicySatisfier

2016-11-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11151: Status: Patch Available (was: Open) > [SPS]: Handle unable to choose target node for the required storage

[jira] [Updated] (HDFS-11151) [SPS]: Handle unable to choose target node for the required storage type by StoragePolicySatisfier

2016-11-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11151: Attachment: HDFS-11151-HDFS-10285.00.patch Attached an initial patch to handle the cases mentioned in desc.

[jira] [Commented] (HDFS-10706) Add tool generating FSImage from external store

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673702#comment-15673702 ] Hadoop QA commented on HDFS-10706: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10706) Add tool generating FSImage from external store

2016-11-17 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673696#comment-15673696 ] Ewan Higgs commented on HDFS-10706: --- I was able to apply this patch but it seems

[jira] [Commented] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-11-17 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673673#comment-15673673 ] Nandakumar commented on HDFS-10206: --- Thanks for the review [~mingma]. {quote} When the conditions

[jira] [Commented] (HDFS-11051) Test Balancer behavior when some block moves are slow

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673573#comment-15673573 ] Hadoop QA commented on HDFS-11051: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11051) Test Balancer behavior when some block moves are slow

2016-11-17 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11051: - Attachment: HDFS-11051.002.patch Sorry for the delay response, thanks for your concrete explanation for

[jira] [Updated] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10802: Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-11153) RPC Client detect address changed should reconnect immediately

2016-11-17 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-11153: Description: HA mode,the _*"ipc.client.connect.max.retries.on.timeouts"*_ and

[jira] [Created] (HDFS-11153) RPC Client detect address changed should reconnect immediately

2016-11-17 Thread DENG FEI (JIRA)
DENG FEI created HDFS-11153: --- Summary: RPC Client detect address changed should reconnect immediately Key: HDFS-11153 URL: https://issues.apache.org/jira/browse/HDFS-11153 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673088#comment-15673088 ] Uma Maheswara Rao G commented on HDFS-10802: Thank you. +1 on the latest patch. > [SPS]: Add