[jira] [Commented] (HDFS-11469) Ozone: SCM: Container allocation based on node report

[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906074#comment-15906074 ] Anu Engineer commented on HDFS-11469: - [~xyao] Thanks for the patch. It looks very good overall. Some

[jira] [Commented] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906036#comment-15906036 ] Hadoop QA commented on HDFS-11336: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11517) Expose slow disks via DataNode JMX

[ https://issues.apache.org/jira/browse/HDFS-11517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906032#comment-15906032 ] Hadoop QA commented on HDFS-11517: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905995#comment-15905995 ] Uma Maheswara Rao G commented on HDFS-11336: I triggered again. Lets see if we can get the

[jira] [Commented] (HDFS-11505) Do not enable any erasure coding policies by default

[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905992#comment-15905992 ] Hadoop QA commented on HDFS-11505: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11517) Expose slow disks via DataNode JMX

[ https://issues.apache.org/jira/browse/HDFS-11517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11517: -- Status: Patch Available (was: Open) > Expose slow disks via DataNode JMX >

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905960#comment-15905960 ] Chris Nauroth commented on HDFS-11163: -- The Checkstyle warnings are not worth addressing. The test

[jira] [Updated] (HDFS-11517) Expose slow disks via DataNode JMX

[ https://issues.apache.org/jira/browse/HDFS-11517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11517: -- Attachment: HDFS-11517.000.patch > Expose slow disks via DataNode JMX >

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905953#comment-15905953 ] Hadoop QA commented on HDFS-9705: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11395) RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode

[ https://issues.apache.org/jira/browse/HDFS-11395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905949#comment-15905949 ] Arpit Agarwal commented on HDFS-11395: -- [~jingzhao], are you +1 for this patch? >

[jira] [Updated] (HDFS-11071) Ozone: SCM: Move SCM config keys to ScmConfig

[ https://issues.apache.org/jira/browse/HDFS-11071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11071: -- Resolution: Fixed Target Version/s: HDFS-7240 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-11505) Do not enable any erasure coding policies by default

[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905921#comment-15905921 ] Andrew Wang commented on HDFS-11505: Hi Manoj, I'd rather we enable the correct policy on a

[jira] [Comment Edited] (HDFS-11505) Do not enable any erasure coding policies by default

[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905908#comment-15905908 ] Manoj Govindassamy edited comment on HDFS-11505 at 3/11/17 12:09 AM: -

[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default

[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Attachment: HDFS-11505.03.patch Attaching v03 patch to address the test failures. > Do

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905906#comment-15905906 ] Manoj Govindassamy commented on HDFS-10530: --- bq. isPlacementPolicySatisfied should use

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905898#comment-15905898 ] Andrew Wang commented on HDFS-10530: BTW, do you have any review comments for the v3 patch? We need a

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905897#comment-15905897 ] Andrew Wang commented on HDFS-10530: Nice investigation Manoj. This relates to a long-standing HDFS

[jira] [Comment Edited] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905864#comment-15905864 ] Manoj Govindassamy edited comment on HDFS-10530 at 3/10/17 11:26 PM: -

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905864#comment-15905864 ] Manoj Govindassamy commented on HDFS-10530: --- [~demongaorui], [~andrew.wang], [~zhz], The test

[jira] [Created] (HDFS-11527) WebHDFS and Search Query

Eric Jang created HDFS-11527: Summary: WebHDFS and Search Query Key: HDFS-11527 URL: https://issues.apache.org/jira/browse/HDFS-11527 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905854#comment-15905854 ] Andrew Wang commented on HDFS-9705: --- Yea, sorry about the lack of precommit...I've been trying to

[jira] [Commented] (HDFS-11340) DataNode reconfigure for disks doesn't remove the failed volumes

[ https://issues.apache.org/jira/browse/HDFS-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905825#comment-15905825 ] Manoj Govindassamy commented on HDFS-11340: --- Thanks a lot for the reviews and commit help,

[jira] [Updated] (HDFS-11340) DataNode reconfigure for disks doesn't remove the failed volumes

[ https://issues.apache.org/jira/browse/HDFS-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11340: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Updated] (HDFS-11520) libhdfs++: Support cancellation of individual RPC calls in C++ API

[ https://issues.apache.org/jira/browse/HDFS-11520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11520: --- Attachment: HDFS-11520.HDFS-8707.000.patch Preview patch, need to expose cancel in the

[jira] [Updated] (HDFS-11520) libhdfs++: Support cancellation of individual RPC calls in C++ API

[ https://issues.apache.org/jira/browse/HDFS-11520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11520: --- Status: Patch Available (was: Open) > libhdfs++: Support cancellation of individual RPC

[jira] [Updated] (HDFS-11511) Support Timeout when checking single disk

[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11511: -- Attachment: HDFS-11511.001.patch > Support Timeout when checking single disk >

[jira] [Updated] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11519: --- Attachment: HDFS-11519-HDFS-7240.20170310.patch HDFS-11519-HDFS-7240.20170310.patch:

[jira] [Updated] (HDFS-11513) Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations

[ https://issues.apache.org/jira/browse/HDFS-11513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11513: --- Component/s: ozone > Ozone: Separate XceiverServer and XceiverClient into interfaces

[jira] [Commented] (HDFS-11469) Ozone: SCM: Container allocation based on node report

[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905726#comment-15905726 ] Hadoop QA commented on HDFS-11469: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Status: Open (was: Patch Available) > In Hadoop 3, make FileStatus serialize itself via protobuf >

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Attachment: (was: HDFS-6984.004.patch) > In Hadoop 3, make FileStatus serialize itself via

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Attachment: HDFS-6984.004.patch > In Hadoop 3, make FileStatus serialize itself via protobuf >

[jira] [Work started] (HDFS-11514) ChooseRandom can potentially be optimized

[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-11514 started by Chen Liang. - > ChooseRandom can potentially be optimized >

[jira] [Updated] (HDFS-11514) ChooseRandom can potentially be optimized

[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11514: -- Attachment: HDFS-11514.001.patch > ChooseRandom can potentially be optimized >

[jira] [Updated] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom

[ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11482: -- Attachment: HDFS-11482.009.patch Re-post v008 patch as v009 patch again to trigger Jenkins. > Add

[jira] [Updated] (HDFS-11491) Ozone: Add close container RPC

[ https://issues.apache.org/jira/browse/HDFS-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11491: Status: Patch Available (was: Open) > Ozone: Add close container RPC >

[jira] [Updated] (HDFS-11491) Ozone: Add close container RPC

[ https://issues.apache.org/jira/browse/HDFS-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11491: Attachment: HDFS-11491-HDFS-7240.001.patch > Ozone: Add close container RPC >

[jira] [Updated] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is not defined by order in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-6648: -- Attachment: HDFS-6648-001.patch Respecting config order and supporting random order option. > Order of

[jira] [Commented] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is not defined by order in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905548#comment-15905548 ] Inigo Goiri commented on HDFS-6648: --- [~chris.douglas], I'll check on {{TestNameNodeRetryCacheMetrics}}.

[jira] [Commented] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is not defined by order in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905533#comment-15905533 ] Chris Douglas commented on HDFS-6648: - It looks like the patch is causing

[jira] [Commented] (HDFS-11525) "Address already in use" has no exact conflict information

[ https://issues.apache.org/jira/browse/HDFS-11525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905520#comment-15905520 ] Surendra Singh Lilhore commented on HDFS-11525: --- Hi [~yuxh00], I tried in 2.7.2 and it is

[jira] [Updated] (HDFS-11526) Fix confusing block recovery message

[ https://issues.apache.org/jira/browse/HDFS-11526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11526: --- Labels: supportability (was: ) > Fix confusing block recovery message >

[jira] [Created] (HDFS-11526) Fix confusing block recovery message

Wei-Chiu Chuang created HDFS-11526: -- Summary: Fix confusing block recovery message Key: HDFS-11526 URL: https://issues.apache.org/jira/browse/HDFS-11526 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-11469) Ozone: SCM: Container allocation based on node report

[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11469: -- Status: Patch Available (was: Open) > Ozone: SCM: Container allocation based on node report >

[jira] [Updated] (HDFS-11469) Ozone: SCM: Container allocation based on node report

[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11469: -- Affects Version/s: HDFS-7240 > Ozone: SCM: Container allocation based on node report >

[jira] [Updated] (HDFS-11469) Ozone: SCM: Container allocation based on node report

[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11469: -- Attachment: (was: HDFS-11469-HDFS-7240.001.patch) > Ozone: SCM: Container allocation based on node

[jira] [Updated] (HDFS-11469) Ozone: SCM: Container allocation based on node report

[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11469: -- Attachment: HDFS-11469-HDFS-7240.001.patch > Ozone: SCM: Container allocation based on node report >

[jira] [Updated] (HDFS-11469) Ozone: SCM: Container allocation based on node report

[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11469: -- Attachment: HDFS-11469-HDFS-7240.001.patch Attach a patch that support container allocation 1. with

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905442#comment-15905442 ] Wei-Chiu Chuang commented on HDFS-11499: The precommit build failed because it attempted to run

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905396#comment-15905396 ] Hadoop QA commented on HDFS-11499: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11499) Decommissioning stuck because of failing recovery

[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11499: --- Attachment: HDFS-11499.branch-2.7.patch Branch-2.7 patch > Decommissioning stuck because of

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905374#comment-15905374 ] Hadoop QA commented on HDFS-11499: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11499) Decommissioning stuck because of failing recovery

[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11499: --- Release Note: Allow a block to complete if the number of replicas on live nodes,

[jira] [Updated] (HDFS-11499) Decommissioning stuck because of failing recovery

[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11499: --- Status: Patch Available (was: Reopened) > Decommissioning stuck because of failing recovery

[jira] [Reopened] (HDFS-11499) Decommissioning stuck because of failing recovery

[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-11499: Reopen the issue to submit the branch-2.8 patch > Decommissioning stuck because of failing

[jira] [Updated] (HDFS-11499) Decommissioning stuck because of failing recovery

[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11499: --- Attachment: HDFS-11499.branch-2.8.patch I think we should backport the fix into 2.7 and 2.8.

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905335#comment-15905335 ] Hadoop QA commented on HDFS-8344: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905321#comment-15905321 ] Wei-Chiu Chuang commented on HDFS-8344: --- Interesting... [~raviprak] are you saying even after

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905290#comment-15905290 ] Ravi Prakash commented on HDFS-8344: This problem still exists in trunk today. The same steps I listed

[jira] [Commented] (HDFS-8802) dfs.checksum.type is not described in hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905274#comment-15905274 ] Andras Bokor commented on HDFS-8802: Fixed by HDFS-8356. I am not sure about the resolution. Duplicate,

[jira] [Comment Edited] (HDFS-5567) CacheAdmin operations not supported with viewfs

[ https://issues.apache.org/jira/browse/HDFS-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905213#comment-15905213 ] Andras Bokor edited comment on HDFS-5567 at 3/10/17 3:26 PM: - CacheAdmin

[jira] [Commented] (HDFS-5567) CacheAdmin operations not supported with viewfs

[ https://issues.apache.org/jira/browse/HDFS-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905213#comment-15905213 ] Andras Bokor commented on HDFS-5567: CacheAdmin commands work with -fs option. Commands where

[jira] [Commented] (HDFS-11395) RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode

[ https://issues.apache.org/jira/browse/HDFS-11395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905099#comment-15905099 ] Nandakumar commented on HDFS-11395: --- Test case failures are not related to this patch. >

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904824#comment-15904824 ] SammiChen commented on HDFS-9705: - Hi [~andrew.wang], would you please help to trigger a Jenkin build? It