[jira] [Commented] (HDFS-13080) Ozone: Make finalhash in ContainerInfo of StorageContainerDatanodeProtocol.proto optional

2018-01-30 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345132#comment-16345132 ] Nanda kumar commented on HDFS-13080: Thanks [~elek] for the contribution. I have committed this to the

[jira] [Updated] (HDFS-13080) Ozone: Make finalhash in ContainerInfo of StorageContainerDatanodeProtocol.proto optional

2018-01-30 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-13080: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: Make finalhash in

[jira] [Commented] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345089#comment-16345089 ] genericqa commented on HDFS-12116: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13080) Ozone: Make finalhash in ContainerInfo of StorageContainerDatanodeProtocol.proto optional

2018-01-30 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345110#comment-16345110 ] Nanda kumar commented on HDFS-13080: +1, I will commit this shortly. > Ozone: Make finalhash in

[jira] [Commented] (HDFS-11701) NPE from Unresolved Host causes permanent DFSInputStream failures

2018-01-30 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345156#comment-16345156 ] Jitendra Nath Pandey commented on HDFS-11701: - +1. The patch looks good to me. > NPE from

[jira] [Comment Edited] (HDFS-13084) [SPS]: Fix the branch review comments

2018-01-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344876#comment-16344876 ] Rakesh R edited comment on HDFS-13084 at 1/30/18 4:51 PM: -- Thanks a lot [~daryn]

[jira] [Assigned] (HDFS-13083) Fix HDFS Router Federation doc error

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-13083: -- Assignee: tartarus > Fix HDFS Router Federation doc error >

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-01-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345478#comment-16345478 ] Wei-Chiu Chuang commented on HDFS-11187: v005 to address checkstyl warning. > Optimize disk

[jira] [Updated] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-01-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11187: --- Attachment: HDFS-11187.005.patch > Optimize disk access for last partial chunk checksum of

[jira] [Updated] (HDFS-13044) RBF: Add a safe mode for the Router

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13044: --- Attachment: HDFS-13044.005.patch > RBF: Add a safe mode for the Router >

[jira] [Commented] (HDFS-12522) Ozone: Remove the Priority Queues used in the Container State Manager

2018-01-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345548#comment-16345548 ] Anu Engineer commented on HDFS-12522: - [~xyao] and [~nandakumar131]  Can you please take a look at the

[jira] [Commented] (HDFS-13083) RBF: Fix doc error setting up client

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345574#comment-16345574 ] Íñigo Goiri commented on HDFS-13083: I took the freedom to make this part of HDFS-12615 and renamed

[jira] [Updated] (HDFS-12636) Ozone: OzoneFileSystem: Implement seek functionality for rpc client

2018-01-30 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-12636: Parent Issue: HDFS-13074 (was: HDFS-7240) > Ozone: OzoneFileSystem: Implement seek

[jira] [Commented] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345583#comment-16345583 ] Íñigo Goiri commented on HDFS-13068: Thanks [~linyiqun] for [^HDFS-13068.001.patch] . Most of the

[jira] [Commented] (HDFS-13083) Fix HDFS Router Federation doc error

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345367#comment-16345367 ] Íñigo Goiri commented on HDFS-13083: I missed this. Thanks [~tartarus] for the patch, I assigned it to

[jira] [Commented] (HDFS-12909) SSLConnectionConfigurator creation error should be printed only if security is enabled

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345401#comment-16345401 ] Ajay Kumar commented on HDFS-12909: --- [~ljain], thanks for working on this. Do you mind adding a test

[jira] [Comment Edited] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-01-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345478#comment-16345478 ] Wei-Chiu Chuang edited comment on HDFS-11187 at 1/30/18 5:43 PM: - v005 to

[jira] [Commented] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345546#comment-16345546 ] Ajay Kumar commented on HDFS-13060: --- Patch v2 to address checkstyle issues. > Adding a

[jira] [Updated] (HDFS-13043) RBF: Expose the state of the Routers in the federation

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13043: --- Attachment: HDFS-13043.006.patch > RBF: Expose the state of the Routers in the federation >

[jira] [Commented] (HDFS-12522) Ozone: Remove the Priority Queues used in the Container State Manager

2018-01-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345588#comment-16345588 ] Xiaoyu Yao commented on HDFS-12522: --- Thanks [~anu] for the update. Patch v4 LGTM, +1. > Ozone: Remove

[jira] [Commented] (HDFS-13061) SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345595#comment-16345595 ] Ajay Kumar commented on HDFS-13061: --- [~xyao], Updated patch to remove {{socket.close()}} call. >

[jira] [Updated] (HDFS-13061) SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13061: -- Attachment: HDFS-13061.003.patch > SaslDataTransferClient#checkTrustAndSend should not trust a

[jira] [Updated] (HDFS-13083) Fix HDFS Router Federation doc error

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13083: --- Status: Patch Available (was: Reopened) > Fix HDFS Router Federation doc error >

[jira] [Commented] (HDFS-13083) Fix HDFS Router Federation doc error

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345513#comment-16345513 ] genericqa commented on HDFS-13083: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-13085) getStoragePolicy varies b/w REST and CLI for unspecified path

2018-01-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13085: - Hadoop Flags: Incompatible change > getStoragePolicy varies b/w REST and CLI for unspecified path

[jira] [Commented] (HDFS-13085) getStoragePolicy varies b/w REST and CLI for unspecified path

2018-01-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345350#comment-16345350 ] Arpit Agarwal commented on HDFS-13085: -- Thanks for the analysis [~msingh]. [~brahmareddy], any

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-01-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345489#comment-16345489 ] Daryn Sharp commented on HDFS-10285: More comments, mostly focusing on the DN side.  There appear to

[jira] [Commented] (HDFS-13044) RBF: Add a safe mode for the Router

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345528#comment-16345528 ] genericqa commented on HDFS-13044: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13044) RBF: Add a safe mode for the Router

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345543#comment-16345543 ] Íñigo Goiri commented on HDFS-13044: I added [^HDFS-13044.005.patch] with the actual commit to trunk

[jira] [Updated] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13060: -- Attachment: HDFS-13060.001.patch > Adding a BlacklistBasedTrustedChannelResolver for

[jira] [Commented] (HDFS-12528) Add an option to not disable short-circuit reads on failures

2018-01-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345343#comment-16345343 ] Xiao Chen commented on HDFS-12528: -- Thanks all, and thanks John for writing the initial unit test! > Add

[jira] [Updated] (HDFS-13083) Fix HDFS Router Federation doc error

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13083: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-12615 > Fix HDFS Router Federation doc error >

[jira] [Commented] (HDFS-13061) SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel

2018-01-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345557#comment-16345557 ] Xiaoyu Yao commented on HDFS-13061: --- Thanks [~ajayydv] for the update.  Just one more NIT, +1 after than

[jira] [Updated] (HDFS-13083) RBF: Fix doc error setting up client

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13083: --- Summary: RBF: Fix doc error setting up client (was: Fix HDFS Router Federation doc error) > RBF:

[jira] [Comment Edited] (HDFS-11701) NPE from Unresolved Host causes permanent DFSInputStream failures

2018-01-30 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345156#comment-16345156 ] Jitendra Nath Pandey edited comment on HDFS-11701 at 1/30/18 6:51 PM: --

[jira] [Updated] (HDFS-13044) RBF: Add a safe mode for the Router

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13044: --- Attachment: HDFS-13044-branch-3.0.000.patch > RBF: Add a safe mode for the Router >

[jira] [Comment Edited] (HDFS-13084) [SPS]: Fix the branch review comments

2018-01-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344876#comment-16344876 ] Rakesh R edited comment on HDFS-13084 at 1/30/18 4:57 PM: -- Thanks a lot [~daryn]

[jira] [Updated] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12997: -- Attachment: HDFS-12997.006.patch > Move logging to slf4j in BlockPoolSliceStorage and Storage >

[jira] [Commented] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345592#comment-16345592 ] Ajay Kumar commented on HDFS-12997: --- Test failures are unrelated. Updated patch to fix 1 checkstyle

[jira] [Comment Edited] (HDFS-13084) [SPS]: Fix the branch review comments

2018-01-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344876#comment-16344876 ] Rakesh R edited comment on HDFS-13084 at 1/30/18 12:25 PM: --- Thanks a lot

[jira] [Commented] (HDFS-12528) Add an option to not disable short-circuit reads on failures

2018-01-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346009#comment-16346009 ] Hudson commented on HDFS-12528: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13584 (See

[jira] [Updated] (HDFS-12528) Add an option to not disable short-circuit reads on failures

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12528: --- Fix Version/s: 3.0.1 > Add an option to not disable short-circuit reads on failures >

[jira] [Commented] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346028#comment-16346028 ] Ajay Kumar commented on HDFS-12997: --- [~xyao], Updated patch v7 to address suggestions. > Move logging

[jira] [Updated] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12997: -- Attachment: HDFS-12997.007.patch > Move logging to slf4j in BlockPoolSliceStorage and Storage >

[jira] [Commented] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-01-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345996#comment-16345996 ] Hanisha Koneru commented on HDFS-13062: --- Thanks for updating the patch, [~bharatviswa]. * In

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-01-30 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345680#comment-16345680 ] Wei Yan commented on HDFS-12512: [~elgoiri] any comments from your test cluster? :) > RBF: Add WebHDFS >

[jira] [Updated] (HDFS-12522) Ozone: Remove the Priority Queues used in the Container State Manager

2018-01-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12522: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345716#comment-16345716 ] Xiaoyu Yao commented on HDFS-12997: --- Thanks [~ajayydv] for the update. The patch looks good to me. Two

[jira] [Updated] (HDFS-7240) Object store in HDFS

2018-01-30 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-7240: --- Attachment: HDFS Scalability-v2.pdf > Object store in HDFS > > >

[jira] [Commented] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345828#comment-16345828 ] genericqa commented on HDFS-12997: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13069) Enable HDFS to cache data read from external storage systems

2018-01-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345673#comment-16345673 ] Virajith Jalaparti commented on HDFS-13069: --- The design for caching PROVIDED files is as

[jira] [Created] (HDFS-13088) Allow HDFS files/blocks to be over-replicated.

2018-01-30 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-13088: - Summary: Allow HDFS files/blocks to be over-replicated. Key: HDFS-13088 URL: https://issues.apache.org/jira/browse/HDFS-13088 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345722#comment-16345722 ] genericqa commented on HDFS-11187: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-13069) Enable HDFS to cache data read from external storage systems

2018-01-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345673#comment-16345673 ] Virajith Jalaparti edited comment on HDFS-13069 at 1/30/18 7:55 PM:

[jira] [Commented] (HDFS-13044) RBF: Add a safe mode for the Router

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345705#comment-16345705 ] genericqa commented on HDFS-13044: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13080) Ozone: Make finalhash in ContainerInfo of StorageContainerDatanodeProtocol.proto optional

2018-01-30 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344729#comment-16344729 ] Nanda kumar commented on HDFS-13080: [~elek], makes sense. Thanks for updating the patch. LGTM. >

[jira] [Commented] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345954#comment-16345954 ] genericqa commented on HDFS-13060: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13043) RBF: Expose the state of the Routers in the federation

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345843#comment-16345843 ] genericqa commented on HDFS-13043: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13089) Add test to validate dfs used and no of blocks when blocks are moved across volumes

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13089: -- Status: Patch Available (was: Open) > Add test to validate dfs used and no of blocks when blocks are

[jira] [Updated] (HDFS-7240) Object store in HDFS

2018-01-30 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-7240: --- Description: [^HDFS Scalability-v2.pdf] describes areas where HDFS does well and its scaling

[jira] [Updated] (HDFS-7240) Scaling HDFS

2018-01-30 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-7240: --- Summary: Scaling HDFS (was: Object store in HDFS) > Scaling HDFS > > >

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-01-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345983#comment-16345983 ] Daryn Sharp commented on HDFS-10285: *StoragePolicySatisifier* Should {{handleException}} use a

[jira] [Updated] (HDFS-12528) Add an option to not disable short-circuit reads on failures

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12528: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Status: Resolved

[jira] [Updated] (HDFS-12528) Add an option to not disable short-circuit reads on failures

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12528: --- Release Note: Added an option to not disables short-circuit reads on failures, by setting

[jira] [Commented] (HDFS-12528) Add an option to not disable short-circuit reads on failures

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345993#comment-16345993 ] Weiwei Yang commented on HDFS-12528: Thanks [~xiaochen] to provide the fix, thanks for [~jzhuge] for

[jira] [Updated] (HDFS-7240) Object store in HDFS

2018-01-30 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-7240: --- Description: [^HDFS Scalability-v2.pdf] describes areas where HDFS does well and its scaling

[jira] [Created] (HDFS-13089) Add test to validate dfs used and no of blocks when blocks are moved across volumes

2018-01-30 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-13089: - Summary: Add test to validate dfs used and no of blocks when blocks are moved across volumes Key: HDFS-13089 URL: https://issues.apache.org/jira/browse/HDFS-13089 Project:

[jira] [Updated] (HDFS-7240) Object store in HDFS

2018-01-30 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-7240: --- Description: [Scaling HDFS| x] describes areas where HDFS does well and its scaling challenges and

[jira] [Commented] (HDFS-13061) SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345866#comment-16345866 ] genericqa commented on HDFS-13061: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13089) Add test to validate dfs used and no of blocks when blocks are moved across volumes

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13089: -- Attachment: HDFS-13089.000.patch > Add test to validate dfs used and no of blocks when blocks are moved

[jira] [Updated] (HDFS-12528) Add an option to not disable short-circuit reads on failures

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12528: --- Release Note: Add an option to not disables short-circuit reads on failures, by setting

[jira] [Created] (HDFS-13091) Remove tomcat from the Hadoop-auth test bundle

2018-01-30 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-13091: Summary: Remove tomcat from the Hadoop-auth test bundle Key: HDFS-13091 URL: https://issues.apache.org/jira/browse/HDFS-13091 Project: Hadoop HDFS Issue Type: Task

[jira] [Created] (HDFS-13090) Support composite trusted channel resolver that supports both whitelist and blacklist

2018-01-30 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-13090: - Summary: Support composite trusted channel resolver that supports both whitelist and blacklist Key: HDFS-13090 URL: https://issues.apache.org/jira/browse/HDFS-13090

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346035#comment-16346035 ] Íñigo Goiri commented on HDFS-12512: Tested and working fine; we had most of it already there and the

[jira] [Commented] (HDFS-13044) RBF: Add a safe mode for the Router

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346038#comment-16346038 ] Íñigo Goiri commented on HDFS-13044: The patch for branch-3.0 [^HDFS-13044-branch-3.0.000.patch]

[jira] [Updated] (HDFS-13043) RBF: Expose the state of the Routers in the federation

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13043: --- Attachment: HDFS-13043.007.patch > RBF: Expose the state of the Routers in the federation >

[jira] [Updated] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-30 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Status: In Progress (was: Patch Available) > Reimplement NameCache in NameNode: Intern

[jira] [Updated] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-30 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Attachment: HDFS-12051.09.patch > Reimplement NameCache in NameNode: Intern duplicate byte[]

[jira] [Updated] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-30 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Status: Patch Available (was: In Progress) I've just updated this patch to make NameNode

[jira] [Commented] (HDFS-13048) LowRedundancyReplicatedBlocks metric can be negative

2018-01-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346064#comment-16346064 ] Chen Liang commented on HDFS-13048: --- Thanks for the catch [~ajisakaa]! +1 on v002 patch.  >

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-30 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346080#comment-16346080 ] Misha Dmitriev commented on HDFS-12051: --- I ran another test in a cluster with ~30M HDFS files, where

[jira] [Commented] (HDFS-12942) Synchronization issue in FSDataSetImpl#moveBlock

2018-01-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346120#comment-16346120 ] Ajay Kumar commented on HDFS-12942: --- test failures are unrelated. all of them passed locally. >

[jira] [Commented] (HDFS-13083) RBF: Fix doc error setting up client

2018-01-30 Thread tartarus (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346125#comment-16346125 ] tartarus commented on HDFS-13083: - [~elgoiri]  Thank you for your optimization. it's okay no problem. >

[jira] [Updated] (HDFS-13083) RBF: Fix doc error setting up client

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13083: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: (was: 3.0.0)

[jira] [Commented] (HDFS-13089) Add test to validate dfs used and no of blocks when blocks are moved across volumes

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346172#comment-16346172 ] genericqa commented on HDFS-13089: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13083) RBF: Fix doc error setting up client

2018-01-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346183#comment-16346183 ] Hudson commented on HDFS-13083: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13585 (See

[jira] [Commented] (HDFS-13043) RBF: Expose the state of the Routers in the federation

2018-01-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346188#comment-16346188 ] Yiqun Lin commented on HDFS-13043: -- The patch almost looks good to me. Would you fix the related failure

[jira] [Commented] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346195#comment-16346195 ] genericqa commented on HDFS-12997: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13043) RBF: Expose the state of the Routers in the federation

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346223#comment-16346223 ] genericqa commented on HDFS-13043: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346231#comment-16346231 ] genericqa commented on HDFS-12051: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13083) RBF: Fix doc error setting up client

2018-01-30 Thread tartarus (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346233#comment-16346233 ] tartarus commented on HDFS-13083: - [~elgoiri]  [~hudson]  It's my pleasure to participate in the project's

[jira] [Commented] (HDFS-13085) getStoragePolicy varies b/w REST and CLI for unspecified path

2018-01-30 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346259#comment-16346259 ] Surendra Singh Lilhore commented on HDFS-13085: --- Thanks [~brahmareddy] for reporting issue.

[jira] [Updated] (HDFS-12528) Add an option to not disable short-circuit reads on failures

2018-01-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12528: - Fix Version/s: 2.10.0 > Add an option to not disable short-circuit reads on failures >

[jira] [Commented] (HDFS-12528) Add an option to not disable short-circuit reads on failures

2018-01-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346285#comment-16346285 ] Xiao Chen commented on HDFS-12528: -- Thanks for the commit [~cheersyang]. Cherry-picked to branch-2 as

[jira] [Commented] (HDFS-13044) RBF: Add a safe mode for the Router

2018-01-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346291#comment-16346291 ] Yiqun Lin commented on HDFS-13044: -- +1 on the patch for branch-3.0. Please go ahead. > RBF: Add a safe

[jira] [Assigned] (HDFS-13080) Ozone: Make finalhash in ContainerInfo of StorageContainerDatanodeProtocol.proto optional

2018-01-30 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar reassigned HDFS-13080: -- Assignee: Elek, Marton (was: Nanda kumar) > Ozone: Make finalhash in ContainerInfo of >

[jira] [Commented] (HDFS-13085) getStoragePolicy varies b/w REST and CLI for unspecified path

2018-01-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344803#comment-16344803 ] Brahma Reddy Battula commented on HDFS-13085: - IMHO,CLI should be same as rest call as

[jira] [Commented] (HDFS-12508) Refactor TestFsck to separate EC related unit tests

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344825#comment-16344825 ] genericqa commented on HDFS-12508: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-13084) [SPS]: Fix the branch review comments

2018-01-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344876#comment-16344876 ] Rakesh R edited comment on HDFS-13084 at 1/30/18 10:55 AM: --- Thanks a lot

[jira] [Commented] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344767#comment-16344767 ] genericqa commented on HDFS-13068: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >