[jira] [Commented] (HDFS-13374) TestCommonConfigurationFields is broken by HADOOP-15312

2018-03-29 Thread Hari Matta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420112#comment-16420112 ] Hari Matta commented on HDFS-13374: --- [~shv] I would like to work on this.   Thanks, Hari Gopal >

[jira] [Commented] (HDFS-13359) DataXceiver hung due to the lock in FsDatasetImpl#getBlockInputStream

2018-03-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420098#comment-16420098 ] Yiqun Lin commented on HDFS-13359: -- [~jojochuang], thanks for your reference of HDFS-10682. {quote} Do

[jira] [Commented] (HDFS-13365) RBF: Adding trace support

2018-03-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420075#comment-16420075 ] genericqa commented on HDFS-13365: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10419) Building HDFS on top of new storage layer (HDSL)

2018-03-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420058#comment-16420058 ] Konstantin Shvachko commented on HDFS-10419: Looks like "Hadoop Distributed Data Store" is

[jira] [Comment Edited] (HDFS-13374) TestCommonConfigurationFields is broken by HADOOP-15312

2018-03-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420047#comment-16420047 ] Konstantin Shvachko edited comment on HDFS-13374 at 3/30/18 1:29 AM: -

[jira] [Commented] (HDFS-13374) TestCommonConfigurationFields is broken by HADOOP-15312

2018-03-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420047#comment-16420047 ] Konstantin Shvachko commented on HDFS-13374: Here is the log {code} 2018-03-29 14:54:59,747

[jira] [Created] (HDFS-13374) TestCommonConfigurationFields is broken by HADOOP-15312

2018-03-29 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-13374: -- Summary: TestCommonConfigurationFields is broken by HADOOP-15312 Key: HDFS-13374 URL: https://issues.apache.org/jira/browse/HDFS-13374 Project: Hadoop

[jira] [Resolved] (HDFS-898) Sequential generation of block ids

2018-03-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-898. -- Resolution: Duplicate This was done by HDFS-4645. Resolving ... > Sequential generation

[jira] [Comment Edited] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420027#comment-16420027 ] Íñigo Goiri edited comment on HDFS-13248 at 3/30/18 1:06 AM: - [~ajayydv] that

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420027#comment-16420027 ] Íñigo Goiri commented on HDFS-13248: [~ajayydv] that sounds promising, do you mind posting a PoC? >

[jira] [Commented] (HDFS-13365) RBF: Adding trace support

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420026#comment-16420026 ] Íñigo Goiri commented on HDFS-13365: I added the super user check and also I had forgotten to do the

[jira] [Updated] (HDFS-13365) RBF: Adding trace support

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13365: --- Attachment: HDFS-13365.003.patch > RBF: Adding trace support > - > >

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-03-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420014#comment-16420014 ] Ajay Kumar commented on HDFS-13248: --- [~elgoiri], May i propose an alternate approach of adding optional

[jira] [Commented] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420002#comment-16420002 ] genericqa commented on HDFS-13371: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-13331) Add lastSeenStateId to RpcRequestHeader.

2018-03-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419948#comment-16419948 ] Erik Krogen edited comment on HDFS-13331 at 3/29/18 11:48 PM: -- One way to

[jira] [Comment Edited] (HDFS-13331) Add lastSeenStateId to RpcRequestHeader.

2018-03-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419948#comment-16419948 ] Erik Krogen edited comment on HDFS-13331 at 3/29/18 11:47 PM: -- One way to

[jira] [Commented] (HDFS-13331) Add lastSeenStateId to RpcRequestHeader.

2018-03-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419948#comment-16419948 ] Erik Krogen commented on HDFS-13331: One way to achieve it would be to make {{alignmentContext}} a

[jira] [Commented] (HDFS-10867) [PROVIDED Phase 2] Block Bit Field Allocation of Provided Storage

2018-03-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419934#comment-16419934 ] Chris Douglas commented on HDFS-10867: -- bq. Don't forget about legacy negative block ids that already

[jira] [Updated] (HDFS-13087) Snapshotted encryption zone information should be immutable

2018-03-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13087: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.1 3.0.2

[jira] [Updated] (HDFS-13087) Snapshotted encryption zone information should be immutable

2018-03-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13087: - Fix Version/s: 3.2.0 > Snapshotted encryption zone information should be immutable >

[jira] [Updated] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng updated HDFS-13371: -- Attachment: HDFS-13371.000.patch > NPE for FsServerDefaults.getKeyProviderUri() for

[jira] [Updated] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng updated HDFS-13371: -- Attachment: (was: HADOOP-15336.000.patch) > NPE for FsServerDefaults.getKeyProviderUri()

[jira] [Updated] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng updated HDFS-13371: -- Attachment: (was: HADOOP-15336.001.patch) > NPE for FsServerDefaults.getKeyProviderUri()

[jira] [Commented] (HDFS-13087) Snapshotted encryption zone information should be immutable

2018-03-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419899#comment-16419899 ] Xiao Chen commented on HDFS-13087: -- +1, committing this > Snapshotted encryption zone information should

[jira] [Updated] (HDFS-13087) Snapshotted encryption zone information should be immutable

2018-03-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13087: - Summary: Snapshotted encryption zone information should be immutable (was: Snapshots On encryption zones

[jira] [Commented] (HDFS-13373) Handle expunge command on NN and DN

2018-03-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419895#comment-16419895 ] genericqa commented on HDFS-13373: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13087) Snapshots On encryption zones get incorrect EZ settings when encryption zone changes

2018-03-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13087: - Summary: Snapshots On encryption zones get incorrect EZ settings when encryption zone changes (was: Fix:

[jira] [Commented] (HDFS-13310) [PROVIDED Phase 2] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-29 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419882#comment-16419882 ] Daryn Sharp commented on HDFS-13310: Is there any way to generalize this feature?  Scanning the patch,

[jira] [Commented] (HDFS-10867) [PROVIDED Phase 2] Block Bit Field Allocation of Provided Storage

2018-03-29 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419853#comment-16419853 ] Daryn Sharp commented on HDFS-10867: Don't forget about legacy negative block ids that already aren't

[jira] [Comment Edited] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-03-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416571#comment-16416571 ] Ajay Kumar edited comment on HDFS-13248 at 3/29/18 9:50 PM: [~elgoiri] thanks

[jira] [Commented] (HDFS-13281) Namenode#createFile should be /.reserved/raw/ aware.

2018-03-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419827#comment-16419827 ] Xiao Chen commented on HDFS-13281: -- Fair enough for webhdfs. Please add necessary links. I'd think this

[jira] [Commented] (HDFS-13281) Namenode#createFile should be /.reserved/raw/ aware.

2018-03-29 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419803#comment-16419803 ] Rushabh S Shah commented on HDFS-13281: --- {quote}I think at the minimum we should setxattr

[jira] [Commented] (HDFS-13331) Add lastSeenStateId to RpcRequestHeader.

2018-03-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419788#comment-16419788 ] Erik Krogen commented on HDFS-13331: I see, sorry I skimmed the comments on the last patch but didn't

[jira] [Updated] (HDFS-13373) Handle expunge command on NN and DN

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13373: -- Attachment: (was: HDFS-13373-HDFS-12996.00.patch) > Handle expunge command on NN

[jira] [Updated] (HDFS-13373) Handle expunge command on NN and DN

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13373: -- Attachment: HDFS-13373-HDFS-12996.00.patch > Handle expunge command on NN and DN >

[jira] [Updated] (HDFS-13373) Handle expunge command on NN and DN

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13373: -- Attachment: HDFS-13373-HDFS-12996.00.patch > Handle expunge command on NN and DN >

[jira] [Commented] (HDFS-13373) Handle expunge command on NN and DN

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419772#comment-16419772 ] Bharat Viswanadham commented on HDFS-13373: --- This patch is dependant on HDFS-13372.   > Handle

[jira] [Updated] (HDFS-13373) Handle expunge command on NN and DN

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13373: -- Status: Patch Available (was: In Progress) > Handle expunge command on NN and DN >

[jira] [Updated] (HDFS-13373) Handle expunge command on NN and DN

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13373: -- Description: When DataNodes receive the DN_EXPUNGE command from Namenode, they will

[jira] [Work started] (HDFS-13373) Handle expunge command on NN and DN

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13373 started by Bharat Viswanadham. - > Handle expunge command on NN and DN >

[jira] [Commented] (HDFS-11639) [PROVIDED Phase 2] Encode the BlockAlias in the client protocol

2018-03-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419747#comment-16419747 ] genericqa commented on HDFS-11639: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12478) [PROVIDED Phase 2] Command line tools for managing Provided Storage Backup mounts

2018-03-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419748#comment-16419748 ] genericqa commented on HDFS-12478: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12666) [PROVIDED Phase 2] Provided Storage Mount Manager (PSMM) mount

2018-03-29 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12666: -- Summary: [PROVIDED Phase 2] Provided Storage Mount Manager (PSMM) mount (was: Provided

[jira] [Updated] (HDFS-12848) [PROVIDED Phase 2] Add a pluggable policy for selecting locations for Provided files.

2018-03-29 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12848: -- Summary: [PROVIDED Phase 2] Add a pluggable policy for selecting locations for Provided

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-03-29 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-13186: -- Summary: [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations (was:

[jira] [Updated] (HDFS-10867) [PROVIDED Phase 2] Block Bit Field Allocation of Provided Storage

2018-03-29 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10867: -- Summary: [PROVIDED Phase 2] Block Bit Field Allocation of Provided Storage (was: Block

[jira] [Updated] (HDFS-13310) [PROVIDED Phase 2] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-29 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-13310: -- Summary: [PROVIDED Phase 2] The DatanodeProtocol should be have DNA_BACKUP to backup

[jira] [Updated] (HDFS-12478) [PROVIDED Phase 2] Command line tools for managing Provided Storage Backup mounts

2018-03-29 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12478: -- Summary: [PROVIDED Phase 2] Command line tools for managing Provided Storage Backup

[jira] [Updated] (HDFS-11828) [PROVIDED Phase 2] Refactor FsDatasetImpl to use the BlockAlias from ClientProtocol for PROVIDED blocks.

2018-03-29 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11828: -- Summary: [PROVIDED Phase 2] Refactor FsDatasetImpl to use the BlockAlias from

[jira] [Updated] (HDFS-11639) [PROVIDED Phase 2] Encode the BlockAlias in the client protocol

2018-03-29 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11639: -- Summary: [PROVIDED Phase 2] Encode the BlockAlias in the client protocol (was: [WRITE]

[jira] [Commented] (HDFS-12090) Handling writes from HDFS to Provided storages

2018-03-29 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419742#comment-16419742 ] Virajith Jalaparti commented on HDFS-12090: --- Cut branch HDFS-12090 from trunk to track this

[jira] [Resolved] (HDFS-12165) getSnapshotDiffReport throws NegativeArraySizeException for very large snapshot diff summary

2018-03-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-12165. Resolution: Duplicate > getSnapshotDiffReport throws NegativeArraySizeException for very

[jira] [Commented] (HDFS-13350) Negative legacy block ID will confuse Erasure Coding to be considered as striped block

2018-03-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419735#comment-16419735 ] genericqa commented on HDFS-13350: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13372) New Expunge Replica Trash Client-Namenode-Protocol

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13372: -- Attachment: HDFS-13372-HDFS-12996.00.patch > New Expunge Replica Trash

[jira] [Updated] (HDFS-13372) New Expunge Replica Trash Client-Namenode-Protocol

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13372: -- Status: Patch Available (was: Open) > New Expunge Replica Trash

[jira] [Updated] (HDFS-13373) Handle expunge command on NN and DN

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13373: -- Attachment: (was: HDFS-13372-HDFS-12996.00.patch) > Handle expunge command on NN

[jira] [Updated] (HDFS-13373) Handle expunge command on NN and DN

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13373: -- Attachment: HDFS-13372-HDFS-12996.00.patch > Handle expunge command on NN and DN >

[jira] [Commented] (HDFS-13331) Add lastSeenStateId to RpcRequestHeader.

2018-03-29 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419704#comment-16419704 ] Plamen Jeliazkov commented on HDFS-13331: - Yes you are correct. I brought up that concern in the

[jira] [Comment Edited] (HDFS-13331) Add lastSeenStateId to RpcRequestHeader.

2018-03-29 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419704#comment-16419704 ] Plamen Jeliazkov edited comment on HDFS-13331 at 3/29/18 8:26 PM: -- Hi

[jira] [Commented] (HDFS-13364) RBF: Support NamenodeProtocol in the Router

2018-03-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419675#comment-16419675 ] genericqa commented on HDFS-13364: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-13331) Add lastSeenStateId to RpcRequestHeader.

2018-03-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419655#comment-16419655 ] Erik Krogen commented on HDFS-13331: Hey [~zero45], just looked through the most recent patch. I have

[jira] [Commented] (HDFS-13279) Datanodes usage is imbalanced if number of nodes per rack is not equal

2018-03-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419647#comment-16419647 ] genericqa commented on HDFS-13279: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13372) New Expunge Replica Trash Client-Namenode-Protocol

2018-03-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13372: -- Description: When client issues an expunge replica-trash RPC call to Namenode, the

[jira] [Created] (HDFS-13373) Handle expunge command on NN and DN

2018-03-29 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-13373: - Summary: Handle expunge command on NN and DN Key: HDFS-13373 URL: https://issues.apache.org/jira/browse/HDFS-13373 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13372) New Expunge Replica Trash Client-Namenode-Protocol

2018-03-29 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-13372: - Summary: New Expunge Replica Trash Client-Namenode-Protocol Key: HDFS-13372 URL: https://issues.apache.org/jira/browse/HDFS-13372 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13365) RBF: Adding trace support

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419577#comment-16419577 ] Íñigo Goiri commented on HDFS-13365: A note on the TODO, the Namenode does

[jira] [Commented] (HDFS-13365) RBF: Adding trace support

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419567#comment-16419567 ] Íñigo Goiri commented on HDFS-13365: [^HDFS-13365.001.patch] is ready for review.

[jira] [Commented] (HDFS-13359) DataXceiver hung due to the lock in FsDatasetImpl#getBlockInputStream

2018-03-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419568#comment-16419568 ] Wei-Chiu Chuang commented on HDFS-13359: Thanks. I'm not so sure about performance of

[jira] [Commented] (HDFS-13364) RBF: Support NamenodeProtocol in the Router

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419561#comment-16419561 ] Íñigo Goiri commented on HDFS-13364: [^HDFS-13364.003.patch] is ready for review. Right now,

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2018-03-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419559#comment-16419559 ] Wei-Chiu Chuang commented on HDFS-10682: For the record, the commit message was incorrect about

[jira] [Updated] (HDFS-13364) RBF: Support NamenodeProtocol in the Router

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13364: --- Attachment: HDFS-13364.003.patch > RBF: Support NamenodeProtocol in the Router >

[jira] [Commented] (HDFS-13365) RBF: Adding trace support

2018-03-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419549#comment-16419549 ] genericqa commented on HDFS-13365: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-13331) Add lastSeenStateId to RpcRequestHeader.

2018-03-29 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419521#comment-16419521 ] Plamen Jeliazkov commented on HDFS-13331: - The failed unit tests appear to be unrelated to the

[jira] [Commented] (HDFS-13364) RBF: Support NamenodeProtocol in the Router

2018-03-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419498#comment-16419498 ] genericqa commented on HDFS-13364: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-13350) Negative legacy block ID will confuse Erasure Coding to be considered as striped block

2018-03-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419497#comment-16419497 ] Lei (Eddy) Xu commented on HDFS-13350: -- The legacy negative block ID and EC block IDs are safe in the

[jira] [Updated] (HDFS-13350) Negative legacy block ID will confuse Erasure Coding to be considered as striped block

2018-03-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-13350: - Status: Patch Available (was: Open) > Negative legacy block ID will confuse Erasure Coding to be

[jira] [Updated] (HDFS-13350) Negative legacy block ID will confuse Erasure Coding to be considered as striped block

2018-03-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-13350: - Target Version/s: 3.0.2, 3.2.0, 3.1.1 (was: 3.1.0, 3.0.2) > Negative legacy block ID will

[jira] [Updated] (HDFS-13350) Negative legacy block ID will confuse Erasure Coding to be considered as striped block

2018-03-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-13350: - Attachment: HDFS-13350.00.patch > Negative legacy block ID will confuse Erasure Coding to be

[jira] [Updated] (HDFS-13350) Negative legacy block ID will confuse Erasure Coding to be considered as striped block

2018-03-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-13350: - Attachment: (was: HDFS-13350.00.patch) > Negative legacy block ID will confuse Erasure Coding

[jira] [Commented] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419489#comment-16419489 ] Jason Lowe commented on HDFS-13371: --- {quote}Is there a good way to handle this other than having test

[jira] [Commented] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419480#comment-16419480 ] Íñigo Goiri commented on HDFS-13371: I guess now [^HADOOP-15336.001.patch] should be renamed to

[jira] [Updated] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13371: --- Priority: Minor (was: Major) > NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol

[jira] [Updated] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13371: --- Labels: (was: common) > NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol

[jira] [Commented] (HDFS-12284) RBF: Support for Kerberos authentication

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419472#comment-16419472 ] Íñigo Goiri commented on HDFS-12284: Thanks [~daryn] for chiming it. Would you be available for

[jira] [Updated] (HDFS-13350) Negative legacy block ID will confuse Erasure Coding to be considered as striped block

2018-03-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-13350: - Attachment: HDFS-13350.00.patch > Negative legacy block ID will confuse Erasure Coding to be

[jira] [Commented] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419461#comment-16419461 ] Íñigo Goiri commented on HDFS-13371: {quote} Handling optional PB fields when re-encoding the

[jira] [Updated] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng updated HDFS-13371: -- Attachment: (was: HADOOP-15336.001.patch) > NPE for FsServerDefaults.getKeyProviderUri()

[jira] [Moved] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng moved HADOOP-15336 to HDFS-13371: Affects Version/s: (was: 3.2.0)

[jira] [Updated] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng updated HDFS-13371: -- Attachment: HADOOP-15336.001.patch > NPE for FsServerDefaults.getKeyProviderUri() for

[jira] [Commented] (HDFS-13365) RBF: Adding trace support

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419451#comment-16419451 ] Íñigo Goiri commented on HDFS-13365: I added a unit test exclusively for this as it doesn't need a

[jira] [Updated] (HDFS-13365) RBF: Adding trace support

2018-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13365: --- Attachment: HDFS-13365.001.patch > RBF: Adding trace support > - > >

[jira] [Commented] (HDFS-13281) Namenode#createFile should be /.reserved/raw/ aware.

2018-03-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419441#comment-16419441 ] Xiao Chen commented on HDFS-13281: -- {quote} {quote}in which case there will be no step #3 {quote} Didn't

[jira] [Commented] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

2018-03-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419417#comment-16419417 ] Tsz Wo Nicholas Sze commented on HDFS-13314: {quote} The test case would protect this feature

[jira] [Commented] (HDFS-13358) RBF: Support for Delegation Token

2018-03-29 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419408#comment-16419408 ] Daryn Sharp commented on HDFS-13358: Is there a design doc for how security is being handled?  It

[jira] [Commented] (HDFS-12284) RBF: Support for Kerberos authentication

2018-03-29 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419403#comment-16419403 ] Daryn Sharp commented on HDFS-12284: All due respect, there need to be domain experts reviewing these

[jira] [Updated] (HDFS-13352) RBF: Add xsl stylesheet for hdfs-rbf-default.xml

2018-03-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13352: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-12884) BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo

2018-03-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12884: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-13204) RBF: Optimize name service safe mode icon

2018-03-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13204: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-03-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-13195: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

[jira] [Updated] (HDFS-12512) RBF: Add WebHDFS

2018-03-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12512: -- Fix Version/s: (was: 3.1.1) Doing 3.1.0 RC1 now, moved all 3.1.1 (branch-3.1) fixes to 3.1.0

  1   2   >