[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262025#comment-16262025 ] Xiao Chen commented on HDFS-12754: -- Thanks Kuhu for revving and Kihwal for triggering pre-commit. - The

[jira] [Updated] (HDFS-12741) ADD support for KSM --createObjectStore command

2017-11-21 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12741: --- Attachment: HDFS-12741-HDFS-7240.001.patch Patch v1 implements the KSM

[jira] [Updated] (HDFS-12741) ADD support for KSM --createObjectStore command

2017-11-21 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12741: --- Status: Patch Available (was: Open) > ADD support for KSM --createObjectStore

[jira] [Created] (HDFS-12852) pig script failed with 'java.nio.channels.ClosedByInterruptException'

2017-11-21 Thread Pengfei Yang (JIRA)
Pengfei Yang created HDFS-12852: --- Summary: pig script failed with 'java.nio.channels.ClosedByInterruptException' Key: HDFS-12852 URL: https://issues.apache.org/jira/browse/HDFS-12852 Project: Hadoop

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262085#comment-16262085 ] Vinayakumar B commented on HDFS-12832: -- bq. A more accurate approach is to remove ReplicationWork.bc

[jira] [Commented] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

2017-11-21 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260437#comment-16260437 ] Mukul Kumar Singh commented on HDFS-12794: -- Thanks for the updated patch [~shashikant], 1)

[jira] [Comment Edited] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

2017-11-21 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260437#comment-16260437 ] Mukul Kumar Singh edited comment on HDFS-12794 at 11/21/17 8:50 AM:

[jira] [Commented] (HDFS-12840) Creating a replicated file in a EC zone does not correctly serialized in EditLogs

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260449#comment-16260449 ] Hadoop QA commented on HDFS-12840: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12838) Ozone: Optimize number of allocated block rpc by aggregating multiple block allocation requests

2017-11-21 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12838: - Attachment: HDFS-12838-HDFS-7240.002.patch > Ozone: Optimize number of allocated block

[jira] [Commented] (HDFS-12740) SCM should support a RPC to share the cluster Id with KSM and DataNodes

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260476#comment-16260476 ] Hadoop QA commented on HDFS-12740: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260767#comment-16260767 ] Kihwal Lee commented on HDFS-12754: --- Kicked the build manually. > Lease renewal can hit a deadlock >

[jira] [Updated] (HDFS-12780) Fix spelling mistake in DistCpUtils.java

2017-11-21 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12780: - Resolution: Fixed Status: Resolved (was: Patch Available) > Fix spelling mistake in

[jira] [Commented] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260990#comment-16260990 ] Hadoop QA commented on HDFS-12794: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261054#comment-16261054 ] Hadoop QA commented on HDFS-12754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12838) Ozone: Optimize number of allocated block rpc by aggregating multiple block allocation requests

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260801#comment-16260801 ] Hadoop QA commented on HDFS-12838: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12842) Ozone: SCM: During startup SCM should check if the cluster is INITIALIZED

2017-11-21 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12842: --- Attachment: HDFS-12842-HDFS-7240.000.patch > Ozone: SCM: During startup SCM should check if the

[jira] [Updated] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12832: --- Labels: release-blocker (was: ) Target Version/s: 2.7.5 >

[jira] [Updated] (HDFS-12741) ADD support for KSM --createObjectStore command

2017-11-21 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12741: --- Attachment: (was: HDFS-12741-HDFS-7240.001.patch) > ADD support for KSM

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261178#comment-16261178 ] Chris Douglas commented on HDFS-12681: -- {{TestUnbuffer}} fails on trunk (HADOOP-15056, HADOOP-12815).

[jira] [Commented] (HDFS-12842) Ozone: SCM: During startup SCM should check if the cluster is INITIALIZED

2017-11-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261191#comment-16261191 ] Anu Engineer commented on HDFS-12842: - [~nandakumar131] Thanks for catching this. +1. Please feel free

[jira] [Commented] (HDFS-12740) SCM should support a RPC to share the cluster Id with KSM and DataNodes

2017-11-21 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261132#comment-16261132 ] Nanda kumar commented on HDFS-12740: LGTM, +1. I will commit this shortly. > SCM should support a RPC

[jira] [Updated] (HDFS-12740) SCM should support a RPC to share the cluster Id with KSM and DataNodes

2017-11-21 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12740: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-12740) SCM should support a RPC to share the cluster Id with KSM and DataNodes

2017-11-21 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261168#comment-16261168 ] Nanda kumar commented on HDFS-12740: Thanks [~shashikant] for your contribution and thanks [~linyiqun]

[jira] [Comment Edited] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261178#comment-16261178 ] Chris Douglas edited comment on HDFS-12681 at 11/21/17 6:10 PM:

[jira] [Created] (HDFS-12842) Ozone: SCM: During startup SCM should check if the cluster is INITIALIZED or not

2017-11-21 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-12842: -- Summary: Ozone: SCM: During startup SCM should check if the cluster is INITIALIZED or not Key: HDFS-12842 URL: https://issues.apache.org/jira/browse/HDFS-12842 Project:

[jira] [Updated] (HDFS-12842) Ozone: SCM: During startup SCM should check if the cluster is INITIALIZED

2017-11-21 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12842: --- Summary: Ozone: SCM: During startup SCM should check if the cluster is INITIALIZED (was: Ozone: SCM:

[jira] [Created] (HDFS-12843) Ozone: Client: TestOzoneRpcClient#testPutKeyRatisThreeNodes is failing

2017-11-21 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-12843: -- Summary: Ozone: Client: TestOzoneRpcClient#testPutKeyRatisThreeNodes is failing Key: HDFS-12843 URL: https://issues.apache.org/jira/browse/HDFS-12843 Project: Hadoop

[jira] [Commented] (HDFS-12843) Ozone: Client: TestOzoneRpcClient#testPutKeyRatisThreeNodes is failing

2017-11-21 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261208#comment-16261208 ] Nanda kumar commented on HDFS-12843: KSM Log {noformat} 2017-11-21 07:22:04,091 [IPC Server handler 2

[jira] [Updated] (HDFS-12838) Ozone: Optimize number of allocated block rpc by aggregating multiple block allocation requests

2017-11-21 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12838: - Attachment: HDFS-12838-HDFS-7240.003.patch [~nandakumar131], thanks for taking a look.

[jira] [Created] (HDFS-12844) TestClientDistributedCacheManager::testDetermineCacheVisibilities assumes all parent dirs set other exec

2017-11-21 Thread Chris Douglas (JIRA)
Chris Douglas created HDFS-12844: Summary: TestClientDistributedCacheManager::testDetermineCacheVisibilities assumes all parent dirs set other exec Key: HDFS-12844 URL:

[jira] [Updated] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-11-21 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12745: - Attachment: HDFS-12745-HDFS-7240.007.patch > Ozone: XceiverClientManager should cache

[jira] [Commented] (HDFS-12838) Ozone: Optimize number of allocated block rpc by aggregating multiple block allocation requests

2017-11-21 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261212#comment-16261212 ] Nanda kumar commented on HDFS-12838: [~msingh], the patch is not applying anymore, can you please

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261414#comment-16261414 ] Chris Douglas commented on HDFS-12681: -- Ran most of the MapReduce tests. Looks good. > Make

[jira] [Commented] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels

2017-11-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261456#comment-16261456 ] Zhe Zhang commented on HDFS-12791: -- Thanks for the work [~msingh] and [~vagarychen]. What should be the

[jira] [Updated] (HDFS-12840) Creating a replicated file in a EC zone does not correctly serialized in EditLogs

2017-11-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12840: - Attachment: editsStored HDFS-12840.01.patch Fix test failure and findbugs

[jira] [Commented] (HDFS-12838) Ozone: Optimize number of allocated block rpc by aggregating multiple block allocation requests

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261510#comment-16261510 ] Hadoop QA commented on HDFS-12838: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12845) JournalNode Test failures

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12845: -- Attachment: HDFS-12845-branch-3.0.00.patch > JournalNode Test failures >

[jira] [Updated] (HDFS-12845) JournalNode Test failures

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12845: -- Status: Patch Available (was: Open) > JournalNode Test failures >

[jira] [Updated] (HDFS-11751) DFSZKFailoverController daemon exits with wrong status code

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-11751: -- Status: In Progress (was: Patch Available) > DFSZKFailoverController daemon exits with

[jira] [Updated] (HDFS-11751) DFSZKFailoverController daemon exits with wrong status code

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-11751: -- Status: Patch Available (was: In Progress) > DFSZKFailoverController daemon exits with

[jira] [Updated] (HDFS-12845) JournalNode Test failures

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12845: -- Affects Version/s: 3.0.0 3.0.0-beta1 > JournalNode Test failures

[jira] [Created] (HDFS-12845) JournalNode Test failures

2017-11-21 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-12845: - Summary: JournalNode Test failures Key: HDFS-12845 URL: https://issues.apache.org/jira/browse/HDFS-12845 Project: Hadoop HDFS Issue Type: Bug

[jira] [Assigned] (HDFS-12845) JournalNode Test failures

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-12845: - Assignee: Bharat Viswanadham > JournalNode Test failures >

[jira] [Updated] (HDFS-12845) JournalNode Test failures

2017-11-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12845: - Affects Version/s: (was: 3.0.0-beta1) Target Version/s: 3.0.1 > JournalNode Test

[jira] [Commented] (HDFS-12845) JournalNode Test failures

2017-11-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261540#comment-16261540 ] Arpit Agarwal commented on HDFS-12845: -- +1 pending Jenkins. > JournalNode Test failures >

[jira] [Comment Edited] (HDFS-11751) DFSZKFailoverController daemon exits with wrong status code

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261532#comment-16261532 ] Bharat Viswanadham edited comment on HDFS-11751 at 11/21/17 9:46 PM: -

[jira] [Commented] (HDFS-12778) [READ] Report multiple locations for PROVIDED blocks

2017-11-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261387#comment-16261387 ] Íñigo Goiri commented on HDFS-12778: The failed unit tests seem unrelated. The most suspicious ones

[jira] [Updated] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels

2017-11-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12791: -- Fix Version/s: 3.1.0 > NameNode Fsck http Connection can timeout for directories with multiple levels >

[jira] [Commented] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels

2017-11-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261474#comment-16261474 ] Chen Liang commented on HDFS-12791: --- [~zhz] Sorry I should have updated it. I believe it should be

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-11-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261492#comment-16261492 ] Tsz Wo Nicholas Sze commented on HDFS-12594: Thanks for the update. Some more comments - In

[jira] [Updated] (HDFS-9034) "StorageTypeStats" Metric should not count failed storage.

2017-11-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9034: -- Fix Version/s: 2.8.0 2.9.0 3.0.0-alpha2 >

[jira] [Commented] (HDFS-9034) "StorageTypeStats" Metric should not count failed storage.

2017-11-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261514#comment-16261514 ] Wei-Chiu Chuang commented on HDFS-9034: --- Updated fixVersions based on git commit log. >

[jira] [Updated] (HDFS-11751) DFSZKFailoverController daemon exits with wrong status code

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-11751: -- Attachment: HDFS-11751.02.patch > DFSZKFailoverController daemon exits with wrong

[jira] [Resolved] (HDFS-5896) DataXceiver and DFSOutputStream call Thread.setName(), which is not thread safe

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDFS-5896. -- Resolution: Not A Problem > DataXceiver and DFSOutputStream call Thread.setName(), which

[jira] [Updated] (HDFS-11751) DFSZKFailoverController daemon exits with wrong status code

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-11751: -- Attachment: (was: HDFS-11751.02.patch) > DFSZKFailoverController daemon exits with

[jira] [Updated] (HDFS-11751) DFSZKFailoverController daemon exits with wrong status code

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-11751: -- Attachment: HDFS-11751.02.patch > DFSZKFailoverController daemon exits with wrong

[jira] [Assigned] (HDFS-11751) DFSZKFailoverController daemon exits with wrong status code

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-11751: - Assignee: Bharat Viswanadham > DFSZKFailoverController daemon exits with wrong

[jira] [Commented] (HDFS-11751) DFSZKFailoverController daemon exits with wrong status code

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261532#comment-16261532 ] Bharat Viswanadham commented on HDFS-11751: --- [~doris] Similar kind of fix I have provided in

[jira] [Commented] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

2017-11-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261612#comment-16261612 ] Anu Engineer commented on HDFS-12794: - [~shashikant] Thanks for updating this patch. I am afraid that

[jira] [Commented] (HDFS-12778) [READ] Report multiple locations for PROVIDED blocks

2017-11-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261627#comment-16261627 ] Íñigo Goiri commented on HDFS-12778: Double checked the tests. LGTM +1 > [READ] Report multiple

[jira] [Updated] (HDFS-12299) Race Between update pipeline and DN Re-Registration

2017-11-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12299: --- Labels: release-blocker (was: ) > Race Between update pipeline and DN Re-Registration >

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261880#comment-16261880 ] Konstantin Shvachko commented on HDFS-12832: The funny thing is that in

[jira] [Comment Edited] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261880#comment-16261880 ] Konstantin Shvachko edited comment on HDFS-12832 at 11/22/17 2:41 AM: --

[jira] [Commented] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261890#comment-16261890 ] Íñigo Goiri commented on HDFS-12809: OK, makes sense. The code here looks good. Do the old unit test

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261891#comment-16261891 ] Íñigo Goiri commented on HDFS-12681: Should we file JIRAs to remove the 2-RPC variant and use the

[jira] [Commented] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261935#comment-16261935 ] Yiqun Lin commented on HDFS-12850: -- Tested time elapsed in my local, create 10 containers costs around 4

[jira] [Updated] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12850: - Attachment: HDFS-12850-HDFS-7240.001.patch Attach the patch to reduce create-container number. > Ozone:

[jira] [Updated] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12850: - Status: Patch Available (was: Open) > Ozone: TestContainerPersistence#testListContainer fails frequently

[jira] [Commented] (HDFS-12847) Regenerate editsStored and editsStored.xml in HDFS tests

2017-11-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261944#comment-16261944 ] Xiao Chen commented on HDFS-12847: -- Straightforward patch fixing existing mismatching test data. +1.

[jira] [Updated] (HDFS-12299) Race Between update pipeline and DN Re-Registration

2017-11-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12299: --- Target Version/s: 2.8.2, 2.7.5 (was: 2.8.2) > Race Between update pipeline and DN

[jira] [Updated] (HDFS-12778) [READ] Report multiple locations for PROVIDED blocks

2017-11-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12778: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [READ] Report

[jira] [Commented] (HDFS-12840) Creating a replicated file in a EC zone does not correctly serialized in EditLogs

2017-11-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261715#comment-16261715 ] Xiao Chen commented on HDFS-12840: -- Thanks for reporting and fixing this Eddy. Some comments: - as

[jira] [Commented] (HDFS-12740) SCM should support a RPC to share the cluster Id with KSM and DataNodes

2017-11-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261624#comment-16261624 ] Anu Engineer commented on HDFS-12740: - Sorry to comment this late, can some please tell me what

[jira] [Commented] (HDFS-12299) Race Between update pipeline and DN Re-Registration

2017-11-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261649#comment-16261649 ] Wei-Chiu Chuang commented on HDFS-12299: This is a good candidate for 2.7.5 release as well. I

[jira] [Commented] (HDFS-11751) DFSZKFailoverController daemon exits with wrong status code

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261722#comment-16261722 ] Hadoop QA commented on HDFS-11751: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261602#comment-16261602 ] Hadoop QA commented on HDFS-12745: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12778) [READ] Report multiple locations for PROVIDED blocks

2017-11-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261610#comment-16261610 ] Virajith Jalaparti commented on HDFS-12778: --- The tests pass locally. > [READ] Report multiple

[jira] [Commented] (HDFS-12741) ADD support for KSM --createObjectStore command

2017-11-21 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261633#comment-16261633 ] Shashikant Banerjee commented on HDFS-12741: Removing the patch as it does not apply . Will

[jira] [Commented] (HDFS-12778) [READ] Report multiple locations for PROVIDED blocks

2017-11-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261632#comment-16261632 ] Virajith Jalaparti commented on HDFS-12778: --- Thanks for the review [~elgoiri]! Committing v03 to

[jira] [Commented] (HDFS-12740) SCM should support a RPC to share the cluster Id with KSM and DataNodes

2017-11-21 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261643#comment-16261643 ] Shashikant Banerjee commented on HDFS-12740: SCM --init is handled in HDFS-12739. > SCM

[jira] [Created] (HDFS-12846) WebHDFS/Jetty misinterprets empty path

2017-11-21 Thread David Tucker (JIRA)
David Tucker created HDFS-12846: --- Summary: WebHDFS/Jetty misinterprets empty path Key: HDFS-12846 URL: https://issues.apache.org/jira/browse/HDFS-12846 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261724#comment-16261724 ] Chris Douglas commented on HDFS-12681: -- This is ready for review. To page in some context, the

[jira] [Commented] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-11-21 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260643#comment-16260643 ] Mukul Kumar Singh commented on HDFS-12745: -- NIT: XceiverClientStandAlone.java ->

[jira] [Updated] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

2017-11-21 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12794: --- Attachment: HDFS-12794-HDFS-7240.004.patch Thanks [~msingh], for the review comments.

[jira] [Assigned] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti reassigned HDFS-12809: - Assignee: Virajith Jalaparti > [READ] Fix the randomized selection of locations

[jira] [Created] (HDFS-12848) [READ] Add a pluggable policy for selecting loctions for Provided files.

2017-11-21 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12848: - Summary: [READ] Add a pluggable policy for selecting loctions for Provided files. Key: HDFS-12848 URL: https://issues.apache.org/jira/browse/HDFS-12848

[jira] [Updated] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12809: -- Attachment: HDFS-12809-HDFS-9806.001.patch Attached patch makes the random selection of

[jira] [Updated] (HDFS-12848) [READ] Add a pluggable policy for selecting locations for Provided files.

2017-11-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12848: -- Summary: [READ] Add a pluggable policy for selecting locations for Provided files.

[jira] [Updated] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12809: -- Status: Patch Available (was: Open) > [READ] Fix the randomized selection of locations

[jira] [Commented] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261836#comment-16261836 ] Virajith Jalaparti commented on HDFS-12809: --- [~elgoiri], wrt your

[jira] [Created] (HDFS-12849) Update the auth_to_local rules documentation in hadoop documentation

2017-11-21 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-12849: - Summary: Update the auth_to_local rules documentation in hadoop documentation Key: HDFS-12849 URL: https://issues.apache.org/jira/browse/HDFS-12849

[jira] [Commented] (HDFS-12849) Update the auth_to_local rules documentation in hadoop documentation

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261847#comment-16261847 ] Bharat Viswanadham commented on HDFS-12849: --- HADOOP-14229 jira should be backported to branch-2

[jira] [Commented] (HDFS-12849) Update the auth_to_local rules documentation in hadoop documentation

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261848#comment-16261848 ] Bharat Viswanadham commented on HDFS-12849: --- Same patch applies cleanly to branch-2. This need

[jira] [Resolved] (HDFS-12849) Update the auth_to_local rules documentation in hadoop documentation

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDFS-12849. --- Resolution: Duplicate > Update the auth_to_local rules documentation in hadoop

[jira] [Moved] (HDFS-12847) Regenerate editsStored and editsStored.xml in HDFS tests

2017-11-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu moved HADOOP-15061 to HDFS-12847: --- Affects Version/s: (was: 3.0.0-beta1)

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-11-21 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261791#comment-16261791 ] Sanjay Radia commented on HDFS-7240: Ozone Cloudera Meeting Date: Thursday, November 16th 2017

[jira] [Commented] (HDFS-12845) JournalNode Test failures

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261804#comment-16261804 ] Hadoop QA commented on HDFS-12845: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11751) DFSZKFailoverController daemon exits with wrong status code

2017-11-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261755#comment-16261755 ] Bharat Viswanadham commented on HDFS-11751: --- Test case failures are not related to this patch.

[jira] [Updated] (HDFS-12847) Regenerate editsStored and editsStored.xml in HDFS tests

2017-11-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12847: - Status: Patch Available (was: Open) Please take a look [~xiaochen]. > Regenerate editsStored

[jira] [Updated] (HDFS-12847) Regenerate editsStored and editsStored.xml in HDFS tests

2017-11-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12847: - Attachment: HDFS-12847.00.patch editsStored Re-generate {{editsStored}} from

  1   2   >