[jira] [Updated] (HDDS-806) writeStateMachineData times out because chunk executors are not scheduled

2018-11-08 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-806: --- Attachment: HDDS-806.002.patch > writeStateMachineData times out because chunk executors are

[jira] [Commented] (HDDS-816) Create OM metrics for bucket, volume, keys

2018-11-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679344#comment-16679344 ] Yiqun Lin commented on HDDS-816: Thanks for working on this, [~bharatviswa]. Two comments from me: * For

[jira] [Updated] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

2018-11-08 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDFS-13762: -- Attachment: SCMCacheDesign-2018-11-08.pdf > Support non-volatile storage class memory(SCM) in HDFS

[jira] [Assigned] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

2018-11-08 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDFS-13762: - Assignee: Wei Zhou (was: Sammi Chen) > Support non-volatile storage class memory(SCM) in HDFS

[jira] [Commented] (HDDS-806) Update Ratis to latest snapshot version in ozone

2018-11-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680184#comment-16680184 ] Hudson commented on HDDS-806: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15391 (See

[jira] [Updated] (HDDS-823) OzoneRestClient is failing with NPE on getKeyDetails call

2018-11-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-823: Attachment: HDDS-823.00.patch > OzoneRestClient is failing with NPE on getKeyDetails call >

[jira] [Updated] (HDDS-806) Update Ratis to latest snapshot version in ozone

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-806: - Summary: Update Ratis to latest snapshot version in ozone (was: Update Ratis to latest

[jira] [Commented] (HDFS-14039) ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3)

2018-11-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680101#comment-16680101 ] Xiao Chen commented on HDFS-14039: -- +1 on patch 6 > ec -listPolicies doesn't show correct state for the

[jira] [Updated] (HDDS-824) WriteStateMachineData Times Out leading to Datanode crash

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-824: - Attachment: (was: HDDS-806.002.patch) > WriteStateMachineData Times Out leading to

[jira] [Updated] (HDDS-806) Update Ratis to latest snapshot version in ozone

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-806: - Resolution: Fixed Fix Version/s: 0.4.0 Status: Resolved (was: Patch

[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-819: Status: Patch Available (was: Open) > Match OzoneFileSystem behavior with S3AFileSystem >

[jira] [Commented] (HDDS-733) Create container if not exist, as part of chunk write

2018-11-08 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679586#comment-16679586 ] Lokesh Jain commented on HDDS-733: -- [~nandakumar131] [~linyiqun] Thanks for reviewing the patch! v3 patch

[jira] [Commented] (HDDS-802) Container State Manager should get open pipelines for allocating container

2018-11-08 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679600#comment-16679600 ] Lokesh Jain commented on HDDS-802: -- [~linyiqun] Thanks for reviewing the patch! v2 patch addresses your

[jira] [Updated] (HDDS-539) ozone datanode ignores the invalid options

2018-11-08 Thread Vinicius Higa Murakami (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinicius Higa Murakami updated HDDS-539: Attachment: HDDS-539.patch > ozone datanode ignores the invalid options >

[jira] [Updated] (HDFS-14055) Over-eager allocation in ByteBufferUtil.fallbackRead

2018-11-08 Thread Vanco Buca (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vanco Buca updated HDFS-14055: -- Issue Type: Bug (was: Improvement) > Over-eager allocation in ByteBufferUtil.fallbackRead >

[jira] [Assigned] (HDDS-789) Reduce usage of Guava Preconditions

2018-11-08 Thread Danilo Perez (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danilo Perez reassigned HDDS-789: - Assignee: Danilo Perez > Reduce usage of Guava Preconditions >

[jira] [Updated] (HDDS-806) writeStateMachineData times out because chunk executors are not scheduled

2018-11-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDDS-806: - Assignee: Tsz Wo Nicholas Sze (was: Mukul Kumar Singh) Status: Patch Available

[jira] [Updated] (HDDS-802) Container State Manager should get open pipelines for allocating container

2018-11-08 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDDS-802: - Attachment: HDDS-802.002.patch > Container State Manager should get open pipelines for allocating

[jira] [Created] (HDDS-821) Handle empty x-amz-storage-class header in Ozone S3 gateway

2018-11-08 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-821: - Summary: Handle empty x-amz-storage-class header in Ozone S3 gateway Key: HDDS-821 URL: https://issues.apache.org/jira/browse/HDDS-821 Project: Hadoop Distributed Data

[jira] [Commented] (HDFS-13985) Clearer error message for ReplicaNotFoundException

2018-11-08 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679797#comment-16679797 ] Adam Antal commented on HDFS-13985: --- Thanks for the comment [~zvenczel]. I looked at the use-cases

[jira] [Commented] (HDFS-14039) ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3)

2018-11-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680139#comment-16680139 ] Hudson commented on HDFS-14039: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15390 (See

[jira] [Commented] (HDFS-14050) Use parameterized logging construct in NamenodeFsck class

2018-11-08 Thread Hrishikesh Gadre (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680218#comment-16680218 ] Hrishikesh Gadre commented on HDFS-14050: - [~knanasi] thanks a lot for the review :) I have

[jira] [Commented] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680221#comment-16680221 ] Hanisha Koneru commented on HDDS-819: - Contract tests are passing for me locally. I have re-triggered a

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-08 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.005.patch > Use different metrics in DataNode to better measure latency

[jira] [Commented] (HDDS-642) Add chill mode exit condition for pipeline availability

2018-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679589#comment-16679589 ] Hadoop QA commented on HDDS-642: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680370#comment-16680370 ] Konstantin Shvachko commented on HDFS-14017: The patch looks good. Really liked all changes

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680004#comment-16680004 ] Hadoop QA commented on HDFS-14045: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

2018-11-08 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDFS-13762: -- Description: No-volatile storage class memory is a type of memory that can keep the data content

[jira] [Commented] (HDFS-13998) ECAdmin NPE with -setPolicy -replicate

2018-11-08 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679385#comment-16679385 ] Ayush Saxena commented on HDFS-13998: - Thanx [~zvenczel] for working on it and [~xiaochen] for the

[jira] [Commented] (HDDS-737) Introduce Incremental Container Report

2018-11-08 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679739#comment-16679739 ] Nanda kumar commented on HDDS-737: -- Thanks [~linyiqun] & [~jnp] for the reviews. Committed it to trunk. >

[jira] [Created] (HDDS-820) Use more strict data format for the Last-Modified headers of s3 gateway

2018-11-08 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-820: - Summary: Use more strict data format for the Last-Modified headers of s3 gateway Key: HDDS-820 URL: https://issues.apache.org/jira/browse/HDDS-820 Project: Hadoop

[jira] [Commented] (HDDS-812) TestEndPoint#testCheckVersionResponse is failing

2018-11-08 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679704#comment-16679704 ] Nanda kumar commented on HDDS-812: -- [~hanishakoneru], It seems you have accidentally attached HDDS-797's

[jira] [Commented] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

2018-11-08 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679912#comment-16679912 ] Sammi Chen commented on HDFS-13762: --- Initial patch with design document and test plan. All test cases

[jira] [Updated] (HDDS-821) Handle empty x-amz-storage-class header in Ozone S3 gateway

2018-11-08 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-821: -- Attachment: HDDS-821.001.patch > Handle empty x-amz-storage-class header in Ozone S3 gateway >

[jira] [Updated] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14035: -- Attachment: HDFS-14035-HDFS-12943.012.patch > NN status discovery does not leverage delegation token >

[jira] [Created] (HDDS-824) WriteStateMachineData Times Out leading to Datanode crash

2018-11-08 Thread Shashikant Banerjee (JIRA)
Shashikant Banerjee created HDDS-824: Summary: WriteStateMachineData Times Out leading to Datanode crash Key: HDDS-824 URL: https://issues.apache.org/jira/browse/HDDS-824 Project: Hadoop

[jira] [Commented] (HDDS-822) Adding SCM audit log

2018-11-08 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680174#comment-16680174 ] Dinesh Chitlangia commented on HDDS-822: [~anu] - I leave this to your judgement. Do we want to

[jira] [Commented] (HDFS-13772) Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled

2018-11-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680149#comment-16680149 ] Xiao Chen commented on HDFS-13772: -- Cherry-picked to branch-3.0 to reduce conflict with another backport

[jira] [Commented] (HDFS-13998) ECAdmin NPE with -setPolicy -replicate

2018-11-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680192#comment-16680192 ] Xiao Chen commented on HDFS-13998: -- Good catch, [~ayushtkn]. We should optimize to only getPolicy for

[jira] [Commented] (HDDS-709) Modify Close Container handling sequence on datanodes

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680294#comment-16680294 ] Shashikant Banerjee commented on HDDS-709: -- Patch v3: rebased to latest trunk. > Modify Close

[jira] [Updated] (HDDS-737) Introduce Incremental Container Report

2018-11-08 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-737: - Resolution: Fixed Fix Version/s: 0.4.0 Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-14057) Improve ErasureCodingPolicyManager's data structures

2018-11-08 Thread Kitti Nanasi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kitti Nanasi updated HDFS-14057: Affects Version/s: 3.1.1 > Improve ErasureCodingPolicyManager's data structures >

[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-819: Attachment: HDDS-819.001.patch > Match OzoneFileSystem behavior with S3AFileSystem >

[jira] [Commented] (HDDS-737) Introduce Incremental Container Report

2018-11-08 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679368#comment-16679368 ] Jitendra Nath Pandey commented on HDDS-737: --- I am +1 for the patch, if failures are not related

[jira] [Commented] (HDDS-821) Handle empty x-amz-storage-class header in Ozone S3 gateway

2018-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679551#comment-16679551 ] Hadoop QA commented on HDDS-821: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679480#comment-16679480 ] Hadoop QA commented on HDFS-14045: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDDS-822) Adding SCM audit log

2018-11-08 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDDS-822: -- Summary: Adding SCM audit log Key: HDDS-822 URL: https://issues.apache.org/jira/browse/HDDS-822 Project: Hadoop Distributed Data Store Issue Type: Improvement

[jira] [Commented] (HDDS-733) Create container if not exist, as part of chunk write

2018-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679730#comment-16679730 ] Hadoop QA commented on HDDS-733: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-820) Use more strict data format for the Last-Modified headers of s3 gateway

2018-11-08 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-820: -- Status: Patch Available (was: Open) > Use more strict data format for the Last-Modified headers of s3

[jira] [Commented] (HDDS-806) writeStateMachineData times out because chunk executors are not scheduled

2018-11-08 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679699#comment-16679699 ] Mukul Kumar Singh commented on HDDS-806: Looked into this by adding more detail. Create container

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679188#comment-16679188 ] Chen Liang commented on HDFS-14017: --- Had some offline discussion with [~shv]. Turns out we can further

[jira] [Commented] (HDFS-13358) RBF: Support for Delegation Token (RPC)

2018-11-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680148#comment-16680148 ] Brahma Reddy Battula commented on HDFS-13358: - [~crh] any update on this..? > RBF: Support

[jira] [Commented] (HDDS-806) Update Ratis to latest Snapshot Version in Ozone

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680154#comment-16680154 ] Shashikant Banerjee commented on HDDS-806: -- TimeoutException will be handled as a part of

[jira] [Updated] (HDDS-824) WriteStateMachineData Times Out leading to Datanode crash

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-824: - Attachment: (was: HDDS-806_20181107.patch) > WriteStateMachineData Times Out leading

[jira] [Updated] (HDDS-709) Modify Close Container handling sequence on datanodes

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-709: - Attachment: HDDS-709.003.patch > Modify Close Container handling sequence on datanodes >

[jira] [Updated] (HDDS-709) Modify Close Container handling sequence on datanodes

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-709: - Status: Patch Available (was: Open) > Modify Close Container handling sequence on

[jira] [Commented] (HDFS-14039) ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3)

2018-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679148#comment-16679148 ] Hadoop QA commented on HDFS-14039: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-14055) Over-eager allocation in ByteBufferUtil.fallbackRead

2018-11-08 Thread Vanco Buca (JIRA)
Vanco Buca created HDFS-14055: - Summary: Over-eager allocation in ByteBufferUtil.fallbackRead Key: HDFS-14055 URL: https://issues.apache.org/jira/browse/HDFS-14055 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-08 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679413#comment-16679413 ] Jiandan Yang commented on HDFS-14045: -- Hi, [~cheersyang] and [~xkrogen], thanks for your

[jira] [Updated] (HDDS-820) Use more strict data format for the Last-Modified headers of s3 gateway

2018-11-08 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-820: -- Attachment: HDDS-820.001.patch > Use more strict data format for the Last-Modified headers of s3 gateway

[jira] [Commented] (HDFS-7197) Enhancements to Mover

2018-11-08 Thread Xiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679267#comment-16679267 ] Xiang Li commented on HDFS-7197: [~benoyantony], I am not sure if HDFS-9034 could be added as a sub-task

[jira] [Updated] (HDDS-806) writeStateMachineData times out because chunk executors are not scheduled

2018-11-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDDS-806: - Attachment: HDDS-806_20181107.patch > writeStateMachineData times out because chunk

[jira] [Updated] (HDDS-823) OzoneRestClient is failing with NPE on getKeyDetails call

2018-11-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-823: Attachment: report.html > OzoneRestClient is failing with NPE on getKeyDetails call >

[jira] [Commented] (HDDS-823) OzoneRestClient is failing with NPE on getKeyDetails call

2018-11-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680164#comment-16680164 ] Bharat Viswanadham commented on HDDS-823: - Thank You [~nandakumar131] for reporting this. Attached

[jira] [Updated] (HDDS-778) Add an interface for CA and Clients for Certificate operations

2018-11-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDDS-778: -- Resolution: Fixed Fix Version/s: 0.4.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDDS-732) Add read method which takes offset and length in SignedChunkInputStream

2018-11-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-732: Target Version/s: 0.4.0 > Add read method which takes offset and length in

[jira] [Comment Edited] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-08 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679222#comment-16679222 ] Jiandan Yang edited comment on HDFS-14045 at 11/8/18 3:01 AM: --- Hi,

[jira] [Commented] (HDDS-806) writeStateMachineData times out because chunk executors are not scheduled

2018-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679105#comment-16679105 ] Hadoop QA commented on HDDS-806: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-733) Create container if not exist, as part of chunk write

2018-11-08 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDDS-733: - Attachment: HDDS-733.003.patch > Create container if not exist, as part of chunk write >

[jira] [Created] (HDFS-14057) Improve ErasureCodingPolicyManager's data structures

2018-11-08 Thread Kitti Nanasi (JIRA)
Kitti Nanasi created HDFS-14057: --- Summary: Improve ErasureCodingPolicyManager's data structures Key: HDFS-14057 URL: https://issues.apache.org/jira/browse/HDFS-14057 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-13818) Extend OIV to detect FSImage corruption

2018-11-08 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679748#comment-16679748 ] Adam Antal commented on HDFS-13818: --- Whitespace warnings are coming from markdown file, where I

[jira] [Updated] (HDDS-823) OzoneRestClient is failing with NPE on getKeyDetails call

2018-11-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-823: Status: Patch Available (was: Open) > OzoneRestClient is failing with NPE on getKeyDetails

[jira] [Updated] (HDFS-14039) ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3)

2018-11-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-14039: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.1 3.3.0

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680121#comment-16680121 ] Chen Liang commented on HDFS-14035: --- Thanks for the catch [~shv], updated with v012 patch. > NN status

[jira] [Updated] (HDDS-824) WriteStateMachineData Times Out leading to Datanode crash

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-824: - Attachment: (was: HDDS-806.001.patch) > WriteStateMachineData Times Out leading to

[jira] [Assigned] (HDDS-824) WriteStateMachineData Times Out leading to Datanode crash

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-824: Assignee: Mukul Kumar Singh (was: Tsz Wo Nicholas Sze) > WriteStateMachineData

[jira] [Commented] (HDDS-823) OzoneRestClient is failing with NPE on getKeyDetails call

2018-11-08 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679663#comment-16679663 ] Nanda kumar commented on HDDS-823: -- This is happening after HDDS-798. > OzoneRestClient is failing with

[jira] [Commented] (HDDS-806) writeStateMachineData times out because chunk executors are not scheduled

2018-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679411#comment-16679411 ] Hadoop QA commented on HDDS-806: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14039) ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3)

2018-11-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679249#comment-16679249 ] Xiao Chen commented on HDFS-14039: -- Thanks for revving Kitti, and the patch. I think current patch is

[jira] [Updated] (HDFS-14050) Use parameterized logging construct in NamenodeFsck class

2018-11-08 Thread Hrishikesh Gadre (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hrishikesh Gadre updated HDFS-14050: Attachment: HADOOP-14128-003.patch > Use parameterized logging construct in NamenodeFsck

[jira] [Updated] (HDFS-14050) Use parameterized logging construct in NamenodeFsck class

2018-11-08 Thread Hrishikesh Gadre (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hrishikesh Gadre updated HDFS-14050: Attachment: HDFS-14050-003.patch > Use parameterized logging construct in NamenodeFsck

[jira] [Updated] (HDFS-14050) Use parameterized logging construct in NamenodeFsck class

2018-11-08 Thread Hrishikesh Gadre (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hrishikesh Gadre updated HDFS-14050: Attachment: (was: HADOOP-14128-003.patch) > Use parameterized logging construct in

[jira] [Commented] (HDDS-823) OzoneRestClient is failing with NPE on getKeyDetails call

2018-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680283#comment-16680283 ] Hadoop QA commented on HDDS-823: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-818) OzoneConfiguration uses an existing XMLRoot value

2018-11-08 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680285#comment-16680285 ] Giovanni Matteo Fumarola commented on HDDS-818: --- Should we fix this one in HDDS or in YARN?

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2018-11-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680381#comment-16680381 ] Íñigo Goiri commented on HDFS-6874: --- What is the status here? HttpFs doesn't seem to have

[jira] [Commented] (HDDS-806) writeStateMachineData times out because chunk executors are not scheduled

2018-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679326#comment-16679326 ] Hadoop QA commented on HDDS-806: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13998) ECAdmin NPE with -setPolicy -replicate

2018-11-08 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679470#comment-16679470 ] Zsolt Venczel commented on HDFS-13998: -- [~ayushtkn] your proposed solution is more efficient I

[jira] [Updated] (HDFS-14039) ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3)

2018-11-08 Thread Kitti Nanasi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kitti Nanasi updated HDFS-14039: Attachment: HDFS-14039.006.patch > ec -listPolicies doesn't show correct state for the default

[jira] [Commented] (HDDS-802) Container State Manager should get open pipelines for allocating container

2018-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679713#comment-16679713 ] Hadoop QA commented on HDDS-802: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-798) Storage-class is showing incorrectly

2018-11-08 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679669#comment-16679669 ] Nanda kumar commented on HDDS-798: -- After this change {{RestClient#getKeyDetails}} is failing with

[jira] [Updated] (HDDS-821) Handle empty x-amz-storage-class header in Ozone S3 gateway

2018-11-08 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-821: -- Status: Patch Available (was: Open) Sorry, I renamed the TestPutObject class to TestObjectPut to follow

[jira] [Updated] (HDDS-801) Quasi close the container when close is not executed via Ratis

2018-11-08 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-801: - Status: Patch Available (was: Open) > Quasi close the container when close is not executed via Ratis >

[jira] [Commented] (HDDS-709) Modify Close Container handling sequence on datanodes

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679698#comment-16679698 ] Shashikant Banerjee commented on HDDS-709: -- Patch v2 is dependent on HDDS-806. > Modify Close

[jira] [Created] (HDDS-823) OzoneRestClient is failing with NPE on getKeyDetails call

2018-11-08 Thread Nanda kumar (JIRA)
Nanda kumar created HDDS-823: Summary: OzoneRestClient is failing with NPE on getKeyDetails call Key: HDDS-823 URL: https://issues.apache.org/jira/browse/HDDS-823 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-737) Introduce Incremental Container Report

2018-11-08 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679732#comment-16679732 ] Nanda kumar commented on HDDS-737: -- Tested it locally, failures are not related to this patch. I will

[jira] [Updated] (HDFS-13772) Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled

2018-11-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13772: - Fix Version/s: 3.0.4 > Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling >

[jira] [Updated] (HDDS-806) Update Ratis to latest Snapshot Version in Ozone

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-806: - Summary: Update Ratis to latest Snapshot Version in Ozone (was: writeStateMachineData

[jira] [Assigned] (HDDS-806) Update Ratis to latest Snapshot Version in Ozone

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-806: Assignee: Mukul Kumar Singh (was: Tsz Wo Nicholas Sze) > Update Ratis to latest

[jira] [Assigned] (HDDS-806) Update Ratis to latest Snapshot Version in Ozone

2018-11-08 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-806: Assignee: Tsz Wo Nicholas Sze (was: Mukul Kumar Singh) > Update Ratis to latest

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679071#comment-16679071 ] Íñigo Goiri commented on HDFS-14045: {quote} The unit of dfs.heartbeat.interval is second instead of

  1   2   3   >