[jira] [Resolved] (HDDS-451) PutKey failed due to error "Rejecting write chunk request. Chunk overwrite without explicit request"

2019-02-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDDS-451. -- Resolution: Cannot Reproduce Resolving as "Cannot Reproduce". > PutKey failed due to

[jira] [Created] (HDDS-826) Update Ratis to 0.3.0-6f3419a-SNAPSHOT

2018-11-09 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDDS-826: Summary: Update Ratis to 0.3.0-6f3419a-SNAPSHOT Key: HDDS-826 URL: https://issues.apache.org/jira/browse/HDDS-826 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-691) Dependency convergence error for org.apache.hadoop:hadoop-annotations

2018-10-18 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDDS-691: Summary: Dependency convergence error for org.apache.hadoop:hadoop-annotations Key: HDDS-691 URL: https://issues.apache.org/jira/browse/HDDS-691 Project:

[jira] [Created] (HDDS-632) TimeoutScheduler and SlidingWindow should use daemon threads

2018-10-11 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDDS-632: Summary: TimeoutScheduler and SlidingWindow should use daemon threads Key: HDDS-632 URL: https://issues.apache.org/jira/browse/HDDS-632 Project: Hadoop

[jira] [Created] (HDDS-554) In XceiverClientSpi, implements sendCommand(..) using sendCommandAsync(..)

2018-09-25 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDDS-554: Summary: In XceiverClientSpi, implements sendCommand(..) using sendCommandAsync(..) Key: HDDS-554 URL: https://issues.apache.org/jira/browse/HDDS-554

[jira] [Created] (HDDS-372) There are two buffer copies in ChunkOutputStream

2018-08-23 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDDS-372: Summary: There are two buffer copies in ChunkOutputStream Key: HDDS-372 URL: https://issues.apache.org/jira/browse/HDDS-372 Project: Hadoop Distributed Data

[jira] [Resolved] (HDFS-13205) Incorrect path is passed to checkPermission during authorization of file under a snapshot (specifically under a subdir) after original subdir is deleted

2018-08-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-13205. Resolution: Not A Problem Resolving as Not A Problem. > Incorrect path is passed

[jira] [Created] (HDDS-293) Reduce memory usage in KeyData

2018-07-25 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDDS-293: Summary: Reduce memory usage in KeyData Key: HDDS-293 URL: https://issues.apache.org/jira/browse/HDDS-293 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-288) Fix bugs in OpenContainerBlockMap

2018-07-24 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDDS-288: Summary: Fix bugs in OpenContainerBlockMap Key: HDDS-288 URL: https://issues.apache.org/jira/browse/HDDS-288 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-42) Inconsistent module names and descriptions

2018-05-10 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDDS-42: --- Summary: Inconsistent module names and descriptions Key: HDDS-42 URL: https://issues.apache.org/jira/browse/HDDS-42 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-28) Duplicate declaration in hadoop-tools/hadoop-ozone/pom.xml

2018-05-07 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDDS-28: --- Summary: Duplicate declaration in hadoop-tools/hadoop-ozone/pom.xml Key: HDDS-28 URL: https://issues.apache.org/jira/browse/HDDS-28 Project: Hadoop Distributed

[jira] [Created] (HDFS-13526) Use TimeoutScheduler in RaftClientImpl

2018-05-03 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-13526: -- Summary: Use TimeoutScheduler in RaftClientImpl Key: HDFS-13526 URL: https://issues.apache.org/jira/browse/HDFS-13526 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-898) Sequential generation of block ids

2018-03-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-898. -- Resolution: Duplicate This was done by HDFS-4645. Resolving ... > Sequential generation

[jira] [Created] (HDFS-13252) Code refactoring: Remove Diff.ListType

2018-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-13252: -- Summary: Code refactoring: Remove Diff.ListType Key: HDFS-13252 URL: https://issues.apache.org/jira/browse/HDFS-13252 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13223) Reduce DiffListBySkipList memory usage

2018-03-02 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-13223: -- Summary: Reduce DiffListBySkipList memory usage Key: HDFS-13223 URL: https://issues.apache.org/jira/browse/HDFS-13223 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12839) Refactor ratis-server tests to reduce the use DEFAULT_CALLID

2017-11-20 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-12839: -- Summary: Refactor ratis-server tests to reduce the use DEFAULT_CALLID Key: HDFS-12839 URL: https://issues.apache.org/jira/browse/HDFS-12839 Project:

[jira] [Created] (HDFS-12527) CLONE - javadoc: error - class file for org.apache.http.annotation.ThreadSafe not found

2017-09-21 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-12527: -- Summary: CLONE - javadoc: error - class file for org.apache.http.annotation.ThreadSafe not found Key: HDFS-12527 URL: https://issues.apache.org/jira/browse/HDFS-12527

[jira] [Created] (HDFS-12507) StripedBlockUtil.java:694: warning - Tag @link: reference not found: StripingCell

2017-09-20 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-12507: -- Summary: StripedBlockUtil.java:694: warning - Tag @link: reference not found: StripingCell Key: HDFS-12507 URL: https://issues.apache.org/jira/browse/HDFS-12507

[jira] [Created] (HDFS-12244) Ozone: the static cache provided by ContainerCache does not work in Unit tests

2017-08-01 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-12244: -- Summary: Ozone: the static cache provided by ContainerCache does not work in Unit tests Key: HDFS-12244 URL: https://issues.apache.org/jira/browse/HDFS-12244

[jira] [Created] (HDFS-12163) Ozone: MiniOzoneCluster uses 400+ threads

2017-07-19 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-12163: -- Summary: Ozone: MiniOzoneCluster uses 400+ threads Key: HDFS-12163 URL: https://issues.apache.org/jira/browse/HDFS-12163 Project: Hadoop HDFS

[jira] [Created] (HDFS-12006) Ozone: add TestDistributedOzoneVolumesRatis

2017-06-21 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-12006: -- Summary: Ozone: add TestDistributedOzoneVolumesRatis Key: HDFS-12006 URL: https://issues.apache.org/jira/browse/HDFS-12006 Project: Hadoop HDFS

[jira] [Created] (HDFS-11989) Oz

2017-06-17 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11989: -- Summary: Oz Key: HDFS-11989 URL: https://issues.apache.org/jira/browse/HDFS-11989 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11979) Ozone: TestContainerPersistence never uses MiniOzoneCluster

2017-06-15 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11979: -- Summary: Ozone: TestContainerPersistence never uses MiniOzoneCluster Key: HDFS-11979 URL: https://issues.apache.org/jira/browse/HDFS-11979 Project:

[jira] [Created] (HDFS-11977) Ozone: cannot enable test debug/trace log

2017-06-15 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11977: -- Summary: Ozone: cannot enable test debug/trace log Key: HDFS-11977 URL: https://issues.apache.org/jira/browse/HDFS-11977 Project: Hadoop HDFS

[jira] [Created] (HDFS-11948) Ozone: change TestRatisManager to check cluster with data

2017-06-07 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11948: -- Summary: Ozone: change TestRatisManager to check cluster with data Key: HDFS-11948 URL: https://issues.apache.org/jira/browse/HDFS-11948 Project: Hadoop

[jira] [Created] (HDFS-11947) BPOfferService prints a invalid warning message "Block pool ID needed, but service not yet registered with NN"

2017-06-07 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11947: -- Summary: BPOfferService prints a invalid warning message "Block pool ID needed, but service not yet registered with NN" Key: HDFS-11947 URL:

[jira] [Created] (HDFS-11946) Ozone: Containers in different datanodes are mapped to the same location

2017-06-07 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11946: -- Summary: Ozone: Containers in different datanodes are mapped to the same location Key: HDFS-11946 URL: https://issues.apache.org/jira/browse/HDFS-11946

[jira] [Created] (HDFS-11865) Ozone: Do not initialize Ratis cluster during datanode startup

2017-05-22 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11865: -- Summary: Ozone: Do not initialize Ratis cluster during datanode startup Key: HDFS-11865 URL: https://issues.apache.org/jira/browse/HDFS-11865 Project:

[jira] [Created] (HDFS-11843) Ozone: XceiverClientRatis should implement XceiverClientSpi.connect()

2017-05-17 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11843: -- Summary: Ozone: XceiverClientRatis should implement XceiverClientSpi.connect() Key: HDFS-11843 URL: https://issues.apache.org/jira/browse/HDFS-11843

[jira] [Created] (HDFS-11735) Ozone: In Ratis, leader should validate ContainerCommandRequestProto before propagating it to followers

2017-05-01 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11735: -- Summary: Ozone: In Ratis, leader should validate ContainerCommandRequestProto before propagating it to followers Key: HDFS-11735 URL:

[jira] [Created] (HDFS-11734) Ozone: provide a way to validate ContainerCommandRequestProto

2017-05-01 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11734: -- Summary: Ozone: provide a way to validate ContainerCommandRequestProto Key: HDFS-11734 URL: https://issues.apache.org/jira/browse/HDFS-11734 Project:

[jira] [Created] (HDFS-11597) Ozone: Add Ratis management API

2017-03-29 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11597: -- Summary: Ozone: Add Ratis management API Key: HDFS-11597 URL: https://issues.apache.org/jira/browse/HDFS-11597 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-11559) Ozone: MiniOzoneCluster prints too many log messages by default

2017-03-21 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11559: -- Summary: Ozone: MiniOzoneCluster prints too many log messages by default Key: HDFS-11559 URL: https://issues.apache.org/jira/browse/HDFS-11559 Project:

[jira] [Created] (HDFS-11558) BPServiceActor thread name is too long

2017-03-21 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11558: -- Summary: BPServiceActor thread name is too long Key: HDFS-11558 URL: https://issues.apache.org/jira/browse/HDFS-11558 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-11513) Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations

2017-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11513: -- Summary: Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations Key: HDFS-11513 URL: https://issues.apache.org/jira/browse/HDFS-11513

[jira] [Created] (HDFS-11429) Move out the Hadoop RPC config keys from RaftServerConfigKeys

2017-02-17 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11429: -- Summary: Move out the Hadoop RPC config keys from RaftServerConfigKeys Key: HDFS-11429 URL: https://issues.apache.org/jira/browse/HDFS-11429 Project:

[jira] [Created] (HDFS-11168) Bump Netty 4 version

2016-11-22 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11168: -- Summary: Bump Netty 4 version Key: HDFS-11168 URL: https://issues.apache.org/jira/browse/HDFS-11168 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-10791) Delete block meta file when the block file is missing

2016-08-24 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-10791: -- Summary: Delete block meta file when the block file is missing Key: HDFS-10791 URL: https://issues.apache.org/jira/browse/HDFS-10791 Project: Hadoop HDFS

[jira] [Created] (HDFS-10535) Rename AsyncDistributedFileSystem

2016-06-16 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-10535: -- Summary: Rename AsyncDistributedFileSystem Key: HDFS-10535 URL: https://issues.apache.org/jira/browse/HDFS-10535 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-8715) Checkpoint node keeps throwing exception

2016-06-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8715. --- Resolution: Duplicate > Checkpoint node keeps throwing exception >

[jira] [Resolved] (HDFS-10445) Add timeout tests for async DFS API

2016-05-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-10445. Resolution: Duplicate After HDFS-10431, all tests have timeout now. Resolving as

[jira] [Created] (HDFS-10319) Balancer should not try to pair storages with different types

2016-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-10319: -- Summary: Balancer should not try to pair storages with different types Key: HDFS-10319 URL: https://issues.apache.org/jira/browse/HDFS-10319 Project:

[jira] [Created] (HDFS-9943) Support reconfiguring namenode replication confs

2016-03-10 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9943: - Summary: Support reconfiguring namenode replication confs Key: HDFS-9943 URL: https://issues.apache.org/jira/browse/HDFS-9943 Project: Hadoop HDFS

[jira] [Created] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9924: - Summary: [umbrella] Asynchronous HDFS Access Key: HDFS-9924 URL: https://issues.apache.org/jira/browse/HDFS-9924 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-9838) Refactor the excessReplicateMap to a class

2016-02-19 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9838: - Summary: Refactor the excessReplicateMap to a class Key: HDFS-9838 URL: https://issues.apache.org/jira/browse/HDFS-9838 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-9825) Balancer should not terminate if only one of the namenodes has error

2016-02-17 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9825: - Summary: Balancer should not terminate if only one of the namenodes has error Key: HDFS-9825 URL: https://issues.apache.org/jira/browse/HDFS-9825 Project:

[jira] [Resolved] (HDFS-8050) Separate the client conf key from DFSConfigKeys

2016-02-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8050. --- Resolution: Duplicate The was done by other subtasks in HDFS-8048. > Separate the

[jira] [Created] (HDFS-9822) BlockManager.validateReconstructionWork throws AssertionError

2016-02-17 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9822: - Summary: BlockManager.validateReconstructionWork throws AssertionError Key: HDFS-9822 URL: https://issues.apache.org/jira/browse/HDFS-9822 Project: Hadoop

[jira] [Created] (HDFS-9729) Use null to replace DataNode.EMPTY_DEL_HINT

2016-02-01 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9729: - Summary: Use null to replace DataNode.EMPTY_DEL_HINT Key: HDFS-9729 URL: https://issues.apache.org/jira/browse/HDFS-9729 Project: Hadoop HDFS

[jira] [Created] (HDFS-9726) Refactor IBR code to a new class

2016-01-30 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9726: - Summary: Refactor IBR code to a new class Key: HDFS-9726 URL: https://issues.apache.org/jira/browse/HDFS-9726 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-9710) Change DN to send block receipt IBRs in batches

2016-01-26 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9710: - Summary: Change DN to send block receipt IBRs in batches Key: HDFS-9710 URL: https://issues.apache.org/jira/browse/HDFS-9710 Project: Hadoop HDFS

[jira] [Created] (HDFS-9690) addBlock is not idempotent

2016-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9690: - Summary: addBlock is not idempotent Key: HDFS-9690 URL: https://issues.apache.org/jira/browse/HDFS-9690 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-9654) Code refactoring for HDFS-8578

2016-01-16 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9654: - Summary: Code refactoring for HDFS-8578 Key: HDFS-9654 URL: https://issues.apache.org/jira/browse/HDFS-9654 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-9573) o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEntry$hashCode inconsistent with equals

2016-01-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-9573. --- Resolution: Invalid "SnapshotDiffReport$DiffReportEntry$hashCode inconsistent with

[jira] [Created] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-08 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9527: - Summary: The return type of FSNamesystem.getBlockCollection should be changed to INodeFile Key: HDFS-9527 URL: https://issues.apache.org/jira/browse/HDFS-9527

[jira] [Created] (HDFS-9528) Cleanup namenode audit/log/exception messages

2015-12-08 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9528: - Summary: Cleanup namenode audit/log/exception messages Key: HDFS-9528 URL: https://issues.apache.org/jira/browse/HDFS-9528 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-4488) Confusing WebHDFS exception when host doesn't resolve

2015-12-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-4488. --- Resolution: Cannot Reproduce Target Version/s: 2.1.0-beta, 3.0.0 (was:

[jira] [Resolved] (HDFS-2593) Rename webhdfs HTTP param 'delegation' to 'delegationtoken'

2015-12-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-2593. --- Resolution: Not A Problem Resolving this stale issue as Not A Problem. > Rename

[jira] [Created] (HDFS-9509) Add new metrics for measuring datanode storage statistics

2015-12-04 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9509: - Summary: Add new metrics for measuring datanode storage statistics Key: HDFS-9509 URL: https://issues.apache.org/jira/browse/HDFS-9509 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-3439) Balancer exits if fs.defaultFS is set to a different, but semantically identical, URI from dfs.namenode.rpc-address

2015-12-03 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-3439. --- Resolution: Cannot Reproduce Target Version/s: (was: ) Resolving as Cannot

[jira] [Resolved] (HDFS-5958) One very large node in a cluster prevents balancer from balancing data

2015-12-03 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-5958. --- Resolution: Duplicate > One very large node in a cluster prevents balancer from

[jira] [Resolved] (HDFS-2220) balancer.Balancer: java.lang.NullPointerException while HADOOP_CONF_DIR is empty or wrong

2015-12-03 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-2220. --- Resolution: Cannot Reproduce Let's resolve this as Cannot Reproduce. >

[jira] [Resolved] (HDFS-2851) HA: Optimize stale block processing by triggering block reports immediately on failover

2015-12-03 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-2851. --- Resolution: Not A Problem Target Version/s: (was: ) Resolving this stale

[jira] [Resolved] (HDFS-2621) Balancer is not checking ALREADY_RUNNING state and never returns this state.

2015-12-03 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-2621. --- Resolution: Not A Problem Resolving this stale issue as Not A Problem. > Balancer is

[jira] [Resolved] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-9434. --- Resolution: Fixed Sangjin, thanks for the review. I have committed the branch-2.6

[jira] [Reopened] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reopened HDFS-9434: --- Reopen for backporting to branch-2.6 > Recommission a datanode with 500k blocks may pause

[jira] [Reopened] (HDFS-8246) Get HDFS file name based on block pool id and block id

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reopened HDFS-8246: --- > Get HDFS file name based on block pool id and block id >

[jira] [Resolved] (HDFS-8246) Get HDFS file name based on block pool id and block id

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8246. --- Resolution: Won't Fix > Get HDFS file name based on block pool id and block id >

[jira] [Resolved] (HDFS-8244) HDFS Custom Storage Tier Policies

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8244. --- Resolution: Duplicate Resolving. > HDFS Custom Storage Tier Policies >

[jira] [Resolved] (HDFS-8464) hdfs namenode UI shows "Max Non Heap Memory" is -1 B

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8464. --- Resolution: Duplicate > hdfs namenode UI shows "Max Non Heap Memory" is -1 B >

[jira] [Reopened] (HDFS-8727) Allow using path style addressing for accessing the s3 endpoint

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reopened HDFS-8727: --- Since no patch was committed, we should not resolve this as fixed. > Allow using path

[jira] [Resolved] (HDFS-8727) Allow using path style addressing for accessing the s3 endpoint

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8727. --- Resolution: Not A Problem Fix Version/s: (was: 2.7.2) > Allow using path

[jira] [Created] (HDFS-9441) Do not call construct path string when choosing block placement targets

2015-11-18 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9441: - Summary: Do not call construct path string when choosing block placement targets Key: HDFS-9441 URL: https://issues.apache.org/jira/browse/HDFS-9441

[jira] [Created] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-16 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9434: - Summary: Recommission a datanode with 500k blocks may pause NN for 30 seconds Key: HDFS-9434 URL: https://issues.apache.org/jira/browse/HDFS-9434 Project:

[jira] [Created] (HDFS-9365) Balaner should call getNNServiceRpcAddressesForCluster after HDFS-6376

2015-11-02 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9365: - Summary: Balaner should call getNNServiceRpcAddressesForCluster after HDFS-6376 Key: HDFS-9365 URL: https://issues.apache.org/jira/browse/HDFS-9365

[jira] [Created] (HDFS-9346) TestDFSStripedOutputStreamWithFailure.testMultipleDatanodeFailure56 may throw NPE

2015-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9346: - Summary: TestDFSStripedOutputStreamWithFailure.testMultipleDatanodeFailure56 may throw NPE Key: HDFS-9346 URL: https://issues.apache.org/jira/browse/HDFS-9346

[jira] [Created] (HDFS-9205) Do not sehedule corrupted blocks for replication

2015-10-06 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9205: - Summary: Do not sehedule corrupted blocks for replication Key: HDFS-9205 URL: https://issues.apache.org/jira/browse/HDFS-9205 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-9194) AlreadyBeingCreatedException ... because pendingCreates is non-null but no leases found.

2015-10-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-9194. --- Resolution: Duplicate > AlreadyBeingCreatedException ... because pendingCreates is

[jira] [Created] (HDFS-9194) AlreadyBeingCreatedException ... because pendingCreates is non-null but no leases found.

2015-10-03 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9194: - Summary: AlreadyBeingCreatedException ... because pendingCreates is non-null but no leases found. Key: HDFS-9194 URL: https://issues.apache.org/jira/browse/HDFS-9194

[jira] [Resolved] (HDFS-8341) HDFS mover stuck in loop trying to move corrupt block with no other valid replicas, doesn't move rest of other data blocks

2015-09-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8341. --- Resolution: Cannot Reproduce > HDFS mover stuck in loop trying to move corrupt block

[jira] [Resolved] (HDFS-8341) (Summary & Description may be invalid) HDFS mover stuck in loop after failing to move block, doesn't move rest of blocks, can't get data back off decommissioning external

2015-09-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8341. --- Resolution: Invalid Resolving as invalid. Please feel free to reopen if you disagree.

[jira] [Created] (HDFS-8921) Add an option to Balancer so tha it only uses the k-most over-utilized DNs or all over-utilized DNs as sources.

2015-08-18 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8921: - Summary: Add an option to Balancer so tha it only uses the k-most over-utilized DNs or all over-utilized DNs as sources. Key: HDFS-8921 URL:

[jira] [Created] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

2015-07-29 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8838: - Summary: Tolerate datanode failures in DFSStripedOutputStream when the data length is small Key: HDFS-8838 URL: https://issues.apache.org/jira/browse/HDFS-8838

[jira] [Created] (HDFS-8824) Do not use small blocks for balancing the cluster

2015-07-27 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8824: - Summary: Do not use small blocks for balancing the cluster Key: HDFS-8824 URL: https://issues.apache.org/jira/browse/HDFS-8824 Project: Hadoop HDFS

[jira] [Created] (HDFS-8825) Enhancements to Balancer

2015-07-27 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8825: - Summary: Enhancements to Balancer Key: HDFS-8825 URL: https://issues.apache.org/jira/browse/HDFS-8825 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-8826) Balancer may not move blocks efficiently in some cases

2015-07-27 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8826: - Summary: Balancer may not move blocks efficiently in some cases Key: HDFS-8826 URL: https://issues.apache.org/jira/browse/HDFS-8826 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-852) Balancer shutdown synchronisation could do with a review

2015-07-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-852. -- Resolution: Not A Problem I think this issue got stale. Resolving as Not a Problem.

[jira] [Resolved] (HDFS-1676) DateFormat.getDateTimeInstance() is very expensive, we can cache it to improve performance

2015-07-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-1676. --- Resolution: Not A Problem Resolving this as not-a-problem. Please feel free to reopen

[jira] [Resolved] (HDFS-3619) isGoodBlockCandidate() in Balancer is not handling properly if replica factor 3

2015-07-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-3619. --- Resolution: Not A Problem Resolving as not-a-problem. Please feel free to reopen if

[jira] [Resolved] (HDFS-3411) Balancer fails to balance blocks between aboveAvgUtilized and belowAvgUtilized datanodes.

2015-07-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-3411. --- Resolution: Not A Problem Resolving as not-a-problem. Please feel free to reopen if

[jira] [Created] (HDFS-8818) Allow Balancer to run faster

2015-07-23 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8818: - Summary: Allow Balancer to run faster Key: HDFS-8818 URL: https://issues.apache.org/jira/browse/HDFS-8818 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-8528) Erasure Coding: optimize client writing by making the writing of data and parity concurrently

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8528. --- Resolution: Duplicate This duplicates HDFS-8287. Let's resolve it. Erasure Coding:

[jira] [Created] (HDFS-8540) Mover should exit with NO_MOVE_BLOCK if no block can be moved

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8540: - Summary: Mover should exit with NO_MOVE_BLOCK if no block can be moved Key: HDFS-8540 URL: https://issues.apache.org/jira/browse/HDFS-8540 Project: Hadoop

[jira] [Created] (HDFS-8541) Mover should exit with NO_MOVE_PROGRESS if there is no move progress

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8541: - Summary: Mover should exit with NO_MOVE_PROGRESS if there is no move progress Key: HDFS-8541 URL: https://issues.apache.org/jira/browse/HDFS-8541 Project:

[jira] [Created] (HDFS-8437) Fail/warn if HDFS is setup with an even number of QJMs.

2015-05-19 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8437: - Summary: Fail/warn if HDFS is setup with an even number of QJMs. Key: HDFS-8437 URL: https://issues.apache.org/jira/browse/HDFS-8437 Project: Hadoop HDFS

[jira] [Created] (HDFS-8433) blockToken is not set in constructInternalBlock and parseStripedBlockGroup in StripedBlockUtil

2015-05-19 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8433: - Summary: blockToken is not set in constructInternalBlock and parseStripedBlockGroup in StripedBlockUtil Key: HDFS-8433 URL:

[jira] [Created] (HDFS-8405) Fix a typo in NamenodeFsck

2015-05-14 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8405: - Summary: Fix a typo in NamenodeFsck Key: HDFS-8405 URL: https://issues.apache.org/jira/browse/HDFS-8405 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-8397) Refactor the error handling code in DataStreamer

2015-05-13 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8397: - Summary: Refactor the error handling code in DataStreamer Key: HDFS-8397 URL: https://issues.apache.org/jira/browse/HDFS-8397 Project: Hadoop HDFS

[jira] [Created] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8383: - Summary: Tolerate multiple failures in DFSStripedOutputStream Key: HDFS-8383 URL: https://issues.apache.org/jira/browse/HDFS-8383 Project: Hadoop HDFS

[jira] [Created] (HDFS-8384) Allow NN to startup if there are files having a lease but are not under construction

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8384: - Summary: Allow NN to startup if there are files having a lease but are not under construction Key: HDFS-8384 URL: https://issues.apache.org/jira/browse/HDFS-8384

  1   2   3   4   5   6   7   >