Re: [VOTE]: Support for RBF data locality Solution

2019-04-10 Thread Akira Ajisaka
The Approach A looks good to me. Thanks, Akira On Thu, Apr 11, 2019 at 2:30 PM Xiaoqiao He wrote: > > Hi forks, > > The current implementation of RBF is not sensitive about data locality, > since NameNode could not get real client hostname by invoke > Server#getRemoteAddress when RPC request for

[VOTE]: Support for RBF data locality Solution

2019-04-10 Thread Xiaoqiao He
Hi forks, The current implementation of RBF is not sensitive about data locality, since NameNode could not get real client hostname by invoke Server#getRemoteAddress when RPC request forward by Router to NameNode. Therefore, it will lead to several challenges, for instance, - a. Client could h

[jira] [Created] (HDDS-1423) Spark job fails to create ozone rpc client

2019-04-10 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDDS-1423: Summary: Spark job fails to create ozone rpc client Key: HDDS-1423 URL: https://issues.apache.org/jira/browse/HDDS-1423 Project: Hadoop Distributed Data Store Issue

[jira] [Created] (HDFS-14421) HDFS block two replicas exist in one DataNode

2019-04-10 Thread Yuanbo Liu (JIRA)
Yuanbo Liu created HDFS-14421: - Summary: HDFS block two replicas exist in one DataNode Key: HDFS-14421 URL: https://issues.apache.org/jira/browse/HDFS-14421 Project: Hadoop HDFS Issue Type: Impro

[jira] [Created] (HDDS-1422) Exception during DataNode shutdown

2019-04-10 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDDS-1422: --- Summary: Exception during DataNode shutdown Key: HDDS-1422 URL: https://issues.apache.org/jira/browse/HDDS-1422 Project: Hadoop Distributed Data Store Issue Ty

[jira] [Created] (HDDS-1421) Avoid unnecessary object allocations in TracingUtil

2019-04-10 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDDS-1421: --- Summary: Avoid unnecessary object allocations in TracingUtil Key: HDDS-1421 URL: https://issues.apache.org/jira/browse/HDDS-1421 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-1420) Tracing exception in DataNode HddsDispatcher

2019-04-10 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDDS-1420: --- Summary: Tracing exception in DataNode HddsDispatcher Key: HDDS-1420 URL: https://issues.apache.org/jira/browse/HDDS-1420 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-1419) Fix shellcheck errors in start-chaos.sh

2019-04-10 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDDS-1419: --- Summary: Fix shellcheck errors in start-chaos.sh Key: HDDS-1419 URL: https://issues.apache.org/jira/browse/HDDS-1419 Project: Hadoop Distributed Data Store Iss

[jira] [Resolved] (HDDS-1418) Move bang line to the start of the start-chaos.sh script

2019-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDDS-1418. - Resolution: Fixed Fix Version/s: 0.5.0 > Move bang line to the start of the start-chaos.sh

[jira] [Created] (HDDS-1418) Move bang line to the start of the start-chaos.sh script

2019-04-10 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDDS-1418: --- Summary: Move bang line to the start of the start-chaos.sh script Key: HDDS-1418 URL: https://issues.apache.org/jira/browse/HDDS-1418 Project: Hadoop Distributed Data St

[jira] [Created] (HDDS-1417) After successfully importing a container, datanode should delete the container tar.gz file from working directory

2019-04-10 Thread Nanda kumar (JIRA)
Nanda kumar created HDDS-1417: - Summary: After successfully importing a container, datanode should delete the container tar.gz file from working directory Key: HDDS-1417 URL: https://issues.apache.org/jira/browse/HDDS

[jira] [Created] (HDDS-1416) MiniOzoneCluster should set custom value for hdds.datanode.replication.work.dir

2019-04-10 Thread Nanda kumar (JIRA)
Nanda kumar created HDDS-1416: - Summary: MiniOzoneCluster should set custom value for hdds.datanode.replication.work.dir Key: HDDS-1416 URL: https://issues.apache.org/jira/browse/HDDS-1416 Project: Hadoop

[jira] [Created] (HDDS-1415) TestOzoneClientRetriesOnException.testGroupMismatchExceptionHandling is flaky

2019-04-10 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDDS-1415: Summary: TestOzoneClientRetriesOnException.testGroupMismatchExceptionHandling is flaky Key: HDDS-1415 URL: https://issues.apache.org/jira/browse/HDDS-1415 Pro

[jira] [Created] (HDDS-1414) TestOzoneManagerHA.testMultipartUploadWithOneOmNodeDown is flaky

2019-04-10 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1414: -- Summary: TestOzoneManagerHA.testMultipartUploadWithOneOmNodeDown is flaky Key: HDDS-1414 URL: https://issues.apache.org/jira/browse/HDDS-1414 Project: Hadoop Distributed

[jira] [Created] (HDDS-1413) TestCloseContainerCommandHandler.testCloseContainerViaStandalone is flaky

2019-04-10 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1413: -- Summary: TestCloseContainerCommandHandler.testCloseContainerViaStandalone is flaky Key: HDDS-1413 URL: https://issues.apache.org/jira/browse/HDDS-1413 Project: Hadoop Dis

[jira] [Created] (HDDS-1412) Provide example k8s deployment files as part of the release package

2019-04-10 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1412: -- Summary: Provide example k8s deployment files as part of the release package Key: HDDS-1412 URL: https://issues.apache.org/jira/browse/HDDS-1412 Project: Hadoop Distribut

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-04-10 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1102/ [Apr 9, 2019 9:40:07 AM] (github) HDDS-1372. getContainerWithPipeline for a standalone pipeline fails with [Apr 9, 2019 3:35:14 PM] (elek) HDDS-1383. Create project skeleton with CLI interface for In-plac

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-04-10 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/287/ No changes -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc check

[jira] [Created] (HDDS-1411) Add unit test to check if SCM correctly sends close commands for containers in closing state after a restart

2019-04-10 Thread Nanda kumar (JIRA)
Nanda kumar created HDDS-1411: - Summary: Add unit test to check if SCM correctly sends close commands for containers in closing state after a restart Key: HDDS-1411 URL: https://issues.apache.org/jira/browse/HDDS-1411

[jira] [Created] (HDDS-1410) TestSCMNodeMetrics is flaky

2019-04-10 Thread Nanda kumar (JIRA)
Nanda kumar created HDDS-1410: - Summary: TestSCMNodeMetrics is flaky Key: HDDS-1410 URL: https://issues.apache.org/jira/browse/HDDS-1410 Project: Hadoop Distributed Data Store Issue Type: Test

[jira] [Created] (HDDS-1409) TestOzoneClientRetriesOnException is flaky

2019-04-10 Thread Nanda kumar (JIRA)
Nanda kumar created HDDS-1409: - Summary: TestOzoneClientRetriesOnException is flaky Key: HDDS-1409 URL: https://issues.apache.org/jira/browse/HDDS-1409 Project: Hadoop Distributed Data Store Issu

[jira] [Created] (HDFS-14420) spelling mistake in console

2019-04-10 Thread hu xiaodong (JIRA)
hu xiaodong created HDFS-14420: -- Summary: spelling mistake in console Key: HDFS-14420 URL: https://issues.apache.org/jira/browse/HDFS-14420 Project: Hadoop HDFS Issue Type: Bug Compone

[jira] [Created] (HDDS-1408) TestMiniOzoneCluster.testDNstartAfterSCM fails with OverlappingFileLockException

2019-04-10 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDDS-1408: --- Summary: TestMiniOzoneCluster.testDNstartAfterSCM fails with OverlappingFileLockException Key: HDDS-1408 URL: https://issues.apache.org/jira/browse/HDDS-1408 Pr