[jira] [Updated] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9170: - Attachment: HDFS-9170.001.patch > Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client >

[jira] [Updated] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9170: - Attachment: HDFS-9170.001.patch > Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client >

[jira] [Updated] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9170: - Status: Patch Available (was: Open) > Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client >

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936199#comment-14936199 ] Haohui Mai commented on HDFS-8766: -- Thanks for updating the patch. {code}

[jira] [Updated] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9170: - Status: Open (was: Patch Available) > Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client >

[jira] [Updated] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9170: - Attachment: (was: HDFS-9170.001.patch) > Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client >

[jira] [Updated] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9170: - Summary: Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client (was: Move libhdfs / fuse-dfs / libwebhdfs

[jira] [Updated] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9170: - Attachment: HDFS-9170.000.patch > Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client >

[jira] [Updated] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9170: - Status: Patch Available (was: Open) > Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client >

[jira] [Updated] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in client package

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8971: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) I've

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935472#comment-14935472 ] Haohui Mai commented on HDFS-8696: -- The patch no longer applies to trunk anymore. Can you please rebase?

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-09-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933610#comment-14933610 ] Haohui Mai commented on HDFS-8578: -- We've seen in production that the upgrades take ~3hours for 24 disks.

[jira] [Created] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to a separate module

2015-09-28 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9170: Summary: Move libhdfs / fuse-dfs / libwebhdfs to a separate module Key: HDFS-9170 URL: https://issues.apache.org/jira/browse/HDFS-9170 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

2015-09-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9064: - Priority: Major (was: Critical) > NN old UI (block_info_xml) not available in 2.7.x >

[jira] [Commented] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

2015-09-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934129#comment-14934129 ] Haohui Mai commented on HDFS-9064: -- HDFS-8246 has discussions on the same topic. My understanding is that

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-09-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934110#comment-14934110 ] Haohui Mai commented on HDFS-8578: -- bq. Datanode may *require more memory* to process all volumes/disks in

[jira] [Commented] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to a separate module

2015-09-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934102#comment-14934102 ] Haohui Mai commented on HDFS-9170: -- There are two options that are available: (1) Move libhdfs, fuse-dfs,

[jira] [Created] (HDFS-9165) Move the rest of the entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-28 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9165: Summary: Move the rest of the entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client Key: HDFS-9165 URL: https://issues.apache.org/jira/browse/HDFS-9165 Project:

[jira] [Created] (HDFS-9166) Move hftp / hsftp filesystem to hfds-client

2015-09-28 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9166: Summary: Move hftp / hsftp filesystem to hfds-client Key: HDFS-9166 URL: https://issues.apache.org/jira/browse/HDFS-9166 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-9168) Move client side uni test to hadoop-hdfs-client

2015-09-28 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9168: Summary: Move client side uni test to hadoop-hdfs-client Key: HDFS-9168 URL: https://issues.apache.org/jira/browse/HDFS-9168 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-9167) Update pom.xml in other modules to depend on hdfs-client instead of hdfs

2015-09-28 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9167: Summary: Update pom.xml in other modules to depend on hdfs-client instead of hdfs Key: HDFS-9167 URL: https://issues.apache.org/jira/browse/HDFS-9167 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8740) Move DistributedFileSystem to hadoop-hdfs-client

2015-09-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8740: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-8740) Move DistributedFileSystem to hadoop-hdfs-client

2015-09-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909818#comment-14909818 ] Haohui Mai commented on HDFS-8740: -- +1 > Move DistributedFileSystem to hadoop-hdfs-client >

[jira] [Commented] (HDFS-8053) Move DFSIn/OutputStream and related classes to hadoop-hdfs-client

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909119#comment-14909119 ] Haohui Mai commented on HDFS-8053: -- Thanks for updating the patch! The change looks mostly good to me.

[jira] [Commented] (HDFS-8053) Move DFSIn/OutputStream and related classes to hadoop-hdfs-client

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909389#comment-14909389 ] Haohui Mai commented on HDFS-8053: -- +1 > Move DFSIn/OutputStream and related classes to

[jira] [Updated] (HDFS-8739) Move DFSClient to hadoop-hdfs-client

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8739: - Resolution: Duplicate Status: Resolved (was: Patch Available) Closing this as a duplicate of

[jira] [Updated] (HDFS-8053) Move DFSIn/OutputStream and related classes to hadoop-hdfs-client

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8053: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-8648) Revisit FsDirectory#resolvePath() function usage to check the call is made under proper lock

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8648: - Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-7416) > Revisit FsDirectory#resolvePath()

[jira] [Commented] (HDFS-8648) Revisit FsDirectory#resolvePath() function usage to check the call is made under proper lock

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909427#comment-14909427 ] Haohui Mai commented on HDFS-8648: -- I think this is an important improvement. HDFS-7416 has focused

[jira] [Resolved] (HDFS-7416) Revisit the abstraction between NameNodeRpcServer, FSNameSystem and FSDirectory

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-7416. -- Resolution: Fixed The desired code refactoring has completed. Closing this jira. Thanks everyone for

[jira] [Closed] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed HDFS-7529. > Consolidate encryption zone related implementation into a single class >

[jira] [Closed] (HDFS-8493) Consolidate truncate() related implementation in a single class

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed HDFS-8493. > Consolidate truncate() related implementation in a single class >

[jira] [Closed] (HDFS-8495) Consolidate append() related implementation into a single class

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed HDFS-8495. > Consolidate append() related implementation into a single class >

[jira] [Closed] (HDFS-7436) Consolidate implementation of concat()

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed HDFS-7436. > Consolidate implementation of concat() > -- > > Key:

[jira] [Closed] (HDFS-7416) Revisit the abstraction between NameNodeRpcServer, FSNameSystem and FSDirectory

2015-09-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed HDFS-7416. > Revisit the abstraction between NameNodeRpcServer, FSNameSystem and > FSDirectory >

[jira] [Commented] (HDFS-8053) Move DFSIn/OutputStream and related classes to hadoop-hdfs-client

2015-09-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908498#comment-14908498 ] Haohui Mai commented on HDFS-8053: -- {code} + +public class HdfsConfigurationLoader { + + /** Load the

[jira] [Commented] (HDFS-8053) Move DFSIn/OutputStream and related classes to hadoop-hdfs-client

2015-09-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908409#comment-14908409 ] Haohui Mai commented on HDFS-8053: -- {code} -static { - //Ensure that HDFS Configuration files are

[jira] [Commented] (HDFS-9131) Move hadoop-hdfs-client related config keys from DFSConfigKeys to HdfsClientConfigKeys

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905941#comment-14905941 ] Haohui Mai commented on HDFS-9131: -- +1. Ran all the failed unit tests, all of them passed locally.

[jira] [Commented] (HDFS-9134) Move LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants to HdfsConstants

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905935#comment-14905935 ] Haohui Mai commented on HDFS-9134: -- {code} + @Deprecated + long LEASE_SOFTLIMIT_PERIOD =

[jira] [Updated] (HDFS-9131) Move config keys used by hdfs-client to HdfsClientConfigKeys

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9131: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9130) Use GenericTestUtils#setLogLevel to set log4j or slf4j logger's level in unit tests

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905914#comment-14905914 ] Haohui Mai commented on HDFS-9130: -- +1. I'll commit it shortly. > Use GenericTestUtils#setLogLevel to set

[jira] [Updated] (HDFS-9130) Use GenericTestUtils#setLogLevel to the logging level

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9130: - Summary: Use GenericTestUtils#setLogLevel to the logging level (was: Use GenericTestUtils#setLogLevel to

[jira] [Commented] (HDFS-8739) Move DFSClient to client implementation package

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905937#comment-14905937 ] Haohui Mai commented on HDFS-8739: -- Please do not move the class at least in branch-2. Though it's a

[jira] [Updated] (HDFS-9131) Move config keys used by hdfs-client to HdfsClientConfigKeys

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9131: - Summary: Move config keys used by hdfs-client to HdfsClientConfigKeys (was: Move hadoop-hdfs-client

[jira] [Updated] (HDFS-9130) Use GenericTestUtils#setLogLevel to the logging level

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9130: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906526#comment-14906526 ] Haohui Mai commented on HDFS-9064: -- There are two reasons that the jsp is removed: (1) Yes, there's

[jira] [Updated] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7529: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906503#comment-14906503 ] Haohui Mai commented on HDFS-7529: -- +1. I'll commit it shortly. > Consolidate encryption zone related

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906597#comment-14906597 ] Haohui Mai commented on HDFS-8696: -- {code} + +

[jira] [Commented] (HDFS-8976) Create HTML5 cluster webconsole for federated cluster

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907032#comment-14907032 ] Haohui Mai commented on HDFS-8976: -- It looks to me that there is no need to have yet another page. It can

[jira] [Commented] (HDFS-9084) Pagination, sorting and filtering of files/directories in the HDFS Web UI

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907042#comment-14907042 ] Haohui Mai commented on HDFS-9084: -- {code} + // Change the format of date-time depending on how old the +

[jira] [Updated] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9108: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Target

[jira] [Updated] (HDFS-9134) Move LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants to HdfsConstants

2015-09-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9134: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-8053) Move DFSIn/OutputStream and related classes to hadoop-hdfs-client

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8053: - Status: Patch Available (was: Open) > Move DFSIn/OutputStream and related classes to hadoop-hdfs-client >

[jira] [Updated] (HDFS-7270) Add congestion signaling capability to DataNode write protocol

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7270: - Release Note: Introduced a new configuration dfs.pipeline.ecn. When the configuration is turned on,

[jira] [Commented] (HDFS-8976) Create HTML5 cluster webconsole for federated cluster

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904989#comment-14904989 ] Haohui Mai commented on HDFS-8976: -- Sure. Will do it in a couple of days. > Create HTML5 cluster

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905406#comment-14905406 ] Haohui Mai commented on HDFS-8766: -- Thanks for the work. It looks like that the code needs a lot of clean

[jira] [Updated] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9062: - Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8707) > Add a parameter to

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905186#comment-14905186 ] Haohui Mai commented on HDFS-8696: -- The patch looks pretty good to me. Hi [~bobhansen], can you please

[jira] [Updated] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7529: - Labels: (was: BB2015-05-TBR) > Consolidate encryption zone related implementation into a single class >

[jira] [Commented] (HDFS-9128) TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows.

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905172#comment-14905172 ] Haohui Mai commented on HDFS-9128: -- +1 pending jenkins. > TestWebHdfsFileContextMainOperations and >

[jira] [Commented] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905215#comment-14905215 ] Haohui Mai commented on HDFS-7529: -- Thanks for taking the work! It looks good overall. {code} +

[jira] [Commented] (HDFS-8053) Move DFSIn/OutputStream and related classes to hadoop-hdfs-client

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905260#comment-14905260 ] Haohui Mai commented on HDFS-8053: -- Thanks for the work. On a high level it makes sense to separate the

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905715#comment-14905715 ] Haohui Mai commented on HDFS-8696: -- {code} + public static final String

[jira] [Updated] (HDFS-9128) TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows.

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9128: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Created] (HDFS-9129) Move the safemode block count into BlockManager

2015-09-23 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9129: Summary: Move the safemode block count into BlockManager Key: HDFS-9129 URL: https://issues.apache.org/jira/browse/HDFS-9129 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905513#comment-14905513 ] Haohui Mai commented on HDFS-8766: -- bq. Agreed. I didn't know we were using automated tools to check the

[jira] [Commented] (HDFS-7766) Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905565#comment-14905565 ] Haohui Mai commented on HDFS-7766: -- I'm nervous to make NN handle all the loads. While 307 is captured by

[jira] [Updated] (HDFS-9095) RPC client should fail gracefully when the connection is timed out or reset

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9095: - Attachment: HDFS-9095.001.patch > RPC client should fail gracefully when the connection is timed out or

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903140#comment-14903140 ] Haohui Mai commented on HDFS-9103: -- bq. I propose (perhaps in another jira), that we separate FileHandle

[jira] [Commented] (HDFS-9095) RPC client should fail gracefully when the connection is timed out or reset

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903134#comment-14903134 ] Haohui Mai commented on HDFS-9095: -- Thanks [~James Clampffer] and [~bobhansen] for the reviews. The v1

[jira] [Commented] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903429#comment-14903429 ] Haohui Mai commented on HDFS-9039: -- +1 > Split o.a.h.hdfs.NameNodeProxies class into two classes in

[jira] [Updated] (HDFS-9039) Separate client and server side methods of o.a.h.hdfs.NameNodeProxies

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9039: - Summary: Separate client and server side methods of o.a.h.hdfs.NameNodeProxies (was: Split

[jira] [Commented] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903909#comment-14903909 ] Haohui Mai commented on HDFS-8733: -- +1. Will commit shortly. > Keep server related definition in

[jira] [Updated] (HDFS-9039) Separate client and server side methods of o.a.h.hdfs.NameNodeProxies

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9039: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903901#comment-14903901 ] Haohui Mai commented on HDFS-9039: -- +1 on the latest patch. Will commit shortly. > Split

[jira] [Updated] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8733: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903575#comment-14903575 ] Haohui Mai commented on HDFS-9108: -- I'm able to reproduce the issue by just using the main thread to run

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903649#comment-14903649 ] Haohui Mai commented on HDFS-9108: -- I used your reproducer and called IoService::Run() directly. Your

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901597#comment-14901597 ] Haohui Mai commented on HDFS-9108: -- The root cause is that {{ReadBlockContinuation}} making a copy of a

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901614#comment-14901614 ] Haohui Mai commented on HDFS-9103: -- There are definitely use cases that need full flexible APIs (rigorous

[jira] [Updated] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9111: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9108: - Summary: InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers (was: Pointer to read

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901601#comment-14901601 ] Haohui Mai commented on HDFS-9108: -- I didn't check the assembly, but I'm surprised that running the

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901630#comment-14901630 ] Haohui Mai commented on HDFS-9118: -- The interfaces of logging class are quite closed to the one used in

[jira] [Updated] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9108: - Attachment: HDFS-9108.000.patch > InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[jira] [Assigned] (HDFS-9108) Pointer to read buffer isn't being passed to recvmsg syscall

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reassigned HDFS-9108: Assignee: Haohui Mai (was: James Clampffer) > Pointer to read buffer isn't being passed to recvmsg

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901722#comment-14901722 ] Haohui Mai commented on HDFS-9117: -- I suggest bringing in RapidXML (http://rapidxml.sourceforge.net/) to

[jira] [Updated] (HDFS-9116) Suppress false positives from Valgrind on uninitialized variables in tests

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9116: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Target

[jira] [Updated] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9108: - Attachment: (was: HDFS-9108.000.patch) > InputStreamImpl::ReadBlockContinuation stores wrong pointers

[jira] [Updated] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9108: - Status: Patch Available (was: In Progress) > InputStreamImpl::ReadBlockContinuation stores wrong pointers

[jira] [Updated] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9108: - Attachment: HDFS-9108.000.patch > InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[jira] [Commented] (HDFS-9095) RPC client should fail gracefully when the connection is timed out or reset

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901053#comment-14901053 ] Haohui Mai commented on HDFS-9095: -- bq. You may want to use CMAKE_CURRENT_LIST_DIR rather than

[jira] [Updated] (HDFS-9093) Initialize protobuf fields in RemoteBlockReaderTest

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9093: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Target

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901077#comment-14901077 ] Haohui Mai commented on HDFS-9103: -- bq. I think it is important to have a high-level C++ "go read this

[jira] [Commented] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901118#comment-14901118 ] Haohui Mai commented on HDFS-9111: -- +1. I'll commit it shortly. > Move hdfs-client protobuf convert

[jira] [Created] (HDFS-9115) Create documentation to describe the overall architecture and rationales of the library

2015-09-21 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9115: Summary: Create documentation to describe the overall architecture and rationales of the library Key: HDFS-9115 URL: https://issues.apache.org/jira/browse/HDFS-9115 Project:

[jira] [Commented] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901121#comment-14901121 ] Haohui Mai commented on HDFS-9111: -- Turns out it's needs to be rebased to trunk. [~liuml07] can you please

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901200#comment-14901200 ] Haohui Mai commented on HDFS-8855: -- Revisiting the use case -- how much benefits are we getting from the

[jira] [Updated] (HDFS-9116) Suppress false positives from Valgrind on uninitialized variables in tests

2015-09-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9116: - Status: Patch Available (was: Open) > Suppress false positives from Valgrind on uninitialized variables

<    1   2   3   4   5   6   7   8   9   10   >