[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951818#comment-15951818 ] Mingliang Liu commented on HDFS-10533: -- I'll commit after another clean Jenkins run. > Make

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.0011.patch > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: (was: HDFS-10533.0011.patch) > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.010.patch Rebase from {{trunk}} and resolve conflicts with [HADOOP-11794].

[jira] [Updated] (HDFS-11592) Closing a file has a wasteful preconditions in NameNode

2017-03-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11592: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1

[jira] [Updated] (HDFS-11592) Closing a file has a wasteful preconditions in NameNode

2017-03-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11592: - Target Version/s: 3.0.0-alpha3, 2.8.1 (was: 2.8.1) Component/s: namenode

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949824#comment-15949824 ] Mingliang Liu commented on HDFS-11384: -- Ping [~szetszwo]. > Add option for balancer to disperse

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2017-03-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949811#comment-15949811 ] Mingliang Liu commented on HDFS-10533: -- Thanks [~jnp] for review! Hi watchers, I'll commit this

[jira] [Commented] (HDFS-11592) Closing a file has a wasteful preconditions

2017-03-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948028#comment-15948028 ] Mingliang Liu commented on HDFS-11592: -- +1 pending on Jenkins. Thanks Eric. > Closing a file has a

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2017-03-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947634#comment-15947634 ] Mingliang Liu commented on HDFS-10326: -- [~daryn] does the patch make sense to you? Thanks, > Disable

[jira] [Commented] (HDFS-11558) BPServiceActor thread name is too long

2017-03-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937415#comment-15937415 ] Mingliang Liu commented on HDFS-11558: -- I'd suggest the thread name be even shorter. The heartbeating

[jira] [Assigned] (HDFS-11558) BPServiceActor thread name is too long

2017-03-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-11558: Assignee: Xiaobing Zhou > BPServiceActor thread name is too long >

[jira] [Commented] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2017-03-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933642#comment-15933642 ] Mingliang Liu commented on HDFS-11132: -- Hi [~jzhuge], yes, this should belong to Hadoop Common. I

[jira] [Updated] (HDFS-11536) Throttle DataNode slow BlockReceiver warnings

2017-03-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11536: - Labels: 2.9.0 (was: ) > Throttle DataNode slow BlockReceiver warnings >

[jira] [Commented] (HDFS-11536) Throttle DataNode slow BlockReceiver warnings

2017-03-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926969#comment-15926969 ] Mingliang Liu commented on HDFS-11536: -- +1 for the proposal. > Throttle DataNode slow BlockReceiver

[jira] [Updated] (HDFS-11536) Throttle DataNode slow BlockReceiver warnings

2017-03-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11536: - Component/s: (was: hdfs) datanode > Throttle DataNode slow BlockReceiver

[jira] [Updated] (HDFS-11494) Log message when DN is not selected for block replication

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11494: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Comment Edited] (HDFS-11494) Log message when DN is not selected for block replication

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895462#comment-15895462 ] Mingliang Liu edited comment on HDFS-11494 at 3/4/17 2:50 AM: -- +1 Failing

[jira] [Commented] (HDFS-11494) Log message when DN is not selected for block replication

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895354#comment-15895354 ] Mingliang Liu commented on HDFS-11494: -- Thanks, looks good to me. By the way, the sample log message

[jira] [Commented] (HDFS-11494) Log message when DN is not selected for block replication

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895098#comment-15895098 ] Mingliang Liu commented on HDFS-11494: -- When logging, {{storage}} can be null? > Log message when DN

[jira] [Updated] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11476: - Target Version/s: 2.8.0 Component/s: datanode > Fix NPE in FsDatasetImpl#checkAndUpdate

[jira] [Commented] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889159#comment-15889159 ] Mingliang Liu commented on HDFS-11476: -- That's interesting. Even the log is checking if the

[jira] [Commented] (HDFS-11455) Fix javac warnings in HDFS that caused by deprecated FileSystem APIs

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888436#comment-15888436 ] Mingliang Liu commented on HDFS-11455: -- Failing tests seem unrelated. I'm +1 on this. Let's hold on

[jira] [Commented] (HDFS-11455) Fix javadoc warnings in HDFS that caused by deprecated FileSystem APIs

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886638#comment-15886638 ] Mingliang Liu commented on HDFS-11455: -- The patch looks good to me overall. One comment is that, for

[jira] [Commented] (HDFS-11455) Fix javadoc warnings in HDFS caused by deprecated FileSystem APIs

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883964#comment-15883964 ] Mingliang Liu commented on HDFS-11455: -- I see. We can file JIRAs on different modules as subtasks of

[jira] [Commented] (HDFS-11455) Fix javadoc warnings in HDFS caused by deprecated FileSystem APIs

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883965#comment-15883965 ] Mingliang Liu commented on HDFS-11455: -- I'll review/commit next week. Thanks for working on this! >

[jira] [Commented] (HDFS-11455) Fix javadoc warnings due to deprecated FileSystem APIs

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883401#comment-15883401 ] Mingliang Liu commented on HDFS-11455: -- This is duplicate to [HADOOP-14106], right? > Fix javadoc

[jira] [Commented] (HDFS-11450) HDFS specific network topology classes with storage type info included

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881661#comment-15881661 ] Mingliang Liu commented on HDFS-11450: -- I see a few of code logic duplicate in between newly added

[jira] [Commented] (HDFS-11439) testGenerationStampInFuture UT fails

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879339#comment-15879339 ] Mingliang Liu commented on HDFS-11439: -- If it fails in {{trunk}}, [HDFS-10499] should have fixed it?

[jira] [Updated] (HDFS-11438) Fix typo in error message of StoragePolicyAdmin tool

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11438: - Hadoop Flags: Reviewed Status: Patch Available (was: Open) Submitting patch. Changed

[jira] [Updated] (HDFS-11438) Fix typo in error message of StoragePolicyAdmin tool

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11438: - Summary: Fix typo in error message of StoragePolicyAdmin tool (was: Fix Typo in HDFS) > Fix

[jira] [Updated] (HDFS-11430) Separate class InnerNode from class NetworkTopology and make it extendable

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11430: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Updated] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11419: - Target Version/s: 3.0.0-alpha3 Setting target version as Hadoop 3. Correct me if I'm wrong. >

[jira] [Commented] (HDFS-11430) Separate class InnerNode from class NetworkTopology and make it extendable

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876970#comment-15876970 ] Mingliang Liu commented on HDFS-11430: -- +1 This is straightforward and clear enough as a refactoring

[jira] [Commented] (HDFS-11434) TestQuota fails in windows

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876882#comment-15876882 ] Mingliang Liu commented on HDFS-11434: -- I lik [~linyiqun]'s idea. p.s. {{public static Path

[jira] [Updated] (HDFS-11375) Display the volume storage type in datanode UI

2017-02-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11375: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11375) Display the volume storage type in datanode UI

2017-02-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868453#comment-15868453 ] Mingliang Liu commented on HDFS-11375: -- +1 The failing tests are not related; let's fix checkstyle

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-02-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.009.patch > Make DistCpOptions class immutable >

[jira] [Commented] (HDFS-9935) Remove LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD and unused import from HdfsServerConstants

2017-01-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15807147#comment-15807147 ] Mingliang Liu commented on HDFS-9935: - HDFS-9134 did not remove or depreacate the public variables in

[jira] [Updated] (HDFS-9935) Remove LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD and unused import from HdfsServerConstants

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9935: Target Version/s: 3.0.0-alpha2 I set the target version as 3.0. Correct me if it's wrong. Thanks, >

[jira] [Updated] (HDFS-11302) Improve Logging for SSLHostnameVerifier

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11302: - Target Version/s: 2.8.0 > Improve Logging for SSLHostnameVerifier >

[jira] [Commented] (HDFS-11302) Improve Logging for SSLHostnameVerifier

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806156#comment-15806156 ] Mingliang Liu commented on HDFS-11302: -- According to the pain in one of our support cases, I strongly

[jira] [Commented] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15796224#comment-15796224 ] Mingliang Liu commented on HDFS-11279: -- {{import java.io.File;}} in DataNode seems unnecessary? It

[jira] [Resolved] (HDFS-10891) Über-jira: Test Improvement by adding missing test cases for existing code

2016-12-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-10891. -- Resolution: Fixed > Über-jira: Test Improvement by adding missing test cases for existing code

[jira] [Updated] (HDFS-11270) Document the missing options of NameNode bootstrap command

2016-12-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11270: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11270) Document the missing options of NameNode bootstrap command

2016-12-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771629#comment-15771629 ] Mingliang Liu commented on HDFS-11270: -- +1 pending on Jenkins. [~akur...@gmail.com], if you don't

[jira] [Comment Edited] (HDFS-11270) Document the missing options of NameNode bootstrap command

2016-12-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771629#comment-15771629 ] Mingliang Liu edited comment on HDFS-11270 at 12/23/16 2:10 AM: +1 pending

[jira] [Commented] (HDFS-11272) Missing whitespace in the message of TestFSDirAttrOp.java

2016-12-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771032#comment-15771032 ] Mingliang Liu commented on HDFS-11272: -- +1 pending on Jenkins. For the last two assert, we can also

[jira] [Commented] (HDFS-11270) Document the missing options of NameNode bootstrap command

2016-12-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770866#comment-15770866 ] Mingliang Liu commented on HDFS-11270: -- Thanks [~linyiqun]. I think the patch is good overall. One

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.9.0, 3.0.0-alpha2) Fix Version/s: (was:

[jira] [Updated] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11253: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 Status:

[jira] [Commented] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752555#comment-15752555 ] Mingliang Liu commented on HDFS-11253: -- +1 pending on Jenkins. > FileInputStream leak on failure

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752505#comment-15752505 ] Mingliang Liu commented on HDFS-11094: -- +1 pending on Jenkins. > Send back HAState along with

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750003#comment-15750003 ] Mingliang Liu commented on HDFS-11094: -- +1 Failing test is not related. Do we need separate patch

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary

2016-12-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749667#comment-15749667 ] Mingliang Liu commented on HDFS-11246: -- audit log can be async; anyway logging out of locks is nice

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746031#comment-15746031 ] Mingliang Liu commented on HDFS-11094: -- Yes I will review this week if no reviews from others.

[jira] [Updated] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11240: - Component/s: (was: fs/adl) fs/azure > Remove snapshot version of SDK

[jira] [Updated] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11240: - Target Version/s: 3.0.0-alpha2 > Remove snapshot version of SDK dependency from Azure Data Lake

[jira] [Updated] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11240: - Assignee: Vishwajeet Dusane > Remove snapshot version of SDK dependency from Azure Data Lake

[jira] [Updated] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11240: - Component/s: fs/adl > Remove snapshot version of SDK dependency from Azure Data Lake Store File

[jira] [Commented] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745625#comment-15745625 ] Mingliang Liu commented on HDFS-11240: -- I think we can simply remove the {{repositories}} related

[jira] [Commented] (HDFS-11240) Remove snapshot version of SDK dependency from Azure Data Lake Store File System

2016-12-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745608#comment-15745608 ] Mingliang Liu commented on HDFS-11240: --

[jira] [Updated] (HDFS-11226) cacheadmin,cryptoadmin and storagepolicyadmin should support generic options

2016-12-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11226: - Component/s: tools > cacheadmin,cryptoadmin and storagepolicyadmin should support generic options

[jira] [Updated] (HDFS-11226) cacheadmin,cryptoadmin and storagepolicyadmin should support generic options

2016-12-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11226: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11234) distcp performance is suboptimal for high bandwidth/high latency setups

2016-12-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15742769#comment-15742769 ] Mingliang Liu commented on HDFS-11234: -- Can you have a look at [HDFS-10326]? I think it's related.

[jira] [Updated] (HDFS-11234) distcp performance is suboptimal for high bandwidth/high latency setups

2016-12-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11234: - Assignee: Suresh Bahuguna > distcp performance is suboptimal for high bandwidth/high latency

[jira] [Commented] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736130#comment-15736130 ] Mingliang Liu commented on HDFS-11227: -- [~subahugu] I've added you as HDFS contributor on the JIRA

[jira] [Updated] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11227: - Status: Patch Available (was: Open) > BlockReader read doesn't timeout >

[jira] [Updated] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11227: - Assignee: Suresh Bahuguna > BlockReader read doesn't timeout > >

[jira] [Commented] (HDFS-11226) Storagepolicy command is not working with "-fs" option

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736115#comment-15736115 ] Mingliang Liu commented on HDFS-11226: -- {code} hdfs storagepolicies Usage: bin/hdfs storagepolicies

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726664#comment-15726664 ] Mingliang Liu commented on HDFS-11094: -- Thanks for bringing this up. If we agree to revert

[jira] [Updated] (HDFS-11211) Add a time unit to the DataNode client trace format

2016-12-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11211: - Fix Version/s: (was: 2.8.0) 2.9.0 > Add a time unit to the DataNode client

[jira] [Updated] (HDFS-11211) Add a time unit to the DataNode client trace format

2016-12-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11211: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724650#comment-15724650 ] Mingliang Liu commented on HDFS-11156: -- Sorry I missed the point of not changing the

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-12-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15721602#comment-15721602 ] Mingliang Liu commented on HDFS-11178: -- Sorry I'm not actively reviewing this patch. Please go ahead

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15716886#comment-15716886 ] Mingliang Liu commented on HDFS-11094: -- For the protocol changes, end-to-end tests are very helpful.

[jira] [Commented] (HDFS-11166) Add webhdfs GETFILEBLOCKLOCATIONS document

2016-12-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15716398#comment-15716398 ] Mingliang Liu commented on HDFS-11166: -- I can also have a look at next week. If [~ajisakaa] can

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Component/s: test > Allow AccessControlException in contract tests when getFileStatus on >

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Assignee: Vishwajeet Dusane > Allow AccessControlException in contract tests when getFileStatus

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Summary: Allow AccessControlException in contract tests when getFileStatus on subdirectory of

[jira] [Commented] (HDFS-11166) Doc for GET_BLOCK_LOCATIONS is missing in webhdfs API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712918#comment-15712918 ] Mingliang Liu commented on HDFS-11166: -- private/stable change only makes more sense to me. Thanks, >

[jira] [Commented] (HDFS-11166) Doc for GET_BLOCK_LOCATIONS is missing in webhdfs API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712884#comment-15712884 ] Mingliang Liu commented on HDFS-11166: -- In [HDFS-11156], we add a new op {{GETFILEBLOCKLOCATIONS}} to

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Summary: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API (was: Webhdfs rest api

[jira] [Updated] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 3.0.0-alpha2) > Webhdfs rest api GET_BLOCK_LOCATIONS

[jira] [Updated] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Issue Type: Improvement (was: Bug) +1 Please also add doc in the REST API page

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705922#comment-15705922 ] Mingliang Liu commented on HDFS-11156: -- They are two different problems. P1. The mismatch of REST

[jira] [Comment Edited] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703890#comment-15703890 ] Mingliang Liu edited comment on HDFS-11094 at 11/29/16 2:18 AM: Hi

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703890#comment-15703890 ] Mingliang Liu commented on HDFS-11094: -- Hi [~ebadger], thanks for updating the patch. Sorry for

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703492#comment-15703492 ] Mingliang Liu commented on HDFS-11178: -- Is {{MiniDFSCluster#triggerBlockReports()}} blocking call? If

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703132#comment-15703132 ] Mingliang Liu commented on HDFS-11156: -- The patch looks good to me overall. +1 I have several minor

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688745#comment-15688745 ] Mingliang Liu commented on HDFS-11156: -- It may happen this week or after the holiday. Thanks, >

[jira] [Updated] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Target Version/s: 3.0.0-alpha2 (was: 2.8.0) +1 for the idea. I change the target version as

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Component/s: datanode > Send back HAState along with NamespaceInfo during a versionRequest as an

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675208#comment-15675208 ] Mingliang Liu commented on HDFS-11094: -- +1 Some comments: # Is it possible to add a unit test for

[jira] [Resolved] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-11105. -- Resolution: Fixed > TestRBWBlockInvalidation#testRWRInvalidation fails intermittently >

[jira] [Reopened] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HDFS-11105: -- > TestRBWBlockInvalidation#testRWRInvalidation fails intermittently >

<    1   2   3   4   5   6   7   8   9   10   >