[jira] [Commented] (HDFS-12301) NN File Browser UI: Navigate to a path when enter is pressed

2017-08-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126662#comment-16126662 ] Haohui Mai commented on HDFS-12301: --- Thanks [~raviprak]. This is a nice feature. +1 pending jenkins. >

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2017-08-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119134#comment-16119134 ] Haohui Mai commented on HDFS-10326: --- Committed to from trunk to branch-2.8.2. Thanks [~daryn] for the

[jira] [Updated] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2017-08-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-10326: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2 Release Note: The size of

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2017-08-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119030#comment-16119030 ] Haohui Mai commented on HDFS-11160: --- Our clusters are around ~2000 nodes and disks failures are quite

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2017-08-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110467#comment-16110467 ] Haohui Mai commented on HDFS-10326: --- +1 It seems that we have a consensus now -- I'll commit it

[jira] [Updated] (HDFS-12107) FsDatasetImpl#removeVolumes floods the logs when removing the volume

2017-08-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-12107: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4 Status:

[jira] [Resolved] (HDFS-5465) Update the package names for hsftp / hftp in the documentation

2017-08-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-5465. -- Resolution: Not A Problem This is no longer an issue as hftp / hsftp have been deprecated. > Update the

[jira] [Commented] (HDFS-12107) FsDatasetImpl#removeVolumes floods the logs when removing the volume

2017-08-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110099#comment-16110099 ] Haohui Mai commented on HDFS-12107: --- The test failures and findbugs warnings are unrelated to this

[jira] [Commented] (HDFS-12107) FsDatasetImpl#removeVolumes floods the logs when removing the volume

2017-08-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110098#comment-16110098 ] Haohui Mai commented on HDFS-12107: --- +1 Thanks for picking this up, [~kelvinchu]! I'll commit shortly.

[jira] [Created] (HDFS-12232) ConfiguredFailoverProxyProvider caches DNS results infinitely

2017-07-31 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-12232: - Summary: ConfiguredFailoverProxyProvider caches DNS results infinitely Key: HDFS-12232 URL: https://issues.apache.org/jira/browse/HDFS-12232 Project: Hadoop HDFS

[jira] [Created] (HDFS-12107) FsDatasetImpl#removeVolumes floods the logs when removing the volume

2017-07-09 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-12107: - Summary: FsDatasetImpl#removeVolumes floods the logs when removing the volume Key: HDFS-12107 URL: https://issues.apache.org/jira/browse/HDFS-12107 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7239) Create a servlet for HDFS UI

2017-06-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-7239. -- Resolution: Won't Fix It turns out that JMX is pretty good at providing such information. Closing this

[jira] [Updated] (HDFS-11609) Some blocks can be permanently lost if nodes are decommissioned while dead

2017-04-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-11609: -- Target Version/s: 2.7.4, 2.8.1 (was: 2.8.1) > Some blocks can be permanently lost if nodes are

[jira] [Resolved] (HDFS-594) Add support for byte-ranges to hsftp

2017-04-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-594. - Resolution: Won't Fix Release Note: As hftp / hsftp have been deprecated a long time a ago. Closing

[jira] [Comment Edited] (HDFS-11641) Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus

2017-04-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964682#comment-15964682 ] Haohui Mai edited comment on HDFS-11641 at 4/11/17 5:30 PM: Thanks for the

[jira] [Commented] (HDFS-11641) Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus

2017-04-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964682#comment-15964682 ] Haohui Mai commented on HDFS-11641: --- +1 pending Jenkins. > Reduce cost of audit logging by using

[jira] [Created] (HDFS-11588) Output Avro format in the offline editlog viewer

2017-03-29 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-11588: - Summary: Output Avro format in the offline editlog viewer Key: HDFS-11588 URL: https://issues.apache.org/jira/browse/HDFS-11588 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11258) File mtime change could not save to editlog

2017-01-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836793#comment-15836793 ] Haohui Mai commented on HDFS-11258: --- Thanks for the reminder. I'll take care of it. > File mtime change

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800550#comment-15800550 ] Haohui Mai commented on HDFS-11280: --- Committed all the way down to branch-2.7. Many thanks everyone for

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-11280: -- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.7.4 2.8.0

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800337#comment-15800337 ] Haohui Mai commented on HDFS-11280: --- Validate that the the latest patch passes the unit tests mentioned

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15795967#comment-15795967 ] Haohui Mai commented on HDFS-11280: --- Any ideas why Jenkins is still happy? > Allow WebHDFS to reuse

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2016-12-31 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15789216#comment-15789216 ] Haohui Mai commented on HDFS-11280: --- Commit to trunk, branch-2, branch-2.8 and branch-2.7. Thanks

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2016-12-31 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-11280: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2016-12-31 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-11280: -- Fix Version/s: 3.0.0-alpha2 2.7.4 2.9.0 2.8.0

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2016-12-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-11280: -- Summary: Allow WebHDFS to reuse HTTP connections to NN (was: Allow WebHDFSClient to reuse HTTP

[jira] [Commented] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15789007#comment-15789007 ] Haohui Mai commented on HDFS-11280: --- +1. Will commit shortly. > Allow WebHDFSClient to reuse HTTP

[jira] [Commented] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788359#comment-15788359 ] Haohui Mai commented on HDFS-11280: --- The patch looks good to me overall. It might be worthwhile to fix

[jira] [Commented] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786179#comment-15786179 ] Haohui Mai commented on HDFS-11280: --- The bug can potentially bring down the NN if users are doing a

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-11280: -- Priority: Major (was: Minor) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-11280: -- Issue Type: Bug (was: Improvement) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Commented] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786175#comment-15786175 ] Haohui Mai commented on HDFS-11280: --- [~zshao], thanks for reporting the bug. Would you mind rebasing the

[jira] [Updated] (HDFS-11258) File mtime change could not save to editlog

2016-12-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-11258: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1

[jira] [Commented] (HDFS-11258) File mtime change could not save to editlog

2016-12-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768157#comment-15768157 ] Haohui Mai commented on HDFS-11258: --- The unit test is irrelevant. Will commit shortly. > File mtime

[jira] [Updated] (HDFS-11258) File mtime change could not save to editlog

2016-12-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-11258: -- Priority: Critical (was: Minor) > File mtime change could not save to editlog >

[jira] [Commented] (HDFS-11258) File mtime change could not save to editlog

2016-12-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762330#comment-15762330 ] Haohui Mai commented on HDFS-11258: --- I'm going to bump the priority from minor to critical because it

[jira] [Commented] (HDFS-11258) File mtime change could not save to editlog

2016-12-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762320#comment-15762320 ] Haohui Mai commented on HDFS-11258: --- The patch looks pretty good to me. Thanks [~jxiang] for working on

[jira] [Commented] (HDFS-11258) File mtime change could not save to editlog

2016-12-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15755818#comment-15755818 ] Haohui Mai commented on HDFS-11258: --- Thanks [~jxiang] for reporting the issue! Can you please add a unit

[jira] [Commented] (HDFS-10331) Use java.util.zip.CRC32 for java8 or above in libhadoop

2016-06-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311883#comment-15311883 ] Haohui Mai commented on HDFS-10331: --- Should we remove the unused code then? > Use java.util.zip.CRC32

[jira] [Commented] (HDFS-8872) Reporting of missing blocks is different in fsck and namenode ui/metasave

2016-04-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253325#comment-15253325 ] Haohui Mai commented on HDFS-8872: -- I think it is a good to call it either way, just need to make sure

[jira] [Updated] (HDFS-8101) DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime

2016-03-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8101: - Fix Version/s: (was: 2.8.0) 2.7.3 > DFSClient use of non-constant DFSConfigKeys

[jira] [Commented] (HDFS-8101) DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime

2016-03-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212558#comment-15212558 ] Haohui Mai commented on HDFS-8101: -- Backporting this patch to branch-2.7. Before this patch, loading

[jira] [Commented] (HDFS-10184) Introduce unit tests framework for HDFS UI

2016-03-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204670#comment-15204670 ] Haohui Mai commented on HDFS-10184: --- Unless we move to Java 8 this is a non starter. The UI is heavily

[jira] [Updated] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2016-03-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7166: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Created] (HDFS-10184) Introduce unit tests framework for HDFS UI

2016-03-20 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-10184: - Summary: Introduce unit tests framework for HDFS UI Key: HDFS-10184 URL: https://issues.apache.org/jira/browse/HDFS-10184 Project: Hadoop HDFS Issue Type: Test

[jira] [Commented] (HDFS-9895) Remove all cached configuration from DataNode

2016-03-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189591#comment-15189591 ] Haohui Mai commented on HDFS-9895: -- Quick question: how to ensure that different threads have a consistent

[jira] [Commented] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2016-03-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188619#comment-15188619 ] Haohui Mai commented on HDFS-7166: -- LGTM. +1. For unit tests I will file another jira to track it. >

[jira] [Commented] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180572#comment-15180572 ] Haohui Mai commented on HDFS-9906: -- The information is useful for debugging but I agree that we don't need

[jira] [Commented] (HDFS-9763) Add merge api

2016-02-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170419#comment-15170419 ] Haohui Mai commented on HDFS-9763: -- I agree with [~cmccabe]. I don't think this is a good idea. The

[jira] [Commented] (HDFS-9084) Pagination, sorting and filtering of files/directories in the HDFS Web UI

2016-02-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154495#comment-15154495 ] Haohui Mai commented on HDFS-9084: -- The issue is that the LISTSTATUS API of WebHDFS can only return the

[jira] [Updated] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9815: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9815: - Assignee: Vinayakumar B > Move o.a.h.fs.Hdfs to hadoop-hdfs-client >

[jira] [Commented] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150966#comment-15150966 ] Haohui Mai commented on HDFS-9815: -- +1. I'll commit it shortly. > Move o.a.h.fs.Hdfs to

[jira] [Commented] (HDFS-7766) Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect

2016-02-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149137#comment-15149137 ] Haohui Mai commented on HDFS-7766: -- Sorry for the confusion. In your patch the POST request will be

[jira] [Updated] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9815: - Priority: Blocker (was: Major) > Move o.a.h.fs.Hdfs to hadoop-hdfs-client >

[jira] [Commented] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148132#comment-15148132 ] Haohui Mai commented on HDFS-9815: -- Marking this as a blocker of 2.8.0 as it prevents downstream clients

[jira] [Created] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-15 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9815: Summary: Move o.a.h.fs.Hdfs to hadoop-hdfs-client Key: HDFS-9815 URL: https://issues.apache.org/jira/browse/HDFS-9815 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-7766) Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect

2016-02-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148122#comment-15148122 ] Haohui Mai commented on HDFS-7766: -- Uploading the files to HDFS is a valid use case. What concerns me is

[jira] [Commented] (HDFS-9796) Add throttler for datanode bandwidth

2016-02-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15146839#comment-15146839 ] Haohui Mai commented on HDFS-9796: -- I think that in practice it is difficult to tune the configuration to

[jira] [Comment Edited] (HDFS-9724) Degraded performance in WebHDFS listing as it does not reuse ObjectMapper

2016-02-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133088#comment-15133088 ] Haohui Mai edited comment on HDFS-9724 at 2/4/16 9:41 PM: -- I've committed to

[jira] [Updated] (HDFS-9724) Degraded performance in WebHDFS listing as it does not reuse ObjectMapper

2016-02-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9724: - Resolution: Fixed Fix Version/s: 2.7.3 Status: Resolved (was: Patch Available) I've

[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565

2016-02-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15132820#comment-15132820 ] Haohui Mai commented on HDFS-9724: -- +1. I'll commit it shortly. > WebHDFS listing is too slow after

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15132832#comment-15132832 ] Haohui Mai commented on HDFS-9711: -- Thanks for the explanation, [~cnauroth]! I agree that there should

[jira] [Updated] (HDFS-9724) Degraded performance in WebHDFS listing as it does not reuse ObjectMapper

2016-02-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9724: - Summary: Degraded performance in WebHDFS listing as it does not reuse ObjectMapper (was: WebHDFS listing

[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565

2016-02-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130942#comment-15130942 ] Haohui Mai commented on HDFS-9724: -- bq. AFAIK, we don't have a re-entrant call pattern in WebHDFS though,

[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565

2016-02-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127981#comment-15127981 ] Haohui Mai commented on HDFS-9724: -- Is {ObjectMapper#writeValueAsString()} reentrant? > WebHDFS listing

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-01-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123030#comment-15123030 ] Haohui Mai commented on HDFS-9711: -- bq. Even if there was a way, it would defeat the intent of blocking

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-01-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122408#comment-15122408 ] Haohui Mai commented on HDFS-9711: -- I don't think it needs to be configurable. The only thing needs to be

[jira] [Created] (HDFS-9680) Doing a lsr against WebImageViewer is slow

2016-01-21 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9680: Summary: Doing a lsr against WebImageViewer is slow Key: HDFS-9680 URL: https://issues.apache.org/jira/browse/HDFS-9680 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110189#comment-15110189 ] Haohui Mai commented on HDFS-9629: -- The clean way to do this is through generating templates through

[jira] [Commented] (HDFS-9640) Remove hsftp from DistCp

2016-01-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095127#comment-15095127 ] Haohui Mai commented on HDFS-9640: -- +1 on removing -mapredSslConf. SSL certificates are usually treated as

[jira] [Updated] (HDFS-9047) Retire libwebhdfs

2016-01-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9047: - Summary: Retire libwebhdfs (was: deprecate libwebhdfs in branch-2; remove from trunk) > Retire

[jira] [Updated] (HDFS-9047) Retire libwebhdfs

2016-01-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9047: - Release Note: libwebhdfs has been retired in 2.8.0 due to the lack of maintenance. > Retire libwebhdfs >

[jira] [Updated] (HDFS-9047) Retire libwebhdfs

2016-01-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9047: - Resolution: Fixed Hadoop Flags: Reviewed,Incompatible change Fix Version/s: 2.8.0

[jira] [Updated] (HDFS-9047) Retire libwebhdfs

2016-01-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9047: - Target Version/s: (was: 3.0.0) > Retire libwebhdfs > - > > Key:

[jira] [Commented] (HDFS-9047) Retire libwebhdfs

2016-01-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086683#comment-15086683 ] Haohui Mai commented on HDFS-9047: -- Looks like there is no effort on fixing anything. IMO +1 on removing

[jira] [Comment Edited] (HDFS-9047) Retire libwebhdfs

2016-01-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086683#comment-15086683 ] Haohui Mai edited comment on HDFS-9047 at 1/7/16 2:25 AM: -- Looks like there is no

[jira] [Commented] (HDFS-8286) Scaling out the namespace using KV store

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083750#comment-15083750 ] Haohui Mai commented on HDFS-8286: -- I have pushed the prototype that corresponds to my [Hadoop summit

[jira] [Updated] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9047: - Attachment: HDFS-9047.000.patch > deprecate libwebhdfs in branch-2; remove from trunk >

[jira] [Updated] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9047: - Status: Patch Available (was: Open) > deprecate libwebhdfs in branch-2; remove from trunk >

[jira] [Updated] (HDFS-7779) Support changing ownership, group and replication in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7779: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9605) Add links to failed volumes to explorer.html in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9605: - Summary: Add links to failed volumes to explorer.html in HDFS Web UI (was: "tab-datanode-volume-failures"

[jira] [Comment Edited] (HDFS-9605) Add links to failed volumes to explorer.html in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083914#comment-15083914 ] Haohui Mai edited comment on HDFS-9605 at 1/5/16 9:56 PM: -- I've committed the

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083801#comment-15083801 ] Haohui Mai commented on HDFS-9047: -- The fact that the code does not build out-of-the-box for several

[jira] [Assigned] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reassigned HDFS-9047: Assignee: Haohui Mai > deprecate libwebhdfs in branch-2; remove from trunk >

[jira] [Commented] (HDFS-7779) Improve the HDFS Web UI browser to allow chowning / chgrp and setting replication

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083864#comment-15083864 ] Haohui Mai commented on HDFS-7779: -- +1. Committing it shortly. > Improve the HDFS Web UI browser to allow

[jira] [Updated] (HDFS-7779) Support changing ownership, group and replication in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7779: - Summary: Support changing ownership, group and replication in HDFS Web UI (was: Improve the HDFS Web UI

[jira] [Updated] (HDFS-9605) Add links to failed volumes to explorer.html in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9605: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Comment Edited] (HDFS-7779) Support changing ownership, group and replication in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083875#comment-15083875 ] Haohui Mai edited comment on HDFS-7779 at 1/5/16 9:57 PM: -- I've committed the

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083836#comment-15083836 ] Haohui Mai commented on HDFS-9525: -- Does it make more sense to extend `HADOOP_TOKEN_FILE_LOCATION` to

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083881#comment-15083881 ] Haohui Mai commented on HDFS-9525: -- bq. No. It's extremely useful to be able to do this from a workflow

[jira] [Commented] (HDFS-9605) "tab-datanode-volume-failures" is missing from explorer.html

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083896#comment-15083896 ] Haohui Mai commented on HDFS-9605: -- +1. Will commit shortly. > "tab-datanode-volume-failures" is missing

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084009#comment-15084009 ] Haohui Mai commented on HDFS-9047: -- [~cmccabe], does it look good to you? I plan to commit ti tomorrow if

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

2015-12-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053641#comment-15053641 ] Haohui Mai commented on HDFS-8562: -- I agree with Colin that we should move away from FileInputStream and

[jira] [Commented] (HDFS-9365) Balaner does not work with the HDFS-6376 HA setup

2015-12-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046635#comment-15046635 ] Haohui Mai commented on HDFS-9365: -- {code} - public static Collection getNsServiceRpcUris(Configuration

[jira] [Comment Edited] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-12-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038291#comment-15038291 ] Haohui Mai edited comment on HDFS-9442 at 12/3/15 7:40 PM: --- The patch looks good

[jira] [Commented] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-12-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038291#comment-15038291 ] Haohui Mai commented on HDFS-9442: -- The patch looks good to me overall. Thanks Mingliang for the work.

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-12-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036442#comment-15036442 ] Haohui Mai commented on HDFS-8791: -- bq. I've also only seen one or two upgrade issues caused by the

[jira] [Commented] (HDFS-9430) waitforloadingfsimage() can be removed since checknnstartup() already ensures image loaded and namenode started.

2015-12-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036414#comment-15036414 ] Haohui Mai commented on HDFS-9430: -- It's okay to remove the {{waitForLoadingFsImage()}} function but I

[jira] [Commented] (HDFS-9371) Code cleanup for DatanodeManager

2015-12-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034935#comment-15034935 ] Haohui Mai commented on HDFS-9371: -- Looks good to me overall. >From BlockManager's prospective the

  1   2   3   4   5   6   7   8   9   10   >