[jira] [Commented] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

2018-11-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673339#comment-16673339 ] John Zhuge commented on HDFS-13984: --- [~yangjiandan]Thanks for the contribution! Could you please take

[jira] [Commented] (HDFS-13752) fs.Path stores file path in java.net.URI causes big memory waste

2018-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551109#comment-16551109 ] John Zhuge commented on HDFS-13752: --- cc [~mi...@cloudera.com] > fs.Path stores file path in

[jira] [Commented] (HDFS-13247) FileInputStream not closed when read the checksum header from the meta file

2018-03-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390867#comment-16390867 ] John Zhuge commented on HDFS-13247: --- Please check out 

[jira] [Commented] (HDFS-240) Should HDFS restrict the names used for files?

2018-03-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386758#comment-16386758 ] John Zhuge commented on HDFS-240: - Unfortunately don't have time to work on it. > Should HDFS restrict the

[jira] [Assigned] (HDFS-240) Should HDFS restrict the names used for files?

2018-03-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-240: --- Assignee: (was: John Zhuge) > Should HDFS restrict the names used for files? >

[jira] [Commented] (HDFS-12528) Add an option to not disable short-circuit reads on failures

2018-01-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344557#comment-16344557 ] John Zhuge commented on HDFS-12528: --- +1 LGTM > Add an option to not disable short-circuit reads on

[jira] [Commented] (HDFS-12528) Short-circuit reads unnecessarily disabled for a long time

2018-01-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343005#comment-16343005 ] John Zhuge commented on HDFS-12528: --- [~xiaochen], thanks for the great work! Patch 03 LGTM. Just a minor

[jira] [Commented] (HDFS-12528) Short-circuit reads unnecessarily disabled for a long time

2017-12-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299614#comment-16299614 ] John Zhuge commented on HDFS-12528: --- Unfortunately I won't have time for a while. Unassign myself. >

[jira] [Assigned] (HDFS-12528) Short-circuit reads unnecessarily disabled for a long time

2017-12-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-12528: - Assignee: (was: John Zhuge) > Short-circuit reads unnecessarily disabled for a long time >

[jira] [Commented] (HDFS-12528) Short-circuit reads unnecessarily disabled for a long time

2017-12-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299589#comment-16299589 ] John Zhuge commented on HDFS-12528: --- Yes, that would shorten the path greatly. > Short-circuit reads

[jira] [Commented] (HDFS-12528) Short-circuit reads unnecessarily disabled for a long time

2017-12-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299531#comment-16299531 ] John Zhuge commented on HDFS-12528: --- [~xiaochen] Puzzled. The hadoop-hdfs/pom.xml changes in

[jira] [Resolved] (HDFS-12604) StreamCapability enums are not displayed in javadoc

2017-11-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12604. --- Resolution: Won't Fix StreamCapability enums are deprecated by HADOOP-15012. > StreamCapability

[jira] [Updated] (HDFS-12528) Short-circuit reads unnecessarily disabled for a long time

2017-11-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12528: -- Summary: Short-circuit reads unnecessarily disabled for a long time (was: Short-circuit reads getting

[jira] [Resolved] (HDFS-12821) Block invalid IOException causes the DFSClient domain socket being disabled

2017-11-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12821. --- Resolution: Duplicate > Block invalid IOException causes the DFSClient domain socket being disabled >

[jira] [Commented] (HDFS-12821) Block invalid IOException causes the DFSClient domain socket being disabled

2017-11-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254904#comment-16254904 ] John Zhuge commented on HDFS-12821: --- Think so too. In HDFS-12528, the file was appended, thus the last

[jira] [Updated] (HDFS-12821) Block invalid IOException causes the DFSClient domain socket being disabled

2017-11-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12821: -- Description: We use HDFS2.4 & 2.6, and recently hit a issue that DFSClient domain socket is disabled

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-11-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12318: -- Fix Version/s: 2.9.1 2.10.0 2.8.3 > Fix IOException condition for

[jira] [Commented] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-11-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246143#comment-16246143 ] John Zhuge commented on HDFS-12318: --- Backported to branch-2, branch-2.9, and branch-2.8. Unfortunately

[jira] [Comment Edited] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-11-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16233678#comment-16233678 ] John Zhuge edited comment on HDFS-12714 at 11/1/17 6:03 AM: Committed to trunk

[jira] [Resolved] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-11-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12714. --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 3.1.0 Committed to trunk and

[jira] [Commented] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-31 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227809#comment-16227809 ] John Zhuge commented on HDFS-12714: --- +1 LGTM I will commit once the testing done is clarified. >

[jira] [Commented] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226256#comment-16226256 ] John Zhuge commented on HDFS-12744: --- +1 LGTM > More logs when short-circuit read is failed and disabled

[jira] [Updated] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12744: -- Labels: supportability (was: ) > More logs when short-circuit read is failed and disabled >

[jira] [Comment Edited] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226037#comment-16226037 ] John Zhuge edited comment on HDFS-12714 at 10/31/17 1:00 AM: - [~joemcdonnell]

[jira] [Commented] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226037#comment-16226037 ] John Zhuge commented on HDFS-12714: --- [~joemcdonnell] Thanks for the contribution! How did u test the

[jira] [Updated] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12710: -- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219380#comment-16219380 ] John Zhuge commented on HDFS-12710: --- Tested the patch in a pseudo distributed cluster. It works as

[jira] [Commented] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219130#comment-16219130 ] John Zhuge commented on HDFS-12710: --- [~pifta] Thanks for the contribution! Is this a bug in HDFS-10423?

[jira] [Commented] (HDFS-3296) Running libhdfs tests in mac fails

2017-10-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217817#comment-16217817 ] John Zhuge commented on HDFS-3296: -- TestDomainSocket#testAsyncCloseDuringWrite failure: {noformat}

[jira] [Updated] (HDFS-3296) Running libhdfs tests in mac fails

2017-10-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-3296: - Attachment: HDFS-3296.004.patch I'd like to share a patch I have been using. Not totally polished or

[jira] [Commented] (HDFS-12528) Short-circuit reads getting disabled frequently in certain scenarios

2017-10-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216277#comment-16216277 ] John Zhuge commented on HDFS-12528: --- The unit test is subtly different from the original case in that

[jira] [Comment Edited] (HDFS-12528) Short-circuit reads getting disabled frequently in certain scenarios

2017-10-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216131#comment-16216131 ] John Zhuge edited comment on HDFS-12528 at 10/24/17 4:16 AM: - Patch 000 * Unit

[jira] [Updated] (HDFS-12528) Short-circuit reads getting disabled frequently in certain scenarios

2017-10-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12528: -- Attachment: HDFS-12528.000.patch Patch 000 * Unit test only Here is the test output. {{Unbuffer}}

[jira] [Work started] (HDFS-12528) Short-circuit reads getting disabled frequently in certain scenarios

2017-10-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12528 started by John Zhuge. - > Short-circuit reads getting disabled frequently in certain scenarios >

[jira] [Updated] (HDFS-12494) libhdfs SIGSEGV in setTLSExceptionStrings

2017-10-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12494: -- Resolution: Fixed Fix Version/s: 3.1.0 3.0.0 Status: Resolved

[jira] [Commented] (HDFS-12494) libhdfs SIGSEGV in setTLSExceptionStrings

2017-10-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195158#comment-16195158 ] John Zhuge commented on HDFS-12494: --- It is ok because getJNIEnv returns NULL in this case and callers

[jira] [Commented] (HDFS-12604) StreamCapability enums are not displayed in javadoc

2017-10-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193859#comment-16193859 ] John Zhuge commented on HDFS-12604: --- [~eddyxu] I recently attempted to make some changes in this area.

[jira] [Commented] (HDFS-12494) libhdfs SIGSEGV in setTLSExceptionStrings

2017-10-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193226#comment-16193226 ] John Zhuge commented on HDFS-12494: --- [~sailesh] Could you please take a look at the patch? > libhdfs

[jira] [Updated] (HDFS-12494) libhdfs SIGSEGV in setTLSExceptionStrings

2017-10-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12494: -- Status: Patch Available (was: Open) > libhdfs SIGSEGV in setTLSExceptionStrings >

[jira] [Updated] (HDFS-12494) libhdfs SIGSEGV in setTLSExceptionStrings

2017-10-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12494: -- Attachment: HDFS-12494.001.patch Patch 001 * Fix SEGV by setting thread local var to {{state}} before

[jira] [Assigned] (HDFS-12494) libhdfs SIGSEGV in setTLSExceptionStrings

2017-10-04 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-12494: - Assignee: John Zhuge > libhdfs SIGSEGV in setTLSExceptionStrings >

[jira] [Assigned] (HDFS-12528) Short-circuit reads getting disabled frequently in certain scenarios

2017-10-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-12528: - Assignee: John Zhuge > Short-circuit reads getting disabled frequently in certain scenarios >

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172074#comment-16172074 ] John Zhuge commented on HDFS-11851: --- Filed HDFS-12494 libhdfs SIGSEGV in setTLSExceptionStrings. >

[jira] [Updated] (HDFS-12494) libhdfs SIGSEGV in setTLSExceptionStrings

2017-09-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12494: -- Description: libhdfs application crashes when CLASSPATH is set but not set properly. It uses wildcard

[jira] [Commented] (HDFS-11529) Add libHDFS API to return last exception

2017-09-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172067#comment-16172067 ] John Zhuge commented on HDFS-11529: --- The patch has a bug tracked by HDFS-12494 libhdfs SIGSEGV in

[jira] [Created] (HDFS-12494) libhdfs SIGSEGV in setTLSExceptionStrings

2017-09-19 Thread John Zhuge (JIRA)
John Zhuge created HDFS-12494: - Summary: libhdfs SIGSEGV in setTLSExceptionStrings Key: HDFS-12494 URL: https://issues.apache.org/jira/browse/HDFS-12494 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-12491) Support wildcard in CLASSPATH for libhdfs

2017-09-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171915#comment-16171915 ] John Zhuge commented on HDFS-12491: --- The workaround: {noformat} export CLASSPATH=$(hadoop classpath

[jira] [Commented] (HDFS-12491) Support wildcard in CLASSPATH for libhdfs

2017-09-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171880#comment-16171880 ] John Zhuge commented on HDFS-12491: --- Be sure update LibHdfs.md. > Support wildcard in CLASSPATH for

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171871#comment-16171871 ] John Zhuge commented on HDFS-11851: --- Filed HDFS-12491 Support wildcard in CLASSPATH for libhdfs. >

[jira] [Commented] (HDFS-12491) Support wildcard in CLASSPATH for libhdfs

2017-09-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171865#comment-16171865 ] John Zhuge commented on HDFS-12491: --- See example code in

[jira] [Created] (HDFS-12491) Support wildcard in CLASSPATH for libhdfs

2017-09-19 Thread John Zhuge (JIRA)
John Zhuge created HDFS-12491: - Summary: Support wildcard in CLASSPATH for libhdfs Key: HDFS-12491 URL: https://issues.apache.org/jira/browse/HDFS-12491 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171821#comment-16171821 ] John Zhuge commented on HDFS-11851: --- [~Tagar] CLASSPATH for libhdfs doesn't support wildcard. Try this:

[jira] [Comment Edited] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-18 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171148#comment-16171148 ] John Zhuge edited comment on HDFS-11851 at 9/19/17 5:52 AM: Got a similar

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-18 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171148#comment-16171148 ] John Zhuge commented on HDFS-11851: --- Got a similar SEGV. Details in

[jira] [Comment Edited] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-18 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171134#comment-16171134 ] John Zhuge edited comment on HDFS-11851 at 9/19/17 5:21 AM: You are right

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-18 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171134#comment-16171134 ] John Zhuge commented on HDFS-11851: --- You are right because

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-18 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171071#comment-16171071 ] John Zhuge commented on HDFS-11851: --- This NoClassDefFoundError indicates misconfigured classpath for

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167047#comment-16167047 ] John Zhuge commented on HDFS-11851: --- Please upload hs_err*.log. Probably a SEGV in

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162252#comment-16162252 ] John Zhuge commented on HDFS-11851: --- This fixes a deadlock introduced by HDFS-11529 which is only in

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12318: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Resolved] (HDFS-12113) `hadoop fs -setrep` requries huge amount of memory on client side

2017-08-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12113. --- Resolution: Duplicate [~Tagar] Thanks for reporting the issue. It is a dup of HADOOP-12502. >

[jira] [Commented] (HDFS-12339) NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper

2017-08-22 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137866#comment-16137866 ] John Zhuge commented on HDFS-12339: --- Thanks [~saileshpatel] for the great report with so much detail! >

[jira] [Updated] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11738: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12318: -- Attachment: HDFS-12318.002.patch Thanks for the unit test! +1 LGTM with minor comments: * Rename unit

[jira] [Commented] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134625#comment-16134625 ] John Zhuge commented on HDFS-12318: --- [~legend] Great catch and thanks for the patch. I will take a look.

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134194#comment-16134194 ] John Zhuge commented on HDFS-11738: --- Plan to commit tomorrow if no objection. Will take care of the typo

[jira] [Updated] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-08-18 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12117: -- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available) The

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-18 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133467#comment-16133467 ] John Zhuge commented on HDFS-11738: --- +1 LGTM pending pre-commit tests. Still typo: "no nodes to

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-18 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131867#comment-16131867 ] John Zhuge commented on HDFS-11738: --- The patch looks great! Only a few minor comments: * Keep the old

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16130007#comment-16130007 ] John Zhuge commented on HDFS-11738: --- Ok, will do before tomorrow noon. > Hedged pread takes more time

[jira] [Comment Edited] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124426#comment-16124426 ] John Zhuge edited comment on HDFS-11303 at 8/12/17 5:39 AM: Committed to

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124474#comment-16124474 ] John Zhuge commented on HDFS-11303: --- Committed to branch-2. > Hedged read might hang infinitely if read

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11303: -- Fix Version/s: 2.9.0 > Hedged read might hang infinitely if read data from all DN failed >

[jira] [Comment Edited] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124428#comment-16124428 ] John Zhuge edited comment on HDFS-11738 at 8/12/17 3:37 AM: [~vinayrpet]

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124428#comment-16124428 ] John Zhuge commented on HDFS-11738: --- [~vinayrpet] Committed HDFS-11303. > Hedged pread takes more time

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11303: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123717#comment-16123717 ] John Zhuge commented on HDFS-11303: --- TestDirectoryScanner was known to be flaky: {noformat} Tests run:

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123632#comment-16123632 ] John Zhuge commented on HDFS-11303: --- Saw TestDataNodeVolumeFailureReporting failure in Aug 10 qbt:

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123628#comment-16123628 ] John Zhuge commented on HDFS-11303: --- Saw TestDecommissioningStatus failure in Jul 28 qbt: {noformat} For

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123625#comment-16123625 ] John Zhuge commented on HDFS-11303: --- Saw it in Aug 6 qbt: {noformat} For more details, see

[jira] [Comment Edited] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123015#comment-16123015 ] John Zhuge edited comment on HDFS-11303 at 8/11/17 8:17 AM: Assigned to myself

[jira] [Assigned] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-11303: - Assignee: Chen Zhang (was: John Zhuge) > Hedged read might hang infinitely if read data from

[jira] [Assigned] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-11303: - Assignee: John Zhuge (was: Chen Zhang) > Hedged read might hang infinitely if read data from

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11303: -- Status: Patch Available (was: In Progress) Assigned to me to submit the patch. > Hedged read might

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11303: -- Attachment: HDFS-11303.005.patch Patch 005 * Reset the metrics before the test since it is static. It

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123008#comment-16123008 ] John Zhuge commented on HDFS-11303: --- TestDFSStripedInputStreamWithRandomECPolicy passed for me locally.

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122889#comment-16122889 ] John Zhuge commented on HDFS-11738: --- [~zhangchen] is the original author. [~jojochuang] and I just tried

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11303: -- Status: In Progress (was: Patch Available) Looking into TestPread and

[jira] [Updated] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11738: -- Summary: Hedged pread takes more time when block moved from initial locations (was: hedged pread takes

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11303: -- Attachment: HDFS-11303.004.patch Patch 004 * Fix checkstyle * Rename futureComplete back to future to

[jira] [Updated] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11957: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11898) DFSClient#isHedgedReadsEnabled() should be per client flag

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121250#comment-16121250 ] John Zhuge commented on HDFS-11898: --- [~shv] Could we get this in first? We can work on non-static pool

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-08-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117494#comment-16117494 ] John Zhuge commented on HDFS-11957: --- Committing to trunk tomorrow if there is no objection. > Enable

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102478#comment-16102478 ] John Zhuge commented on HDFS-11957: --- Thanks [~andrew.wang]! [~cnauroth], what do you think? 3.0 release

[jira] [Resolved] (HDFS-11176) httpfs.sh run fails due to missing temp dir

2017-07-22 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-11176. --- Resolution: Duplicate Fix Version/s: 3.0.0-alpha4 Fixed by HDFS-10860:

[jira] [Updated] (HDFS-12166) Do not deprecate HTTPFS_TEMP

2017-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12166: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12166) Do not deprecate HTTPFS_TEMP

2017-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095267#comment-16095267 ] John Zhuge commented on HDFS-12166: --- Thanks Xiao. Will commit tomorrow pending no other comment. > Do

[jira] [Updated] (HDFS-12166) Do not deprecate HTTPFS_TEMP

2017-07-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12166: -- Attachment: HDFS-12166.002.patch Patch 002 * Use HTTPFS_HOME if defined > Do not deprecate HTTPFS_TEMP

[jira] [Updated] (HDFS-12166) Do not deprecate HTTPFS_TEMP

2017-07-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12166: -- Attachment: HDFS-12166.001.patch Patch 001 * Un-deprecate HTTPFS_TEMP * Set system property

[jira] [Updated] (HDFS-12166) Do not deprecate HTTPFS_TEMP

2017-07-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12166: -- Status: Patch Available (was: Open) > Do not deprecate HTTPFS_TEMP > > >

  1   2   3   4   5   6   7   8   9   10   >