[jira] [Moved] (HADOOP-10755) Support negative caching of user-group mapping

2014-06-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu moved HDFS-5369 to HADOOP-10755: -- Component/s: (was: namenode)

[jira] [Updated] (HADOOP-10755) Support negative caching of user-group mapping

2014-06-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-10755: --- Attachment: HADOOP-10755.000.patch This patch changes default value of negative cache

[jira] [Updated] (HADOOP-10755) Support negative caching of user-group mapping

2014-06-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-10755: --- Attachment: HADOOP-10755.001.patch Fixed some typos in the comments for the unit tests.

[jira] [Updated] (HADOOP-10755) Support negative caching of user-group mapping

2014-06-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-10755: --- Attachment: HADOOP-10755.002.patch Disable negative cache in

[jira] [Assigned] (HADOOP-5353) add progress callback feature to the slow FileUtil operations with ability to cancel the work

2014-06-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu reassigned HADOOP-5353: - Assignee: Lei (Eddy) Xu add progress callback feature to the slow FileUtil operations

[jira] [Updated] (HADOOP-5353) add progress callback feature to the slow FileUtil operations with ability to cancel the work

2014-06-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-5353: -- Attachment: HADOOP-5353.000.patch Upload a {{Progress}} interface for discussion. I would

[jira] [Commented] (HADOOP-5353) add progress callback feature to the slow FileUtil operations with ability to cancel the work

2014-06-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047841#comment-14047841 ] Lei (Eddy) Xu commented on HADOOP-5353: --- Thank you [~stev...@iseran.com]! Your

[jira] [Commented] (HADOOP-10755) Support negative caching of user-group mapping

2014-07-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050481#comment-14050481 ] Lei (Eddy) Xu commented on HADOOP-10755: Hey, [~andrew.wang] and [~kihwal],

[jira] [Updated] (HADOOP-5353) add progress callback feature to the slow FileUtil operations with ability to cancel the work

2014-07-03 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-5353: -- Description: This is something only of relevance of people doing front ends to FS

[jira] [Commented] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-07-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061070#comment-14061070 ] Lei (Eddy) Xu commented on HADOOP-10281: [~chrili] Thank you for this great

[jira] [Updated] (HADOOP-10755) Support negative caching of user-group mapping

2014-07-18 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-10755: --- Attachment: HADOOP-10755.003.patch Thanks [~andrew.wang] for your suggestions! They are

[jira] [Updated] (HADOOP-10755) Support negative caching of user-group mapping

2014-07-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-10755: --- Attachment: HADOOP-10755.004.patch [~andrew.wang] Thank you so much for the review and

[jira] [Commented] (HADOOP-10755) Support negative caching of user-group mapping

2014-07-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069279#comment-14069279 ] Lei (Eddy) Xu commented on HADOOP-10755: [~andrew.wang] No worries :) The

[jira] [Created] (HADOOP-11005) Fix HTTP content type for ReconfigurationServlet

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HADOOP-11005: -- Summary: Fix HTTP content type for ReconfigurationServlet Key: HADOOP-11005 URL: https://issues.apache.org/jira/browse/HADOOP-11005 Project: Hadoop Common

[jira] [Updated] (HADOOP-11005) Fix HTTP content type for ReconfigurationServlet

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11005: --- Attachment: HADOOP-11005.000.patch Upload the patch to add http content type to the

[jira] [Updated] (HADOOP-11005) Fix HTTP content type for ReconfigurationServlet

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11005: --- Status: Patch Available (was: Open) Fix HTTP content type for ReconfigurationServlet

[jira] [Updated] (HADOOP-11005) Fix HTTP content type for ReconfigurationServlet

2014-08-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11005: --- Attachment: HADOOP-11005.000.patch [~andrew.wang] Sure. Here is the re-uploaded patch.

[jira] [Created] (HADOOP-11033) /bin/hdfs script ignores JAVA_HOME

2014-08-29 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HADOOP-11033: -- Summary: /bin/hdfs script ignores JAVA_HOME Key: HADOOP-11033 URL: https://issues.apache.org/jira/browse/HADOOP-11033 Project: Hadoop Common Issue Type:

[jira] [Commented] (HADOOP-11033) shell scripts ignore JAVA_HOME on OS X

2014-08-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115948#comment-14115948 ] Lei (Eddy) Xu commented on HADOOP-11033: [~aw] Thanks for helping this out. I've

[jira] [Commented] (HADOOP-11033) shell scripts ignore JAVA_HOME on OS X

2014-09-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118887#comment-14118887 ] Lei (Eddy) Xu commented on HADOOP-11033: Thank you very much [~aw] for the quick

[jira] [Updated] (HADOOP-11525) FileSystem should expose some performance characteristics for caller (e.g., FsShell) to choose the right algorithm.

2015-02-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11525: --- Resolution: Duplicate Status: Resolved (was: Patch Available)

[jira] [Created] (HADOOP-11556) SwiftNativeFileSystem rename being interrupted during fs -put

2015-02-06 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HADOOP-11556: -- Summary: SwiftNativeFileSystem rename being interrupted during fs -put Key: HADOOP-11556 URL: https://issues.apache.org/jira/browse/HADOOP-11556 Project: Hadoop

[jira] [Commented] (HADOOP-11607) Reduce log spew in S3AFileSystem

2015-02-18 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325655#comment-14325655 ] Lei (Eddy) Xu commented on HADOOP-11607: [~ste...@apache.org] Thanks much for

[jira] [Updated] (HADOOP-11607) Reduce log spew in S3AFileSystem

2015-02-18 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11607: --- Status: Patch Available (was: Open) Reduce log spew in S3AFileSystem

[jira] [Updated] (HADOOP-11607) Reduce log spew in S3AFileSystem

2015-02-18 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11607: --- Attachment: HADOOP-11607.001.patch Updated the patch to use SLF4J formating.

[jira] [Commented] (HADOOP-11556) SwiftNativeFileSystem rename being interrupted during fs -put

2015-02-12 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319382#comment-14319382 ] Lei (Eddy) Xu commented on HADOOP-11556: [~ste...@apache.org] Thanks for

[jira] [Updated] (HADOOP-11607) Reduce log spew in S3AFileSystem

2015-02-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11607: --- Attachment: HADOOP-11607.000.patch Change several INFO level log messages to DEBUG. No

[jira] [Created] (HADOOP-11607) Reduce log spew in S3AFileSystem

2015-02-17 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HADOOP-11607: -- Summary: Reduce log spew in S3AFileSystem Key: HADOOP-11607 URL: https://issues.apache.org/jira/browse/HADOOP-11607 Project: Hadoop Common Issue Type:

[jira] [Commented] (HADOOP-11607) Reduce log spew in S3AFileSystem

2015-02-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14327918#comment-14327918 ] Lei (Eddy) Xu commented on HADOOP-11607: [~ste...@apache.org] Thank you so much

[jira] [Commented] (HADOOP-11525) FileSystem should expose some performance characteristics for caller (e.g., FsShell) to choose the right algorithm.

2015-01-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299099#comment-14299099 ] Lei (Eddy) Xu commented on HADOOP-11525: [~thodemoor] and [~cnauroth] Thank you

[jira] [Created] (HADOOP-11530) BlockPoolSliceStorage could not remove storageDir.

2015-01-30 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HADOOP-11530: -- Summary: BlockPoolSliceStorage could not remove storageDir. Key: HADOOP-11530 URL: https://issues.apache.org/jira/browse/HADOOP-11530 Project: Hadoop Common

[jira] [Commented] (HADOOP-11584) s3a file block size set to 0 in getFileStatus

2015-02-20 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329721#comment-14329721 ] Lei (Eddy) Xu commented on HADOOP-11584: Tests passed on AWS US standard region.

[jira] [Created] (HADOOP-11724) DistCp throws NPE when the target directory is root.

2015-03-17 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HADOOP-11724: -- Summary: DistCp throws NPE when the target directory is root. Key: HADOOP-11724 URL: https://issues.apache.org/jira/browse/HADOOP-11724 Project: Hadoop Common

[jira] [Updated] (HADOOP-11724) DistCp throws NPE when the target directory is root.

2015-03-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11724: --- Attachment: HADOOP-11724.000.patch Check whether parent directory is {{null}} in

[jira] [Updated] (HADOOP-11724) DistCp throws NPE when the target directory is root.

2015-03-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11724: --- Status: Patch Available (was: Open) DistCp throws NPE when the target directory is root.

[jira] [Commented] (HADOOP-11724) DistCp throws NPE when the target directory is root.

2015-03-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366075#comment-14366075 ] Lei (Eddy) Xu commented on HADOOP-11724: The patch is trivial, so no test is

[jira] [Updated] (HADOOP-11626) Comment ReadStatistics to indicate that it tracks the actual read occurred

2015-03-06 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11626: --- Attachment: HADOOP-11626.002.patch [~ozawa] and [~cmccabe] Thank you so much for reviewing

[jira] [Commented] (HADOOP-11697) Use larger value for fs.s3a.connection.timeout.

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353944#comment-14353944 ] Lei (Eddy) Xu commented on HADOOP-11697: This is a trivial patch, thus no test

[jira] [Moved] (HADOOP-11697) Use larger value for fs.s3a.connection.timeout.

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu moved HDFS-7908 to HADOOP-11697: -- Target Version/s: 3.0.0, 2.7.0 (was: 3.0.0, 2.7.0) Affects

[jira] [Updated] (HADOOP-11697) Use larger value for fs.s3a.connection.timeout.

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11697: --- Attachment: HADOOP-11697.001.patch Reverted the patch to not change time unit of socket

[jira] [Commented] (HADOOP-11571) Über-jira: S3a stabilisation phase I

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353988#comment-14353988 ] Lei (Eddy) Xu commented on HADOOP-11571: [~stev...@iseran.com] Thank you so much

[jira] [Commented] (HADOOP-11697) Use larger value for fs.s3a.connection.timeout.

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354383#comment-14354383 ] Lei (Eddy) Xu commented on HADOOP-11697: Hey, [~yzhangal]. Thanks a lot for your

[jira] [Commented] (HADOOP-9565) Add a Blobstore interface to add to blobstore FileSystems

2015-03-13 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360857#comment-14360857 ] Lei (Eddy) Xu commented on HADOOP-9565: --- Hi, [~ste...@apache.org] and [~thodemoor].

[jira] [Updated] (HADOOP-11697) Use larger value for fs.s3a.connection.timeout.

2015-03-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11697: --- Status: Open (was: Patch Available) Use larger value for fs.s3a.connection.timeout.

[jira] [Updated] (HADOOP-11724) DistCp throws NPE when the target directory is root.

2015-03-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11724: --- Attachment: HADOOP-11724.001.patch Thanks a lot [~yzhangal]. It is a great suggestion. I

[jira] [Commented] (HADOOP-11724) DistCp throws NPE when the target directory is root.

2015-03-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14379330#comment-14379330 ] Lei (Eddy) Xu commented on HADOOP-11724: No test is included, because the change

[jira] [Updated] (HADOOP-11724) DistCp throws NPE when the target directory is root.

2015-03-25 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11724: --- Attachment: HADOOP-11724.002.patch Hi, [~yzhangal] Thanks for reviewing it. I removed the

[jira] [Updated] (HADOOP-11724) DistCp throws NPE when the target directory is root.

2015-03-25 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11724: --- Attachment: HADOOP-11724.002.patch Re-upload the patch to trigger jenkin job DistCp

[jira] [Updated] (HADOOP-11724) DistCp throws NPE when the target directory is root.

2015-03-25 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11724: --- Attachment: (was: HADOOP-11724.002.patch) DistCp throws NPE when the target directory

[jira] [Updated] (HADOOP-11626) Comment ReadStatistics to indicate that it tracks the actual read occurred, also logs the

2015-03-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11626: --- Summary: Comment ReadStatistics to indicate that it tracks the actual read occurred, also

[jira] [Updated] (HADOOP-11626) DFSInputStream should only update ReadStatistics when the read is success.

2015-03-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11626: --- Attachment: HADOOP-11626.001.patch [~ozawa] and [~cmccabe] Thanks for reviewing this. You

[jira] [Updated] (HADOOP-11626) Comment ReadStatistics to indicate that it tracks the actual read occurred

2015-03-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11626: --- Summary: Comment ReadStatistics to indicate that it tracks the actual read occurred (was:

[jira] [Updated] (HADOOP-11626) Comment ReadStatistics to indicate that it tracks the actual read occurred, also logs the

2015-03-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11626: --- Description: In {{DFSOutputStream#actualGetFromOneDataNode()}}, it updates the

[jira] [Updated] (HADOOP-11626) Comment ReadStatistics to indicate that it tracks the actual read occurred

2015-03-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11626: --- Description: In {{DFSOutputStream#actualGetFromOneDataNode()}}, it updates the

[jira] [Created] (HADOOP-11626) DFSInputStream should only update ReadStatistics when the read is success.

2015-02-23 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HADOOP-11626: -- Summary: DFSInputStream should only update ReadStatistics when the read is success. Key: HADOOP-11626 URL: https://issues.apache.org/jira/browse/HADOOP-11626

[jira] [Updated] (HADOOP-11607) Reduce log spew in S3AFileSystem

2015-02-20 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11607: --- Resolution: Fixed Fix Version/s: 2.7.0 3.0.0 Status:

[jira] [Updated] (HADOOP-11626) DFSInputStream should only update ReadStatistics when the read is success.

2015-02-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11626: --- Attachment: HADOOP-11626.000.patch Change the order of updating {{ReadStatistics}}. No

[jira] [Updated] (HADOOP-11626) DFSInputStream should only update ReadStatistics when the read is success.

2015-02-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11626: --- Status: Patch Available (was: Open) DFSInputStream should only update ReadStatistics when

[jira] [Commented] (HADOOP-11724) DistCp throws NPE when the target directory is root.

2015-03-25 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381073#comment-14381073 ] Lei (Eddy) Xu commented on HADOOP-11724: Thanks much for the reviews and

[jira] [Assigned] (HADOOP-11525) FileSystem should expose some performance characteristics for caller (e.g., FsShell) to choose the right algorithm.

2015-01-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu reassigned HADOOP-11525: -- Assignee: Lei (Eddy) Xu FileSystem should expose some performance characteristics

[jira] [Updated] (HADOOP-11525) FileSystem should expose some performance characteristics for caller (e.g., FsShell) to choose the right algorithm.

2015-01-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11525: --- Status: Patch Available (was: Open) FileSystem should expose some performance

[jira] [Updated] (HADOOP-11525) FileSystem should expose some performance characteristics for caller (e.g., FsShell) to choose the right algorithm.

2015-01-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11525: --- Attachment: HADOOP-11525.000.patch This patch exposes {{FileSystem#Characteristics}} to the

[jira] [Moved] (HADOOP-11525) FileSystem should expose some performance characteristics for caller (e.g., FsShell) to choose the right algorithm.

2015-01-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu moved HDFS-7705 to HADOOP-11525: -- Component/s: (was: tools) tools

[jira] [Updated] (HADOOP-11918) Listing an empty s3a root directory throws FileNotFound.

2015-05-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11918: --- Attachment: HADOOP-11918.001.patch Hi, [~ste...@apache.org] Thanks a lot for the

[jira] [Created] (HADOOP-11918) Listing an empty s3a root directory throws FileNotFound.

2015-05-04 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HADOOP-11918: -- Summary: Listing an empty s3a root directory throws FileNotFound. Key: HADOOP-11918 URL: https://issues.apache.org/jira/browse/HADOOP-11918 Project: Hadoop Common

[jira] [Updated] (HADOOP-11918) Listing an empty s3a root directory throws FileNotFound.

2015-05-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11918: --- Status: Patch Available (was: Open) Listing an empty s3a root directory throws

[jira] [Updated] (HADOOP-11918) Listing an empty s3a root directory throws FileNotFound.

2015-05-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11918: --- Attachment: HADOOP-11918.000.patch If the input directory is root and there is no

[jira] [Commented] (HADOOP-11918) Listing an empty s3a root directory throws FileNotFound.

2015-05-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14545741#comment-14545741 ] Lei (Eddy) Xu commented on HADOOP-11918: Hi, [~thodemoor] Are you pointing to

[jira] [Commented] (HADOOP-12057) swiftfs rename on partitioned file attempts to consolidate partitions

2015-06-03 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571827#comment-14571827 ] Lei (Eddy) Xu commented on HADOOP-12057: [~highlycaffeinated] You don't need to

[jira] [Commented] (HADOOP-12056) DiskChecker#checkDirs should check null pointer for the return value from File#listFiles to avoid NPE.

2015-06-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573230#comment-14573230 ] Lei (Eddy) Xu commented on HADOOP-12056: Hi, [~zxu] Thanks for updating the

[jira] [Commented] (HADOOP-12056) DiskChecker#checkDirs should check null pointer for the return value from File#listFiles to avoid NPE.

2015-06-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575199#comment-14575199 ] Lei (Eddy) Xu commented on HADOOP-12056: Hi, [~zxu] Thanks much for updating the

[jira] [Commented] (HADOOP-12056) DiskChecker#checkDirs should check null pointer for the return value from File#listFiles to avoid NPE.

2015-06-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570060#comment-14570060 ] Lei (Eddy) Xu commented on HADOOP-12056: Hi, [~zxu] Nice find. This patch looks

[jira] [Commented] (HADOOP-9565) Add a Blobstore interface to add to blobstore FileSystems

2015-06-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602469#comment-14602469 ] Lei (Eddy) Xu commented on HADOOP-9565: --- [~airbots], you might want to check the

[jira] [Commented] (HADOOP-12043) Display warning if defaultFs is not set when running fs commands.

2015-05-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565703#comment-14565703 ] Lei (Eddy) Xu commented on HADOOP-12043: Thanks for reviews and suggestions,

[jira] [Updated] (HADOOP-12164) Fix TestMove and TestFsShellReturnCode failed to get command name using reflection.

2015-06-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-12164: --- Resolution: Fixed Fix Version/s: 2.8.0 3.0.0 Status:

[jira] [Commented] (HADOOP-9565) Add a Blobstore interface to add to blobstore FileSystems

2015-07-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612734#comment-14612734 ] Lei (Eddy) Xu commented on HADOOP-9565: --- Hi, [~Thomas Demoor]. Thanks a lot for

[jira] [Created] (HADOOP-12148) Expose the stats of IOErrors on each FsVolume through JMX

2015-06-29 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HADOOP-12148: -- Summary: Expose the stats of IOErrors on each FsVolume through JMX Key: HADOOP-12148 URL: https://issues.apache.org/jira/browse/HADOOP-12148 Project: Hadoop

[jira] [Updated] (HADOOP-12164) Fix TestMove and TestFsShellReturnCode failed to get command name using reflection.

2015-06-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-12164: --- Status: Patch Available (was: Open) Fix TestMove and TestFsShellReturnCode failed to get

[jira] [Updated] (HADOOP-12164) Fix TestMove and TestFsShellReturnCode failed to get command name using reflection.

2015-06-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-12164: --- Attachment: HADOOP-12164.000.patch Uploaded the patch, which added {{static String NAME}}

[jira] [Created] (HADOOP-12164) Fix TestMove and TestFsShellReturnCode failed to get command name using reflection.

2015-06-30 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HADOOP-12164: -- Summary: Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. Key: HADOOP-12164 URL: https://issues.apache.org/jira/browse/HADOOP-12164

[jira] [Resolved] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu resolved HADOOP-12267. Resolution: Duplicate Hi, [~fabbri] As we discussed offline, we will close this as

[jira] [Commented] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646681#comment-14646681 ] Lei (Eddy) Xu commented on HADOOP-12267: Hi, [~fabbri]. The patch itself looks

[jira] [Updated] (HADOOP-12269) Update aws-sdk dependency to 1.10.6

2015-08-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-12269: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0

[jira] [Commented] (HADOOP-12269) Update aws-sdk dependency to 1.10.6

2015-08-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654667#comment-14654667 ] Lei (Eddy) Xu commented on HADOOP-12269: +1, Ran {{hdfs dfs -put }} to s3a. I

[jira] [Comment Edited] (HADOOP-12269) Update aws-sdk dependency to 1.10.6

2015-08-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654667#comment-14654667 ] Lei (Eddy) Xu edited comment on HADOOP-12269 at 8/5/15 1:53 AM:

[jira] [Comment Edited] (HADOOP-12269) Update aws-sdk dependency to 1.10.6

2015-08-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654667#comment-14654667 ] Lei (Eddy) Xu edited comment on HADOOP-12269 at 8/5/15 3:25 AM:

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-11-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995770#comment-14995770 ] Lei (Eddy) Xu commented on HADOOP-11684: [~ajisakaa] Thanks a lot for this note. I put the

[jira] [Updated] (HADOOP-12482) Race condition in JMX cache update

2015-11-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-12482: --- Resolution: Fixed Fix Version/s: 3.0.0 2.8.0 Status:

[jira] [Commented] (HADOOP-12482) Race condition in JMX cache update

2015-11-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997552#comment-14997552 ] Lei (Eddy) Xu commented on HADOOP-12482: Hi, [~twu] Thanks for the update, a few final

[jira] [Commented] (HADOOP-12482) Race condition in JMX cache update

2015-10-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983509#comment-14983509 ] Lei (Eddy) Xu commented on HADOOP-12482: Thanks a lot for working on this, [~twu]. A few

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-11-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990187#comment-14990187 ] Lei (Eddy) Xu commented on HADOOP-11684: Hi, [~fabbri]. It LGTM. Could you update

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-11-03 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988233#comment-14988233 ] Lei (Eddy) Xu commented on HADOOP-11684: Hi, [~fabbri]. I am OK with either 1 or 2. Please

[jira] [Commented] (HADOOP-11262) Enable YARN to use S3A

2015-11-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986384#comment-14986384 ] Lei (Eddy) Xu commented on HADOOP-11262: [~PieterReuse], thanks a lot for working on this. Could

[jira] [Updated] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-11-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-11684: --- Resolution: Fixed Fix Version/s: 3.0.0 2.8.0 Status:

[jira] [Commented] (HADOOP-12553) [JDK8] Fix javadoc error caused by illegal tag

2015-11-06 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994073#comment-14994073 ] Lei (Eddy) Xu commented on HADOOP-12553: +1 Thanks a lot for fixing it, [~ajisakaa]. > [JDK8]

[jira] [Commented] (HADOOP-11262) Enable YARN to use S3A

2015-11-06 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994094#comment-14994094 ] Lei (Eddy) Xu commented on HADOOP-11262: Thanks for the explanations, [~cnauroth] and [~Thomas

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-11-06 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994080#comment-14994080 ] Lei (Eddy) Xu commented on HADOOP-11684: Thanks for finding the issues. [~aw], [~ajisakaa] and

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-10-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961766#comment-14961766 ] Lei (Eddy) Xu commented on HADOOP-11684: Thanks a lot for working on this, [~Thomas Demoor] and

[jira] [Updated] (HADOOP-12346) Increase some default timeouts / retries for S3a connector

2015-08-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-12346: --- Resolution: Fixed Fix Version/s: 3.0.0 2.8.0 Target

[jira] [Commented] (HADOOP-11918) Listing an empty s3a root directory throws FileNotFound.

2015-09-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744422#comment-14744422 ] Lei (Eddy) Xu commented on HADOOP-11918: [~cnauroth], [~steve_l] and [~Thomas Demoor]. Sorry

  1   2   3   4   >