[jira] [Commented] (HDFS-12519) Ozone: Add a Lease Manager to SCM

2017-10-10 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198319#comment-16198319 ] Nandakumar commented on HDFS-12519: --- [~linyiqun], The reason for having

[jira] [Updated] (HDFS-12622) Fix enumerate in HDFSErasureCoding.md

2017-10-10 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12622: - Attachment: Screen Shot 2017-10-10 at 17.36.16.png Attaching a screenshot. The enumerate is

[jira] [Updated] (HDFS-12622) Fix enumerate in HDFSErasureCoding.md

2017-10-10 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12622: - Labels: newbie (was: ) > Fix enumerate in HDFSErasureCoding.md >

[jira] [Created] (HDFS-12622) Fix enumerate in HDFSErasureCoding.md

2017-10-10 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-12622: Summary: Fix enumerate in HDFSErasureCoding.md Key: HDFS-12622 URL: https://issues.apache.org/jira/browse/HDFS-12622 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-206: Status: Patch Available (was: Open) > Support for head in FSShell > --- > >

[jira] [Comment Edited] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198430#comment-16198430 ] Gabor Bota edited comment on HDFS-206 at 10/10/17 10:18 AM: The solution uses

[jira] [Assigned] (HDFS-5926) documation should clarify dfs.datanode.du.reserved wrt reserved disk capacity

2017-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HDFS-5926: Assignee: Gabor Bota > documation should clarify dfs.datanode.du.reserved wrt reserved disk

[jira] [Commented] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

2017-10-10 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198299#comment-16198299 ] Huafeng Wang commented on HDFS-12257: - Hi [~asuresh], about next major release, do you mean 3.0

[jira] [Updated] (HDFS-12583) Ozone: Fix swallow exceptions which makes hard to debug failures

2017-10-10 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12583: - Attachment: HDFS-12583-HDFS-7240.004.patch New patch attached. [~cheersyang], [~anu] and [~vagarychen],

[jira] [Updated] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-206: Attachment: HDFS-206.001.patch The solution uses the similar approach as the head command. > Support for

[jira] [Assigned] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HDFS-206: --- Assignee: Gabor Bota > Support for head in FSShell > --- > >

[jira] [Comment Edited] (HDFS-12583) Ozone: Fix swallow exceptions which makes hard to debug failures

2017-10-10 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198525#comment-16198525 ] Yiqun Lin edited comment on HDFS-12583 at 10/10/17 11:20 AM: - New patch

[jira] [Commented] (HDFS-12572) Ozone: OzoneFileSystem: delete/list status/rename/mkdir APIs

2017-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198294#comment-16198294 ] Hadoop QA commented on HDFS-12572: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

2017-10-10 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198672#comment-16198672 ] Ewan Higgs edited comment on HDFS-11707 at 10/10/17 1:33 PM: - I've seen this

[jira] [Created] (HDFS-12623) Add UT for the Test Command

2017-10-10 Thread legend (JIRA)
legend created HDFS-12623: - Summary: Add UT for the Test Command Key: HDFS-12623 URL: https://issues.apache.org/jira/browse/HDFS-12623 Project: Hadoop HDFS Issue Type: Test Affects Versions:

[jira] [Updated] (HDFS-12623) Add UT for the Test Command

2017-10-10 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-12623: Component/s: test > Add UT for the Test Command > --- > >

[jira] [Commented] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

2017-10-10 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198672#comment-16198672 ] Ewan Higgs commented on HDFS-11707: --- I've seen this error pop up. One theory is that if the throttle

[jira] [Created] (HDFS-12624) Ozone: number of keys/values/buckets to KSMMetrics

2017-10-10 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-12624: --- Summary: Ozone: number of keys/values/buckets to KSMMetrics Key: HDFS-12624 URL: https://issues.apache.org/jira/browse/HDFS-12624 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198717#comment-16198717 ] Gabor Bota commented on HDFS-206: - I think the failed test is not related. Could somebody confirm this? >

[jira] [Commented] (HDFS-12570) [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements

2017-10-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198546#comment-16198546 ] Uma Maheswara Rao G commented on HDFS-12570: [~rakeshr] Thank you for updating the patch.

[jira] [Comment Edited] (HDFS-12570) [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements

2017-10-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198546#comment-16198546 ] Uma Maheswara Rao G edited comment on HDFS-12570 at 10/10/17 11:49 AM:

[jira] [Commented] (HDFS-11045) TestDirectoryScanner#testThrottling fails: Throttle is too permissive

2017-10-10 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198703#comment-16198703 ] Ewan Higgs commented on HDFS-11045: --- [~dan...@cloudera.com], can you rebase this? {quote} Karthik

[jira] [Commented] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

2017-10-10 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198685#comment-16198685 ] Ewan Higgs commented on HDFS-11707: --- This should probably be closed as duplicate of HDFS-11045 >

[jira] [Updated] (HDFS-12623) Add UT for the Test Command

2017-10-10 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12623: -- Status: Patch Available (was: Open) > Add UT for the Test Command > --- > >

[jira] [Commented] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198641#comment-16198641 ] Hadoop QA commented on HDFS-206: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12623) Add UT for the Test Command

2017-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198666#comment-16198666 ] Hadoop QA commented on HDFS-12623: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12504) Ozone: Improve SQLCLI performance

2017-10-10 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12504: -- Attachment: HDFS-12504-HDFS-7240.001.patch upload v1 patch for this JIRA. I've refactored the code in

[jira] [Updated] (HDFS-12504) Ozone: Improve SQLCLI performance

2017-10-10 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12504: -- Status: Patch Available (was: In Progress) > Ozone: Improve SQLCLI performance >

[jira] [Commented] (HDFS-12464) Ozone: More detailed documentation about the ozone components

2017-10-10 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198556#comment-16198556 ] Elek, Marton commented on HDFS-12464: - I will close this issue for now. We agreed that the content of

[jira] [Resolved] (HDFS-12464) Ozone: More detailed documentation about the ozone components

2017-10-10 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton resolved HDFS-12464. - Resolution: Won't Fix > Ozone: More detailed documentation about the ozone components >

[jira] [Resolved] (HDFS-12373) Trying to construct Path for a file that has colon (":") throws IllegalArgumentException

2017-10-10 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor resolved HDFS-12373. - Resolution: Duplicate HADOOP-14217 will fix this. HADOOP-14217 has already had a patch and has

[jira] [Commented] (HDFS-12583) Ozone: Fix swallow exceptions which makes hard to debug failures

2017-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198745#comment-16198745 ] Hadoop QA commented on HDFS-12583: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12623) Add UT for the Test Command

2017-10-10 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12623: -- Attachment: HDFS-12623.patch > Add UT for the Test Command > --- > >

[jira] [Commented] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198981#comment-16198981 ] Gabor Bota commented on HDFS-206: - Fixed checkstyle errors, try to run again, hope not related test won't

[jira] [Updated] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12521: Labels: ozoneMerge (was: performance) > Ozone: SCM should read all Container info into memory when

[jira] [Updated] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-206: Attachment: HDFS-206.002.patch > Support for head in FSShell > --- > >

[jira] [Updated] (HDFS-12519) Ozone: Add a Lease Manager to SCM

2017-10-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12519: Labels: ozoneMerge (was: OzonePostMerge) > Ozone: Add a Lease Manager to SCM >

[jira] [Commented] (HDFS-12619) Do not catch and throw unchecked exceptions if IBRs fail to process

2017-10-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198994#comment-16198994 ] Hanisha Koneru commented on HDFS-12619: --- Thanks for the patch [~jojochuang]. LGTM. +1

[jira] [Updated] (HDFS-11575) Supporting HDFS NFS gateway with Federated HDFS

2017-10-10 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-11575: Resolution: Fixed Status: Resolved (was: Patch Available) I have committed

[jira] [Commented] (HDFS-12504) Ozone: Improve SQLCLI performance

2017-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198972#comment-16198972 ] Hadoop QA commented on HDFS-12504: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12613) Native EC coder should implement release() as idempotent function.

2017-10-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12613: - Attachment: HDFS-12613.01.patch Fix checkstyle warnings. Ping [~andrew.wang], [~xiaochen],

[jira] [Updated] (HDFS-12585) Add description for config in Ozone config UI

2017-10-10 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12585: -- Summary: Add description for config in Ozone config UI (was: Add description for each config in Ozone

[jira] [Work started] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-206 started by Gabor Bota. --- > Support for head in FSShell > --- > > Key:

[jira] [Updated] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-206: Status: Patch Available (was: In Progress) > Support for head in FSShell > --- > >

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

2017-10-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199097#comment-16199097 ] Hudson commented on HDFS-10467: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13061 (See

[jira] [Commented] (HDFS-11575) Supporting HDFS NFS gateway with Federated HDFS

2017-10-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199099#comment-16199099 ] Hudson commented on HDFS-11575: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13061 (See

[jira] [Updated] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-206: Status: Open (was: Patch Available) > Support for head in FSShell > --- > >

[jira] [Updated] (HDFS-12620) Backporting HDFS-10467 to branch-2

2017-10-10 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12620: --- Attachment: HDFS-10467-branch-2.003.patch > Backporting HDFS-10467 to branch-2 >

[jira] [Updated] (HDFS-11575) Supporting HDFS NFS gateway with Federated HDFS

2017-10-10 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-11575: Fix Version/s: 3.1.0 > Supporting HDFS NFS gateway with Federated HDFS >

[jira] [Commented] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

2017-10-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199061#comment-16199061 ] Daryn Sharp commented on HDFS-12614: I've not liked the inconsistency with whether the root inode's

[jira] [Commented] (HDFS-12621) Inconsistency/confusion around ViewFileSystem.getDelagation

2017-10-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199141#comment-16199141 ] Erik Krogen commented on HDFS-12621: {{addDelegationTokens}} had to be added to accommodate the fact

[jira] [Commented] (HDFS-12490) Ozone: OzoneClient: OzoneBucket/OzoneKey should have information about the bucket/key creation/modification time

2017-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199173#comment-16199173 ] Hadoop QA commented on HDFS-12490: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

2017-10-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-11707. Resolution: Duplicate > TestDirectoryScanner#testThrottling fails on OSX >

[jira] [Resolved] (HDFS-5834) TestCheckpoint#testCheckpoint may fail due to Bad value assertion

2017-10-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-5834. -- Resolution: Cannot Reproduce > TestCheckpoint#testCheckpoint may fail due to Bad value assertion >

[jira] [Commented] (HDFS-12593) Ozone: update Ratis to the latest snapshot

2017-10-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198831#comment-16198831 ] Tsz Wo Nicholas Sze commented on HDFS-12593: [~linyiqun], many thanks for testing the patch!

[jira] [Updated] (HDFS-12490) Ozone: OzoneClient: OzoneBucket/OzoneKey should have information about the bucket/key creation/modification time

2017-10-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12490: - Attachment: HDFS-12490-HDFS-7240.002.patch Thanks for the review [~nandakumar131] and

[jira] [Commented] (HDFS-12593) Ozone: update Ratis to the latest snapshot

2017-10-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198916#comment-16198916 ] Tsz Wo Nicholas Sze commented on HDFS-12593: [~msingh], it is a good idea to change

[jira] [Resolved] (HDFS-5718) TestHttpsFileSystem intermittently fails with Port in use error

2017-10-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-5718. -- Resolution: Cannot Reproduce > TestHttpsFileSystem intermittently fails with Port in use error >

[jira] [Resolved] (HDFS-5831) TestAuditLogs#testAuditAllowedStat sometimes fails in trunk

2017-10-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-5831. -- Resolution: Cannot Reproduce > TestAuditLogs#testAuditAllowedStat sometimes fails in trunk >

[jira] [Commented] (HDFS-12593) Ozone: update Ratis to the latest snapshot

2017-10-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198859#comment-16198859 ] Mukul Kumar Singh commented on HDFS-12593: -- Thanks for the updated patch [~szetszwo] and thanks

[jira] [Updated] (HDFS-12490) Ozone: OzoneClient: OzoneBucket/OzoneKey should have information about the bucket/key creation/modification time

2017-10-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12490: - Summary: Ozone: OzoneClient: OzoneBucket/OzoneKey should have information about the

[jira] [Commented] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

2017-10-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198813#comment-16198813 ] Erik Krogen commented on HDFS-11707: I agree with you, thanks [~ehiggs]. Closing out as duplicate. >

[jira] [Updated] (HDFS-12593) Ozone: update Ratis to the latest snapshot

2017-10-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12593: --- Attachment: HDFS-12593-HDFS-7240.20171011.patch HDFS-12593-HDFS-7240.20171011.patch:

[jira] [Commented] (HDFS-12519) Ozone: Add a Lease Manager to SCM

2017-10-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199221#comment-16199221 ] Chen Liang commented on HDFS-12519: --- This is actually a quite complex work, seems lots of thoughts have

[jira] [Updated] (HDFS-12625) Reduce expense of deleting large directories

2017-10-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-12625: -- Release Note: (was: Deletion of ~5M files on a large cluster jammed the NN for 52 seconds. The call

[jira] [Updated] (HDFS-12625) Reduce expense of deleting large directories

2017-10-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-12625: -- Description: Deletion of ~5M files on a large cluster jammed the NN for 52 seconds. The call queue

[jira] [Commented] (HDFS-12625) Reduce expense of deleting large directories

2017-10-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199264#comment-16199264 ] Eric Payne commented on HDFS-12625: --- Features like snapshots have increased the difficulty to redesign

[jira] [Commented] (HDFS-12619) Do not catch and throw unchecked exceptions if IBRs fail to process

2017-10-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199308#comment-16199308 ] Xiao Chen commented on HDFS-12619: -- +1, thanks [~jojochuang]! > Do not catch and throw unchecked

[jira] [Created] (HDFS-12627) Typo in DFSAdmin

2017-10-10 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-12627: - Summary: Typo in DFSAdmin Key: HDFS-12627 URL: https://issues.apache.org/jira/browse/HDFS-12627 Project: Hadoop HDFS Issue Type: Bug Reporter: Ajay

[jira] [Commented] (HDFS-12542) Update javadoc and documentation for listStatus

2017-10-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199313#comment-16199313 ] Arpit Agarwal commented on HDFS-12542: -- Thanks for the contribution [~ajayydv]. The patch looks good,

[jira] [Commented] (HDFS-12593) Ozone: update Ratis to the latest snapshot

2017-10-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199189#comment-16199189 ] Mukul Kumar Singh commented on HDFS-12593: -- Thanks for the updated patch [~szetszwo]. The latest

[jira] [Created] (HDFS-12625) Reduce expense of deleting large directories

2017-10-10 Thread Eric Payne (JIRA)
Eric Payne created HDFS-12625: - Summary: Reduce expense of deleting large directories Key: HDFS-12625 URL: https://issues.apache.org/jira/browse/HDFS-12625 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-10 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12626: - Summary: Ozone : delete open key entries that will no longer be closed Key: HDFS-12626 URL: https://issues.apache.org/jira/browse/HDFS-12626 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199303#comment-16199303 ] Chen Liang commented on HDFS-12626: --- There are definitely different ways to handle this, but the simpler

[jira] [Commented] (HDFS-7174) Support for more efficient large directories

2017-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199310#comment-16199310 ] Hadoop QA commented on HDFS-7174: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12585) Add description for config in Ozone config UI

2017-10-10 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12585: -- Attachment: HDFS-12585-HDFS-7240.02.patch patch v2 to address checkstyle and findbug warnings. > Add

[jira] [Updated] (HDFS-12627) Typo in DFSAdmin

2017-10-10 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12627: -- Attachment: HDFS-12627.01.patch > Typo in DFSAdmin > > > Key:

[jira] [Updated] (HDFS-12627) Typo in DFSAdmin

2017-10-10 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12627: -- Status: Patch Available (was: Open) > Typo in DFSAdmin > > > Key:

[jira] [Commented] (HDFS-12627) Typo in DFSAdmin

2017-10-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199323#comment-16199323 ] Arpit Agarwal commented on HDFS-12627: -- Thanks [~ajayydv]. The fix looks good. You'll also need to

[jira] [Commented] (HDFS-12627) Typo in DFSAdmin

2017-10-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199353#comment-16199353 ] Arpit Agarwal commented on HDFS-12627: -- +1 pending Jenkins. > Typo in DFSAdmin > >

[jira] [Updated] (HDFS-12572) Ozone: OzoneFileSystem: delete/list status/rename/mkdir APIs

2017-10-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12572: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-10-10 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12553: -- Attachment: HDFS-12553.10.patch > Add nameServiceId to QJournalProtocol >

[jira] [Updated] (HDFS-12612) DFSStripedOutputStream#close will throw if called a second time with a failed streamer

2017-10-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12612: - Attachment: HDFS-12612.00.patch Add a test to verify the bug, and only logs remaining IOE from

[jira] [Updated] (HDFS-12612) DFSStripedOutputStream#close will throw if called a second time with a failed streamer

2017-10-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12612: - Status: Patch Available (was: Open) > DFSStripedOutputStream#close will throw if called a second

[jira] [Commented] (HDFS-12573) Divide the total block metrics into replica and ec

2017-10-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199419#comment-16199419 ] Hudson commented on HDFS-12573: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13064 (See

[jira] [Updated] (HDFS-12628) libhdfs crashes on thread exit for JNI+libhdfs applications

2017-10-10 Thread Joe McDonnell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe McDonnell updated HDFS-12628: - Attachment: jni-util-test2.cc > libhdfs crashes on thread exit for JNI+libhdfs applications >

[jira] [Created] (HDFS-12628) libhdfs crashes on thread exit for JNI+libhdfs applications

2017-10-10 Thread Joe McDonnell (JIRA)
Joe McDonnell created HDFS-12628: Summary: libhdfs crashes on thread exit for JNI+libhdfs applications Key: HDFS-12628 URL: https://issues.apache.org/jira/browse/HDFS-12628 Project: Hadoop HDFS

[jira] [Commented] (HDFS-206) Support for head in FSShell

2017-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199333#comment-16199333 ] Hadoop QA commented on HDFS-206: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12627) Typo in DFSAdmin

2017-10-10 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12627: -- Attachment: HDFS-12627.02.patch > Typo in DFSAdmin > > > Key:

[jira] [Commented] (HDFS-12627) Typo in DFSAdmin

2017-10-10 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199354#comment-16199354 ] Ajay Kumar commented on HDFS-12627: --- [~arpitagarwal], thanks for having a look. Added fix for both

[jira] [Updated] (HDFS-12573) Divide the total block metrics into replica and ec

2017-10-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12573: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12572) Ozone: OzoneFileSystem: delete/list status/rename/mkdir APIs

2017-10-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199413#comment-16199413 ] Xiaoyu Yao commented on HDFS-12572: --- Thanks [~msingh] for the update. Patch v6 looks good to me, +1. I

[jira] [Commented] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

2017-10-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199469#comment-16199469 ] Arun Suresh commented on HDFS-12257: I am ok with porting this into the next 2.9.x release or 2.10 >

[jira] [Updated] (HDFS-12411) Ozone: Add container usage information to DN container report

2017-10-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12411: -- Attachment: (was: HDFS-12411-HDFS-7240.006.patch) > Ozone: Add container usage information to DN

[jira] [Updated] (HDFS-12411) Ozone: Add container usage information to DN container report

2017-10-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12411: -- Attachment: HDFS-12411-HDFS-7240.006.patch Thanks [~yuanbo] for the review. I've attached a rebased new

[jira] [Updated] (HDFS-12411) Ozone: Add container usage information to DN container report

2017-10-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12411: -- Attachment: HDFS-12572-HDFS-7240.006.patch > Ozone: Add container usage information to DN container

[jira] [Updated] (HDFS-12411) Ozone: Add container usage information to DN container report

2017-10-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12411: -- Attachment: (was: HDFS-12572-HDFS-7240.006.patch) > Ozone: Add container usage information to DN

[jira] [Updated] (HDFS-12629) NameNode UI should report total blocks count by type - replicated and erasure coded

2017-10-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12629: -- Attachment: NN_UI_Summary_BlockCount_BeforeFix.png > NameNode UI should report total

[jira] [Updated] (HDFS-12629) NameNode UI should report total blocks count by type - replicated and erasure coded

2017-10-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12629: -- Description: Currently NameNode UI displays total files and directories and total

[jira] [Commented] (HDFS-12612) DFSStripedOutputStream#close will throw if called a second time with a failed streamer

2017-10-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199530#comment-16199530 ] Andrew Wang commented on HDFS-12612: Change looks pretty simple :) Did you dig up any info on the

  1   2   >