[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457625#comment-15457625 ] Manoj Govindassamy commented on HDFS-10830: --- [~xiaochen], {quote}At that time removeVolumes was

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457611#comment-15457611 ] Xiao Chen commented on HDFS-10830: -- Thanks Manoj and Arpit. IIRC the reason of not {{Thread.sleep}} here

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457568#comment-15457568 ] Xiao Chen commented on HDFS-9781: - Sorry for my epic slow response on this one And thanks all for

[jira] [Commented] (HDFS-10778) Optimize the output result of FileDistribution processor in hdfs oiv command

[ https://issues.apache.org/jira/browse/HDFS-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457441#comment-15457441 ] Yiqun Lin commented on HDFS-10778: -- Hi [~ajisakaa], can we go ahead for this JIRA, the latest patch can

[jira] [Commented] (HDFS-10833) Fix JSON errors in WebHDFS.md examples

[ https://issues.apache.org/jira/browse/HDFS-10833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457310#comment-15457310 ] Hadoop QA commented on HDFS-10833: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10833) Fix JSON errors in WebHDFS.md examples

[ https://issues.apache.org/jira/browse/HDFS-10833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10833: --- Status: Patch Available (was: Open) > Fix JSON errors in WebHDFS.md examples >

[jira] [Updated] (HDFS-10833) Fix JSON errors in WebHDFS.md examples

[ https://issues.apache.org/jira/browse/HDFS-10833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10833: --- Attachment: HDFS-10833.001.patch Patch attached, trivial. > Fix JSON errors in WebHDFS.md examples >

[jira] [Created] (HDFS-10833) Fix JSON errors in WebHDFS.md examples

Andrew Wang created HDFS-10833: -- Summary: Fix JSON errors in WebHDFS.md examples Key: HDFS-10833 URL: https://issues.apache.org/jira/browse/HDFS-10833 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457255#comment-15457255 ] Arpit Agarwal commented on HDFS-10830: -- We can probably fix this without a temporary workaround as it

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457239#comment-15457239 ] Manoj Govindassamy commented on HDFS-10830: --- As part of HDFS-9781, I have updated the unit test

[jira] [Commented] (HDFS-10735) Distcp using webhdfs on secure HA clusters fails with StandbyException

[ https://issues.apache.org/jira/browse/HDFS-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457238#comment-15457238 ] Arpit Agarwal commented on HDFS-10735: -- Hi [~benoyantony], the change looks fine to me. It will

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457226#comment-15457226 ] Manoj Govindassamy commented on HDFS-10830: --- Thanks for taking a look at this [~arpitagarwal].

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457208#comment-15457208 ] Manoj Govindassamy commented on HDFS-9781: -- TestFileChecksum unit test failure is not related to

[jira] [Commented] (HDFS-10832) HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326

[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457191#comment-15457191 ] Hadoop QA commented on HDFS-10832: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457154#comment-15457154 ] Yiqun Lin commented on HDFS-10820: -- Thanks for the commit, Xiao! > Reuse closeResponder to reset the

[jira] [Updated] (HDFS-10832) HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326

[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10832: --- Attachment: HDFS-10823.001.patch Patch attached. This is actually a bit worse than I thought. The acl

[jira] [Updated] (HDFS-10832) HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326

[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10832: --- Target Version/s: 2.9.0 Status: Patch Available (was: Open) > HttpFS does not use the

[jira] [Assigned] (HDFS-10832) HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326

[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-10832: -- Assignee: Andrew Wang > HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326 >

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457107#comment-15457107 ] Hadoop QA commented on HDFS-9781: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10831) Add log when URLConnectionFactory.openConnection failed

[ https://issues.apache.org/jira/browse/HDFS-10831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457077#comment-15457077 ] Hadoop QA commented on HDFS-10831: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457055#comment-15457055 ] Erik Krogen commented on HDFS-10817: Created HDFS-10829 to address concerns in testing noted in Zhe's

[jira] [Commented] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457047#comment-15457047 ] Andrew Wang commented on HDFS-10823: Made a little progress breaking out the iterator from HDFS-10784.

[jira] [Created] (HDFS-10832) HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326

Andrew Wang created HDFS-10832: -- Summary: HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326 Key: HDFS-10832 URL: https://issues.apache.org/jira/browse/HDFS-10832 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10831) Add log when URLConnectionFactory.openConnection failed

[ https://issues.apache.org/jira/browse/HDFS-10831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yunjiong zhao updated HDFS-10831: - Status: Patch Available (was: Open) > Add log when URLConnectionFactory.openConnection failed >

[jira] [Updated] (HDFS-10831) Add log when URLConnectionFactory.openConnection failed

[ https://issues.apache.org/jira/browse/HDFS-10831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yunjiong zhao updated HDFS-10831: - Attachment: HDFS-10831.001.patch Since this patch only added on line code to log error

[jira] [Commented] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457010#comment-15457010 ] Zhe Zhang commented on HDFS-10673: -- Just backported this one to branch-2.8. Working on branch-2.7

[jira] [Updated] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10673: - Fix Version/s: 2.8.0 > Optimize FSPermissionChecker's internal path usage >

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456982#comment-15456982 ] Arpit Agarwal commented on HDFS-10830: -- Hi [~eddyxu], [~xiaochen], I am looking into fixing this

[jira] [Created] (HDFS-10831) Add log when URLConnectionFactory.openConnection failed

yunjiong zhao created HDFS-10831: Summary: Add log when URLConnectionFactory.openConnection failed Key: HDFS-10831 URL: https://issues.apache.org/jira/browse/HDFS-10831 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456973#comment-15456973 ] Arpit Agarwal commented on HDFS-10830: -- Thanks for reporting this [~manojg]. I am looking for a

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456969#comment-15456969 ] Chris Douglas commented on HDFS-7878: - [~jingzhao] Good idea on {{FileHandle}}; I prefer that to

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9781: - Attachment: (was: HDFS-9781.001.patch) > FsDatasetImpl#getBlockReports can

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9781: - Attachment: HDFS-9781.002.patch > FsDatasetImpl#getBlockReports can occasionally throw

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9781: - Status: Patch Available (was: Open) > FsDatasetImpl#getBlockReports can occasionally

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9781: - Attachment: HDFS-9781.001.patch 1. Attaching the patch to ignore unavailable volumes seen

[jira] [Commented] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456913#comment-15456913 ] Hudson commented on HDFS-10820: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10388 (See

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456904#comment-15456904 ] Manoj Govindassamy commented on HDFS-9781: -- Filed HDFS-10830 to track IllegalMonitorStateException

[jira] [Created] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

Manoj Govindassamy created HDFS-10830: - Summary: FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use Key: HDFS-10830 URL:

[jira] [Comment Edited] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456864#comment-15456864 ] Xiao Chen edited comment on HDFS-10820 at 9/1/16 10:51 PM: --- I have committed

[jira] [Updated] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10820: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Comment Edited] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453821#comment-15453821 ] Manoj Govindassamy edited comment on HDFS-9781 at 9/1/16 10:48 PM: --- Ref:

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456831#comment-15456831 ] Hadoop QA commented on HDFS-4025: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10662) Optimize UTF8 string/byte conversions

[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10662: - Resolution: Fixed Fix Version/s: 2.7.4 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-10662) Optimize UTF8 string/byte conversions

[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456812#comment-15456812 ] Zhe Zhang commented on HDFS-10662: -- Thanks [~kihwal]! I removed the unused import and verified all

[jira] [Updated] (HDFS-10829) Improve Testing for NN Lock Logging

[ https://issues.apache.org/jira/browse/HDFS-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10829: --- Description: Currently the testing for the namenode logging when locks are held for a long time is a

[jira] [Created] (HDFS-10829) Improve Testing for NN Lock Logging

Erik Krogen created HDFS-10829: -- Summary: Improve Testing for NN Lock Logging Key: HDFS-10829 URL: https://issues.apache.org/jira/browse/HDFS-10829 Project: Hadoop HDFS Issue Type: Test

[jira] [Assigned] (HDFS-10829) Improve Testing for NN Lock Logging

[ https://issues.apache.org/jira/browse/HDFS-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-10829: -- Assignee: Erik Krogen > Improve Testing for NN Lock Logging >

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456737#comment-15456737 ] Jing Zhao commented on HDFS-7878: - So the InodeId is actually a file handler? Maybe in that sense to

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456734#comment-15456734 ] Zhe Zhang commented on HDFS-10817: -- Ahh, right, the patch verifies the method name as well as the count.

[jira] [Comment Edited] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446784#comment-15446784 ] John Zhuge edited comment on HDFS-10684 at 9/1/16 9:52 PM: --- [~loungerdork], I

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456729#comment-15456729 ] Sean Mackrory commented on HDFS-10797: -- Just a note for anyone reading my comments above, I learned

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456710#comment-15456710 ] Zhe Zhang commented on HDFS-8901: - Thanks for the update [~Sammi]. # {{TestPread}} failure looks related.

[jira] [Updated] (HDFS-7987) Allow files / directories to be moved

[ https://issues.apache.org/jira/browse/HDFS-7987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7987: --- Fix Version/s: 2.9.0 > Allow files / directories to be moved > - >

[jira] [Commented] (HDFS-7987) Allow files / directories to be moved

[ https://issues.apache.org/jira/browse/HDFS-7987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456702#comment-15456702 ] Ravi Prakash commented on HDFS-7987: Thanks Allen! I've backported this to branch-2 > Allow files /

[jira] [Commented] (HDFS-7767) Use the noredirect flag in WebHDFS to allow web browsers to upload files via the NN UI

[ https://issues.apache.org/jira/browse/HDFS-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456700#comment-15456700 ] Ravi Prakash commented on HDFS-7767: Thanks Allen! I've backported this to branch-2 > Use the

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10684: --- Labels: compatibility webhdfs (was: compatibility) > WebHDFS DataNode calls fail without parameter

[jira] [Updated] (HDFS-9877) HDFS Namenode UI: Fix browsing directories that need to be encoded

[ https://issues.apache.org/jira/browse/HDFS-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-9877: --- Fix Version/s: 2.9.0 > HDFS Namenode UI: Fix browsing directories that need to be encoded >

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10684: --- Priority: Blocker (was: Major) > WebHDFS DataNode calls fail without parameter createparent >

[jira] [Commented] (HDFS-9877) HDFS Namenode UI: Fix browsing directories that need to be encoded

[ https://issues.apache.org/jira/browse/HDFS-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456697#comment-15456697 ] Ravi Prakash commented on HDFS-9877: Thanks Allen! Backported to branch-2 > HDFS Namenode UI: Fix

[jira] [Updated] (HDFS-7767) Use the noredirect flag in WebHDFS to allow web browsers to upload files via the NN UI

[ https://issues.apache.org/jira/browse/HDFS-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7767: --- Fix Version/s: 2.9.0 > Use the noredirect flag in WebHDFS to allow web browsers to upload files via >

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456692#comment-15456692 ] Andrew Wang commented on HDFS-10684: Thanks for picking this up John, the patch looks good. Great find

[jira] [Commented] (HDFS-7766) Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect

[ https://issues.apache.org/jira/browse/HDFS-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456653#comment-15456653 ] Ravi Prakash commented on HDFS-7766: Ok. The change is indeed backward compatible. > Add a flag to

[jira] [Commented] (HDFS-7766) Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect

[ https://issues.apache.org/jira/browse/HDFS-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456647#comment-15456647 ] Andrew Wang commented on HDFS-7766: --- Up to you, I pulled this one in to make another backport clean. I

[jira] [Commented] (HDFS-7766) Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect

[ https://issues.apache.org/jira/browse/HDFS-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456616#comment-15456616 ] Ravi Prakash commented on HDFS-7766: Thanks Andrew! Should I backport the other NN UI changes to

[jira] [Updated] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-4025: - Attachment: HDFS-4025.003.patch > QJM: Sychronize past log segments to JNs that missed them >

[jira] [Commented] (HDFS-10822) Log DataNodes in the write pipeline

[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456398#comment-15456398 ] Hadoop QA commented on HDFS-10822: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456400#comment-15456400 ] Hadoop QA commented on HDFS-4025: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456003#comment-15456003 ] John Zhuge edited comment on HDFS-10684 at 9/1/16 7:22 PM: --- Patch 001-branch-2:

[jira] [Updated] (HDFS-10822) Log DataNodes in the write pipeline

[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10822: -- Status: Patch Available (was: Open) > Log DataNodes in the write pipeline >

[jira] [Updated] (HDFS-10822) Log DataNodes in the write pipeline

[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10822: -- Attachment: HDFS-10822.001.patch Patch 001: * {{initDataStreaming}} is a better place to add DEBUG msg

[jira] [Created] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

Arpit Agarwal created HDFS-10828: Summary: Fix usage of FsDatasetImpl object lock in ReplicaMap Key: HDFS-10828 URL: https://issues.apache.org/jira/browse/HDFS-10828 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456213#comment-15456213 ] Chris Douglas commented on HDFS-7878: - bq. I meant when callers are in different processes/nodes, e.g.

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456206#comment-15456206 ] Arpit Agarwal commented on HDFS-10713: -- Re capturing the thread stack every time we see a higher lock

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456192#comment-15456192 ] Hadoop QA commented on HDFS-10684: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456174#comment-15456174 ] Sergey Shelukhin commented on HDFS-7878: I meant when callers are in different processes/nodes,

[jira] [Updated] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-4025: - Attachment: HDFS-4025.002.patch Fixed checkstyle and findbug errors > QJM: Sychronize past log

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Status: Patch Available (was: Open) > WebHDFS DataNode calls fail without parameter createparent >

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Attachment: HDFS-10684.001-branch-2.patch Patch 001-branch-2: * Start with branch-2 patch because mixed

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455994#comment-15455994 ] Erik Krogen commented on HDFS-10817: Thanks [~zhz]! But I disagree that spinning up multiple threads

[jira] [Commented] (HDFS-10662) Optimize UTF8 string/byte conversions

[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455967#comment-15455967 ] Kihwal Lee commented on HDFS-10662: --- [~zhz], the patch looks good in general. There is an unused import

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Labels: compatibility (was: ) > WebHDFS DataNode calls fail without parameter createparent >

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Target Version/s: 2.8.0 > WebHDFS DataNode calls fail without parameter createparent >

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455957#comment-15455957 ] John Zhuge commented on HDFS-10684: --- To support mixed versions of NNs and DNs in webhdfs, we have to

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455915#comment-15455915 ] churro morales commented on HDFS-10608: --- [~surendrasingh] Thank you for the review. You are right,

[jira] [Commented] (HDFS-10662) Optimize UTF8 string/byte conversions

[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455869#comment-15455869 ] Kihwal Lee commented on HDFS-10662: --- [~zhz], I will take a look. The 2.7 precommit has more test

[jira] [Commented] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455653#comment-15455653 ] Rushabh S Shah commented on HDFS-10827: --- We don't use ec in our builds but we see the error as shown

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455385#comment-15455385 ] Hadoop QA commented on HDFS-8901: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455139#comment-15455139 ] Hadoop QA commented on HDFS-9847: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455110#comment-15455110 ] SammiChen commented on HDFS-8901: - attach patch v17, improve the code based on Zhe's good suggestions >

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8901: Attachment: HDFS-8901-v17.patch > Use ByteBuffer in striping positional read >

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455103#comment-15455103 ] SammiChen commented on HDFS-8901: - Thanks Zhe for take a lot of time review patch and give so many good

[jira] [Updated] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10827: Description: For RS-6-3, when there is one ec block group and 1) 0~3 of 9 internal blocks

[jira] [Updated] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10827: Attachment: case_3.png case_2.png > When there are unrecoverable ec block

[jira] [Updated] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10827: Attachment: (was: スクリーンショット 2016-09-01 19.34.18.png) > When there are unrecoverable ec

[jira] [Updated] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10827: Attachment: (was: スクリーンショット 2016-08-31 13.42.21.png) > When there are unrecoverable ec

[jira] [Updated] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10827: Attachment: スクリーンショット 2016-09-01 19.34.18.png スクリーンショット 2016-08-31

[jira] [Created] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

Takanobu Asanuma created HDFS-10827: --- Summary: When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names. Key: HDFS-10827 URL:

[jira] [Updated] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10826: Issue Type: Sub-task (was: Bug) Parent: HDFS-8031 > The result of fsck should be

[jira] [Updated] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10826: Attachment: HDFS-10826.WIP.1.patch I created an unit test for this problem and uploaded. >

[jira] [Created] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

Takanobu Asanuma created HDFS-10826: --- Summary: The result of fsck should be CRITICAL when there are unrecoverable ec block groups. Key: HDFS-10826 URL: https://issues.apache.org/jira/browse/HDFS-10826

  1   2   >