[jira] [Comment Edited] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385254#comment-15385254 ] Youwei Wang edited comment on HDFS-10651 at 7/20/16 4:20 AM: - Thanks :) was

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Youwei Wang updated HDFS-10651: --- Attachment: (was: HDFS-10651.v4.patch) > Clean up some configuration related codes about legacy

[jira] [Updated] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10645: -- Attachment: HDFS-10645.003.patch > Make block report size as a metric and add this metric to datanode

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385268#comment-15385268 ] Yuanbo Liu commented on HDFS-10645: --- [~ajisakaa] Thanks for your comments, they are very helpful!

[jira] [Commented] (HDFS-10613) Wrong real size when a DSQuotaExceededException occur

2016-07-19 Thread Xiaohe Lan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385259#comment-15385259 ] Xiaohe Lan commented on HDFS-10613: --- Hi Liang, In my settings: replication factor: 3 block size: 128

[jira] [Commented] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385254#comment-15385254 ] Youwei Wang commented on HDFS-10651: HDFS-10651.v4.patch uploaded: > Clean up some configuration

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Youwei Wang updated HDFS-10651: --- Attachment: HDFS-10651.v4.patch > Clean up some configuration related codes about legacy block reader

[jira] [Commented] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385241#comment-15385241 ] Kai Zheng commented on HDFS-10651: -- The patch LGTM. Note it also removed the following from

[jira] [Commented] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385219#comment-15385219 ] Youwei Wang commented on HDFS-10651: HDFS-10651.v3.patch uploaded: All unrelated changes are removed.

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Youwei Wang updated HDFS-10651: --- Attachment: HDFS-10651.v3.patch > Clean up some configuration related codes about legacy block reader

[jira] [Commented] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385213#comment-15385213 ] Kai Zheng commented on HDFS-10651: -- Hi [~hayabusa], The patch seems to have some format change. Please

[jira] [Comment Edited] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383651#comment-15383651 ] Youwei Wang edited comment on HDFS-10651 at 7/20/16 2:24 AM: - Hi Kai. i have

[jira] [Commented] (HDFS-10603) Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot

2016-07-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385187#comment-15385187 ] Yiqun Lin commented on HDFS-10603: -- Thanks [~ajisakaa] for the commit, and thanks [~yzhangal] for the

[jira] [Commented] (HDFS-10647) Add a link to HDFS disk balancer document in site.xml

2016-07-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385182#comment-15385182 ] Yiqun Lin commented on HDFS-10647: -- Thanks [~ajisakaa] for the commit! > Add a link to HDFS disk

[jira] [Commented] (HDFS-10619) Cache path in InodesInPath

2016-07-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385178#comment-15385178 ] Yiqun Lin commented on HDFS-10619: -- Thanks [~daryn], I believe the works for these jiras will greatly

[jira] [Commented] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385175#comment-15385175 ] Youwei Wang commented on HDFS-10651: HDFS-10651.v2.patch uploaded. > Clean up some configuration

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Youwei Wang updated HDFS-10651: --- Attachment: HDFS-10651.v2.patch > Clean up some configuration related codes about legacy block reader

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Youwei Wang updated HDFS-10651: --- Status: In Progress (was: Patch Available) > Clean up some configuration related codes about legacy

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Youwei Wang updated HDFS-10651: --- Status: Patch Available (was: Open) > Clean up some configuration related codes about legacy block

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Youwei Wang updated HDFS-10651: --- Attachment: HDFS-10651.v1.patch > Clean up some configuration related codes about legacy block reader

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Youwei Wang updated HDFS-10651: --- Status: Open (was: Patch Available) > Clean up some configuration related codes about legacy block

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Youwei Wang updated HDFS-10651: --- Status: Patch Available (was: Open) > Clean up some configuration related codes about legacy block

[jira] [Updated] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

2016-07-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8957: Assignee: Youwei Wang (was: Kai Zheng) > Consolidate client striping input stream codes for stateful read

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10651: - Assignee: Youwei Wang (was: Kai Zheng) > Clean up some configuration related codes about legacy block

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-19 Thread Jiayi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385131#comment-15385131 ] Jiayi Zhou commented on HDFS-10519: --- Thanks Andrew for the review. I have attached a new patch to solve

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385120#comment-15385120 ] Mingliang Liu commented on HDFS-10301: -- Thanks for the patch, [~redvine]. I'm catching up all the

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-19 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385100#comment-15385100 ] Konstantin Shvachko commented on HDFS-10301: This looks good to me. +1 > BlockReport

[jira] [Updated] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-19 Thread Jiayi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Zhou updated HDFS-10519: -- Attachment: HDFS-10519.008.patch > Add a configuration option to enable in-progress edit log tailing >

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385026#comment-15385026 ] Akira Ajisaka commented on HDFS-10645: -- Thanks [~yuanbo] for updating the patch. Some comments: #

[jira] [Created] (HDFS-10656) Optimize conversion of byte arrays back to path string

2016-07-19 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10656: -- Summary: Optimize conversion of byte arrays back to path string Key: HDFS-10656 URL: https://issues.apache.org/jira/browse/HDFS-10656 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-07-19 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10655: --- Attachment: HDFS-10655.patch Other than fixing bugs, reuses an empty byte array for the root

[jira] [Created] (HDFS-10655) Fix path related byte array conversion bugs

2016-07-19 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10655: -- Summary: Fix path related byte array conversion bugs Key: HDFS-10655 URL: https://issues.apache.org/jira/browse/HDFS-10655 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9852) hdfs dfs -setfacl error message is misleading

2016-07-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385005#comment-15385005 ] Wei-Chiu Chuang commented on HDFS-9852: --- Thanks [~aw] and [~cnauroth] for committing the patch! >

[jira] [Updated] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10620: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10620: - Assignee: Staffan Friberg > StringBuilder created and appended even if logging is disabled >

[jira] [Updated] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10650: -- Attachment: HDFS-10650.002.patch Patch 002: * Fix a regression in 001 > DFSClient#mkdirs and

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-19 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.011.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-19 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384955#comment-15384955 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Patch 011 fixes the two checkstyle issues and

[jira] [Commented] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-07-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384937#comment-15384937 ] Xiao Chen commented on HDFS-10225: -- Thank you for the work, Eddy. +1 pending jenkins. > DataNode hot

[jira] [Commented] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384940#comment-15384940 ] John Zhuge commented on HDFS-10650: --- Thanks [~xiaochen]. This jira came out of discussion

[jira] [Updated] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-07-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10225: - Attachment: HDFS-10225.003.patch Good catch, [~xiaochen] bq. Any reason not to put the newly

[jira] [Updated] (HDFS-10647) Add a link to HDFS disk balancer document in site.xml

2016-07-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10647: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1

[jira] [Updated] (HDFS-9852) hdfs dfs -setfacl error message is misleading

2016-07-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9852: Affects Version/s: (was: 3.0.0-alpha1) Fix Version/s: (was: 3.0.0-alpha1)

[jira] [Updated] (HDFS-10654) Move building of httpfs dependency analysis under "docs" profile

2016-07-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10654: --- Attachment: HDFS-10654.001.patch Fairly trivial patch attached. I checked "mvn clean package

[jira] [Updated] (HDFS-10654) Move building of httpfs dependency analysis under "docs" profile

2016-07-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10654: --- Status: Patch Available (was: Open) > Move building of httpfs dependency analysis under "docs"

[jira] [Created] (HDFS-10654) Move building of httpfs dependency analysis under "docs" profile

2016-07-19 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-10654: -- Summary: Move building of httpfs dependency analysis under "docs" profile Key: HDFS-10654 URL: https://issues.apache.org/jira/browse/HDFS-10654 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10647) Add a link to HDFS disk balancer document in site.xml

2016-07-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384911#comment-15384911 ] Akira Ajisaka commented on HDFS-10647: -- LGTM, +1. > Add a link to HDFS disk balancer document in

[jira] [Commented] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384879#comment-15384879 ] Xiao Chen commented on HDFS-10650: -- Thanks [~jzhuge] for creating the jira and providing a fix. I think

[jira] [Commented] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-07-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384858#comment-15384858 ] Xiao Chen commented on HDFS-10225: -- Thanks [~eddyxu] for the new rev. Nits: - Any reason not to put the

[jira] [Commented] (HDFS-10649) Remove unused PermissionStatus#applyUMask

2016-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384854#comment-15384854 ] Hadoop QA commented on HDFS-10649: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384841#comment-15384841 ] Yongjun Zhang commented on HDFS-10652: -- HI [~vinayrpet], The test needs the following code to throw

[jira] [Updated] (HDFS-10603) Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot

2016-07-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10603: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Status:

[jira] [Updated] (HDFS-10603) Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot

2016-07-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10603: - Hadoop Flags: Reviewed Summary: Fix flaky tests in

[jira] [Updated] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-07-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10225: - Attachment: HDFS-10225.002.patch Hi, [~cmccabe] and [~arpitagarwal] Thanks for the suggestions. I

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-07-19 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Attachment: HDFS-10637.002.patch Posting a new patch to work with the new patch of

[jira] [Updated] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10650: -- Status: Patch Available (was: Open) > DFSClient#mkdirs and DFSClient#primitiveMkdir should use default

[jira] [Updated] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10650: -- Attachment: HDFS-10650.001.patch > DFSClient#mkdirs and DFSClient#primitiveMkdir should use default

[jira] [Updated] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10650: -- Attachment: (was: HADOOP-13191.002.patch) > DFSClient#mkdirs and DFSClient#primitiveMkdir should

[jira] [Updated] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10650: -- Attachment: HADOOP-13191.002.patch Patch 001: * These 2 methods should use default dir permission

[jira] [Commented] (HDFS-10613) Wrong real size when a DSQuotaExceededException occur

2016-07-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384723#comment-15384723 ] Chen Liang commented on HDFS-10613: --- Hi Xiaohe, Some initial tests show that this is related to a

[jira] [Assigned] (HDFS-10613) Wrong real size when a DSQuotaExceededException occur

2016-07-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-10613: - Assignee: Chen Liang > Wrong real size when a DSQuotaExceededException occur >

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10651: --- Affects Version/s: 3.0.0-alpha1 > Clean up some configuration related codes about legacy block reader

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-19 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384611#comment-15384611 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- > For example, an RPC could have gotten

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-19 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384609#comment-15384609 ] Konstantin Shvachko commented on HDFS-10301: Hey [~redvine], # looks like checkstyle found

[jira] [Updated] (HDFS-10649) Remove unused PermissionStatus#applyUMask

2016-07-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10649: -- Status: Patch Available (was: Open) Attached a simple patch to fix it. Simply removed the applyUMask

[jira] [Updated] (HDFS-10649) Remove unused PermissionStatus#applyUMask

2016-07-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10649: -- Attachment: HDFS-10649.001.patch > Remove unused PermissionStatus#applyUMask >

[jira] [Commented] (HDFS-10627) Volume Scanner mark a block as "suspect" even if the block sender encounters 'Broken pipe' or 'Connection reset by peer' exception

2016-07-19 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384523#comment-15384523 ] Daryn Sharp commented on HDFS-10627: Adding a feedback mechanism would be very useful, but should be a

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384462#comment-15384462 ] Hadoop QA commented on HDFS-10653: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383695#comment-15383695 ] Yongjun Zhang edited comment on HDFS-10587 at 7/19/16 4:04 PM: --- Thanks

[jira] [Commented] (HDFS-10619) Cache path in InodesInPath

2016-07-19 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384231#comment-15384231 ] Daryn Sharp commented on HDFS-10619: [~linyiqun], sure. Trying to untangle intersecting patches to

[jira] [Updated] (HDFS-10653) Optimize conversion from path string to components

2016-07-19 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10653: --- Status: Patch Available (was: Open) > Optimize conversion from path string to components >

[jira] [Updated] (HDFS-10653) Optimize conversion from path string to components

2016-07-19 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10653: --- Attachment: HDFS-10653.patch > Optimize conversion from path string to components >

[jira] [Created] (HDFS-10653) Optimize conversion from path string to components

2016-07-19 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10653: -- Summary: Optimize conversion from path string to components Key: HDFS-10653 URL: https://issues.apache.org/jira/browse/HDFS-10653 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10645: -- Attachment: HDFS-10645.002.patch > Make block report size as a metric and add this metric to datanode

[jira] [Commented] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383806#comment-15383806 ] Hadoop QA commented on HDFS-10652: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383795#comment-15383795 ] Kai Zheng commented on HDFS-10651: -- Sure, please go ahead. > Clean up some configuration related codes

[jira] [Commented] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383790#comment-15383790 ] Youwei Wang commented on HDFS-10651: I have finished this patch and verified it using the utility

[jira] [Commented] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383784#comment-15383784 ] Kai Zheng commented on HDFS-10651: -- Yes, right. Thanks [~hayabusa]. > Clean up some configuration

[jira] [Commented] (HDFS-10633) DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md

2016-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383753#comment-15383753 ] Hadoop QA commented on HDFS-10633: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383716#comment-15383716 ] Yongjun Zhang commented on HDFS-10652: -- Thanks Vinay, yes, agreed, and would you please add comments

[jira] [Commented] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383695#comment-15383695 ] Yongjun Zhang commented on HDFS-10587: -- Thanks [~vinayrpet], you are really fast responding! and our

[jira] [Commented] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383692#comment-15383692 ] Yongjun Zhang commented on HDFS-10587: -- Hi [~xupener], Per [~vinayrpet]'s comment here:

[jira] [Commented] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-19 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383690#comment-15383690 ] Vinayakumar B commented on HDFS-10587: -- bq. I did an experiment by reverting HDFS-4660 etc, and found

[jira] [Assigned] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-19 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B reassigned HDFS-10652: Assignee: Vinayakumar B > Add a unit test for HDFS-4660 > - >

[jira] [Comment Edited] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383685#comment-15383685 ] Yongjun Zhang edited comment on HDFS-10587 at 7/19/16 7:03 AM: --- Hi

[jira] [Commented] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383685#comment-15383685 ] Yongjun Zhang commented on HDFS-10587: -- Hi [~vinayrpet], Thanks much again for creating the

[jira] [Commented] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-19 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383681#comment-15383681 ] Vinayakumar B commented on HDFS-10652: -- Thanks [~yzhangal]. test given earlier was not of commit

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Status: Patch Available (was: Open) > Add a unit test for HDFS-4660 >

[jira] [Commented] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383679#comment-15383679 ] Yongjun Zhang commented on HDFS-10652: -- Thanks [~vinayrpet] a lot for the help to create the testcase

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Attachment: HDFS-10652.001.patch > Add a unit test for HDFS-4660 > -

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Attachment: (was: HDFS-10587-test.patch) > Add a unit test for HDFS-4660 >

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Attachment: HDFS-10587-test.patch > Add a unit test for HDFS-4660 > -

[jira] [Created] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-19 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10652: Summary: Add a unit test for HDFS-4660 Key: HDFS-10652 URL: https://issues.apache.org/jira/browse/HDFS-10652 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10603) Flaky test org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot.testWithCheckpoint

2016-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383654#comment-15383654 ] Yongjun Zhang commented on HDFS-10603: -- Thanks for working on this [~linyiqun], nice catch! Thanks

[jira] [Updated] (HDFS-10633) DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md

2016-07-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10633: - Attachment: (was: HDFS-10633.003.patch) > DiskBalancer : Add the description for the new setting >

[jira] [Updated] (HDFS-10633) DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md

2016-07-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10633: - Attachment: HDFS-10633.003.patch > DiskBalancer : Add the description for the new setting >

[jira] [Comment Edited] (HDFS-10633) DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md

2016-07-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383530#comment-15383530 ] Yiqun Lin edited comment on HDFS-10633 at 7/19/16 6:07 AM: --- Thanks [~ajisakaa]