[jira] [Commented] (HDFS-5395) write(ByteBuffer) method

2016-08-23 Thread Mai H. Dinh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434298#comment-15434298 ] Mai H. Dinh commented on HDFS-5395: --- Is there any related issues to this issue? Why there

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

2016-08-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434210#comment-15434210 ] Xiao Chen commented on HDFS-8986: - Thanks [~jojochuang] for triggering a new run! - Checks

[jira] [Commented] (HDFS-10340) data node sudden killed

2016-08-23 Thread KWON BYUNGCHANG (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434106#comment-15434106 ] KWON BYUNGCHANG commented on HDFS-10340: Yes. my cluster was configured same user

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434097#comment-15434097 ] Hadoop QA commented on HDFS-10742: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434094#comment-15434094 ] Xiaoyu Yao commented on HDFS-10690: --- I mean the LinkedMap patch should just work without

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434085#comment-15434085 ] Hadoop QA commented on HDFS-10742: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-08-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9781: Assignee: Manoj Govindassamy (was: Xiao Chen) > FsDatasetImpl#getBlockReports can occasionally throw NullPoi

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434078#comment-15434078 ] Arpit Agarwal commented on HDFS-10742: -- bq. On a related note, the virtues of AutoClo

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434077#comment-15434077 ] Fenghua Hu commented on HDFS-10690: --- I got you. I'll run YCSB. Regarding the patch, wha

[jira] [Commented] (HDFS-10706) Add tool generating FSImage from external store

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434047#comment-15434047 ] Hadoop QA commented on HDFS-10706: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-10780) Block replication not happening on removing a volume when data being written to a datanode -- TestDataNodeHotSwapVolumes fails

2016-08-23 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433995#comment-15433995 ] Manoj Govindassamy edited comment on HDFS-10780 at 8/24/16 1:14 AM:

[jira] [Commented] (HDFS-10780) Block replication not happening on removing a volume when data being written to a datanode -- TestDataNodeHotSwapVolumes fails

2016-08-23 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433995#comment-15433995 ] Manoj Govindassamy commented on HDFS-10780: --- *Summary:* -- I can see an issue

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433988#comment-15433988 ] Xiaoyu Yao commented on HDFS-10690: --- bq. I'll write a micro benchmark to compare Linked

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433987#comment-15433987 ] Chen Liang commented on HDFS-10742: --- Thanks for the catch [~chris.douglas]! Updated a pa

[jira] [Updated] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10742: -- Attachment: HDFS-10742.004.patch > Measurement of lock held time in FsDatasetImpl >

[jira] [Updated] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10742: -- Attachment: (was: HDFS-10742.004.patch) > Measurement of lock held time in FsDatasetImpl > -

[jira] [Updated] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10742: -- Attachment: HDFS-10742.004.patch > Measurement of lock held time in FsDatasetImpl >

[jira] [Commented] (HDFS-10783) The option '-maxSize' and '-step' fail in OfflineImageViewer

2016-08-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433957#comment-15433957 ] Yiqun Lin commented on HDFS-10783: -- Thanks a lot for the commit! > The option '-maxSize'

[jira] [Comment Edited] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

2016-08-23 Thread Jeff Field (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433950#comment-15433950 ] Jeff Field edited comment on HDFS-10788 at 8/24/16 12:40 AM: -

[jira] [Commented] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

2016-08-23 Thread Jeff Field (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433950#comment-15433950 ] Jeff Field commented on HDFS-10788: --- For anyone that does encounter the problem, once yo

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-08-23 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433922#comment-15433922 ] Yuanbo Liu commented on HDFS-10756: --- [~jojochuang] and [~xiaochen] Thanks a lot for your

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433918#comment-15433918 ] Fenghua Hu commented on HDFS-10690: --- [~xyao], thanks for your comments. I'll write a mic

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-08-23 Thread Joe Pallas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433904#comment-15433904 ] Joe Pallas commented on HDFS-10636: --- Possibly the only requirement to subclass {{Finaliz

[jira] [Comment Edited] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433853#comment-15433853 ] Chris Douglas edited comment on HDFS-10742 at 8/23/16 11:28 PM:

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433853#comment-15433853 ] Chris Douglas commented on HDFS-10742: -- * Is this the intended {{ConcurrentHashMap}}

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

2016-08-23 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433785#comment-15433785 ] Chris Trezzo commented on HDFS-9696: [~kihwal] Do you think this is worth backporting t

[jira] [Updated] (HDFS-10706) Add tool generating FSImage from external store

2016-08-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-10706: - Attachment: HDFS-10706-HDFS-9806.002.patch Sorry for the confusion; the HDFS-9806 branch is just a

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-23 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433751#comment-15433751 ] Chris Trezzo commented on HDFS-10763: - [~kihwal] do you think this is worth backportin

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-08-23 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433727#comment-15433727 ] Virajith Jalaparti commented on HDFS-10636: --- Hi [~eddyxu], bq. I know vendors

[jira] [Commented] (HDFS-9539) libhdfs++: enable default configuration files

2016-08-23 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433674#comment-15433674 ] Anatoli Shein commented on HDFS-9539: - The scope of this jira will include updating all

[jira] [Commented] (HDFS-10762) Pass IIP for file status related methods

2016-08-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433628#comment-15433628 ] Kihwal Lee commented on HDFS-10762: --- +1 > Pass IIP for file status related methods > --

[jira] [Updated] (HDFS-10789) Route webhdfs through the RPC call queue

2016-08-23 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10789: --- Attachment: HDFS-10789.patch > Route webhdfs through the RPC call queue >

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-23 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433618#comment-15433618 ] churro morales commented on HDFS-10608: --- looked over tests that failed this time aro

[jira] [Created] (HDFS-10789) Route webhdfs through the RPC call queue

2016-08-23 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10789: -- Summary: Route webhdfs through the RPC call queue Key: HDFS-10789 URL: https://issues.apache.org/jira/browse/HDFS-10789 Project: Hadoop HDFS Issue Type: Improvem

[jira] [Updated] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

2016-08-23 Thread Jeff Field (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Field updated HDFS-10788: -- Environment: CDH5.5.2, CentOS 6.7 (was: 2.6.0-cdh5.5.2 is the HDFS version from the CDH build this clus

[jira] [Created] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

2016-08-23 Thread Jeff Field (JIRA)
Jeff Field created HDFS-10788: - Summary: fsck NullPointerException when it encounters corrupt replicas Key: HDFS-10788 URL: https://issues.apache.org/jira/browse/HDFS-10788 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433558#comment-15433558 ] Andrew Wang commented on HDFS-10784: Good find Brahma, somehow I forgot about that one

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433550#comment-15433550 ] Hadoop QA commented on HDFS-8986: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433542#comment-15433542 ] Hadoop QA commented on HDFS-10608: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-9392) Admins support for maintenance state

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1542#comment-1542 ] Hadoop QA commented on HDFS-9392: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-23 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] churro morales updated HDFS-10608: -- Status: Open (was: Patch Available) > Include event for AddBlock in Inotify Event Stream >

[jira] [Updated] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-23 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] churro morales updated HDFS-10608: -- Status: Patch Available (was: Open) > Include event for AddBlock in Inotify Event Stream >

[jira] [Updated] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-23 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] churro morales updated HDFS-10608: -- Attachment: HDFS-10608.v3.patch > Include event for AddBlock in Inotify Event Stream > -

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-23 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433319#comment-15433319 ] churro morales commented on HDFS-10608: --- TestDataNodeLifeline and TestDataNodeHotSwa

[jira] [Commented] (HDFS-6804) race condition between transferring block and appending block causes "Unexpected checksum mismatch exception"

2016-08-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433292#comment-15433292 ] Yongjun Zhang commented on HDFS-6804: - Thanks for working on [~jojochuang]. For HDFS-1

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433269#comment-15433269 ] Xiaoyu Yao commented on HDFS-10690: --- [~fenghua_hu], I understand the tradeoff between me

[jira] [Comment Edited] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433269#comment-15433269 ] Xiaoyu Yao edited comment on HDFS-10690 at 8/23/16 5:40 PM: [~

[jira] [Commented] (HDFS-6804) race condition between transferring block and appending block causes "Unexpected checksum mismatch exception"

2016-08-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433239#comment-15433239 ] Wei-Chiu Chuang commented on HDFS-6804: --- I have been working on this for quite some t

[jira] [Commented] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-08-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433238#comment-15433238 ] John Zhuge commented on HDFS-10650: --- Done, [~rchiang] and [~xiaochen]. > DFSClient#mkdi

[jira] [Updated] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-08-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10650: -- Release Note: If the caller does not supply a permission, DFSClient#mkdirs and DFSClient#primitiveMkdir

[jira] [Updated] (HDFS-9392) Admins support for maintenance state

2016-08-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9392: -- Attachment: HDFS-9392-4.patch New patch with additional checkstyle fixes. > Admins support for maintenance state

[jira] [Comment Edited] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433142#comment-15433142 ] Fenghua Hu edited comment on HDFS-10690 at 8/23/16 4:43 PM: I

[jira] [Comment Edited] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433142#comment-15433142 ] Fenghua Hu edited comment on HDFS-10690 at 8/23/16 4:41 PM: I

[jira] [Comment Edited] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433142#comment-15433142 ] Fenghua Hu edited comment on HDFS-10690 at 8/23/16 4:38 PM: I

[jira] [Updated] (HDFS-10786) Erasure Coding: Add removeErasureCodingPolicy API

2016-08-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10786: - Labels: hdfs-ec-3.0-must-do (was: ) > Erasure Coding: Add removeErasureCodingPolicy API > ---

[jira] [Comment Edited] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433142#comment-15433142 ] Fenghua Hu edited comment on HDFS-10690 at 8/23/16 4:32 PM: I

[jira] [Comment Edited] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433142#comment-15433142 ] Fenghua Hu edited comment on HDFS-10690 at 8/23/16 4:30 PM: I

[jira] [Commented] (HDFS-10781) libhdfs++: redefine NN timeout to be "time without a response"

2016-08-23 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433143#comment-15433143 ] Anatoli Shein commented on HDFS-10781: -- Current hack that we are using in the code is

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-23 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433142#comment-15433142 ] Fenghua Hu commented on HDFS-10690: --- I would like to explain the solution here. Current

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433115#comment-15433115 ] Hadoop QA commented on HDFS-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9745) TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts

2016-08-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433048#comment-15433048 ] Xiao Chen commented on HDFS-9745: - Woot. Thanks [~jlowe]! > TestSecureNNWithQJM#testSecure

[jira] [Created] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API

2016-08-23 Thread Anatoli Shein (JIRA)
Anatoli Shein created HDFS-10787: Summary: libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API Key: HDFS-10787 URL: https://issues.apache.org/jira/browse/HDFS-10787

[jira] [Updated] (HDFS-10786) Erasure Coding: Add removeErasureCodingPolicy API

2016-08-23 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-10786: --- Description: HDFS-7859 has developed addErasureCodingPolicy API to add some user-added Erasure Coding

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-08-23 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432993#comment-15432993 ] Xinwei Qin commented on HDFS-7859: --- Hi, [~zhz], Have updated the patch with your comme

[jira] [Created] (HDFS-10786) Erasure Coding: Add removeErasureCodingPolicy API

2016-08-23 Thread Xinwei Qin (JIRA)
Xinwei Qin created HDFS-10786: -- Summary: Erasure Coding: Add removeErasureCodingPolicy API Key: HDFS-10786 URL: https://issues.apache.org/jira/browse/HDFS-10786 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10762) Pass IIP for file status related methods

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432976#comment-15432976 ] Hadoop QA commented on HDFS-10762: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-9745) TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts

2016-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-9745: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.4 2.8.0

[jira] [Commented] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-23 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432974#comment-15432974 ] Bob Hansen commented on HDFS-10679: --- [~anatoli.shein]: this looks very usesful. I like

[jira] [Commented] (HDFS-9745) TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts

2016-08-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432964#comment-15432964 ] Hudson commented on HDFS-9745: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1032

[jira] [Commented] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432949#comment-15432949 ] Wei-Chiu Chuang commented on HDFS-8224: --- Committed this to 2.7. Branch 2.6 uses the o

[jira] [Commented] (HDFS-9745) TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432939#comment-15432939 ] Hadoop QA commented on HDFS-9745: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432937#comment-15432937 ] Hadoop QA commented on HDFS-8986: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-08-23 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-7859: -- Attachment: HDFS-7859.007.patch > Erasure Coding: Persist erasure coding policies in NameNode > -

[jira] [Commented] (HDFS-9745) TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts

2016-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432932#comment-15432932 ] Jason Lowe commented on HDFS-9745: -- Seeing occasional timeouts for this test as well. +1

[jira] [Commented] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432919#comment-15432919 ] Hadoop QA commented on HDFS-10679: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

2016-08-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8986: Attachment: HDFS-8986.branch-2.patch Thanks Wei-Chiu. HADOOP-11666 reverted an incompatible change, which ca

[jira] [Updated] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8224: -- Fix Version/s: 2.7.4 > Schedule a block for scanning if its metadata file is corrupt > --

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, and hdfs_chmod

2016-08-23 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432872#comment-15432872 ] Bob Hansen commented on HDFS-10754: --- One more thing... Should we add a logger to the to

[jira] [Commented] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432866#comment-15432866 ] Hadoop QA commented on HDFS-10719: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, and hdfs_chmod

2016-08-23 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432868#comment-15432868 ] Bob Hansen commented on HDFS-10754: --- This is lots of good work, [~anatoli.shein]. I hav

[jira] [Commented] (HDFS-10340) data node sudden killed

2016-08-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432830#comment-15432830 ] Kihwal Lee commented on HDFS-10340: --- I checked the oom killer code and it is SIGKILL as

[jira] [Created] (HDFS-10785) libhdfs++: Implement the rest of the tools

2016-08-23 Thread Anatoli Shein (JIRA)
Anatoli Shein created HDFS-10785: Summary: libhdfs++: Implement the rest of the tools Key: HDFS-10785 URL: https://issues.apache.org/jira/browse/HDFS-10785 Project: Hadoop HDFS Issue Type: Su

[jira] [Assigned] (HDFS-10785) libhdfs++: Implement the rest of the tools

2016-08-23 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein reassigned HDFS-10785: Assignee: Anatoli Shein > libhdfs++: Implement the rest of the tools >

[jira] [Comment Edited] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, and hdfs_chmod

2016-08-23 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431644#comment-15431644 ] Anatoli Shein edited comment on HDFS-10754 at 8/23/16 1:48 PM: -

[jira] [Updated] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-23 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10679: - Attachment: HDFS-10679.HDFS-8707.013.patch Separated recursive state, fixed config loader, change

[jira] [Updated] (HDFS-10762) Pass IIP for file status related methods

2016-08-23 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10762: --- Attachment: HDFS-10762.1.patch Undid loss of one of my prior changes. Patch now applies to both branc

[jira] [Commented] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-08-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432759#comment-15432759 ] Xiao Chen commented on HDFS-10650: -- Thanks Ray for the reminder. [~jzhuge], could you Ed

[jira] [Commented] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-23 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432716#comment-15432716 ] Karthik Palanisamy commented on HDFS-10719: --- I simplify the fix here by throwing

[jira] [Updated] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-23 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HDFS-10719: -- Attachment: HDFS-10719-4.patch > In HA, Namenode is failed to start If any of the Quorum

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

2016-08-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432658#comment-15432658 ] Wei-Chiu Chuang commented on HDFS-8986: --- Committed this to trunk. But the patch has a

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

2016-08-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432648#comment-15432648 ] Hudson commented on HDFS-8986: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1032

[jira] [Commented] (HDFS-10783) The option '-maxSize' and '-step' fail in OfflineImageViewer

2016-08-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432629#comment-15432629 ] Hudson commented on HDFS-10783: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

2016-08-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432621#comment-15432621 ] Wei-Chiu Chuang commented on HDFS-8986: --- +1 committing this. > Add option to -du to

[jira] [Updated] (HDFS-10783) The option '-maxSize' and '-step' fail in OfflineImageViewer

2016-08-23 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10783: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10783) The option '-maxSize' and '-step' fail in OfflineImageViewer

2016-08-23 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432612#comment-15432612 ] Akira Ajisaka commented on HDFS-10783: -- +1, checking this in. > The option '-maxSize

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-08-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432606#comment-15432606 ] Wei-Chiu Chuang commented on HDFS-10756: Hello [~yuanbo], nice work! On top of Xia

[jira] [Commented] (HDFS-10783) The option '-maxSize' and '-step' fail in OfflineImageViewer

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432479#comment-15432479 ] Hadoop QA commented on HDFS-10783: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-9785) Remove unused TrashPolicy#getInstance and initiate code

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432446#comment-15432446 ] Hadoop QA commented on HDFS-9785: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (HDFS-9785) Remove unused TrashPolicy#getInstance and initiate code

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432434#comment-15432434 ] Hadoop QA commented on HDFS-9785: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (HDFS-9785) Remove unused TrashPolicy#getInstance and initiate code

2016-08-23 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-9785: Target Version/s: (was: ) Labels: (was: incompatibleChange) Hadoop Flags: In

  1   2   >