[jira] [Updated] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat and hdfs_chgrp

2016-08-18 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10754: - Attachment: HDFS-10754.HDFS-8707.003.patch Removed unneeded futures, improved readability. >

[jira] [Commented] (HDFS-10774) Reflective XSS and HTML injection vulnerability

2016-08-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426512#comment-15426512 ] Jason Lowe commented on HDFS-10774: --- Security issues can be mailed to secur...@hadoop.apache.org. See

[jira] [Commented] (HDFS-9599) TestDecommissioningStatus.testDecommissionStatus occasionally fails

2016-08-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427406#comment-15427406 ] Mingliang Liu commented on HDFS-9599: - The test is still failing sometimes. See

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, and hdfs_chmod

2016-08-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427322#comment-15427322 ] James Clampffer commented on HDFS-10754: Nice set of tools. If you happen to have perf

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-08-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427386#comment-15427386 ] Konstantin Shvachko commented on HDFS-10301: Hey [~cmccabe], I agree with you this jira is

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-08-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-8312: -- Attachment: (was: HDFS-8312-005.patch) > Trash does not descent into child directories to check for

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-08-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-8312: -- Attachment: HDFS-8312-005.patch > Trash does not descent into child directories to check for permissions

[jira] [Commented] (HDFS-10762) Pass IIP for file status related methods

2016-08-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427329#comment-15427329 ] Daryn Sharp commented on HDFS-10762: Test failures not related. > Pass IIP for file status related

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427201#comment-15427201 ] Daryn Sharp commented on HDFS-10763: +1 the combined patch looks good. it's better than it was before

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-08-18 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427349#comment-15427349 ] Lei (Eddy) Xu commented on HDFS-10636: -- Hi, [~virajith] Thanks a lot for update the patch and

[jira] [Updated] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10763: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed the patch to branch-2.7.

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-08-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427387#comment-15427387 ] Konstantin Shvachko commented on HDFS-10301: Took some time to look into heartbeat processing

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427188#comment-15427188 ] Kihwal Lee commented on HDFS-10763: --- The test passes reliably when run on my box. {noformat}

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-08-18 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427460#comment-15427460 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Thanks [~shv] for summarizing how zombies can

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-08-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427479#comment-15427479 ] Virajith Jalaparti commented on HDFS-10636: --- Hi [~eddyxu], bq. E.g., If you implement recovery

[jira] [Comment Edited] (HDFS-10778) Optimize the output result of FileDistribution processor in hdfs oiv command

2016-08-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427560#comment-15427560 ] Yiqun Lin edited comment on HDFS-10778 at 8/19/16 3:40 AM: --- Some test output

[jira] [Updated] (HDFS-10778) Optimize the output result of FileDistribution processor in hdfs oiv command

2016-08-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10778: - Description: Now It's not directly to understand the output result of the {{FileDistribution}} processor

[jira] [Updated] (HDFS-10778) Optimize the output result of FileDistribution processor in hdfs oiv command

2016-08-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10778: - Status: Patch Available (was: Open) > Optimize the output result of FileDistribution processor in hdfs

[jira] [Updated] (HDFS-10778) Optimize the output result of FileDistribution processor in hdfs oiv command

2016-08-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10778: - Attachment: HDFS-10778.001.patch > Optimize the output result of FileDistribution processor in hdfs oiv

[jira] [Commented] (HDFS-10776) Revisit Hdfs Audit Logging

2016-08-18 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427553#comment-15427553 ] Allen Wittenauer commented on HDFS-10776: - FWIW, I'm writing a blog post on the origins of the

[jira] [Comment Edited] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-08-18 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427658#comment-15427658 ] Jingcheng Du edited comment on HDFS-9668 at 8/19/16 5:44 AM: - Thanks

[jira] [Commented] (HDFS-10778) Optimize the output result of FileDistribution processor in hdfs oiv command

2016-08-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427560#comment-15427560 ] Yiqun Lin commented on HDFS-10778: -- Some test output result in my test cluster: {code} Size Range

[jira] [Commented] (HDFS-10778) Optimize the output result of FileDistribution processor in hdfs oiv command

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427638#comment-15427638 ] Hadoop QA commented on HDFS-10778: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-08-18 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427542#comment-15427542 ] Fenghua Hu commented on HDFS-9668: -- [~jingcheng...@intel.com], Thanks for the great work. I found you had

[jira] [Created] (HDFS-10778) Optimize the output result of FileDistribution processor in hdfs oiv command

2016-08-18 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-10778: Summary: Optimize the output result of FileDistribution processor in hdfs oiv command Key: HDFS-10778 URL: https://issues.apache.org/jira/browse/HDFS-10778 Project: Hadoop

[jira] [Commented] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427558#comment-15427558 ] Hadoop QA commented on HDFS-8312: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427627#comment-15427627 ] Hadoop QA commented on HDFS-8905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-08-18 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427658#comment-15427658 ] Jingcheng Du commented on HDFS-9668: Thanks [~fenghua_hu]. Think about the patches again carefully. I

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-18 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8905: Attachment: HDFS-8905-v10.patch Rebased the patch once more. > Refactor DFSInputStream#ReaderStrategy >

[jira] [Updated] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.2

2016-08-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-10692: -- Summary: Point JDiff base version for HDFS from 2.6.0 to 2.7.2 (was: Point JDiff base version for HDFS

[jira] [Updated] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.3

2016-08-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-10692: -- Attachment: HDFS-10692.2.patch Attached ver.2 patch, downgraded 2.7.3 to 2.7.2 since 2.7.3 is not

[jira] [Updated] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.2

2016-08-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-10692: -- Description: Now JDiff is pointed to 2.6.0, we need to upgrade it to the latest stable release (2.7.2)

[jira] [Commented] (HDFS-10778) Optimize the output result of FileDistribution processor in hdfs oiv command

2016-08-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427564#comment-15427564 ] Yiqun Lin commented on HDFS-10778: -- Softly ping [~ajisakaa], I think this is also a improvement for users

[jira] [Commented] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-08-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427646#comment-15427646 ] Weiwei Yang commented on HDFS-8312: --- Hello [~eyang] Can you help to review latest v5 patch? The test

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427286#comment-15427286 ] Kihwal Lee commented on HDFS-9395: -- [~vinodkv], I also reverted it from branch-2.7. > Make HDFS audit

[jira] [Commented] (HDFS-10772) Reduce byte/string conversions for get listing

2016-08-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427331#comment-15427331 ] Daryn Sharp commented on HDFS-10772: Test failure not related. No test because it's just an

[jira] [Created] (HDFS-10776) Revisit Hdfs Audit Logging

2016-08-18 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-10776: -- Summary: Revisit Hdfs Audit Logging Key: HDFS-10776 URL: https://issues.apache.org/jira/browse/HDFS-10776 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Updated] (HDFS-10776) Revisit Hdfs Audit Logging

2016-08-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10776: --- Description: HDFS audit logging is considered critical in many scenarios, but it hasn't been always

[jira] [Updated] (HDFS-10745) Directly resolve paths into INodesInPath

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10745: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426874#comment-15426874 ] Daryn Sharp commented on HDFS-10763: Minor comment is that the full path is being built twice. I'd

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426896#comment-15426896 ] Kihwal Lee commented on HDFS-10763: --- Ouch. I meant to reuse {{path}}, but apparently I didn't. > Open

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat and hdfs_chgrp

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426841#comment-15426841 ] Hadoop QA commented on HDFS-10754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

2016-08-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426866#comment-15426866 ] Kuhu Shukla commented on HDFS-9395: --- [~vinodkv], This bug fix was originally requested by our grid

[jira] [Assigned] (HDFS-10776) Revisit Hdfs Audit Logging

2016-08-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned HDFS-10776: -- Assignee: Kuhu Shukla > Revisit Hdfs Audit Logging > -- > >

[jira] [Commented] (HDFS-10711) Optimize FSPermissionChecker group membership check

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426889#comment-15426889 ] Kihwal Lee commented on HDFS-10711: --- Kicked the build > Optimize FSPermissionChecker group membership

[jira] [Updated] (HDFS-10776) Revisit Hdfs Audit Logging

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10776: -- Description: HDFS audit logging is considered critical in many scenarios, but it hasn't been always

[jira] [Updated] (HDFS-10762) Pass IIP for file status related methods

2016-08-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10762: --- Status: Patch Available (was: Open) > Pass IIP for file status related methods >

[jira] [Updated] (HDFS-10772) Reduce byte/string conversions for get listing

2016-08-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10772: --- Status: Patch Available (was: Open) pre-req now in > Reduce byte/string conversions for get listing

[jira] [Updated] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10763: -- Attachment: HDFS-10763.branch-2.7.v2.patch Reverted the original commit from branch-2.7. Attaching a

[jira] [Comment Edited] (HDFS-10776) Revisit Hdfs Audit Logging

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426946#comment-15426946 ] Kihwal Lee edited comment on HDFS-10776 at 8/18/16 6:22 PM: Regarding bq.1)

[jira] [Commented] (HDFS-10776) Revisit Hdfs Audit Logging

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426946#comment-15426946 ] Kihwal Lee commented on HDFS-10776: --- Regarding bq.1) What is the correct way of doing the hdfs audit

[jira] [Updated] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-18 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10679: - Attachment: HDFS-10679.HDFS-8707.012.patch Fixed locked sections. > libhdfs++: Implement

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-08-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-8312: -- Attachment: HDFS-8312-005.patch > Trash does not descent into child directories to check for permissions

[jira] [Commented] (HDFS-10605) Can not synchronized call method of object and Mockito.spy(object), So UT:testRemoveVolumeBeingWritten passed but maybe deadlock online

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426073#comment-15426073 ] Hadoop QA commented on HDFS-10605: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10605) Can not synchronized call method of object and Mockito.spy(object), So UT:testRemoveVolumeBeingWritten passed but maybe deadlock online

2016-08-18 Thread ade (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ade updated HDFS-10605: --- Status: Patch Available (was: Open) > Can not synchronized call method of object and Mockito.spy(object), So >

[jira] [Created] (HDFS-10775) Under-Replicated Blocks can not be recovered

2016-08-18 Thread Eisuke Umeda (JIRA)
Eisuke Umeda created HDFS-10775: --- Summary: Under-Replicated Blocks can not be recovered Key: HDFS-10775 URL: https://issues.apache.org/jira/browse/HDFS-10775 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10605) Can not synchronized call method of object and Mockito.spy(object), So UT:testRemoveVolumeBeingWritten passed but maybe deadlock online

2016-08-18 Thread ade (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ade updated HDFS-10605: --- Priority: Minor (was: Major) > Can not synchronized call method of object and Mockito.spy(object), So >

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-08-18 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-3.patch Upload a new patch V3. Sorry for the late updates. This patch is much

[jira] [Commented] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2016-08-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426044#comment-15426044 ] Andrew Wang commented on HDFS-10702: Hi Jiayi, thanks for working on this. I didn't get through all of

[jira] [Commented] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425958#comment-15425958 ] Hadoop QA commented on HDFS-8312: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10605) Can not synchronized call method of object and Mockito.spy(object), So UT:testRemoveVolumeBeingWritten passed but maybe deadlock online

2016-08-18 Thread ade (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ade updated HDFS-10605: --- Attachment: TestDataNodeHotSwapVolumes.java.patch > Can not synchronized call method of object and

[jira] [Updated] (HDFS-10605) Can not synchronized call method of object and Mockito.spy(object), So UT:testRemoveVolumeBeingWritten passed but maybe deadlock online

2016-08-18 Thread ade (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ade updated HDFS-10605: --- Description: The UT: TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten can be ran successful, but deadlock

[jira] [Commented] (HDFS-10340) data node sudden killed

2016-08-18 Thread KWON BYUNGCHANG (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426325#comment-15426325 ] KWON BYUNGCHANG commented on HDFS-10340: [~kihwal] OOM Killer use SIGKILL. does not use SIGTERM.

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426472#comment-15426472 ] Kihwal Lee commented on HDFS-10763: --- Going through the test failures. {{TestRenameWithSnapshots}}

[jira] [Commented] (HDFS-10774) Reflective XSS and HTML injection vulnerability

2016-08-18 Thread Will Harmon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426608#comment-15426608 ] Will Harmon commented on HDFS-10774: Jason, Thanks very much for your reply. I emailed them on August

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426578#comment-15426578 ] Kihwal Lee commented on HDFS-10763: --- Other tests run fine, except {{TestDataNodeVolumeFailure}}. But it

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-08-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-8312: -- Status: In Progress (was: Patch Available) > Trash does not descent into child directories to check for

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-08-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-8312: -- Status: Patch Available (was: In Progress) > Trash does not descent into child directories to check for

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat and hdfs_chgrp

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1542#comment-1542 ] Hadoop QA commented on HDFS-10754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-08-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426693#comment-15426693 ] Kihwal Lee commented on HDFS-10745: --- The branch-2 patch looks good. > Directly resolve paths into

[jira] [Updated] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat and hdfs_chgrp

2016-08-18 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10754: - Attachment: HDFS-10754.HDFS-8707.004.patch Improvements to the user code. > libhdfs++: Create

[jira] [Updated] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, and hdfs_chown

2016-08-18 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10754: - Attachment: HDFS-10754.HDFS-8707.005.patch Implemented hdfs_chown. > libhdfs++: Create tools

[jira] [Updated] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, and hdfs_chown

2016-08-18 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10754: - Summary: libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, and hdfs_chown

[jira] [Commented] (HDFS-10772) Reduce byte/string conversions for get listing

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427017#comment-15427017 ] Hadoop QA commented on HDFS-10772: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10711) Optimize FSPermissionChecker group membership check

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426995#comment-15426995 ] Hadoop QA commented on HDFS-10711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427018#comment-15427018 ] Hadoop QA commented on HDFS-10679: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, and hdfs_chmod

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427115#comment-15427115 ] Hadoop QA commented on HDFS-10754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10777) DataNode should report volume failures if DU cannot access files

2016-08-18 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10777: -- Summary: DataNode should report volume failures if DU cannot access files Key: HDFS-10777 URL: https://issues.apache.org/jira/browse/HDFS-10777 Project: Hadoop

[jira] [Commented] (HDFS-10761) libhdfs++: Fix broken logic in HA retry policy

2016-08-18 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427127#comment-15427127 ] Anatoli Shein commented on HDFS-10761: -- [~James C], the patch looks good to me. (y) +1 > libhdfs++:

[jira] [Updated] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.3

2016-08-18 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-10692: --- Target Version/s: 2.8.0, 3.0.0-alpha1 (was: 3.0.0-alpha1) Let's get this

[jira] [Commented] (HDFS-10692) Point JDiff base version for HDFS from 2.6.0 to 2.7.3

2016-08-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427160#comment-15427160 ] Wangda Tan commented on HDFS-10692: --- This needs some common fixes of HADOOP-13428, added link. > Point

[jira] [Updated] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, and hdfs_chown

2016-08-18 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10754: - Attachment: HDFS-10754.HDFS-8707.006.patch Added hdfs_chmod. > libhdfs++: Create tools directory

[jira] [Commented] (HDFS-10762) Pass IIP for file status related methods

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427042#comment-15427042 ] Hadoop QA commented on HDFS-10762: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, and hdfs_chmod

2016-08-18 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10754: - Summary: libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, and

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427076#comment-15427076 ] Hadoop QA commented on HDFS-10763: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||