[jira] [Commented] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415567#comment-15415567 ] Hadoop QA commented on HDFS-10679: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10711) Optimize FSPermissionChecker group membership check

2016-08-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10711: --- Status: Patch Available (was: Open) > Optimize FSPermissionChecker group membership check >

[jira] [Updated] (HDFS-10744) Internally optimize path component resolution

2016-08-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10744: --- Attachment: HDFS-10744.patch > Internally optimize path component resolution >

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415455#comment-15415455 ] Hadoop QA commented on HDFS-8668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415504#comment-15415504 ] Hadoop QA commented on HDFS-10679: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10743) MiniDFSCluster test runtimes can be drastically reduce

2016-08-10 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10743: -- Summary: MiniDFSCluster test runtimes can be drastically reduce Key: HDFS-10743 URL: https://issues.apache.org/jira/browse/HDFS-10743 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9271) Implement basic NN operations

2016-08-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9271: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Implement basic NN

[jira] [Commented] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415633#comment-15415633 ] Hadoop QA commented on HDFS-8224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10690: -- Attachment: ShortCircuitCache_LinkedMap.patch > Optimize insertion/removal of replica in

[jira] [Commented] (HDFS-10743) MiniDFSCluster test runtimes can be drastically reduce

2016-08-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415565#comment-15415565 ] Daryn Sharp commented on HDFS-10743: Don't have the bandwidth to handle ensuring all test cases

[jira] [Commented] (HDFS-9271) Implement basic NN operations

2016-08-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415581#comment-15415581 ] James Clampffer commented on HDFS-9271: --- Awesome! Thanks for this, it pretty much completes the the

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-10 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415608#comment-15415608 ] churro morales commented on HDFS-10608: --- Hi [~surendrasingh] , thanks for the review. Good catch

[jira] [Updated] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-10 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10679: - Attachment: HDFS-10679.HDFS-8707.008.patch Changed unique_ptr & to shared_ptr. > libhdfs++:

[jira] [Assigned] (HDFS-10743) MiniDFSCluster test runtimes can be drastically reduce

2016-08-10 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned HDFS-10743: -- Assignee: Kuhu Shukla > MiniDFSCluster test runtimes can be drastically reduce >

[jira] [Updated] (HDFS-10744) Internally optimize path component resolution

2016-08-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10744: --- Status: Patch Available (was: Open) > Internally optimize path component resolution >

[jira] [Commented] (HDFS-10740) libhdfs++: Implement recursive directory generator

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415524#comment-15415524 ] Hadoop QA commented on HDFS-10740: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10744) Internally optimize path component resolution

2016-08-10 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10744: -- Summary: Internally optimize path component resolution Key: HDFS-10744 URL: https://issues.apache.org/jira/browse/HDFS-10744 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415563#comment-15415563 ] Xiaoyu Yao commented on HDFS-10690: --- bq. I tried to replace TreeMap with linkedHashMap, but found

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415586#comment-15415586 ] Hadoop QA commented on HDFS-10690: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415616#comment-15415616 ] Rakesh R commented on HDFS-10584: - Thanks [~zhz] for the review comments. bq. Should the successful

[jira] [Created] (HDFS-10745) Directly resolve paths into INodesInPath

2016-08-10 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10745: -- Summary: Directly resolve paths into INodesInPath Key: HDFS-10745 URL: https://issues.apache.org/jira/browse/HDFS-10745 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-10 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8668: Attachment: HDFS-8668-v6.patch > Erasure Coding: revisit buffer used for encoding and decoding. >

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415281#comment-15415281 ] Zhe Zhang commented on HDFS-8901: - I'm catching up on the history of this JIRA. [~drankye] Back to

[jira] [Updated] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Attachment: HDFS-8224-branch-2.patch Attaching a branch-2 patch. Same as trunk. Just fixed one

[jira] [Updated] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-10 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10679: - Attachment: HDFS-10679.HDFS-8707.007.patch Optional dereferencing fixed. > libhdfs++: Implement

[jira] [Commented] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415211#comment-15415211 ] Zhe Zhang commented on HDFS-10584: -- Sorry about the delay. The main patch LGTM. A few comments on the

[jira] [Commented] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-08-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415235#comment-15415235 ] Zhe Zhang commented on HDFS-10673: -- Sorry for responding late. I was on vacation. Thanks Daryn and

[jira] [Commented] (HDFS-10740) libhdfs++: Implement recursive directory generator

2016-08-10 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415427#comment-15415427 ] Anatoli Shein commented on HDFS-10740: -- Thanks for the review, [~James C]. I have addressed your

[jira] [Updated] (HDFS-10740) libhdfs++: Implement recursive directory generator

2016-08-10 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10740: - Attachment: HDFS-10740.HDFS-8707.001.patch New patch attached. > libhdfs++: Implement recursive

[jira] [Updated] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-10 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10679: - Attachment: HDFS-10679.HDFS-8707.006.patch Fixed unit test failure + minor changes. Please

[jira] [Commented] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415335#comment-15415335 ] Rushabh S Shah commented on HDFS-8224: -- [~jojochuang]: Thanks a lot for the reviews and committing. >

[jira] [Commented] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415404#comment-15415404 ] Hadoop QA commented on HDFS-10679: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10706) Add tool generating FSImage from external store

2016-08-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415226#comment-15415226 ] Zhe Zhang commented on HDFS-10706: -- Looks like the patch should be named something like

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-10 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415276#comment-15415276 ] SammiChen commented on HDFS-8668: - 1. fix checkstyle 2. allocate direct ByteBuffer for checksumBuf per

[jira] [Commented] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416341#comment-15416341 ] Hadoop QA commented on HDFS-8897: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10549) Memory leak if exception happens when closing files being written

2016-08-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416265#comment-15416265 ] Xiao Chen commented on HDFS-10549: -- Thanks [~linyiqun] for working on this. Looking at your comment on

[jira] [Commented] (HDFS-9530) ReservedSpace is not cleared for abandoned Blocks

2016-08-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416285#comment-15416285 ] Brahma Reddy Battula commented on HDFS-9530: yes,Seems to be some docker dependcies

[jira] [Updated] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10584: Attachment: HDFS-10584-03.patch Attached another patch fixing whitespace warning. > Allow long-running

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-08-10 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416357#comment-15416357 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- [~daryn] That is a good suggestion. Zombies

[jira] [Commented] (HDFS-9804) Allow long-running Balancer to login with keytab

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416287#comment-15416287 ] Hadoop QA commented on HDFS-9804: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9530) ReservedSpace is not cleared for abandoned Blocks

2016-08-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416294#comment-15416294 ] Allen Wittenauer commented on HDFS-9530: It's branch-2.6. You'll need to ping someone who cares

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-10 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416326#comment-15416326 ] Fenghua Hu commented on HDFS-10690: --- Xiaoyu, [~xyao]Thanks for the suggestion. I'll test the patch once

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682-branch-2.004.patch > Replace FsDatasetImpl object lock with a separate lock

[jira] [Commented] (HDFS-10694) BlockManager.processReport() should print blockReportId in each log message.

2016-08-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415714#comment-15415714 ] Hudson commented on HDFS-10694: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10253 (See

[jira] [Created] (HDFS-10746) libhdfs++: synchronize access to working_directory and bytes_read_.

2016-08-10 Thread Anatoli Shein (JIRA)
Anatoli Shein created HDFS-10746: Summary: libhdfs++: synchronize access to working_directory and bytes_read_. Key: HDFS-10746 URL: https://issues.apache.org/jira/browse/HDFS-10746 Project: Hadoop

[jira] [Updated] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8224: -- Resolution: Fixed Fix Version/s: 2.9.0 2.8.0 Status:

[jira] [Commented] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415772#comment-15415772 ] Wei-Chiu Chuang commented on HDFS-10560: Any updates? I think we are ok to check this in trunk.

[jira] [Commented] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415782#comment-15415782 ] Rushabh S Shah commented on HDFS-8224: -- Do we want it to commit it to 2.7.4 ? > Schedule a block for

[jira] [Updated] (HDFS-10694) BlockManager.processReport() should print blockReportId in each log message.

2016-08-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10694: --- Resolution: Fixed Fix Version/s: 2.7.4 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-10740) libhdfs++: Implement recursive directory generator

2016-08-10 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415778#comment-15415778 ] Anatoli Shein commented on HDFS-10740: -- Thanks for the review, [~James C]. Actually, I don't think

[jira] [Commented] (HDFS-10711) Optimize FSPermissionChecker group membership check

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415795#comment-15415795 ] Hadoop QA commented on HDFS-10711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: Patch Available (was: In Progress) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: In Progress (was: Patch Available) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Updated] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10584: Attachment: HDFS-10584-02.patch > Allow long-running Mover tool to login with keytab >

[jira] [Commented] (HDFS-9271) Implement basic NN operations

2016-08-10 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415748#comment-15415748 ] Anatoli Shein commented on HDFS-9271: - Thank you [~James C]. I created a new jira to address the

[jira] [Assigned] (HDFS-10746) libhdfs++: synchronize access to working_directory and bytes_read_.

2016-08-10 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein reassigned HDFS-10746: Assignee: Anatoli Shein > libhdfs++: synchronize access to working_directory and

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415849#comment-15415849 ] Rushabh S Shah commented on HDFS-10625: --- [~vinayrpet]: Can you please review the latest patch. I

[jira] [Commented] (HDFS-10740) libhdfs++: Implement recursive directory generator

2016-08-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415660#comment-15415660 ] James Clampffer commented on HDFS-10740: Thanks for updating the patch [~anatoli.shein]. Not sure

[jira] [Updated] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10625: -- Status: Open (was: Patch Available) Cancelling the patch to address the checkstyle issues. >

[jira] [Updated] (HDFS-10747) o.a.h.hdfs.tools.DebugAdmin usage message is misleading

2016-08-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10747: - Attachment: HDFS-10747.000.patch > o.a.h.hdfs.tools.DebugAdmin usage message is misleading >

[jira] [Updated] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10625: -- Attachment: HDFS-10625.005.patch Attaching a new patch. Just addressed the checkstyle warning.

[jira] [Commented] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415894#comment-15415894 ] Hadoop QA commented on HDFS-10584: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10625: -- Target Version/s: 2.7.4 Status: Patch Available (was: Open) > VolumeScanner to

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415908#comment-15415908 ] Hadoop QA commented on HDFS-10682: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10747) o.a.h.hdfs.tools.DebugAdmin usage message is misleading

2016-08-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10747: - Affects Version/s: 2.7.0 Status: Patch Available (was: Open) Ping [~cmccabe] and

[jira] [Comment Edited] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415849#comment-15415849 ] Rushabh S Shah edited comment on HDFS-10625 at 8/10/16 7:45 PM:

[jira] [Created] (HDFS-10747) o.a.h.hdfs.tools.DebugAdmin usage message is misleading

2016-08-10 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10747: Summary: o.a.h.hdfs.tools.DebugAdmin usage message is misleading Key: HDFS-10747 URL: https://issues.apache.org/jira/browse/HDFS-10747 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10737) disk balance reporter print null for the volume's path

2016-08-10 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10737: -- Description: reproduction steps: 1. hdfs diskbalancer -plan xxx.xx(host name of datanode) 2. If plan

[jira] [Commented] (HDFS-10643) HDFS namenode should always use service user (hdfs) to generateEncryptedKey

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416018#comment-15416018 ] Hadoop QA commented on HDFS-10643: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416029#comment-15416029 ] Hadoop QA commented on HDFS-10625: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-08-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10659: -- Attachment: HDFS-10659.001.patch > Namenode crashes after Journalnode re-installation in an HA

[jira] [Commented] (HDFS-10747) o.a.h.hdfs.tools.DebugAdmin usage message is misleading

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416059#comment-15416059 ] Hadoop QA commented on HDFS-10747: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10643) HDFS namenode should always use service user (hdfs) to generateEncryptedKey

2016-08-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416099#comment-15416099 ] Xiao Chen commented on HDFS-10643: -- Thanks [~xyao] for explaining and revving! Patch 5 LGTM, +1. > HDFS

[jira] [Reopened] (HDFS-9804) Allow long-running Balancer to login with keytab

2016-08-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-9804: - > Allow long-running Balancer to login with keytab > > >

[jira] [Updated] (HDFS-9804) Allow long-running Balancer to login with keytab

2016-08-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9804: Attachment: HDFS-9804-branch-2.00.patch Actually the issue is still valid in branch-2. Some large clusters

[jira] [Commented] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416016#comment-15416016 ] Wei-Chiu Chuang commented on HDFS-8224: --- Yeah given this error could potentially impair HDFS's

[jira] [Commented] (HDFS-9804) Allow long-running Balancer to login with keytab

2016-08-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416022#comment-15416022 ] Xiao Chen commented on HDFS-9804: - Thanks [~zhz]! Not very related but just FYI - there are follow-on jiras

[jira] [Commented] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416052#comment-15416052 ] Wei-Chiu Chuang commented on HDFS-8897: --- +1 Test failures are unrelated. Will commit by end of today.

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-08-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416047#comment-15416047 ] Hanisha Koneru commented on HDFS-10659: --- Thank you [~jingzhao] for reviewing the patch. I have made

[jira] [Created] (HDFS-10748) TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout

2016-08-10 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10748: - Summary: TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout Key: HDFS-10748 URL: https://issues.apache.org/jira/browse/HDFS-10748 Project: Hadoop

[jira] [Commented] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416406#comment-15416406 ] Hadoop QA commented on HDFS-10584: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416464#comment-15416464 ] Rakesh R commented on HDFS-10584: - Test case failures are unrelated to this patch, please ignore it. >

[jira] [Commented] (HDFS-10720) Fix intermittent test failure of TestDataNodeErasureCodingMetrics

2016-08-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416476#comment-15416476 ] Hudson commented on HDFS-10720: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10259 (See

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416385#comment-15416385 ] Kai Zheng commented on HDFS-8668: - Thanks [~Sammi] for the great update! Could you add some test to trigger

[jira] [Updated] (HDFS-10720) Fix intermittent test failure of TestDataNodeErasureCodingMetrics

2016-08-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10720: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1 Target

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416554#comment-15416554 ] Vinayakumar B commented on HDFS-10625: -- +1 for v5 patch. checkstyle for method length can be

[jira] [Commented] (HDFS-10720) Fix intermittent test failure of TestDataNodeErasureCodingMetrics#testEcTasks

2016-08-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416446#comment-15416446 ] Kai Zheng commented on HDFS-10720: -- Thanks for the update. The patch LGTM and +1. Will commit it shortly.

[jira] [Commented] (HDFS-10720) Fix intermittent test failure of TestDataNodeErasureCodingMetrics

2016-08-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416462#comment-15416462 ] Rakesh R commented on HDFS-10720: - Thank you [~drankye] for the detailed reviews and committing the patch.

[jira] [Commented] (HDFS-10694) BlockManager.processReport() should print blockReportId in each log message.

2016-08-10 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416382#comment-15416382 ] Yuanbo Liu commented on HDFS-10694: --- Thanks very much! [~shv] > BlockManager.processReport() should

[jira] [Updated] (HDFS-10720) Fix intermittent test failure of TestDataNodeErasureCodingMetrics

2016-08-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10720: - Summary: Fix intermittent test failure of TestDataNodeErasureCodingMetrics (was: Fix intermittent test

[jira] [Commented] (HDFS-9530) ReservedSpace is not cleared for abandoned Blocks

2016-08-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416547#comment-15416547 ] Arpit Agarwal commented on HDFS-9530: - Thanks for posting the patch [~brahmareddy]. I am out this rest

[jira] [Commented] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415734#comment-15415734 ] Rakesh R commented on HDFS-10584: - Attached another patch addressing comments. Like I mentioned in my

[jira] [Commented] (HDFS-10744) Internally optimize path component resolution

2016-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415791#comment-15415791 ] Hadoop QA commented on HDFS-10744: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10643) HDFS namenode should always use service user (hdfs) to generateEncryptedKey

2016-08-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10643: -- Attachment: HDFS-10643.05.patch [~xiaochen], thanks for the review. This reason for not repro with the

[jira] [Updated] (HDFS-9804) Allow long-running Balancer to login with keytab

2016-08-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9804: Target Version/s: (was: ) Status: Patch Available (was: Reopened) > Allow long-running

[jira] [Commented] (HDFS-10643) HDFS namenode should always use service user (hdfs) to generateEncryptedKey

2016-08-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416057#comment-15416057 ] Xiaoyu Yao commented on HDFS-10643: --- Open separate ticket HDFS-10748 to track the unit test failure,

[jira] [Updated] (HDFS-10643) Namenode should use loginUser(hdfs) to generateEncryptedKey

2016-08-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10643: -- Summary: Namenode should use loginUser(hdfs) to generateEncryptedKey (was: HDFS namenode should always

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416118#comment-15416118 ] Kai Zheng commented on HDFS-8901: - Thanks [~zhz] for the look! I thought you meant this saying in the

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416021#comment-15416021 ] Chen Liang commented on HDFS-10742: --- The failed test is unrelated. > Measurement of lock held time in

[jira] [Commented] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416100#comment-15416100 ] John Zhuge commented on HDFS-8897: -- Sure [~jojochuang]. > Balancer should handle fs.defaultFS trailing

  1   2   >