[jira] [Updated] (HDFS-10298) Document the usage of distcp -diff option

2016-04-22 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10298: --- Attachment: HDFS-10298.2.patch > Document the usage of distcp -diff option >

[jira] [Updated] (HDFS-10298) Document the usage of distcp -diff option

2016-04-22 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10298: --- Status: Patch Available (was: Open) > Document the usage of distcp -diff option >

[jira] [Updated] (HDFS-10298) Document the usage of distcp -diff option

2016-04-22 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10298: --- Status: Open (was: Patch Available) > Document the usage of distcp -diff option >

[jira] [Commented] (HDFS-10298) Document the usage of distcp -diff option

2016-04-22 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255158#comment-15255158 ] Takashi Ohnishi commented on HDFS-10298: Thanks [~ajisakaa] for your comments ! I have fixed in

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255127#comment-15255127 ] Hadoop QA commented on HDFS-10224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

2016-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255121#comment-15255121 ] Hadoop QA commented on HDFS-10313: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

2016-04-22 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10313: - Attachment: (was: HDFS-10313.003.patch) > Distcp does not check the order of snapshot names passed to

[jira] [Updated] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

2016-04-22 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10313: - Attachment: HDFS-10313.003.patch > Distcp does not check the order of snapshot names passed to -diff >

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

2016-04-22 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255104#comment-15255104 ] Lin Yiqun commented on HDFS-10313: -- The latest patch looks good that all the unit tests are passed and

[jira] [Commented] (HDFS-9895) Push up DataNode#conf to base class

2016-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255081#comment-15255081 ] Hadoop QA commented on HDFS-9895: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10310) libhdfs++: hdfsConnect hangs when given bad host or port

2016-04-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255049#comment-15255049 ] James Clampffer commented on HDFS-10310: Committed to HDFS-8707. > libhdfs++: hdfsConnect hangs

[jira] [Updated] (HDFS-10310) libhdfs++: hdfsConnect hangs when given bad host or port

2016-04-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10310: --- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: hdfsConnect

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255016#comment-15255016 ] Hadoop QA commented on HDFS-9905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254994#comment-15254994 ] Konstantin Shvachko commented on HDFS-10301: Colin I ran your unit test and verified that it

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254940#comment-15254940 ] ASF GitHub Bot commented on HDFS-10224: --- GitHub user xiaobingo opened a pull request:

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254938#comment-15254938 ] Hadoop QA commented on HDFS-9732: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254936#comment-15254936 ] Hudson commented on HDFS-9427: -- FAILURE: Integrated in Hadoop-trunk-Commit #9659 (See

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.007.patch Patch v007 removed that clause, thank you. >

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254909#comment-15254909 ] Tsz Wo Nicholas Sze commented on HDFS-10224: The 006 patch looks good except that the javadoc

[jira] [Updated] (HDFS-9895) Push up DataNode#conf to base class

2016-04-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9895: Attachment: HDFS-9895.001.patch I posted patch v001 after rebase. I also created pull request for

[jira] [Commented] (HDFS-9895) Push up DataNode#conf to base class

2016-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254907#comment-15254907 ] ASF GitHub Bot commented on HDFS-9895: -- GitHub user xiaobingo opened a pull request:

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254847#comment-15254847 ] Xiaobing Zhou commented on HDFS-10224: -- Patch v006 is posted to simplify

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.006.patch > Implement asynchronous rename for

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-04-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254810#comment-15254810 ] Xiaobing Zhou commented on HDFS-9427: - Thank you [~jingzhao] for +1ing and committing it. Thank you all

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254798#comment-15254798 ] Xiaobing Zhou commented on HDFS-10224: -- Patch v005 is posted with all your comments addressed,

[jira] [Updated] (HDFS-9427) HDFS should not default to ephemeral ports

2016-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9427: Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed Fix Version/s: 3.0.0 Release

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.005.patch > Implement asynchronous rename for

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254790#comment-15254790 ] Jing Zhao commented on HDFS-9427: - +1. I will commit the patch shortly. > HDFS should not default to

[jira] [Commented] (HDFS-10245) Fix the findbug warnings in branch-2.7

2016-04-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254789#comment-15254789 ] Akira AJISAKA commented on HDFS-10245: -- Thanks [~brahmareddy] for the patch. Adding synchronization

[jira] [Updated] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-04-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9905: -- Attachment: HDFS-9905.002.patch Posted patch v02. Thanks [~eepayne] and [~iwasakims]. Tested

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254740#comment-15254740 ] Jing Zhao commented on HDFS-10301: -- As an optimization, maybe we can have a retry-cache similar mechanism

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2016-04-22 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254695#comment-15254695 ] Kai Zheng commented on HDFS-10285: -- Thanks Uma for the nice proposal! bq. Another scenarios is, when user

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254673#comment-15254673 ] Konstantin Shvachko commented on HDFS-10301: [~cmccabe] I don't think that HDFS-9198 breaks

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254668#comment-15254668 ] Konstantin Shvachko commented on HDFS-10301: Hey [~walter.k.su], sorry let me rephrase my

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254642#comment-15254642 ] Tsz Wo Nicholas Sze commented on HDFS-10224: - Indeed, it does not make sense to add the

[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254634#comment-15254634 ] Tsz Wo Nicholas Sze commented on HDFS-9917: --- [~brahmareddy] and [~vinayrpet], thanks a lot for

[jira] [Commented] (HDFS-10298) Document the usage of distcp -diff option

2016-04-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254614#comment-15254614 ] Akira AJISAKA commented on HDFS-10298: -- Thanks [~bwtakacy] for the patch. Two minor comments: 1.

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254586#comment-15254586 ] Arpit Agarwal commented on HDFS-10264: -- Looks like we are making an exception for the parallel

[jira] [Commented] (HDFS-9943) Support reconfiguring namenode replication confs

2016-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254545#comment-15254545 ] Arpit Agarwal commented on HDFS-9943: - Thanks for the patch [~xiaobingo]. #

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254503#comment-15254503 ] Colin Patrick McCabe commented on HDFS-10175: - bq. Can I also note that as the @Public @Stable

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254489#comment-15254489 ] Steve Loughran commented on HDFS-10175: --- Can I also note that as the {{@Public @Stable FileSystem}}

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254483#comment-15254483 ] Steve Loughran commented on HDFS-10175: --- In HADOOP-13028 I've just implemented something for S3A

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254478#comment-15254478 ] Andrew Wang commented on HDFS-10324: Yes, that's why I suggested adding a new flag on {{hdfs crypto

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254469#comment-15254469 ] Tsz Wo Nicholas Sze commented on HDFS-10224: - Let's also pass statistics in the

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254463#comment-15254463 ] Tsz Wo Nicholas Sze commented on HDFS-10224: Thanks for the new patch. It looks good in

[jira] [Work started] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10324 started by Wei-Chiu Chuang. -- > Trash directory in an encryption zone should be pre-created with sticky

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254436#comment-15254436 ] Hadoop QA commented on HDFS-9958: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-04-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254398#comment-15254398 ] Xiao Chen commented on HDFS-9427: - Thanks Xiaobing for pushing this forward. We need a committer +1 as

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-04-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254376#comment-15254376 ] Xiaobing Zhou commented on HDFS-9427: - Could anyone help to commit this? Thanks. > HDFS should not

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254363#comment-15254363 ] Wei-Chiu Chuang commented on HDFS-10324: Also, if a directory is initialized as an EZ and a

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254353#comment-15254353 ] Konstantin Shvachko commented on HDFS-10264: No problem, Arpit. I thought that we list the

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254350#comment-15254350 ] Colin Patrick McCabe commented on HDFS-10301: - Yeah, perhaps we should file a follow-on JIRA

[jira] [Assigned] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reassigned HDFS-10301: --- Assignee: Colin Patrick McCabe > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254328#comment-15254328 ] Andrew Wang commented on HDFS-10324: Does this work when the EZ root is not writable by the

[jira] [Updated] (HDFS-10310) libhdfs++: hdfsConnect hangs when given bad host or port

2016-04-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10310: --- Summary: libhdfs++: hdfsConnect hangs when given bad host or port (was: libhdfs++:

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254304#comment-15254304 ] Wei-Chiu Chuang commented on HDFS-10324: Cool! Thanks Xiaoyu. I initially had the similar fix, but

[jira] [Commented] (HDFS-10310) libhdfs++: hdfsConnect needs timeout logic

2016-04-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254295#comment-15254295 ] James Clampffer commented on HDFS-10310: Thanks for the quick review Bob! I'm going to leave this

[jira] [Commented] (HDFS-10310) libhdfs++: hdfsConnect needs timeout logic

2016-04-22 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254279#comment-15254279 ] Bob Hansen commented on HDFS-10310: --- +1 > libhdfs++: hdfsConnect needs timeout logic >

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254284#comment-15254284 ] Xiaoyu Yao commented on HDFS-10324: --- Thanks [~jojochuang] for reporting the issue and posting the patch

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

2016-04-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254255#comment-15254255 ] Allen Wittenauer commented on HDFS-9016: This is basically Hadoop's operability problems coming to

[jira] [Comment Edited] (HDFS-9016) Display upgrade domain information in fsck

2016-04-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254255#comment-15254255 ] Allen Wittenauer edited comment on HDFS-9016 at 4/22/16 5:21 PM: - This is

[jira] [Commented] (HDFS-9894) Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives

2016-04-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254208#comment-15254208 ] Xiaobing Zhou commented on HDFS-9894: - Thank you [~jingzhao] for committing it. > Add

[jira] [Updated] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2016-04-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9555: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254197#comment-15254197 ] Ming Ma commented on HDFS-10175: This is a great idea. It also addresses an issue at the consumption side.

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Attachment: HDFS-9958.004.patch Updating patch to address the case where we try and mark a block corrupt

[jira] [Commented] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2016-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254153#comment-15254153 ] Hudson commented on HDFS-9555: -- FAILURE: Integrated in Hadoop-trunk-Commit #9654 (See

[jira] [Commented] (HDFS-10310) libhdfs++: hdfsConnect needs timeout logic

2016-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254148#comment-15254148 ] Hadoop QA commented on HDFS-10310: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2016-04-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254144#comment-15254144 ] Kihwal Lee commented on HDFS-9555: -- +1 the patch looks good. > LazyPersistFileScrubber should still sleep

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

2016-04-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254145#comment-15254145 ] Ming Ma commented on HDFS-9016: --- I can add a new config property or maybe a new fsck CLI option

[jira] [Commented] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2016-04-22 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254122#comment-15254122 ] Rushabh S Shah commented on HDFS-9555: -- +1. ltgm [~yangzhe1991]: do you mind creating a patch for

[jira] [Commented] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2016-04-22 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254124#comment-15254124 ] Rushabh S Shah commented on HDFS-9555: -- +1 (non-binding) > LazyPersistFileScrubber should still sleep

[jira] [Updated] (HDFS-10310) libhdfs++: hdfsConnect needs timeout logic

2016-04-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10310: --- Attachment: HDFS-10310.HDFS-8707.001.patch New patch. Moved the template stuff that was

[jira] [Updated] (HDFS-10310) libhdfs++: hdfsConnect needs timeout logic

2016-04-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10310: --- Status: Patch Available (was: Open) > libhdfs++: hdfsConnect needs timeout logic >

[jira] [Resolved] (HDFS-9030) libwebhdfs lacks headers, documentation; not part of mvn package

2016-04-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-9030. Resolution: Won't Fix libwebhdfs has been removed. closing as won't fix. > libwebhdfs lacks

[jira] [Commented] (HDFS-334) dfsadmin -metasave should also log corrupt replicas info

2016-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254036#comment-15254036 ] Hadoop QA commented on HDFS-334: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10310) libhdfs++: hdfsConnect needs timeout logic

2016-04-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10310: --- Attachment: HDFS-10310.HDFS-8707.000.patch Initial fix posted + a tiny unrelated refactor to

[jira] [Reopened] (HDFS-9328) Formalize coding standards for libhdfs++

2016-04-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reopened HDFS-9328: --- Reopening this for a couple reasons 1) Nobody is using clang-format; mostly because it causes

[jira] [Resolved] (HDFS-3557) provide means of escaping special characters to `hadoop fs` command

2016-04-22 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-3557. --- Resolution: Not A Problem Resolving per comment (also stale) > provide means of escaping special characters

[jira] [Updated] (HDFS-334) dfsadmin -metasave should also log corrupt replicas info

2016-04-22 Thread Denis Bolshakov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Bolshakov updated HDFS-334: - Status: Patch Available (was: Open) > dfsadmin -metasave should also log corrupt replicas info >

[jira] [Updated] (HDFS-334) dfsadmin -metasave should also log corrupt replicas info

2016-04-22 Thread Denis Bolshakov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Bolshakov updated HDFS-334: - Attachment: HDFS-334.001.patch Patch > dfsadmin -metasave should also log corrupt replicas info >

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253729#comment-15253729 ] Hadoop QA commented on HDFS-10224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-22 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253593#comment-15253593 ] Takanobu Asanuma commented on HDFS-8057: Thank you very much for your quick response and kind

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-04-22 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253523#comment-15253523 ] Walter Su commented on HDFS-10220: -- I mean, saving administrators the trouble to tune this. > Namenode

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-04-22 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253497#comment-15253497 ] Xinwei Qin commented on HDFS-7859: --- Need to update patch to fix the checkstyles and relevant unit test

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253459#comment-15253459 ] Andrew Wang commented on HDFS-10324: Not sure about this one. It doesn't handle existing EZs from an

[jira] [Updated] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10324: --- Description: We encountered a bug in HDFS-8831: After HDFS-8831, a deleted file in an

[jira] [Updated] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10324: --- Attachment: HDFS-10324.001.patch Attach my patch v001. I am not entirely sure if this should

[jira] [Created] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-22 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10324: -- Summary: Trash directory in an encryption zone should be pre-created with sticky bit Key: HDFS-10324 URL: https://issues.apache.org/jira/browse/HDFS-10324

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253413#comment-15253413 ] Xiaobing Zhou commented on HDFS-10224: -- I posted patch v004 addressed all your comments, thank you