[jira] [Created] (HDFS-10214) Checkpoint Can not be done by StandbyNameNode.Because checkpoint may cause DataNode blockReport.blockReceivedAndDeleted.heartbeat rpc timeout when the object num > 100000

2016-03-24 Thread ChenFolin (JIRA)
ChenFolin created HDFS-10214: Summary: Checkpoint Can not be done by StandbyNameNode.Because checkpoint may cause DataNode blockReport.blockReceivedAndDeleted.heartbeat rpc timeout when the object num > 1. Key: HDFS-10214

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211401#comment-15211401 ] Hadoop QA commented on HDFS-3702: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211397#comment-15211397 ] Hadoop QA commented on HDFS-9847: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-03-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10175: - Attachment: HDFS-10175.003.patch Thanks [~cmccabe] for providing comments. I agree with you

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211371#comment-15211371 ] Hadoop QA commented on HDFS-6489: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10210) Remove the defunct startKdc profile

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211369#comment-15211369 ] Hadoop QA commented on HDFS-10210: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-24 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10204: - Attachment: HDFS-10204.003.patch > Use HadoopIllegalArgumentException replace IllegalArgumentException in

[jira] [Commented] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-24 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211357#comment-15211357 ] Lin Yiqun commented on HDFS-10204: -- The failed unit tests seem not related, update the patch for fixing

[jira] [Commented] (HDFS-10195) Ozone: Add container persistence

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211339#comment-15211339 ] Hadoop QA commented on HDFS-10195: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10213) there is a corrupt/missing block report, but fsck result is HEALTHY

2016-03-24 Thread Wataru Yukawa (JIRA)
Wataru Yukawa created HDFS-10213: Summary: there is a corrupt/missing block report, but fsck result is HEALTHY Key: HDFS-10213 URL: https://issues.apache.org/jira/browse/HDFS-10213 Project: Hadoop

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211310#comment-15211310 ] Vinayakumar B commented on HDFS-9847: - {code}LOG.warn("No unit for " + name + "(" + timeStr + ")

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211296#comment-15211296 ] Lin Yiqun commented on HDFS-9847: - When we want to change the default config values, we can update its unit

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211288#comment-15211288 ] Lin Yiqun commented on HDFS-9847: - {quote} But we can't change the type of a config variable without

[jira] [Updated] (HDFS-10212) HDFS: Upgrade Hadoop MiniKDC with Kerby

2016-03-24 Thread Jiajia Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiajia Li updated HDFS-10212: - Status: Patch Available (was: Open) > HDFS: Upgrade Hadoop MiniKDC with Kerby >

[jira] [Updated] (HDFS-10212) HDFS: Upgrade Hadoop MiniKDC with Kerby

2016-03-24 Thread Jiajia Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiajia Li updated HDFS-10212: - Attachment: HDFS-10212-v1.patch > HDFS: Upgrade Hadoop MiniKDC with Kerby >

[jira] [Updated] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6489: -- Status: Patch Available (was: Open) > DFS Used space is not correct computed on frequent append

[jira] [Updated] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6489: -- Status: Open (was: Patch Available) > DFS Used space is not correct computed on frequent append

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211227#comment-15211227 ] Chris Douglas commented on HDFS-9847: - bq. Should we just keep the defaults as they are to keep the

[jira] [Commented] (HDFS-10195) Ozone: Add container persistence

2016-03-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211219#comment-15211219 ] Jing Zhao commented on HDFS-10195: -- The 003 patch looks good to me. +1 > Ozone: Add container

[jira] [Updated] (HDFS-10195) Ozone: Add container persistence

2016-03-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10195: Attachment: HDFS-10195-HDFS-7240.003.patch This patch addresses comments from [~jingzhao] > Ozone:

[jira] [Created] (HDFS-10212) HDFS: Upgrade Hadoop MiniKDC with Kerby

2016-03-24 Thread Jiajia Li (JIRA)
Jiajia Li created HDFS-10212: Summary: HDFS: Upgrade Hadoop MiniKDC with Kerby Key: HDFS-10212 URL: https://issues.apache.org/jira/browse/HDFS-10212 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-10195) Ozone: Add container persistence

2016-03-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211166#comment-15211166 ] Jing Zhao commented on HDFS-10195: -- Anu pointed out that the FileInputStream will throw

[jira] [Commented] (HDFS-964) hdfs-default.xml shouldn't use hadoop.tmp.dir for dfs.data.dir (0.20 and lower) / dfs.datanode.dir (0.21 and up)

2016-03-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211146#comment-15211146 ] Yongjun Zhang commented on HDFS-964: Thanks [~aw]. > hdfs-default.xml shouldn't use hadoop.tmp.dir for

[jira] [Resolved] (HDFS-10211) Add more info to DelegationTokenIdentifier#toString for better supportability

2016-03-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-10211. -- Resolution: Duplicate > Add more info to DelegationTokenIdentifier#toString for better

[jira] [Commented] (HDFS-10211) Add more info to DelegationTokenIdentifier#toString for better supportability

2016-03-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211130#comment-15211130 ] Yongjun Zhang commented on HDFS-10211: -- HI [~cnauroth], Thanks for bringing HDFS-9732 to my

[jira] [Updated] (HDFS-10202) ozone : Add key commands to CLI

2016-03-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10202: Attachment: HDFS-10202-HDFS-7240.002.patch fix the findbug warnings > ozone : Add key commands to

[jira] [Commented] (HDFS-10211) Add more info to DelegationTokenIdentifier#toString for better supportability

2016-03-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211123#comment-15211123 ] Chris Nauroth commented on HDFS-10211: -- Hi [~yzhangal]. Is this a duplicate of HDFS-9732? bq. I

[jira] [Commented] (HDFS-10195) Ozone: Add container persistence

2016-03-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211103#comment-15211103 ] Jing Zhao commented on HDFS-10195: -- Thanks for updating the patch, Anu. Just some minor comments on the

[jira] [Commented] (HDFS-9895) Push up DataNode#conf to base class

2016-03-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211055#comment-15211055 ] Xiaobing Zhou commented on HDFS-9895: - Thanks [~cmccabe] for make it clear. It's what I meant.

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211057#comment-15211057 ] Arpit Agarwal commented on HDFS-9349: - Hi [~xiaobingo], thanks for updating the patch. The

[jira] [Updated] (HDFS-9931) Push up NameNode#conf to base class

2016-03-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9931: Summary: Push up NameNode#conf to base class (was: Push up NameNode#conf to the base class) > Push

[jira] [Updated] (HDFS-9931) Push up NameNode#conf to the base class

2016-03-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9931: Summary: Push up NameNode#conf to the base class (was: Remove NameNode#conf because there is

[jira] [Comment Edited] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210759#comment-15210759 ] Lei (Eddy) Xu edited comment on HDFS-3702 at 3/24/16 10:18 PM: --- Updated the

[jira] [Updated] (HDFS-9895) Push up DataNode#conf to base class

2016-03-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9895: Summary: Push up DataNode#conf to base class (was: Remove DataNode#conf because there is already a

[jira] [Updated] (HDFS-10195) Ozone: Add container persistence

2016-03-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10195: Attachment: HDFS-10195-HDFS-7240.002.patch [~cnauroth] and [~jingzhao] Thanks for the code review

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211010#comment-15211010 ] Arpit Agarwal commented on HDFS-9847: - Should we just keep the defaults as they are to keep the patch

[jira] [Updated] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9847: Attachment: HDFS-9847-branch-2.002.patch > HDFS configuration without time unit name should accept

[jira] [Updated] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9847: Attachment: branch-2-delta.002.txt > HDFS configuration without time unit name should accept

[jira] [Updated] (HDFS-10210) Remove the defunct startKdc profile

2016-03-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10210: --- Attachment: HDFS-10210.002.patch Added two missing properties. > Remove the defunct startKdc

[jira] [Updated] (HDFS-10210) Remove the defunct startKdc profile

2016-03-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10210: --- Status: Patch Available (was: Open) > Remove the defunct startKdc profile >

[jira] [Updated] (HDFS-10210) Remove the defunct startKdc profile

2016-03-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10210: --- Status: Open (was: Patch Available) > Remove the defunct startKdc profile >

[jira] [Created] (HDFS-10211) Add more info to DelegationTokenIdentifier#toString for better supportability

2016-03-24 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10211: Summary: Add more info to DelegationTokenIdentifier#toString for better supportability Key: HDFS-10211 URL: https://issues.apache.org/jira/browse/HDFS-10211 Project:

[jira] [Updated] (HDFS-10210) Remove the defunct startKdc profile

2016-03-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10210: --- Status: Patch Available (was: Open) > Remove the defunct startKdc profile >

[jira] [Updated] (HDFS-10210) Remove the defunct startKdc profile

2016-03-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10210: --- Component/s: test > Remove the defunct startKdc profile > ---

[jira] [Updated] (HDFS-10210) Remove the defunct startKdc profile

2016-03-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10210: --- Attachment: HDFS-10210.001.patch Attach my patch which removes startKdc profile from hdfs

[jira] [Created] (HDFS-10210) Remove the defunct startKdc profile

2016-03-24 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10210: -- Summary: Remove the defunct startKdc profile Key: HDFS-10210 URL: https://issues.apache.org/jira/browse/HDFS-10210 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210982#comment-15210982 ] Hadoop QA commented on HDFS-9847: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-2580) NameNode#main(...) can make use of GenericOptionsParser.

2016-03-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210980#comment-15210980 ] Konstantin Shvachko commented on HDFS-2580: --- This is an old patch, but never made it to any

[jira] [Commented] (HDFS-9908) Datanode should tolerate disk scan failure during NN handshake

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210976#comment-15210976 ] Hadoop QA commented on HDFS-9908: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-03-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210877#comment-15210877 ] Colin Patrick McCabe commented on HDFS-10175: - -1. As [~andrew.wang] mentioned, this change

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210853#comment-15210853 ] Chris Douglas commented on HDFS-9847: - The patch needs to change _all_ the uses of the config vars,

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-03-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210849#comment-15210849 ] Arpit Agarwal commented on HDFS-9427: - I haven't looked at the patch in detail yet but I am +1 on the

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210836#comment-15210836 ] Chris Douglas commented on HDFS-9847: - Well, that's not promising. > HDFS configuration without time

[jira] [Updated] (HDFS-10188) libhdfs++: Implement debug allocators

2016-03-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10188: --- Description: I propose implementing a set of memory new/delete pairs with additional

[jira] [Updated] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-03-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10207: -- Description: It will be useful to allow changing {{ipc.#port#.backoff.enable}} without a namenode

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-03-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210805#comment-15210805 ] Xiaoyu Yao commented on HDFS-10209: --- The configuration key is {{hadoop.caller.context.enabled}} that is

[jira] [Created] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-03-24 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10209: - Summary: Support enable caller context in HDFS namenode audit log without restart namenode Key: HDFS-10209 URL: https://issues.apache.org/jira/browse/HDFS-10209 Project:

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210797#comment-15210797 ] Hadoop QA commented on HDFS-9847: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-3702: Attachment: HDFS-3702.010.patch Updated the patch to: * Move {{AddBlockFlag}} to {{o.a.h.hdfs}} *

[jira] [Commented] (HDFS-9959) add log when block removed from last live datanode

2016-03-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210731#comment-15210731 ] Arpit Agarwal commented on HDFS-9959: - One comment - please consider replacing the StringBuilder

[jira] [Updated] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6489: -- Status: Patch Available (was: In Progress) > DFS Used space is not correct computed on frequent append

[jira] [Updated] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6489: -- Attachment: HDFS-6489.002.patch > DFS Used space is not correct computed on frequent append operations >

[jira] [Commented] (HDFS-10195) Ozone: Add container persistence

2016-03-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210632#comment-15210632 ] Jing Zhao commented on HDFS-10195: -- Thanks a lot for the detailed comments and explanation, [~anu]! bq.

[jira] [Created] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-03-24 Thread Ming Ma (JIRA)
Ming Ma created HDFS-10208: -- Summary: Addendum for HDFS-9579: to handle the case when client machine can't resolve network path Key: HDFS-10208 URL: https://issues.apache.org/jira/browse/HDFS-10208 Project:

[jira] [Updated] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-9847: Attachment: HDFS-9847-branch-2.001.patch > HDFS configuration without time unit name should accept

[jira] [Created] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-03-24 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10207: - Summary: Support enable Hadoop IPC backoff without namenode restart Key: HDFS-10207 URL: https://issues.apache.org/jira/browse/HDFS-10207 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210568#comment-15210568 ] Arpit Agarwal commented on HDFS-9847: - +1 for HDFS-9847-nothrow.002.patch. > HDFS configuration

[jira] [Updated] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-03-24 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10206: --- Issue Type: Improvement (was: Bug) > getBlockLocations might not sort datanodes properly by distance >

[jira] [Created] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-03-24 Thread Ming Ma (JIRA)
Ming Ma created HDFS-10206: -- Summary: getBlockLocations might not sort datanodes properly by distance Key: HDFS-10206 URL: https://issues.apache.org/jira/browse/HDFS-10206 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210542#comment-15210542 ] Chris Douglas commented on HDFS-9847: - Yeah, I agree it's not clear-cut. Attached a patch that includes

[jira] [Updated] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-9847: Attachment: HDFS-9847-nothrow.002.patch > HDFS configuration without time unit name should accept

[jira] [Commented] (HDFS-3980) NPE in HttpURLConnection.java while starting SecondaryNameNode.

2016-03-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210538#comment-15210538 ] Steve Loughran commented on HDFS-3980: -- This is HADOOP-9363 surfacing > NPE in HttpURLConnection.java

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210509#comment-15210509 ] Arpit Agarwal commented on HDFS-9847: - bq. This is the WARN for missing units? It should warn,

[jira] [Updated] (HDFS-10196) Ozone : Enable better error reporting for failed commands in ozone shell

2016-03-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10196: - Resolution: Fixed Status: Resolved (was: Patch Available) I have committed this to the

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210501#comment-15210501 ] Chris Douglas commented on HDFS-9847: - bq. Remove the warning on line 1651 in Configuration.java. Else

[jira] [Work started] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6489 started by Weiwei Yang. - > DFS Used space is not correct computed on frequent append operations >

[jira] [Updated] (HDFS-9908) Datanode should tolerate disk scan failure during NN handshake

2016-03-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9908: -- Attachment: HDFS-9908.004.patch Thanks for Eddy's comments: Attached rev04 to address Eddy's

[jira] [Created] (HDFS-10205) libhdfs++: Integrate logging with the C API

2016-03-24 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10205: -- Summary: libhdfs++: Integrate logging with the C API Key: HDFS-10205 URL: https://issues.apache.org/jira/browse/HDFS-10205 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210404#comment-15210404 ] Hadoop QA commented on HDFS-10204: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9633) Test SnapshotDiffReport file path corner cases

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210300#comment-15210300 ] Hadoop QA commented on HDFS-9633: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210308#comment-15210308 ] Arpit Agarwal commented on HDFS-3702: - bq. Meantime, you still -0 on this patch going in in meantime?

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210299#comment-15210299 ] Arpit Agarwal commented on HDFS-9847: - There is one more improvement and I am sorry for not noticing it

[jira] [Commented] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210145#comment-15210145 ] Hadoop QA commented on HDFS-9694: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-24 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10204: - Attachment: HDFS-10204.002.patch Upload a complete patch. > Use HadoopIllegalArgumentException replace

[jira] [Commented] (HDFS-10197) TestFsDatasetCache failing intermittently due to timeout

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210058#comment-15210058 ] Hadoop QA commented on HDFS-10197: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210015#comment-15210015 ] Hadoop QA commented on HDFS-10204: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10202) ozone : Add key commands to CLI

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210010#comment-15210010 ] Hadoop QA commented on HDFS-10202: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9939) Increase DecompressorStream skip buffer size

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209974#comment-15209974 ] Hadoop QA commented on HDFS-9939: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10196) Ozone : Enable better error reporting for failed commands in ozone shell

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209973#comment-15209973 ] Hadoop QA commented on HDFS-10196: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209971#comment-15209971 ] Akira AJISAKA commented on HDFS-10199: -- Oh, I've missed the above conversations. Thanks

[jira] [Commented] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209970#comment-15209970 ] Akira AJISAKA commented on HDFS-10199: -- Looks like the patch is for branch-2/2.8. Hi

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209960#comment-15209960 ] Hadoop QA commented on HDFS-10175: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-03-24 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9694: Attachment: HDFS-9694-v9.patch Attempted to resolve the Javac issue. > Make existing

[jira] [Updated] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-24 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10204: - Attachment: HDFS-10204.001.patch Attach a initial patch. Almost {{IllegalArgumentException}} has been

[jira] [Updated] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-24 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10204: - Status: Patch Available (was: Open) > Use HadoopIllegalArgumentException replace

[jira] [Updated] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-24 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10204: - Issue Type: Sub-task (was: Bug) Parent: HDFS-1151 > Use HadoopIllegalArgumentException replace

[jira] [Created] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-24 Thread Lin Yiqun (JIRA)
Lin Yiqun created HDFS-10204: Summary: Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs Key: HDFS-10204 URL: https://issues.apache.org/jira/browse/HDFS-10204 Project:

[jira] [Commented] (HDFS-10203) Excessive topology lookup for large number of client machines in namenode

2016-03-24 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209837#comment-15209837 ] Ming Ma commented on HDFS-10203: Couple ideas we talked about: * Use {{TableMapping}} or better version

[jira] [Updated] (HDFS-10196) Ozone : Enable better error reporting for failed commands in ozone shell

2016-03-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10196: - Hadoop Flags: Reviewed +1 for patch v002 pending another pre-commit run. > Ozone : Enable better