[jira] [Updated] (HDFS-13100) Handle IllegalArgumentException when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-03-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13100: - Description: HDFS-12386 added getserverdefaults call to webhdfs (this method is used by

[jira] [Commented] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401429#comment-16401429 ] genericqa commented on HDFS-13217: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12883) RBF: Document Router and State Store metrics

2018-03-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401412#comment-16401412 ] Lei (Eddy) Xu commented on HDFS-12883: -- Thank you so much [~linyiqun] to help to revert the change!

[jira] [Updated] (HDFS-12883) RBF: Document Router and State Store metrics

2018-03-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12883: - Target Version/s: 3.1.0 (was: 2.9.1, 3.0.1) > RBF: Document Router and State Store metrics >

[jira] [Updated] (HDFS-12895) RBF: Add ACL support for mount table

2018-03-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12895: - Target Version/s: 3.1.0 (was: 2.9.0, 3.0.1) > RBF: Add ACL support for mount table >

[jira] [Comment Edited] (HDFS-12883) RBF: Document Router and State Store metrics

2018-03-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401404#comment-16401404 ] Yiqun Lin edited comment on HDFS-12883 at 3/16/18 2:52 AM: --- Hi [~eddyxu], I have

[jira] [Commented] (HDFS-12883) RBF: Document Router and State Store metrics

2018-03-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401404#comment-16401404 ] Yiqun Lin commented on HDFS-12883: -- Hi [~eddyxu], I have reverted this and HDFS-12895 in branch-3.0.1.

[jira] [Updated] (HDFS-12895) RBF: Add ACL support for mount table

2018-03-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12895: - Fix Version/s: (was: 3.0.1) > RBF: Add ACL support for mount table >

[jira] [Updated] (HDFS-12883) RBF: Document Router and State Store metrics

2018-03-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12883: - Fix Version/s: (was: 3.0.1) > RBF: Document Router and State Store metrics >

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401389#comment-16401389 ] genericqa commented on HDFS-12977: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13296) GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir generate paths with drive letter in Windows, and fail webhdfs related test cases

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401372#comment-16401372 ] Íñigo Goiri commented on HDFS-13296: The tests for commons run without issues but we need to check

[jira] [Commented] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-15 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401359#comment-16401359 ] liaoyuxiangqin commented on HDFS-13217: --- Thanks for your review and give suggestions on this

[jira] [Updated] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-15 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-13217: -- Attachment: HDFS-13217.003.patch > Log audit event only used last EC policy name when add

[jira] [Updated] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-15 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-13217: -- Status: Patch Available (was: Open) > Log audit event only used last EC policy name when add

[jira] [Commented] (HDFS-13296) GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir generate paths with drive letter in Windows, and fail webhdfs related test cases

2018-03-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401366#comment-16401366 ] genericqa commented on HDFS-13296: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-13297) Add config validation util

2018-03-15 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13297: -- Description: Add a generic util to validate configuration based on TAGS. (was: This is broken after

[jira] [Updated] (HDFS-13297) Add config validation util

2018-03-15 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13297: -- Description: This is broken after merging trunk change HADOOP-15007 into HDFS-7240 branch. I remove the

[jira] [Created] (HDFS-13297) Add config validation util

2018-03-15 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-13297: - Summary: Add config validation util Key: HDFS-13297 URL: https://issues.apache.org/jira/browse/HDFS-13297 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Updated] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-15 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-13217: -- Status: Open (was: Patch Available) > Log audit event only used last EC policy name when add

[jira] [Commented] (HDFS-13296) GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir generate paths with drive letter in Windows, and fail webhdfs related test cases

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401296#comment-16401296 ] Íñigo Goiri commented on HDFS-13296: This seems to be the cause for most failed unit tests in Windows.

[jira] [Updated] (HDFS-13296) GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir generate paths with drive letter in Windows, and fail webhdfs related test cases

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13296: --- Status: Patch Available (was: Open) > GenericTestUtils#getTempPath and

[jira] [Updated] (HDFS-13296) GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir generate paths with drive letter in Windows, and fail webhdfs related test cases

2018-03-15 Thread Xiao Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Liang updated HDFS-13296: -- Attachment: HDFS-13296.000.patch > GenericTestUtils#getTempPath and

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-15 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401261#comment-16401261 ] Ajay Kumar commented on HDFS-13251: --- [~xyao] thanks for commit and review. > Avoid using hard coded

[jira] [Commented] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401260#comment-16401260 ] genericqa commented on HDFS-13284: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401256#comment-16401256 ] Chris Douglas commented on HDFS-13265: -- Excellent, thanks [~xkrogen]. Skimming the commit log, does

[jira] [Commented] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401242#comment-16401242 ] Íñigo Goiri commented on HDFS-13250: Believe it or not... no failed unit tests for HDFS! It actually

[jira] [Commented] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401240#comment-16401240 ] Íñigo Goiri commented on HDFS-13232: OK, we'll leave it as is then. > RBF: ConnectionPool should

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-15 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401224#comment-16401224 ] Ajay Kumar commented on HDFS-12723: --- [~elgoiri],thanks for review and commit. >

[jira] [Commented] (HDFS-11481) hdfs snapshotDiff /.reserved/raw/... fails on snapshottable directories

2018-03-15 Thread Mavin Martin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401216#comment-16401216 ] Mavin Martin commented on HDFS-11481: - Hi [~yzhangal], Thank you for reviewing this!  We are in the

[jira] [Assigned] (HDFS-13296) GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir generate paths with drive letter in Windows, and fail webhdfs related test cases

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-13296: -- Assignee: Xiao Liang > GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401207#comment-16401207 ] Chris Douglas commented on HDFS-11600: -- Thanks, [~Sammi]! > Refactor

[jira] [Created] (HDFS-13296) GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir generate paths with drive letter in Windows, and fail webhdfs related test cases

2018-03-15 Thread Xiao Liang (JIRA)
Xiao Liang created HDFS-13296: - Summary: GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir generate paths with drive letter in Windows, and fail webhdfs related test cases Key: HDFS-13296 URL:

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-15 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401205#comment-16401205 ] Plamen Jeliazkov commented on HDFS-12977: - Thanks for the thorough review Konstantin. I believe I

[jira] [Commented] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401200#comment-16401200 ] Chris Douglas commented on HDFS-13232: -- bq. I committed HDFS-13230 but I messed up the message and

[jira] [Updated] (HDFS-12977) Add stateId to RPC headers.

2018-03-15 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-12977: Attachment: (was: HDFS_12977_trunk_006.patch) > Add stateId to RPC headers. >

[jira] [Updated] (HDFS-12977) Add stateId to RPC headers.

2018-03-15 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-12977: Attachment: HDFS_12977.trunk.006.patch > Add stateId to RPC headers. >

[jira] [Updated] (HDFS-12977) Add stateId to RPC headers.

2018-03-15 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-12977: Attachment: HDFS_12977_trunk_006.patch > Add stateId to RPC headers. >

[jira] [Commented] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401190#comment-16401190 ] genericqa commented on HDFS-13250: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2018-03-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401170#comment-16401170 ] Chris Douglas commented on HDFS-12422: -- bq. do you know anybody fit for reviewing this? [~shv], if he

[jira] [Updated] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13163: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-12996 Status:

[jira] [Comment Edited] (HDFS-12895) RBF: Add ACL support for mount table

2018-03-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401124#comment-16401124 ] Lei (Eddy) Xu edited comment on HDFS-12895 at 3/15/18 9:44 PM: --- Hi,

[jira] [Commented] (HDFS-12895) RBF: Add ACL support for mount table

2018-03-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401124#comment-16401124 ] Lei (Eddy) Xu commented on HDFS-12895: -- Hi, [~linyiqun] Similar to HDFS-12895, should we revert

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401123#comment-16401123 ] genericqa commented on HDFS-11043: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12883) RBF: Document Router and State Store metrics

2018-03-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401122#comment-16401122 ] Lei (Eddy) Xu commented on HDFS-12883: -- Hi, [~linyiqun] Sorry that I am late to this. Is this

[jira] [Commented] (HDFS-12003) Ozone: Misc : Cleanup error messages

2018-03-15 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401096#comment-16401096 ] Elek, Marton commented on HDFS-12003: - Not an error message but a log which is not so meaningfull.

[jira] [Updated] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13284: -- Status: Patch Available (was: Open) > Adjust criteria for

[jira] [Work started] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13284 started by Lukas Majercak. - > Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY >

[jira] [Work stopped] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13284 stopped by Lukas Majercak. - > Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY >

[jira] [Updated] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13250: --- Status: Patch Available (was: Open) > RBF: Router to manage requests across multiple subclusters >

[jira] [Commented] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401018#comment-16401018 ] Íñigo Goiri commented on HDFS-13250: Thanks [~linyiqun] for the comments, I posted

[jira] [Updated] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13250: --- Attachment: HDFS-13250.002.patch > RBF: Router to manage requests across multiple subclusters >

[jira] [Commented] (HDFS-13295) Namenode doesn't leave safemode if dfs.namenode.safemode.replication.min set < dfs.namenode.replication.min

2018-03-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400984#comment-16400984 ] genericqa commented on HDFS-13295: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400979#comment-16400979 ] Xiao Chen commented on HDFS-13040: -- For reference [the test error with UGI mentioned

[jira] [Commented] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2018-03-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400978#comment-16400978 ] genericqa commented on HDFS-12618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-13217: - Target Version/s: 3.1.0, 3.0.2 (was: 3.0.1, 3.0.2) > Log audit event only used last EC policy

[jira] [Updated] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 3.0.2

[jira] [Commented] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400955#comment-16400955 ] Íñigo Goiri commented on HDFS-13284: Thanks [~lukmajercak], this makes sense; I would push this.

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400949#comment-16400949 ] Íñigo Goiri commented on HDFS-11043: So the current plan is to not run TestWebHdfsTimeout for qbt? I

[jira] [Commented] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400946#comment-16400946 ] Lei (Eddy) Xu commented on HDFS-13217: -- Thanks a lot for the contribution [~liaoyuxiangqin]. It

[jira] [Comment Edited] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400944#comment-16400944 ] Chao Sun edited comment on HDFS-11043 at 3/15/18 6:43 PM: -- [~elgoiri]: yes I

[jira] [Comment Edited] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400944#comment-16400944 ] Chao Sun edited comment on HDFS-11043 at 3/15/18 6:43 PM: -- [~elgoiri]]: yes I

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400944#comment-16400944 ] Chao Sun commented on HDFS-11043: - [~goiri]: yes I believe so - from the uname in the report you can see

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400931#comment-16400931 ] Íñigo Goiri commented on HDFS-11043: AFAIK, the qbt runs on Linux, right? The build from yesterday had

[jira] [Commented] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400922#comment-16400922 ] Íñigo Goiri commented on HDFS-12919: This JIRA added a few methods to RouterRpcServer and

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400909#comment-16400909 ] Hudson commented on HDFS-13224: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13845 (See

[jira] [Commented] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400910#comment-16400910 ] Hudson commented on HDFS-13280: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13845 (See

[jira] [Updated] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12919: --- Attachment: HDFS-12919-branch-2.000.patch > RBF: Support erasure coding methods in RouterRpcServer >

[jira] [Comment Edited] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400898#comment-16400898 ] Chao Sun edited comment on HDFS-11043 at 3/15/18 6:26 PM: -- Submitted patch v0.

[jira] [Updated] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-11043: Assignee: Chao Sun (was: John Zhuge) Status: Patch Available (was: Open) Submitted patch v0.

[jira] [Updated] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-11043: Attachment: HDFS-11043.000.patch > TestWebHdfsTimeouts fails > - > >

[jira] [Updated] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13280: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 3.1.0

[jira] [Commented] (HDFS-13281) Namenode#createFile should be /.reserved/raw/ aware.

2018-03-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400858#comment-16400858 ] genericqa commented on HDFS-13281: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400851#comment-16400851 ] Lukas Majercak commented on HDFS-13284: --- Added the description [~elgoiri]. > Adjust criteria for

[jira] [Updated] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13284: -- Description: LowRedundancyBlocks currently has 5 priority queues: QUEUE_HIGHEST_PRIORITY = 0   

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-15 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400845#comment-16400845 ] Wei Yan commented on HDFS-13215: {quote}It looks like Yetus didn't run the unit tests for RBF {quote}

[jira] [Updated] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13284: -- Description: LowRedundancyBlocks currently has 5 priority queues: QUEUE_HIGHEST_PRIORITY = 0   

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400838#comment-16400838 ] Hudson commented on HDFS-13251: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13844 (See

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400837#comment-16400837 ] Hudson commented on HDFS-12723: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13844 (See

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400835#comment-16400835 ] Chao Sun commented on HDFS-11043: - Thanks [~xyao] for the suggestion! yes this is a much better solution.

[jira] [Commented] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400809#comment-16400809 ] Xiaoyu Yao commented on HDFS-13280: --- +1 for the v3 patch. I will commit it shortly.  > WebHDFS: Fix NPE

[jira] [Updated] (HDFS-13258) Ozone: restructure Hdsl/Ozone code to separated maven subprojects

2018-03-15 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-13258: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400803#comment-16400803 ] Xiaoyu Yao commented on HDFS-11043: --- Thanks [~csun]  for looking into this. Since the test works in OS

[jira] [Comment Edited] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400766#comment-16400766 ] Chao Sun edited comment on HDFS-11043 at 3/15/18 5:26 PM: -- Since the backlog

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400766#comment-16400766 ] Chao Sun commented on HDFS-11043: - Since the backlog queue implementation is rather OS-specific (different

[jira] [Updated] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13251: -- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~ajayydv] for the addendum

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400758#comment-16400758 ] Íñigo Goiri commented on HDFS-12723: Thanks [~ajayydv] for the fix. I committed to trunk, branch-3.1

[jira] [Updated] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12723: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 3.0.2

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400751#comment-16400751 ] Íñigo Goiri commented on HDFS-13215: It looks like Yetus didn't run the unit tests for RBF:

[jira] [Commented] (HDFS-11481) hdfs snapshotDiff /.reserved/raw/... fails on snapshottable directories

2018-03-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400741#comment-16400741 ] Yongjun Zhang commented on HDFS-11481: -- HDFS-10997 code change: {code} static SnapshotDiffReport

[jira] [Updated] (HDFS-13289) RBF: TestConnectionManager#testCleanup() test case need correction

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13289: --- Summary: RBF: TestConnectionManager#testCleanup() test case need correction (was:

[jira] [Commented] (HDFS-13289) RBF: TestConnectionManager#testCleanup() test case need correction

2018-03-15 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400686#comment-16400686 ] Wei Yan commented on HDFS-13289: [~dibyendu_hadoop] Thanks for reporting. Feel free to put a patch. >

[jira] [Commented] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2018-03-15 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400670#comment-16400670 ] Wellington Chevreuil commented on HDFS-12618: - Any comments on the last patch proposed? >

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400679#comment-16400679 ] Íñigo Goiri commented on HDFS-13293: Is this something along the lines of HDFS-13248? > RBF: The

[jira] [Commented] (HDFS-13289) RBF: TestConnectionManager#testCleanup() test case need correction

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400675#comment-16400675 ] Íñigo Goiri commented on HDFS-13289: Thanks [~dibyendu_hadoop] for catching this. I added you to the

[jira] [Updated] (HDFS-13295) Namenode doesn't leave safemode if dfs.namenode.safemode.replication.min set < dfs.namenode.replication.min

2018-03-15 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Fraison updated HDFS-13295: --- Attachment: HDFS-13295.patch > Namenode doesn't leave safemode if

[jira] [Updated] (HDFS-13295) Namenode doesn't leave safemode if dfs.namenode.safemode.replication.min set < dfs.namenode.replication.min

2018-03-15 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Fraison updated HDFS-13295: --- Assignee: Nicolas Fraison Status: Patch Available (was: Open) > Namenode doesn't leave

[jira] [Assigned] (HDFS-13289) RBF: TestConnectionManager#testCleanup() test case need correction

2018-03-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-13289: -- Assignee: Dibyendu Karmakar > RBF: TestConnectionManager#testCleanup() test case need

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-03-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400665#comment-16400665 ] Daryn Sharp commented on HDFS-10285: To summarize main _implementation_ issues from an offline

[jira] [Created] (HDFS-13295) Namenode doesn't leave safemode if dfs.namenode.safemode.replication.min set < dfs.namenode.replication.min

2018-03-15 Thread Nicolas Fraison (JIRA)
Nicolas Fraison created HDFS-13295: -- Summary: Namenode doesn't leave safemode if dfs.namenode.safemode.replication.min set < dfs.namenode.replication.min Key: HDFS-13295 URL:

[jira] [Commented] (HDFS-13281) Namenode#createFile should be /.reserved/raw/ aware.

2018-03-15 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400562#comment-16400562 ] Rushabh S Shah commented on HDFS-13281: --- Added a check to skip creating \{{FileEncryptionInfo}} if

  1   2   >