[jira] [Commented] (HDFS-13272) DataNodeHttpServer to have configurable HttpServer2 threads

2018-03-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397433#comment-16397433 ] Kihwal Lee commented on HDFS-13272: --- bq. ... the possibility of this being too few threads ... The jetty

[jira] [Updated] (HDFS-12977) Add stateId to RPC headers.

2018-03-13 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-12977: Attachment: HDFS_12977.trunk.004.patch > Add stateId to RPC headers. >

[jira] [Updated] (HDFS-12977) Add stateId to RPC headers.

2018-03-13 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-12977: Status: Patch Available (was: In Progress) > Add stateId to RPC headers. >

[jira] [Assigned] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-13274: -- Assignee: Íñigo Goiri > RBF: Extend RouterRpcClient to use multiple sockets >

[jira] [Commented] (HDFS-12505) Extend TestFileStatusWithECPolicy with a random EC policy

2018-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397415#comment-16397415 ] Hudson commented on HDFS-12505: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13828 (See

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-13 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397434#comment-16397434 ] Plamen Jeliazkov commented on HDFS-12977: - I spoke with Konstantin offline and concluded to use

[jira] [Commented] (HDFS-12780) Fix spelling mistake in DistCpUtils.java

2018-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397442#comment-16397442 ] Hudson commented on HDFS-12780: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #13829 (See

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-13 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397440#comment-16397440 ] Plamen Jeliazkov commented on HDFS-12977: - I think with this edition of the patch we are now ready

[jira] [Work started] (HDFS-12977) Add stateId to RPC headers.

2018-03-13 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12977 started by Plamen Jeliazkov. --- > Add stateId to RPC headers. > --- > >

[jira] [Commented] (HDFS-13272) DataNodeHttpServer to have configurable HttpServer2 threads

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397454#comment-16397454 ] Erik Krogen commented on HDFS-13272: This is mostly motivated by the desire to reduce the thread

[jira] [Created] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2018-03-13 Thread JIRA
Íñigo Goiri created HDFS-13274: -- Summary: RBF: Extend RouterRpcClient to use multiple sockets Key: HDFS-13274 URL: https://issues.apache.org/jira/browse/HDFS-13274 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13274: --- Description: HADOOP-13144 introduces the ability to create multiple connections for the same user and

[jira] [Commented] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397462#comment-16397462 ] Íñigo Goiri commented on HDFS-13274: As commented in HADOOP-13144, we would be able to create

[jira] [Commented] (HDFS-12780) Fix spelling mistake in DistCpUtils.java

2018-03-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397468#comment-16397468 ] Chris Douglas commented on HDFS-12780: -- Failure is unrelated. {noformat} [ERROR] Failed to execute

[jira] [Commented] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397596#comment-16397596 ] genericqa commented on HDFS-12773: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-13 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Attachment: HDFS-13176-branch-2.03.patch > WebHdfs file path gets truncated when having semicolon

[jira] [Created] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-13275: - Summary: Adding logs for BlockPoolManager#refreshNamenodes Key: HDFS-13275 URL: https://issues.apache.org/jira/browse/HDFS-13275 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-13270) RBF: Router audit logger

2018-03-13 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-13270: -- Issue Type: Sub-task (was: New Feature) Parent: HDFS-12615 > RBF: Router audit logger >

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396599#comment-16396599 ] Xiao Chen commented on HDFS-11600: -- Thanks Sammi, makes sense. +1 from me on patch 6 pending the line

[jira] [Commented] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396618#comment-16396618 ] Yiqun Lin commented on HDFS-12773: -- Hi [~elgoiri], thanks for your comments. Comments make sense to me.

[jira] [Created] (HDFS-13270) RBF: Router audit logger

2018-03-13 Thread maobaolong (JIRA)
maobaolong created HDFS-13270: - Summary: RBF: Router audit logger Key: HDFS-13270 URL: https://issues.apache.org/jira/browse/HDFS-13270 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Updated] (HDFS-12587) Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to apply multiple EC policies

2018-03-13 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-12587: Attachment: HDFS-12587.2.patch > Use Parameterized tests in TestBlockInfoStriped and >

[jira] [Commented] (HDFS-12587) Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to apply multiple EC policies

2018-03-13 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396672#comment-16396672 ] Takanobu Asanuma commented on HDFS-12587: - Hi [~xiaochen], thanks for the review! Updated the

[jira] [Commented] (HDFS-12505) Extend TestFileStatusWithECPolicy with a random EC policy

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1639#comment-1639 ] genericqa commented on HDFS-12505: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396618#comment-16396618 ] Yiqun Lin edited comment on HDFS-12773 at 3/13/18 9:03 AM: --- Hi [~elgoiri],

[jira] [Commented] (HDFS-13141) WebHDFS: Add support for getting snasphottable directory list

2018-03-13 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396709#comment-16396709 ] Lokesh Jain commented on HDFS-13141: [~xyao] [~chris.douglas] I have created HDFS-13271 for adding a

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396772#comment-16396772 ] SammiChen commented on HDFS-11600: -- Thanks [~xiaochen] for the review.  I uploaded 007 patch to address

[jira] [Updated] (HDFS-13271) WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument

2018-03-13 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13271: --- Attachment: HDFS-13271.002.patch > WebHDFS: Add constructor in SnapshottableDirectoryStatus with

[jira] [Commented] (HDFS-13271) WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument

2018-03-13 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396782#comment-16396782 ] Lokesh Jain commented on HDFS-13271: v2 patch fixes a checkstyle issue. > WebHDFS: Add constructor in

[jira] [Updated] (HDFS-13271) WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument

2018-03-13 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13271: --- Attachment: HDFS-13271.001.patch > WebHDFS: Add constructor in SnapshottableDirectoryStatus with

[jira] [Updated] (HDFS-13271) WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument

2018-03-13 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13271: --- Status: Patch Available (was: Open) > WebHDFS: Add constructor in SnapshottableDirectoryStatus with

[jira] [Commented] (HDFS-13270) RBF: Router audit logger

2018-03-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396719#comment-16396719 ] Yiqun Lin commented on HDFS-13270: -- Looks nice to have. > RBF: Router audit logger >

[jira] [Commented] (HDFS-13271) WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396759#comment-16396759 ] genericqa commented on HDFS-13271: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13271) WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396838#comment-16396838 ] genericqa commented on HDFS-13271: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13261) Incorrect null value check

2018-03-13 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-13261: - Attachment: HDFS-13261.002.patch > Incorrect null value check > -- > >

[jira] [Updated] (HDFS-13261) Incorrect null value check

2018-03-13 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-13261: - Status: Patch Available (was: In Progress) Thanks for [~xyao] comment, update the patch for

[jira] [Updated] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11600: - Attachment: HDFS-11600.007.patch > Refactor TestDFSStripedOutputStreamWithFailure test classes >

[jira] [Commented] (HDFS-12587) Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to apply multiple EC policies

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396835#comment-16396835 ] genericqa commented on HDFS-12587: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-13271) WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument

2018-03-13 Thread Lokesh Jain (JIRA)
Lokesh Jain created HDFS-13271: -- Summary: WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument Key: HDFS-13271 URL: https://issues.apache.org/jira/browse/HDFS-13271

[jira] [Updated] (HDFS-13261) Incorrect null value check

2018-03-13 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-13261: - Status: In Progress (was: Patch Available) > Incorrect null value check >

[jira] [Commented] (HDFS-13261) Incorrect null value check

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396884#comment-16396884 ] genericqa commented on HDFS-13261: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13261) Incorrect null value check

2018-03-13 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-13261: - Attachment: HDFS-13261.002-branch-2.patch > Incorrect null value check >

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396881#comment-16396881 ] genericqa commented on HDFS-11600: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397173#comment-16397173 ] Íñigo Goiri commented on HDFS-12514: FindBugs is complaining because I forgot to remove the

[jira] [Commented] (HDFS-13270) RBF: Router audit logger

2018-03-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397188#comment-16397188 ] Wei Yan commented on HDFS-13270: [~maobaolong] Just curious, where do you plan to put the auditlogger, in

[jira] [Commented] (HDFS-13271) WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument

2018-03-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397210#comment-16397210 ] Xiaoyu Yao commented on HDFS-13271: --- Patch v002 looks good to me. cc: [~chris.douglas] for additional

[jira] [Updated] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13239: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.2 3.1.0

[jira] [Commented] (HDFS-13271) WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument

2018-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397283#comment-16397283 ] Hudson commented on HDFS-13271: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13823 (See

[jira] [Commented] (HDFS-13249) Document webhdfs support for getting snapshottable directory list

2018-03-13 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397298#comment-16397298 ] Lokesh Jain commented on HDFS-13249: [~xyao] Thanks for reviewing the patch! v3 patch addresses your

[jira] [Updated] (HDFS-13249) Document webhdfs support for getting snapshottable directory list

2018-03-13 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13249: --- Attachment: HDFS-13249.003.patch > Document webhdfs support for getting snapshottable directory list

[jira] [Updated] (HDFS-13271) WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument

2018-03-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-13271: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Status:

[jira] [Commented] (HDFS-13271) WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument

2018-03-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397250#comment-16397250 ] Xiaoyu Yao commented on HDFS-13271: --- Thanks, [~chris.douglas] for the review and commit. > WebHDFS: Add

[jira] [Commented] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397276#comment-16397276 ] Íñigo Goiri commented on HDFS-12773: Thanks, [~linyiqun] for the comments. Uploaded

[jira] [Commented] (HDFS-12505) Extend TestFileStatusWithECPolicy with a random EC policy

2018-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397287#comment-16397287 ] Hudson commented on HDFS-12505: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #13824 (See

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397289#comment-16397289 ] Hudson commented on HDFS-13239: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #13824 (See

[jira] [Updated] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12773: --- Attachment: HDFS-12773.007.patch > RBF: Improve State Store FS implementation >

[jira] [Updated] (HDFS-12587) Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies

2018-03-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12587: - Summary: Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC

[jira] [Commented] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397238#comment-16397238 ] Wei Yan commented on HDFS-13198: Upload a new patch [^HDFS-13198.002.patch] to address checkstyle issues,

[jira] [Commented] (HDFS-12505) Extend TestFileStatusWithECPolicy with a random EC policy

2018-03-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397254#comment-16397254 ] Xiao Chen commented on HDFS-12505: -- Committing this. > Extend TestFileStatusWithECPolicy with a random

[jira] [Created] (HDFS-13272) DataNodeHttpServer hard-codes HttpServer2 threads at 10

2018-03-13 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-13272: -- Summary: DataNodeHttpServer hard-codes HttpServer2 threads at 10 Key: HDFS-13272 URL: https://issues.apache.org/jira/browse/HDFS-13272 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397256#comment-16397256 ] Íñigo Goiri commented on HDFS-13198: Thanks, [~ywskycn] for [^HDFS-13198.002.patch] . I would extract

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397273#comment-16397273 ] Xiao Chen commented on HDFS-13239: -- +1, committing this > Fix non-empty dir warning message when setting

[jira] [Updated] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-13198: --- Attachment: HDFS-13198.002.patch > RBF: RouterHeartbeatService throws out CachedStateStore related exceptions

[jira] [Updated] (HDFS-12505) Extend TestFileStatusWithECPolicy with a random EC policy

2018-03-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12505: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.2 3.1.0

[jira] [Commented] (HDFS-13249) Document webhdfs support for getting snapshottable directory list

2018-03-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397279#comment-16397279 ] Xiaoyu Yao commented on HDFS-13249: --- Thanks [~ljain] for the update. Two more comments:   The patch

[jira] [Commented] (HDFS-12587) Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to apply multiple EC policies

2018-03-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397292#comment-16397292 ] Xiao Chen commented on HDFS-12587: -- +1, committing this > Use Parameterized tests in

[jira] [Updated] (HDFS-12587) Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies

2018-03-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12587: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.2 3.1.0

[jira] [Updated] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-13 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13163: -- Description: When Blocks are invalidated, move the blocks to replica-trash directory

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397798#comment-16397798 ] genericqa commented on HDFS-12977: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224.007.patch > RBF: Resolvers to support mount points across multiple subclusters

[jira] [Updated] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13235: - Component/s: documentation > DiskBalancer: Update Documentation to add newly added options >

[jira] [Updated] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13235: - Issue Type: Improvement (was: Bug) > DiskBalancer: Update Documentation to add newly added

[jira] [Updated] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13235: - Component/s: diskbalancer > DiskBalancer: Update Documentation to add newly added options >

[jira] [Commented] (HDFS-336) dfsadmin -report should report number of blocks from datanode

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397857#comment-16397857 ] Arpit Agarwal commented on HDFS-336: +1 for the patch. The failed unit tests are known flaky tests. I

[jira] [Updated] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13275: -- Attachment: (was: HDFS-13275.000.patch) > Adding logs for BlockPoolManager#refreshNamenodes >

[jira] [Updated] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13265: --- Attachment: (was: HDFS-13265.000.patch) > MiniDFSCluster should set reasonable defaults to reduce

[jira] [Updated] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-13 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13163: -- Description: When Blocks are invalidated, move the blocks to replica-trash directory

[jira] [Commented] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397823#comment-16397823 ] Arpit Agarwal commented on HDFS-13163: -- Thanks for this patch [~bharatviswa]. A few comments: #

[jira] [Updated] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13235: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Updated] (HDFS-336) dfsadmin -report should report number of blocks from datanode

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-336: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status: Resolved

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397636#comment-16397636 ] Íñigo Goiri commented on HDFS-13276: The culprit for us was {{testDFSClientPeerReadTimeout()}} which

[jira] [Created] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-13 Thread JIRA
Íñigo Goiri created HDFS-13276: -- Summary: TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out Key: HDFS-13276 URL: https://issues.apache.org/jira/browse/HDFS-13276 Project: Hadoop

[jira] [Updated] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13275: -- Attachment: HDFS-13275.000.patch > Adding logs for BlockPoolManager#refreshNamenodes >

[jira] [Updated] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13275: -- Status: Patch Available (was: Open) > Adding logs for BlockPoolManager#refreshNamenodes >

[jira] [Updated] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12514: -- Attachment: HDFS-12514-branch-2.000.patch > Cancelled HedgedReads cause block to be marked as

[jira] [Updated] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13265: --- Attachment: HDFS-13265.000.patch > MiniDFSCluster should set reasonable defaults to reduce resource

[jira] [Updated] (HDFS-13258) Ozone: restructure Hdsl/Ozone code to separated maven subprojects

2018-03-13 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13258: Attachment: HDFS-13258-HDFS-7240.005.patch > Ozone: restructure Hdsl/Ozone code to separated maven

[jira] [Updated] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12514: -- Attachment: HDFS-12514.003.patch > Cancelled HedgedReads cause block to be marked as suspect on

[jira] [Commented] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397660#comment-16397660 ] Lukas Majercak commented on HDFS-12514: --- Fixed the trunk patch and added one for branch-2. >

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397689#comment-16397689 ] Ajay Kumar commented on HDFS-13251: --- Patch v3 to adress [~xyao] suggestions. Removed below changes as

[jira] [Updated] (HDFS-13268) TestWebHdfsFileContextMainOperations fails on Windows

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13268: --- Status: Patch Available (was: Open) > TestWebHdfsFileContextMainOperations fails on Windows >

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397710#comment-16397710 ] Wei Yan commented on HDFS-13215: {quote}I'm leaning towards having our own hdfs-rbf-site.xml. {quote} I'm

[jira] [Updated] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13276: -- Attachment: HDFS-13276.000.patch > TestDistributedFileSystem doesn't cleanup MiniDFSCluster if

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397641#comment-16397641 ] Lukas Majercak commented on HDFS-13276: --- Submitted a patch to clean up the MiniDFSCluster after each

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397645#comment-16397645 ] Íñigo Goiri commented on HDFS-13276: Thanks [~lukmajercak] for [^HDFS-13276.000.patch]. The patch is

[jira] [Updated] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13275: -- Attachment: HDFS-13275.000.patch > Adding logs for BlockPoolManager#refreshNamenodes >

[jira] [Updated] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13251: -- Attachment: HDFS-13251.003.patch > Avoid using hard coded datanode data dirs in unit tests >

[jira] [Commented] (HDFS-13150) Create fast path for SbNN tailing edits from JNs

2018-03-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397731#comment-16397731 ] Konstantin Shvachko commented on HDFS-13150: As a reminder, the two approaches for SBN /

[jira] [Commented] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397738#comment-16397738 ] Erik Krogen commented on HDFS-13265: Attaching v000 patch (trunk & branch-2) which incorporates

[jira] [Updated] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13265: --- Status: Patch Available (was: In Progress) > MiniDFSCluster should set reasonable defaults to reduce

  1   2   >