[jira] [Updated] (HDFS-13714) Fix TestNameNodePrunesMissingStorages test failures on Windows

2018-07-02 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13714: -- Status: Patch Available (was: In Progress) > Fix TestNameNodePrunesMissingStorages test

[jira] [Updated] (HDFS-13714) Fix TestNameNodePrunesMissingStorages

2018-07-02 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13714: -- Description: Failed here:

[jira] [Created] (HDFS-13714) Fix TestNameNodePrunesMissingStorages

2018-07-02 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-13714: - Summary: Fix TestNameNodePrunesMissingStorages Key: HDFS-13714 URL: https://issues.apache.org/jira/browse/HDFS-13714 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-13686) Add overall metrics for FSNamesystemLock

2018-06-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514468#comment-16514468 ] Lukas Majercak commented on HDFS-13686: --- Thanks [~xkrogen]. HDFS-11021 looks helpful, I thought

[jira] [Updated] (HDFS-13686) Add overall metrics for FSNamesystemLock

2018-06-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13686: -- Description: Currently, we have R/W FSNamesystemLock metrics per operation. I'd be useful to

[jira] [Work started] (HDFS-13686) Add overall metrics for FSNamesystemLock

2018-06-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13686 started by Lukas Majercak. - > Add overall metrics for FSNamesystemLock >

[jira] [Updated] (HDFS-13686) Add overall metrics for FSNamesystemLock

2018-06-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13686: -- Attachment: HDFS-13686.000.patch > Add overall metrics for FSNamesystemLock >

[jira] [Updated] (HDFS-13686) Add overall metrics for FSNamesystemLock

2018-06-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13686: -- Status: Patch Available (was: In Progress) > Add overall metrics for FSNamesystemLock >

[jira] [Created] (HDFS-13686) Add overall metrics for FSNamesystemLock

2018-06-15 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-13686: - Summary: Add overall metrics for FSNamesystemLock Key: HDFS-13686 URL: https://issues.apache.org/jira/browse/HDFS-13686 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512990#comment-16512990 ] Lukas Majercak commented on HDFS-13675: --- Added HDFS-13675_branch-2.000.patch > Speed up

[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13675: -- Attachment: HDFS-13675_branch-2.000.patch > Speed up TestDFSAdminWithHA >

[jira] [Assigned] (HDFS-13624) TestHDFSFileSystemContract#testAppend times out on Windows on the first run

2018-06-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak reassigned HDFS-13624: - Assignee: (was: Lukas Majercak) > TestHDFSFileSystemContract#testAppend times out

[jira] [Commented] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512808#comment-16512808 ] Lukas Majercak commented on HDFS-13675: --- patch001 after rebase > Speed up TestDFSAdminWithHA >

[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13675: -- Attachment: HDFS-13675.001.patch > Speed up TestDFSAdminWithHA > --- >

[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13675: -- Description: Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main

[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13675: -- Status: Patch Available (was: In Progress) > Speed up TestDFSAdminWithHA >

[jira] [Commented] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511855#comment-16511855 ] Lukas Majercak commented on HDFS-13675: --- Added patch000 to change the client retry policy

[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13675: -- Attachment: HDFS-13675.000.patch > Speed up TestDFSAdminWithHA > --- >

[jira] [Work started] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13675 started by Lukas Majercak. - > Speed up TestDFSAdminWithHA > --- > >

[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13675: -- Description: Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main

[jira] [Created] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-13 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-13675: - Summary: Speed up TestDFSAdminWithHA Key: HDFS-13675 URL: https://issues.apache.org/jira/browse/HDFS-13675 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-13563) TestDFSAdminWithHA times out on Windows

2018-06-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13563: -- Attachment: HDFS-13563.002.patch > TestDFSAdminWithHA times out on Windows >

[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows

2018-06-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511828#comment-16511828 ] Lukas Majercak commented on HDFS-13563: --- I think we can fix this by changing the retry policy on

[jira] [Commented] (HDFS-13591) TestDFSShell#testSetrepLow fails on Windows

2018-05-18 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481359#comment-16481359 ] Lukas Majercak commented on HDFS-13591: --- Should we do .startsWith/contains ?  >

[jira] [Updated] (HDFS-13590) Backport HDFS-12378 to branch-2

2018-05-18 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13590: -- Attachment: image-2018-05-18-11-01-05-739.png > Backport HDFS-12378 to branch-2 >

[jira] [Commented] (HDFS-13590) Backport HDFS-12378 to branch-2

2018-05-18 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480988#comment-16480988 ] Lukas Majercak commented on HDFS-13590: --- One of the tests affected by this is TestPipelinesFailover.

[jira] [Updated] (HDFS-13590) Backport HDFS-12378 to branch-2

2018-05-18 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13590: -- Status: Patch Available (was: Open) > Backport HDFS-12378 to branch-2 >

[jira] [Updated] (HDFS-13590) Backport HDFS-12378 to branch-2

2018-05-18 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13590: -- Status: In Progress (was: Patch Available) > Backport HDFS-12378 to branch-2 >

[jira] [Updated] (HDFS-13590) Backport HDFS-12378 to branch-2

2018-05-18 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13590: -- Status: Patch Available (was: In Progress) > Backport HDFS-12378 to branch-2 >

[jira] [Work started] (HDFS-13590) Backport HDFS-12378 to branch-2

2018-05-18 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13590 started by Lukas Majercak. - > Backport HDFS-12378 to branch-2 > --- > >

[jira] [Work stopped] (HDFS-13590) Backport HDFS-12378 to branch-2

2018-05-18 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13590 stopped by Lukas Majercak. - > Backport HDFS-12378 to branch-2 > --- > >

[jira] [Updated] (HDFS-13590) Backport HDFS-12378 to branch-2

2018-05-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13590: -- Attachment: HDFS-13590_branch-2.000.patch > Backport HDFS-12378 to branch-2 >

[jira] [Updated] (HDFS-13590) Backport HDFS-12378 to branch-2

2018-05-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13590: -- Fix Version/s: 2.9.0 2.9.1 2.9.2 > Backport HDFS-12378 to

[jira] [Created] (HDFS-13590) Backport HDFS-12378 to branch-2

2018-05-17 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-13590: - Summary: Backport HDFS-12378 to branch-2 Key: HDFS-13590 URL: https://issues.apache.org/jira/browse/HDFS-13590 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-13586) Fsync fails on directories on Windows

2018-05-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479912#comment-16479912 ] Lukas Majercak commented on HDFS-13586: --- Added patch001 to use cleaner Shell.WINDOWS instead of Path

[jira] [Updated] (HDFS-13586) Fsync fails on directories on Windows

2018-05-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13586: -- Attachment: HDFS-13586.001.patch > Fsync fails on directories on Windows >

[jira] [Commented] (HDFS-13586) Fsync fails on directories on Windows

2018-05-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479900#comment-16479900 ] Lukas Majercak commented on HDFS-13586: --- Posted a patch to ignore fsync on directories on Windows.

[jira] [Updated] (HDFS-13586) Fsync fails on directories on Windows

2018-05-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13586: -- Attachment: HDFS-13586.000.patch > Fsync fails on directories on Windows >

[jira] [Commented] (HDFS-13586) Fsync fails on directories on Windows

2018-05-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479775#comment-16479775 ] Lukas Majercak commented on HDFS-13586: --- The tests affected by this on Windows include, but are not

[jira] [Updated] (HDFS-13586) Fsync fails on directories on Windows

2018-05-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13586: -- Description: HDFS-11915 added a fsync call on DataNode's rbw directory on the first hsync()

[jira] [Updated] (HDFS-13586) Fsync fails on directories on Windows

2018-05-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13586: -- Environment: JDK 1.8.0_144 Hadoop 2.9+ > Fsync fails on directories on Windows >

[jira] [Updated] (HDFS-13586) Fsync fails on directories on Windows

2018-05-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13586: -- Description: HDFS-11915 added a fsync call on DataNode's rbw directory on the first hsync()

[jira] [Updated] (HDFS-13586) Fsync fails on directories on Windows

2018-05-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13586: -- Description: HDFS-11915 added a fsync call on DataNode's rbw directory on the first hsync()

[jira] [Created] (HDFS-13586) Fsync fails on directories on Windows

2018-05-17 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-13586: - Summary: Fsync fails on directories on Windows Key: HDFS-13586 URL: https://issues.apache.org/jira/browse/HDFS-13586 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-04-30 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Attachment: HDFS-13283_branch-2.000.patch > Percentage based Reserved Space Calculation for

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-04-30 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459150#comment-16459150 ] Lukas Majercak commented on HDFS-13283: --- Added HDFS-13283_branch-2.000.patch > Percentage based

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-04-30 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459100#comment-16459100 ] Lukas Majercak commented on HDFS-13283: --- Added HDFS-13283_branch-3.0.000.patch [~elgoiri]. >

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-04-30 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Attachment: HDFS-13283_branch-3.0.000.patch > Percentage based Reserved Space Calculation for

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-04-24 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450405#comment-16450405 ] Lukas Majercak commented on HDFS-13283: --- LGTM too, the tests don't seem to be related.

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-04-23 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448846#comment-16448846 ] Lukas Majercak commented on HDFS-13283: --- Added patch007, hope this one works. > Percentage based

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-04-23 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Attachment: HDFS-13283.007.patch > Percentage based Reserved Space Calculation for DataNode >

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-04-20 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446545#comment-16446545 ] Lukas Majercak commented on HDFS-13283: --- Sorry for being quiet on this. Thanks [~virajith] for the

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-04-20 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Attachment: HDFS-13283.006.patch > Percentage based Reserved Space Calculation for DataNode >

[jira] [Commented] (HDFS-13478) RBF: Decommission store API

2018-04-19 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444620#comment-16444620 ] Lukas Majercak commented on HDFS-13478: --- LGTM. Although, I could see changing the CLI commands to

[jira] [Commented] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-04-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441577#comment-16441577 ] Lukas Majercak commented on HDFS-13462: --- Added branch-2 patch. > Add BIND_HOST configuration for

[jira] [Updated] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-04-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13462: -- Attachment: HDFS-13462_branch-2.000.patch > Add BIND_HOST configuration for JournalNode's HTTP

[jira] [Commented] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-04-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441507#comment-16441507 ] Lukas Majercak commented on HDFS-13462: --- Do we wanna fix the 80 char limit in DFSConfigKeys?

[jira] [Commented] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-04-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441421#comment-16441421 ] Lukas Majercak commented on HDFS-13462: --- This is patch001 yetus results, waiting for patch002. >

[jira] [Commented] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-04-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441291#comment-16441291 ] Lukas Majercak commented on HDFS-13462: --- Patch002 to fix the other test failures. > Add BIND_HOST

[jira] [Updated] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-04-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13462: -- Attachment: HDFS-13462.002.patch > Add BIND_HOST configuration for JournalNode's HTTP and RPC

[jira] [Commented] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-04-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441210#comment-16441210 ] Lukas Majercak commented on HDFS-13462: --- Added patch001 to fix TestHdfsConfigFields + checkstyle. >

[jira] [Updated] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-04-17 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13462: -- Attachment: HDFS-13462.001.patch > Add BIND_HOST configuration for JournalNode's HTTP and RPC

[jira] [Updated] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-04-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13462: -- Description: Allow configurable bind-host for JournalNode's HTTP and RPC servers to allow

[jira] [Updated] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-04-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13462: -- Attachment: HDFS-13462.000.patch > Add BIND_HOST configuration for JournalNode's HTTP and RPC

[jira] [Created] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-04-16 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-13462: - Summary: Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers Key: HDFS-13462 URL: https://issues.apache.org/jira/browse/HDFS-13462 Project: Hadoop

[jira] [Commented] (HDFS-13311) RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows

2018-04-02 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422762#comment-16422762 ] Lukas Majercak commented on HDFS-13311: --- lgtm > RBF: TestRouterAdminCLI#testCreateInvalidEntry

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-19 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405379#comment-16405379 ] Lukas Majercak commented on HDFS-13283: --- Patch003 to fix the last checkstyle error. Unit test

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-19 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Attachment: HDFS-13283.003.patch > Percentage based Reserved Space Calculation for DataNode >

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-19 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405147#comment-16405147 ] Lukas Majercak commented on HDFS-13283: --- Added patch002 to fix checkstyle. > Percentage based

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-19 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Attachment: HDFS-13283.002.patch > Percentage based Reserved Space Calculation for DataNode >

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402646#comment-16402646 ] Lukas Majercak commented on HDFS-13283: --- Considering the implementation is minimal, I'd rather keep

[jira] [Commented] (HDFS-12886) Ignore minReplication for block recovery

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402603#comment-16402603 ] Lukas Majercak commented on HDFS-12886: --- Added patch for branch-2 > Ignore minReplication for block

[jira] [Updated] (HDFS-12886) Ignore minReplication for block recovery

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12886: -- Attachment: HDFS-12886_branch-2.000.patch > Ignore minReplication for block recovery >

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402448#comment-16402448 ] Lukas Majercak commented on HDFS-13283: --- Thanks for the review and suggestion [~virajith]. I removed

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Attachment: HDFS-13283.001.patch > Percentage based Reserved Space Calculation for DataNode >

[jira] [Commented] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402261#comment-16402261 ] Lukas Majercak commented on HDFS-12514: --- Reuploaded patch 003 to trigger a build. > Cancelled

[jira] [Updated] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12514: -- Attachment: (was: HDFS-12514.003.patch) > Cancelled HedgedReads cause block to be marked as

[jira] [Updated] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12514: -- Attachment: HDFS-12514.003.patch > Cancelled HedgedReads cause block to be marked as suspect on

[jira] [Updated] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13284: -- Attachment: HDFS-13284.001.patch > Adjust criteria for

[jira] [Commented] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402253#comment-16402253 ] Lukas Majercak commented on HDFS-13284: --- Added patch 001 for fixing checkstyle. Unit test failures

[jira] [Updated] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13284: -- Status: Patch Available (was: Open) > Adjust criteria for

[jira] [Work started] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13284 started by Lukas Majercak. - > Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY >

[jira] [Work stopped] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13284 stopped by Lukas Majercak. - > Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY >

[jira] [Commented] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400851#comment-16400851 ] Lukas Majercak commented on HDFS-13284: --- Added the description [~elgoiri]. > Adjust criteria for

[jira] [Updated] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13284: -- Description: LowRedundancyBlocks currently has 5 priority queues: QUEUE_HIGHEST_PRIORITY = 0   

[jira] [Updated] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-15 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13284: -- Description: LowRedundancyBlocks currently has 5 priority queues: QUEUE_HIGHEST_PRIORITY = 0   

[jira] [Updated] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13284: -- Attachment: HDFS-13284.000.patch > Adjust criteria for

[jira] [Created] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-14 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-13284: - Summary: Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY Key: HDFS-13284 URL: https://issues.apache.org/jira/browse/HDFS-13284 Project: Hadoop

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399490#comment-16399490 ] Lukas Majercak commented on HDFS-13283: --- We've been running this in production for 4months~ with the

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Description: Currently, the only way to configure reserved disk space for non-HDFS data on a

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Status: Patch Available (was: Open) > Percentage based Reserved Space Calculation for DataNode

[jira] [Work started] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13283 started by Lukas Majercak. - > Percentage based Reserved Space Calculation for DataNode >

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Attachment: HDFS-13283.000.patch > Percentage based Reserved Space Calculation for DataNode >

[jira] [Work stopped] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13283 stopped by Lukas Majercak. - > Percentage based Reserved Space Calculation for DataNode >

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399403#comment-16399403 ] Lukas Majercak commented on HDFS-13283: --- Will send a patch momentarily. > Percentage based Reserved

[jira] [Created] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-13283: - Summary: Percentage based Reserved Space Calculation for DataNode Key: HDFS-13283 URL: https://issues.apache.org/jira/browse/HDFS-13283 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13276: -- Attachment: HDFS-13276-branch-2.000.patch > TestDistributedFileSystem doesn't cleanup

[jira] [Commented] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399235#comment-16399235 ] Lukas Majercak commented on HDFS-12422: --- Added patch 002 after rebasing. > Replace DataNode in

[jira] [Updated] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12422: -- Attachment: HDFS-12422.002.patch > Replace DataNode in Pipeline when waiting for Last Packet

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399005#comment-16399005 ] Lukas Majercak commented on HDFS-13276: --- Removed > TestDistributedFileSystem doesn't cleanup

<    1   2   3   4   >