[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-14 Thread JIRA


 [ 
https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Íñigo Goiri updated HDFS-13675:
---
Fix Version/s: 2.9.2
   2.10.0

> Speed up TestDFSAdminWithHA
> ---
>
> Key: HDFS-13675
> URL: https://issues.apache.org/jira/browse/HDFS-13675
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs, namenode
>Reporter: Lukas Majercak
>Assignee: Lukas Majercak
>Priority: Major
> Fix For: 2.10.0, 3.2.0, 3.1.1, 2.9.2
>
> Attachments: HDFS-13675.000.patch, HDFS-13675.001.patch, 
> HDFS-13675_branch-2.000.patch
>
>
> Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main 
> culprits are two tests:
> testListOpenFilesNN1DownNN2Down
> testSetBalancerBandwidthNN1DownNN2Down
>  
> that each take 3~ minutes to finish. This is because they both expect to fail 
> to connect to 2 namenodes, but the client retry policy has way too many 
> retries and exponential backoffs. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-14 Thread Lukas Majercak (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lukas Majercak updated HDFS-13675:
--
Attachment: HDFS-13675_branch-2.000.patch

> Speed up TestDFSAdminWithHA
> ---
>
> Key: HDFS-13675
> URL: https://issues.apache.org/jira/browse/HDFS-13675
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs, namenode
>Reporter: Lukas Majercak
>Assignee: Lukas Majercak
>Priority: Major
> Fix For: 3.2.0, 3.1.1
>
> Attachments: HDFS-13675.000.patch, HDFS-13675.001.patch, 
> HDFS-13675_branch-2.000.patch
>
>
> Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main 
> culprits are two tests:
> testListOpenFilesNN1DownNN2Down
> testSetBalancerBandwidthNN1DownNN2Down
>  
> that each take 3~ minutes to finish. This is because they both expect to fail 
> to connect to 2 namenodes, but the client retry policy has way too many 
> retries and exponential backoffs. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-14 Thread JIRA


 [ 
https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Íñigo Goiri updated HDFS-13675:
---
   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 3.1.1
   3.2.0
   Status: Resolved  (was: Patch Available)

> Speed up TestDFSAdminWithHA
> ---
>
> Key: HDFS-13675
> URL: https://issues.apache.org/jira/browse/HDFS-13675
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs, namenode
>Reporter: Lukas Majercak
>Assignee: Lukas Majercak
>Priority: Major
> Fix For: 3.2.0, 3.1.1
>
> Attachments: HDFS-13675.000.patch, HDFS-13675.001.patch
>
>
> Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main 
> culprits are two tests:
> testListOpenFilesNN1DownNN2Down
> testSetBalancerBandwidthNN1DownNN2Down
>  
> that each take 3~ minutes to finish. This is because they both expect to fail 
> to connect to 2 namenodes, but the client retry policy has way too many 
> retries and exponential backoffs. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-14 Thread Lukas Majercak (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lukas Majercak updated HDFS-13675:
--
Attachment: HDFS-13675.001.patch

> Speed up TestDFSAdminWithHA
> ---
>
> Key: HDFS-13675
> URL: https://issues.apache.org/jira/browse/HDFS-13675
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs, namenode
>Reporter: Lukas Majercak
>Assignee: Lukas Majercak
>Priority: Major
> Attachments: HDFS-13675.000.patch, HDFS-13675.001.patch
>
>
> Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main 
> culprits are two tests:
> testListOpenFilesNN1DownNN2Down
> testSetBalancerBandwidthNN1DownNN2Down
>  
> that each take 3~ minutes to finish. This is because they both expect to fail 
> to connect to 2 namenodes, but the client retry policy has way too many 
> retries and exponential backoffs. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-13 Thread Lukas Majercak (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lukas Majercak updated HDFS-13675:
--
Description: 
Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main 
culprits are two tests:

testListOpenFilesNN1DownNN2Down

testSetBalancerBandwidthNN1DownNN2Down

 

that each take 3~ minutes to finish. This is because they both expect to fail 
to connect to 2 namenodes, but the client retry policy has way too many retries 
and exponential backoffs. 

  was:
Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main 
culprits are two tests:

testListOpenFilesNN1DownNN2Down

 

that each take 3~ minutes to finish. This is because they both expect to fail 
to connect to 2 namenodes, but the client retry policy has way too many retries 
and exponential backoffs. 


> Speed up TestDFSAdminWithHA
> ---
>
> Key: HDFS-13675
> URL: https://issues.apache.org/jira/browse/HDFS-13675
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs, namenode
>Reporter: Lukas Majercak
>Assignee: Lukas Majercak
>Priority: Major
> Attachments: HDFS-13675.000.patch
>
>
> Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main 
> culprits are two tests:
> testListOpenFilesNN1DownNN2Down
> testSetBalancerBandwidthNN1DownNN2Down
>  
> that each take 3~ minutes to finish. This is because they both expect to fail 
> to connect to 2 namenodes, but the client retry policy has way too many 
> retries and exponential backoffs. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-13 Thread Lukas Majercak (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lukas Majercak updated HDFS-13675:
--
Status: Patch Available  (was: In Progress)

> Speed up TestDFSAdminWithHA
> ---
>
> Key: HDFS-13675
> URL: https://issues.apache.org/jira/browse/HDFS-13675
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs, namenode
>Reporter: Lukas Majercak
>Assignee: Lukas Majercak
>Priority: Major
> Attachments: HDFS-13675.000.patch
>
>
> Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main 
> culprits are two tests:
> testListOpenFilesNN1DownNN2Down
>  
> that each take 3~ minutes to finish. This is because they both expect to fail 
> to connect to 2 namenodes, but the client retry policy has way too many 
> retries and exponential backoffs. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-13 Thread Lukas Majercak (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lukas Majercak updated HDFS-13675:
--
Attachment: HDFS-13675.000.patch

> Speed up TestDFSAdminWithHA
> ---
>
> Key: HDFS-13675
> URL: https://issues.apache.org/jira/browse/HDFS-13675
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs, namenode
>Reporter: Lukas Majercak
>Assignee: Lukas Majercak
>Priority: Major
> Attachments: HDFS-13675.000.patch
>
>
> Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main 
> culprits are two tests:
> testListOpenFilesNN1DownNN2Down
>  
> that each take 3~ minutes to finish. This is because they both expect to fail 
> to connect to 2 namenodes, but the client retry policy has way too many 
> retries and exponential backoffs. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13675) Speed up TestDFSAdminWithHA

2018-06-13 Thread Lukas Majercak (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lukas Majercak updated HDFS-13675:
--
Description: 
Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main 
culprits are two tests:

testListOpenFilesNN1DownNN2Down

 

that each take 3~ minutes to finish. This is because they both expect to fail 
to connect to 2 namenodes, but the client retry policy has way too many retries 
and exponential backoffs. 

> Speed up TestDFSAdminWithHA
> ---
>
> Key: HDFS-13675
> URL: https://issues.apache.org/jira/browse/HDFS-13675
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs, namenode
>Reporter: Lukas Majercak
>Assignee: Lukas Majercak
>Priority: Major
>
> Currently, TestDFSAdminWithHA takes about 10 minutes to finish. The main 
> culprits are two tests:
> testListOpenFilesNN1DownNN2Down
>  
> that each take 3~ minutes to finish. This is because they both expect to fail 
> to connect to 2 namenodes, but the client retry policy has way too many 
> retries and exponential backoffs. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org