[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2020-06-12 Thread Kihwal Lee (Jira) 


 [ 
https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kihwal Lee updated HDFS-12453:
--
Fix Version/s: 2.10.1
 Hadoop Flags: Reviewed
   Resolution: Fixed
   Status: Resolved  (was: Patch Available)

> TestDataNodeHotSwapVolumes fails in trunk Jenkins runs
> --
>
> Key: HDFS-12453
> URL: https://issues.apache.org/jira/browse/HDFS-12453
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Arpit Agarwal
>Assignee: Lei (Eddy) Xu
>Priority: Critical
>  Labels: flaky-test
> Fix For: 2.10.1, 3.0.0
>
> Attachments: HDFS-12453-branch-2.10.001.patch, HDFS-12453.00.patch, 
> HDFS-12453.01.patch, TestLogs.txt
>
>
> TestDataNodeHotSwapVolumes fails occasionally with the following error (see 
> comment). Ran it ~10 times locally and it passed every time.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2020-06-11 Thread Jim Brennan (Jira) 


 [ 
https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jim Brennan updated HDFS-12453:
---
Release Note: Submitted version of patch for branch-2.10
  Status: Patch Available  (was: Reopened)

> TestDataNodeHotSwapVolumes fails in trunk Jenkins runs
> --
>
> Key: HDFS-12453
> URL: https://issues.apache.org/jira/browse/HDFS-12453
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Arpit Agarwal
>Assignee: Lei (Eddy) Xu
>Priority: Critical
>  Labels: flaky-test
> Fix For: 3.0.0
>
> Attachments: HDFS-12453-branch-2.10.001.patch, HDFS-12453.00.patch, 
> HDFS-12453.01.patch, TestLogs.txt
>
>
> TestDataNodeHotSwapVolumes fails occasionally with the following error (see 
> comment). Ran it ~10 times locally and it passed every time.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2020-06-06 Thread Jim Brennan (Jira) 


 [ 
https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jim Brennan updated HDFS-12453:
---
Attachment: HDFS-12453-branch-2.10.001.patch

> TestDataNodeHotSwapVolumes fails in trunk Jenkins runs
> --
>
> Key: HDFS-12453
> URL: https://issues.apache.org/jira/browse/HDFS-12453
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Arpit Agarwal
>Assignee: Lei (Eddy) Xu
>Priority: Critical
>  Labels: flaky-test
> Fix For: 3.0.0
>
> Attachments: HDFS-12453-branch-2.10.001.patch, HDFS-12453.00.patch, 
> HDFS-12453.01.patch, TestLogs.txt
>
>
> TestDataNodeHotSwapVolumes fails occasionally with the following error (see 
> comment). Ran it ~10 times locally and it passed every time.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2017-09-29 Thread Lei (Eddy) Xu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei (Eddy) Xu updated HDFS-12453:
-
   Resolution: Fixed
Fix Version/s: 3.0.0
   Status: Resolved  (was: Patch Available)

Thanks for [~xiaochen] reviews. Committed to {trunk} and {branch-3.0}.



> TestDataNodeHotSwapVolumes fails in trunk Jenkins runs
> --
>
> Key: HDFS-12453
> URL: https://issues.apache.org/jira/browse/HDFS-12453
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Arpit Agarwal
>Assignee: Lei (Eddy) Xu
>Priority: Critical
>  Labels: flaky-test
> Fix For: 3.0.0
>
> Attachments: HDFS-12453.00.patch, HDFS-12453.01.patch, TestLogs.txt
>
>
> TestDataNodeHotSwapVolumes fails occasionally with the following error (see 
> comment). Ran it ~10 times locally and it passed every time.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2017-09-28 Thread Lei (Eddy) Xu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei (Eddy) Xu updated HDFS-12453:
-
Attachment: HDFS-12453.01.patch

Thanks [~xiaochen] for the reviews. Update the patch to use 
{{MultipleIOException}} .

> TestDataNodeHotSwapVolumes fails in trunk Jenkins runs
> --
>
> Key: HDFS-12453
> URL: https://issues.apache.org/jira/browse/HDFS-12453
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Arpit Agarwal
>Assignee: Lei (Eddy) Xu
>Priority: Critical
>  Labels: flaky-test
> Attachments: HDFS-12453.00.patch, HDFS-12453.01.patch, TestLogs.txt
>
>
> TestDataNodeHotSwapVolumes fails occasionally with the following error (see 
> comment). Ran it ~10 times locally and it passed every time.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2017-09-27 Thread Lei (Eddy) Xu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei (Eddy) Xu updated HDFS-12453:
-
Status: Patch Available  (was: Open)

> TestDataNodeHotSwapVolumes fails in trunk Jenkins runs
> --
>
> Key: HDFS-12453
> URL: https://issues.apache.org/jira/browse/HDFS-12453
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Arpit Agarwal
>Assignee: Lei (Eddy) Xu
>Priority: Critical
>  Labels: flaky-test
> Attachments: HDFS-12453.00.patch, TestLogs.txt
>
>
> TestDataNodeHotSwapVolumes fails occasionally with the following error (see 
> comment). Ran it ~10 times locally and it passed every time.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2017-09-27 Thread Lei (Eddy) Xu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei (Eddy) Xu updated HDFS-12453:
-
Attachment: HDFS-12453.00.patch

Change the {{stream}} thread to block on barrier, and removing volumes that are 
located by the block, to improve the deterministic of the test.

Ran tests like following and passed with this patch, and fail on trunk.

{code}
for i in `seq 50`; do
  mvn test -Dtest=TestDataNodeHotSwapVolumes
done
{code}

> TestDataNodeHotSwapVolumes fails in trunk Jenkins runs
> --
>
> Key: HDFS-12453
> URL: https://issues.apache.org/jira/browse/HDFS-12453
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Arpit Agarwal
>Assignee: Lei (Eddy) Xu
>Priority: Critical
>  Labels: flaky-test
> Attachments: HDFS-12453.00.patch, TestLogs.txt
>
>
> TestDataNodeHotSwapVolumes fails occasionally with the following error (see 
> comment). Ran it ~10 times locally and it passed every time.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2017-09-20 Thread Andrew Wang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Wang updated HDFS-12453:
---
Labels: flaky-test  (was: )

> TestDataNodeHotSwapVolumes fails in trunk Jenkins runs
> --
>
> Key: HDFS-12453
> URL: https://issues.apache.org/jira/browse/HDFS-12453
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Arpit Agarwal
>Priority: Critical
>  Labels: flaky-test
> Attachments: TestLogs.txt
>
>
> TestDataNodeHotSwapVolumes fails occasionally with the following error (see 
> comment). Ran it ~10 times locally and it passed every time.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2017-09-14 Thread Arpit Agarwal (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Agarwal updated HDFS-12453:
-
Attachment: TestLogs.txt

> TestDataNodeHotSwapVolumes fails in trunk Jenkins runs
> --
>
> Key: HDFS-12453
> URL: https://issues.apache.org/jira/browse/HDFS-12453
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Arpit Agarwal
>Priority: Critical
> Attachments: TestLogs.txt
>
>
> TestDataNodeHotSwapVolumes fails occasionally with the following error (see 
> comment). Ran it ~10 times locally and it passed every time.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2017-09-14 Thread Arpit Agarwal (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Agarwal updated HDFS-12453:
-
Description: TestDataNodeHotSwapVolumes fails occasionally with the 
following error (see comment). Ran it ~10 times locally and it passed every 
time.  (was: TestDataNodeHotSwapVolumes fails occasionally with the following 
error. Ran it ~10 times locally and it passed every time.

{code}
Error Message

Failed to replace a bad datanode on the existing pipeline due to no more good 
datanodes being available to try. (Nodes: 
current=[DatanodeInfoWithStorage[127.0.0.1:46950,DS-e653e0ec-e490-47d3-9cca-cdd6dff3964a,DISK],
 
DatanodeInfoWithStorage[127.0.0.1:34486,DS-fd83f642-be1a-44ed-8ba5-6ad5a42e85fd,DISK]],
 
original=[DatanodeInfoWithStorage[127.0.0.1:34486,DS-fd83f642-be1a-44ed-8ba5-6ad5a42e85fd,DISK],
 
DatanodeInfoWithStorage[127.0.0.1:46950,DS-e653e0ec-e490-47d3-9cca-cdd6dff3964a,DISK]]).
 The current failed datanode replacement policy is DEFAULT, and a client may 
configure this via 'dfs.client.block.write.replace-datanode-on-failure.policy' 
in its configuration.

Stacktrace

java.io.IOException: Failed to replace a bad datanode on the existing pipeline 
due to no more good datanodes being available to try. (Nodes: 
current=[DatanodeInfoWithStorage[127.0.0.1:46950,DS-e653e0ec-e490-47d3-9cca-cdd6dff3964a,DISK],
 
DatanodeInfoWithStorage[127.0.0.1:34486,DS-fd83f642-be1a-44ed-8ba5-6ad5a42e85fd,DISK]],
 
original=[DatanodeInfoWithStorage[127.0.0.1:34486,DS-fd83f642-be1a-44ed-8ba5-6ad5a42e85fd,DISK],
 
DatanodeInfoWithStorage[127.0.0.1:46950,DS-e653e0ec-e490-47d3-9cca-cdd6dff3964a,DISK]]).
 The current failed datanode replacement policy is DEFAULT, and a client may 
configure this via 'dfs.client.block.write.replace-datanode-on-failure.policy' 
in its configuration.
at 
org.apache.hadoop.hdfs.DataStreamer.findNewDatanode(DataStreamer.java:1321)
at 
org.apache.hadoop.hdfs.DataStreamer.addDatanode2ExistingPipeline(DataStreamer.java:1387)
at 
org.apache.hadoop.hdfs.DataStreamer.handleDatanodeReplacement(DataStreamer.java:1586)
at 
org.apache.hadoop.hdfs.DataStreamer.setupPipelineInternal(DataStreamer.java:1487)
at 
org.apache.hadoop.hdfs.DataStreamer.setupPipelineForAppendOrRecovery(DataStreamer.java:1469)
at 
org.apache.hadoop.hdfs.DataStreamer.processDatanodeOrExternalError(DataStreamer.java:1273)
at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:684)

{code})

> TestDataNodeHotSwapVolumes fails in trunk Jenkins runs
> --
>
> Key: HDFS-12453
> URL: https://issues.apache.org/jira/browse/HDFS-12453
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Arpit Agarwal
>Priority: Critical
>
> TestDataNodeHotSwapVolumes fails occasionally with the following error (see 
> comment). Ran it ~10 times locally and it passed every time.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org