Rushabh S Shah created HDFS-12938:
-------------------------------------
Summary: TestErasureCodigCLI test failing consistently.
Key: HDFS-12938
URL: https://issues.apache.org/jira/browse/HDFS-12938
Project: Hadoop HDFS
Issue Type: Bug
Components: erasure-coding, hdfs
Affects Versions: 3.1.0
Reporter: Rushabh S Shah
{{TestErasureCodingCLI#testAll}} is failing consistently.
It failed in this precommit:
https://builds.apache.org/job/PreCommit-HDFS-Build/22435/testReport/org.apache.hadoop.cli/TestErasureCodingCLI/testAll/
I ran locally on my laptop and it failed too.
Below is the detailed report from
{{org.apache.hadoop.cli.TestErasureCodingCLI-output.txt}}.
{noformat}
2017-12-18 09:25:44,821 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(156)) -
-------------------------------------------
2017-12-18 09:25:44,821 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(157)) - Test ID: [15]
2017-12-18 09:25:44,821 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(158)) - Test Description:
[setPolicy : set policy on non-empty directory]
2017-12-18 09:25:44,821 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(159)) -
2017-12-18 09:25:44,821 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(163)) - Test Commands: [-fs
hdfs://localhost:52345 -mkdir /ecdir]
2017-12-18 09:25:44,821 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(163)) - Test Commands: [-fs
hdfs://localhost:52345 -touchz /ecdir/file1]
2017-12-18 09:25:44,821 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(163)) - Test Commands: [-fs
hdfs://localhost:52345 -setPolicy -policy RS-6-3-1024k -path /ecdir]
2017-12-18 09:25:44,821 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(167)) -
2017-12-18 09:25:44,821 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(170)) - Cleanup Commands: [-fs
hdfs://localhost:52345 -rm -R /ecdir]
2017-12-18 09:25:44,821 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(174)) -
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(178)) - Comparator:
[SubstringComparator]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(180)) - Comparision result: [fail]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(182)) - Expected output:
[Warning: setting erasure coding policy on an non-empty directory will not
automatically convert existing data to RS-6-3-1024]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(184)) - Actual output: [Set
erasure coding policy RS-6-3-1024k on /ecdir
Warning: setting erasure coding policy on a non-empty directory will not
automatically convert existing files to RS-6-3-1024k
]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(187)) -
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(156)) -
-------------------------------------------
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(157)) - Test ID: [17]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(158)) - Test Description:
[unsetPolicy : unset policy on non-empty directory]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(159)) -
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(163)) - Test Commands: [-fs
hdfs://localhost:52345 -mkdir /ecdir]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(163)) - Test Commands: [-fs
hdfs://localhost:52345 -setPolicy -policy RS-6-3-1024k -path /ecdir]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(163)) - Test Commands: [-fs
hdfs://localhost:52345 -touchz /ecdir/file1]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(163)) - Test Commands: [-fs
hdfs://localhost:52345 -unsetPolicy -path /ecdir]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(167)) -
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(170)) - Cleanup Commands: [-fs
hdfs://localhost:52345 -rm -R /ecdir]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(174)) -
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(178)) - Comparator:
[SubstringComparator]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(180)) - Comparision result: [fail]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(182)) - Expected output:
[Warning: unsetting erasure coding policy on an non-empty directory will not
automatically convert existing data to replicated data]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(184)) - Actual output:
[Unset erasure coding policy from /ecdir
Warning: unsetting erasure coding policy on a non-empty directory will not
automatically convert existing files to replicated data.
]
2017-12-18 09:25:44,822 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(187)) -
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(191)) - Summary results:
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(192)) - ----------------------------------
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(212)) - Testing mode: test
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(213)) -
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(214)) - Overall result: ---
FAIL ---
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(222)) - # Tests pass: 51 (96%)
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(224)) - # Tests fail: 2 (3%)
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(228)) - # Validations done: 67
(each test may do multiple validations)
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(231)) -
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(232)) - Failing tests:
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(233)) - --------------
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(239)) - 15: setPolicy : set policy on
non-empty directory
2017-12-18 09:25:44,823 [Thread-0] INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(239)) - 17: unsetPolicy : unset policy on
non-empty directory
{noformat}
{{setPolicy}} and {{unsetPolicy}} commands are failing.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
