[
https://issues.apache.org/jira/browse/HBASE-22607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995456#comment-16995456
]
AK97 edited comment on HBASE-22607 at 12/13/19 8:30 AM:
--------------------------------------------------------
I am using the command " mvn test -Dtest=TestExportSnapshotNoCluster -pl
hbase-mapreduce" to run the failing test case.
the logs are as follows:
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Detecting the operating system and CPU architecture
[INFO] ------------------------------------------------------------------------
[INFO] os.detected.name: linux
[INFO] os.detected.arch: ppcle_64
[INFO] os.detected.version: 3.10
[INFO] os.detected.version.major: 3
[INFO] os.detected.version.minor: 10
[INFO] os.detected.release: rhel
[INFO] os.detected.release.version: 7.7
[INFO] os.detected.release.like.rhel: true
[INFO] os.detected.release.like.fedora: true
[INFO] os.detected.classifier: linux-ppcle_64
[INFO]
[INFO] ------------------< org.apache.hbase:hbase-mapreduce >------------------
[INFO] Building Apache HBase - MapReduce 2.2.0
[INFO] --------------------------------[ jar ]---------------------------------
[INFO]
[INFO] --- build-helper-maven-plugin:3.0.0:bsh-property
(negate-license-bundles-property) @ hbase-mapreduce ---
[INFO]
[INFO] --- build-helper-maven-plugin:3.0.0:regex-property
(create-license-file-path-property) @ hbase-mapreduce ---
[INFO] No match to regex '\\' found in
'/root/aishwarya/hbase/hbase-mapreduce/target/maven-shared-archive-resources/META-INF/LICENSE'.
The initial value
'/root/aishwarya/hbase/hbase-mapreduce/target/maven-shared-archive-resources/META-INF/LICENSE'
is left as-is...
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-maven-version) @
hbase-mapreduce ---
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce
(hadoop-profile-min-maven-min-java-banned-xerces) @ hbase-mapreduce ---
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (banned-jsr305) @
hbase-mapreduce ---
[INFO]
[INFO] --- buildnumber-maven-plugin:1.4:create-timestamp (default) @
hbase-mapreduce ---
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (banned-illegal-imports) @
hbase-mapreduce ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles)
@ hbase-mapreduce ---
[INFO]
[INFO] --- maven-resources-plugin:3.1.0:resources (default-resources) @
hbase-mapreduce ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (check-aggregate-license) @
hbase-mapreduce ---
[INFO] Skipping Rule Enforcement.
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
hbase-mapreduce ---
[INFO] Compiling 2 source files to
/root/aishwarya/hbase/hbase-mapreduce/target/classes
[INFO]
[INFO] --- maven-resources-plugin:3.1.0:testResources (default-testResources) @
hbase-mapreduce ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 8 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @
hbase-mapreduce ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- warbucks-maven-plugin:1.1.0:check (run-warbucks) @ hbase-mapreduce
---
[INFO] Rule 0: Class Matches: 76
[INFO] Rule 0: Class Failures: 0
[INFO] Total class failures: 0
[INFO]
[INFO] --- maven-surefire-plugin:2.22.2:test (default-test) @ hbase-mapreduce
---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.hbase.snapshot.TestExportSnapshotNoCluster
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 5.807 s
<<< FAILURE! - in org.apache.hadoop.hbase.snapshot.TestExportSnapshotNoCluster
[ERROR]
testSnapshotWithRefsExportFileSystemState(org.apache.hadoop.hbase.snapshot.TestExportSnapshotNoCluster)
Time elapsed: 4.034 s <<< ERROR!
java.lang.IllegalArgumentException: Wrong FS:
file:/root/aishwarya/hbase/hbase-mapreduce/target/test-data/218afd5b-3ae1-8805-2aba-79f2c841481c/.hbase-snapshot/tableWithRefsV1,
expected: hdfs://localhost:44344
at
org.apache.hadoop.hbase.snapshot.TestExportSnapshotNoCluster.testSnapshotWithRefsExportFileSystemState(TestExportSnapshotNoCluster.java:110)
at
org.apache.hadoop.hbase.snapshot.TestExportSnapshotNoCluster.testSnapshotWithRefsExportFileSystemState(TestExportSnapshotNoCluster.java:90)
[INFO]
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR]
TestExportSnapshotNoCluster.testSnapshotWithRefsExportFileSystemState:90->testSnapshotWithRefsExportFileSystemState:110
» IllegalArgument
[INFO]
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 20.146 s
[INFO] Finished at: 2019-12-13T02:17:10-05:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test (default-test) on
project hbase-mapreduce: There are test failures.
[ERROR]
[ERROR] Please refer to
/root/aishwarya/hbase/hbase-mapreduce/target/surefire-reports for the
individual test results.
[ERROR] Please refer to dump files (if any exist) [date].dump,
[date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
I changed hbase-mapreduce/target/test-classes/hbase-site.xml by replacing
'hdfs://localhost:35345' to
'file:/hbase/hbase-mapreduce/target/test-data/35120b7a-8ae0-1738-09a2-497820fe4ff9/.hbase-snapshot/tableWithRefsV1'
that solved the error.
was (Author: ak2019):
I am using the command " mvn test -Dtest=TestExportSnapshotNoCluster -pl
hbase-mapreduce" to run the failing test case.
Please find attached the logs for the same.
I changed hbase-mapreduce/target/test-classes/hbase-site.xml by replacing
'hdfs://localhost:35345' to
'[file:/hbase/hbase-mapreduce/target/test-data/35120b7a-8ae0-1738-09a2-497820fe4ff9/.hbase-snapshot/tableWithRefsV1|file://hbase/hbase-mapreduce/target/test-data/35120b7a-8ae0-1738-09a2-497820fe4ff9/.hbase-snapshot/tableWithRefsV1]'
that solved the error.
> TestExportSnapshotNoCluster::testSnapshotWithRefsExportFileSystemState()
> fails intermittently
> ---------------------------------------------------------------------------------------------
>
> Key: HBASE-22607
> URL: https://issues.apache.org/jira/browse/HBASE-22607
> Project: HBase
> Issue Type: Bug
> Components: test
> Affects Versions: 3.0.0, 2.2.0, 2.0.6
> Reporter: Mingliang Liu
> Assignee: Mingliang Liu
> Priority: Major
> Fix For: 3.0.0, 2.3.0, 2.2.3, 2.1.9
>
> Attachments: HBASE-22607.000.patch, HBASE-22607.001.patch,
> HBASE-22607.002.patch, HBASE-22607.addendum.000.patch
>
>
> In previous runs, test
> {{TestExportSnapshotNoCluster.testSnapshotWithRefsExportFileSystemState}}
> fails intermittently with {{java.net.ConnectException: Connection refused}}
> exception, see build
> [510|https://builds.apache.org/job/PreCommit-HBASE-Build/510/testReport/org.apache.hadoop.hbase.snapshot/TestExportSnapshotNoCluster/testSnapshotWithRefsExportFileSystemState/],
>
> [545|https://builds.apache.org/job/PreCommit-HBASE-Build/545/testReport/org.apache.hadoop.hbase.snapshot/TestExportSnapshotNoCluster/testSnapshotWithRefsExportFileSystemState/],
> and
> [556|https://builds.apache.org/job/PreCommit-HBASE-Build/556/testReport/org.apache.hadoop.hbase.snapshot/TestExportSnapshotNoCluster/testSnapshotWithRefsExportFileSystemState/].
> So one sample exception is like:
> {quote}
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:155)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:346)
> at com.sun.proxy.$Proxy20.getListing(Unknown Source)
> at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1630)
> at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1614)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:900)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:114)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:964)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:961)
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:961)
> at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1537)
> at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1580)
> at
> org.apache.hadoop.hbase.util.CommonFSUtils.listStatus(CommonFSUtils.java:693)
> at
> org.apache.hadoop.hbase.util.FSTableDescriptors.getCurrentTableInfoStatus(FSTableDescriptors.java:448)
> at
> org.apache.hadoop.hbase.util.FSTableDescriptors.getTableInfoPath(FSTableDescriptors.java:429)
> at
> org.apache.hadoop.hbase.util.FSTableDescriptors.getTableInfoPath(FSTableDescriptors.java:410)
> at
> org.apache.hadoop.hbase.util.FSTableDescriptors.createTableDescriptorForTableDirectory(FSTableDescriptors.java:763)
> at
> org.apache.hadoop.hbase.snapshot.SnapshotTestingUtils$SnapshotMock.createTable(SnapshotTestingUtils.java:675)
> at
> org.apache.hadoop.hbase.snapshot.SnapshotTestingUtils$SnapshotMock.createSnapshot(SnapshotTestingUtils.java:653)
> at
> org.apache.hadoop.hbase.snapshot.SnapshotTestingUtils$SnapshotMock.createSnapshot(SnapshotTestingUtils.java:647)
> at
> org.apache.hadoop.hbase.snapshot.SnapshotTestingUtils$SnapshotMock.createSnapshotV2(SnapshotTestingUtils.java:637)
> at
> org.apache.hadoop.hbase.snapshot.TestExportSnapshotNoCluster.testSnapshotWithRefsExportFileSystemState(TestExportSnapshotNoCluster.java:80)
> {quote}
> This seems that, somehow the rootdir filesystem is not LocalFileSystem, but
> on HDFS. I have not dig deeper why this happens since it's failing
> intermittently and I can not reproduce it locally. Since this is testing
> export snapshot tool without cluster, we can enforce it using
> LocalFileSystem; no breaking change.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
