So I am new to hadoop, but everything is working well so far.
Except.....
I can use S3 fs in 15.3 without a problem.
However, if I try the same in 16.1 I get:
Exception in thread "main" java.lang.IllegalArgumentException: Hook
previously registered
at
java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:45)
at java.lang.Runtime.addShutdownHook(Runtime.java:192)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1194)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
at
org.apache.hadoop.fs.s3.S3FileSystem.initialize(S3FileSystem.java:81)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1180)
at org.apache.hadoop.fs.FileSystem.access$400(FileSystem.java:53)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1197)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148)
at org.apache.hadoop.fs.FileSystem.getNamed(FileSystem.java:122)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:94)
at org.apache.hadoop.fs.FsShell.init(FsShell.java:79)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:1567)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1704)
Same config both place, any thoughts on this? I checked out Jira and could
not find a related bug report.
-Jake