[
https://issues.apache.org/jira/browse/HADOOP-16346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856008#comment-16856008
]
Steve Loughran edited comment on HADOOP-16346 at 6/7/19 10:23 AM:
------------------------------------------------------------------
I can't even get the CLI to work
{code}
~/P/h/h/t/hadoop-3.3.0-SNAPSHOT (s3/HADOOP-15183-s3guard-rename-failures ⚡↩=)
bin/hadoop fs -ls s3a://hwdev-steve-ireland-new/
Exception in thread "main" java.lang.NoClassDefFoundError:
org/wildfly/openssl/OpenSSLProvider
at
org.apache.hadoop.security.ssl.OpenSSLSocketFactory.<clinit>(OpenSSLSocketFactory.java:92)
at
org.apache.hadoop.fs.s3a.S3AUtils.initProtocolSettings(S3AUtils.java:1268)
at
org.apache.hadoop.fs.s3a.S3AUtils.initConnectionSettings(S3AUtils.java:1232)
at org.apache.hadoop.fs.s3a.S3AUtils.createAwsConf(S3AUtils.java:1213)
at
org.apache.hadoop.fs.s3a.DefaultS3ClientFactory.createS3Client(DefaultS3ClientFactory.java:58)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.bindAWSClient(S3AFileSystem.java:561)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:385)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3338)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:136)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3387)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3355)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:497)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:365)
at org.apache.hadoop.fs.shell.PathData.expandAsGlob(PathData.java:352)
at org.apache.hadoop.fs.shell.Command.expandArgument(Command.java:250)
at org.apache.hadoop.fs.shell.Command.expandArguments(Command.java:233)
at
org.apache.hadoop.fs.shell.FsCommand.processRawArguments(FsCommand.java:104)
at org.apache.hadoop.fs.shell.Command.run(Command.java:177)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:327)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:390)
Caused by: java.lang.ClassNotFoundException: org.wildfly.openssl.OpenSSLProvider
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
{code}
Is there any reason why I shouldn't revert this? It's not ready to go in. We've
identified problems, so lets back off until they are addressed
was (Author: [email protected]):
I can't even get the CLI to work
```
~/P/h/h/t/hadoop-3.3.0-SNAPSHOT (s3/HADOOP-15183-s3guard-rename-failures ⚡↩=)
bin/hadoop fs -ls s3a://hwdev-steve-ireland-new/
Exception in thread "main" java.lang.NoClassDefFoundError:
org/wildfly/openssl/OpenSSLProvider
at
org.apache.hadoop.security.ssl.OpenSSLSocketFactory.<clinit>(OpenSSLSocketFactory.java:92)
at
org.apache.hadoop.fs.s3a.S3AUtils.initProtocolSettings(S3AUtils.java:1268)
at
org.apache.hadoop.fs.s3a.S3AUtils.initConnectionSettings(S3AUtils.java:1232)
at org.apache.hadoop.fs.s3a.S3AUtils.createAwsConf(S3AUtils.java:1213)
at
org.apache.hadoop.fs.s3a.DefaultS3ClientFactory.createS3Client(DefaultS3ClientFactory.java:58)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.bindAWSClient(S3AFileSystem.java:561)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:385)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3338)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:136)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3387)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3355)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:497)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:365)
at org.apache.hadoop.fs.shell.PathData.expandAsGlob(PathData.java:352)
at org.apache.hadoop.fs.shell.Command.expandArgument(Command.java:250)
at org.apache.hadoop.fs.shell.Command.expandArguments(Command.java:233)
at
org.apache.hadoop.fs.shell.FsCommand.processRawArguments(FsCommand.java:104)
at org.apache.hadoop.fs.shell.Command.run(Command.java:177)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:327)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:390)
Caused by: java.lang.ClassNotFoundException: org.wildfly.openssl.OpenSSLProvider
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
```
Is there any reason why I shouldn't revert this? It's not ready to go in. We've
identified problems, so lets back off until they are addressed
> Stabilize S3A OpenSSL support
> -----------------------------
>
> Key: HADOOP-16346
> URL: https://issues.apache.org/jira/browse/HADOOP-16346
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.3.0
> Reporter: Steve Loughran
> Priority: Blocker
>
> HADOOP-16050 switched S3A to trying to use OpenSSL. We need to make sure this
> is stable, that people know it exists and aren't left wondering why things
> which did work have now stopped. Which, given I know who will end up with
> those support calls, is not something I want.
> * Set the default back to the original JDK version.
> * Document how to change this so you don't need to use an IDE to work out
> what other values are allowed
> * core-default.xml to include the default value and the text listing the
> other options.
> + anything else
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
