yuqi1129 opened a new issue, #8433:
URL: https://github.com/apache/gravitino/issues/8433
### Version
main branch
### Describe what's wrong
When I run pyspark in JDK8 to access a fileset, I run into the following
problem:
```
Caused by: java.lang.NoSuchMethodError:
java.net.URLEncoder.encode(Ljava/lang/String;Ljava/nio/charset/Charset;)Ljava/lang/String;
at org.apache.gravitino.rest.RESTUtils.encodeString(RESTUtils.java:103)
at
org.apache.gravitino.client.MetadataObjectRoleOperations.<init>(MetadataObjectRoleOperations.java:40)
at
org.apache.gravitino.client.GravitinoMetalake.<init>(GravitinoMetalake.java:164)
at
org.apache.gravitino.client.GravitinoMetalake$Builder.build(GravitinoMetalake.java:1574)
at
org.apache.gravitino.client.DTOConverters.toMetaLake(DTOConverters.java:75)
at
org.apache.gravitino.client.GravitinoClientBase.loadMetalake(GravitinoClientBase.java:139)
at
org.apache.gravitino.client.GravitinoClient.<init>(GravitinoClient.java:105)
at
org.apache.gravitino.client.GravitinoClient.<init>(GravitinoClient.java:80)
at
org.apache.gravitino.client.GravitinoClient$ClientBuilder.build(GravitinoClient.java:707)
at
org.apache.gravitino.client.GravitinoClient$ClientBuilder.build(GravitinoClient.java:667)
at
org.apache.gravitino.filesystem.hadoop.GravitinoVirtualFileSystemUtils.createClient(GravitinoVirtualFileSystemUtils.java:115)
at
org.apache.gravitino.filesystem.hadoop.GravitinoVirtualFileSystemUtils.createClient(GravitinoVirtualFileSystemUtils.java:75)
at
org.apache.gravitino.filesystem.hadoop.BaseGVFSOperations.<init>(BaseGVFSOperations.java:148)
at
org.apache.gravitino.filesystem.hadoop.DefaultGVFSOperations.<init>(DefaultGVFSOperations.java:53)
... 28 more
```
### Error message and/or stacktrace
```text
py4j.protocol.Py4JJavaError: An error occurred while calling o73.csv.
: org.apache.gravitino.exceptions.GravitinoRuntimeException: Cannot create
operations instance:
org.apache.gravitino.filesystem.hadoop.DefaultGVFSOperations
at
org.apache.gravitino.filesystem.hadoop.GravitinoVirtualFileSystem.initialize(GravitinoVirtualFileSystem.java:97)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3469)
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:174)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3574)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3521)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:540)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:365)
at
org.apache.spark.sql.execution.datasources.DataSource.planForWritingFileFormat(DataSource.scala:470)
at
org.apache.spark.sql.execution.datasources.DataSource.planForWriting(DataSource.scala:572)
at
org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:438)
at
org.apache.spark.sql.DataFrameWriter.saveInternal(DataFrameWriter.scala:415)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:293)
at org.apache.spark.sql.DataFrameWriter.csv(DataFrameWriter.scala:979)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
at py4j.Gateway.invoke(Gateway.java:282)
at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
at py4j.commands.CallCommand.execute(CallCommand.java:79)
at py4j.GatewayConnection.run(GatewayConnection.java:238)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.apache.gravitino.filesystem.hadoop.GravitinoVirtualFileSystem.initialize(GravitinoVirtualFileSystem.java:91)
... 23 more
Caused by: java.lang.NoSuchMethodError:
java.net.URLEncoder.encode(Ljava/lang/String;Ljava/nio/charset/Charset;)Ljava/lang/String;
at org.apache.gravitino.rest.RESTUtils.encodeString(RESTUtils.java:103)
at
org.apache.gravitino.client.MetadataObjectRoleOperations.<init>(MetadataObjectRoleOperations.java:40)
at
org.apache.gravitino.client.GravitinoMetalake.<init>(GravitinoMetalake.java:164)
at
org.apache.gravitino.client.GravitinoMetalake$Builder.build(GravitinoMetalake.java:1574)
at
org.apache.gravitino.client.DTOConverters.toMetaLake(DTOConverters.java:75)
at
org.apache.gravitino.client.GravitinoClientBase.loadMetalake(GravitinoClientBase.java:139)
at
org.apache.gravitino.client.GravitinoClient.<init>(GravitinoClient.java:105)
at
org.apache.gravitino.client.GravitinoClient.<init>(GravitinoClient.java:80)
at
org.apache.gravitino.client.GravitinoClient$ClientBuilder.build(GravitinoClient.java:707)
at
org.apache.gravitino.client.GravitinoClient$ClientBuilder.build(GravitinoClient.java:667)
at
org.apache.gravitino.filesystem.hadoop.GravitinoVirtualFileSystemUtils.createClient(GravitinoVirtualFileSystemUtils.java:115)
at
org.apache.gravitino.filesystem.hadoop.GravitinoVirtualFileSystemUtils.createClient(GravitinoVirtualFileSystemUtils.java:75)
at
org.apache.gravitino.filesystem.hadoop.BaseGVFSOperations.<init>(BaseGVFSOperations.java:148)
at
org.apache.gravitino.filesystem.hadoop.DefaultGVFSOperations.<init>(DefaultGVFSOperations.java:53)
... 28 more
```
### How to reproduce
Use the lastest to compile and then try to use GVFS client to access fileset.
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
