tmljob commented on PR #1855:
URL:
https://github.com/apache/incubator-seatunnel/pull/1855#issuecomment-1124456945
In the Windows environment, the log indicates that the related connector jar
package cannot be loaded, and the log is detailed in the attachment, but the
current IT use case can be executed, which is rather strange.
At 2022-05-12 01:33:58, "Wenjun Ruan" ***@***.***> wrote:
In fact, we have CI on Windows, it can run successfully~. Are you sure this
change is needed?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID:
***@***.***>
22/05/12 09:12:44 ERROR SparkContainer: 22/05/12 01:12:39 WARN
NativeCodeLoader: Unable to load native-hadoop library for your platform...
using builtin-java classes where applicable
Using Spark's default log4j profile:
org/apache/spark/log4j-defaults.properties
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-clickhouse-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-console-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-doris-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-elasticsearch-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-email-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-fake-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-feishu-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-file-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hbase-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hive-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-http-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hudi-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-iceberg-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-jdbc-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kafka-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kudu-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-mongodb-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-neo4j-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-phoenix-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-redis-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-socket-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-tidb-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-webhook-2.1.1-SNAPSHOT.jar
does not exist, skipping.
22/05/12 01:12:40 INFO ConfigBuilder: Loading config file:
/tmp/fake/fakesource_to_console.conf
22/05/12 01:12:40 INFO ConfigBuilder: parsed config file: {
"env" : {
"spark.app.name" : "SeaTunnel",
"spark.executor.instances" : 2,
"spark.executor.cores" : 1,
"spark.executor.memory" : "1g",
"spark.master" : "local"
},
"source" : [
{
"result_table_name" : "my_dataset",
"plugin_name" : "Fake"
}
],
"transform" : [],
"sink" : [
{
"plugin_name" : "Console"
}
]
}
22/05/12 01:12:40 INFO SparkContext: Running Spark version 2.4.3
22/05/12 01:12:40 INFO SparkContext: Submitted application: SeaTunnel
22/05/12 01:12:40 INFO SecurityManager: Changing view acls to: spark
22/05/12 01:12:40 INFO SecurityManager: Changing modify acls to: spark
22/05/12 01:12:40 INFO SecurityManager: Changing view acls groups to:
22/05/12 01:12:40 INFO SecurityManager: Changing modify acls groups to:
22/05/12 01:12:40 INFO SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(spark); groups
with view permissions: Set(); users with modify permissions: Set(spark);
groups with modify permissions: Set()
22/05/12 01:12:40 INFO Utils: Successfully started service 'sparkDriver' on
port 43881.
22/05/12 01:12:40 INFO SparkEnv: Registering MapOutputTracker
22/05/12 01:12:40 INFO SparkEnv: Registering BlockManagerMaster
22/05/12 01:12:40 INFO BlockManagerMasterEndpoint: Using
org.apache.spark.storage.DefaultTopologyMapper for getting topology information
22/05/12 01:12:40 INFO BlockManagerMasterEndpoint:
BlockManagerMasterEndpoint up
22/05/12 01:12:40 INFO DiskBlockManager: Created local directory at
/tmp/blockmgr-4fb85862-c852-4dce-ab47-2e0360340937
22/05/12 01:12:40 INFO MemoryStore: MemoryStore started with capacity 366.3
MB
22/05/12 01:12:40 INFO SparkEnv: Registering OutputCommitCoordinator
22/05/12 01:12:40 INFO Utils: Successfully started service 'SparkUI' on port
4040.
22/05/12 01:12:40 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at
http://4d50326a6034:4040
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-clickhouse-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-clickhouse-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-console-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-console-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-doris-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-doris-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-elasticsearch-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-elasticsearch-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-email-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-email-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-fake-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-fake-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-feishu-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-feishu-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-file-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-file-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hbase-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hbase-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hive-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hive-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-http-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-http-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hudi-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hudi-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-iceberg-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-iceberg-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-jdbc-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-jdbc-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kafka-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kafka-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kudu-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kudu-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-mongodb-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-mongodb-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-neo4j-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-neo4j-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-phoenix-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-phoenix-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-redis-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-redis-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-socket-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-socket-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add
file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-tidb-2.1.1-SNAPSHOT.jar
to Spark environment
java.io.FileNotFoundException: Jar
/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-tidb-2.1.1-SNAPSHOT.jar
not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at
org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at
org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSu
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
