xyhc opened a new issue #1034:
URL: https://github.com/apache/incubator-seatunnel/issues/1034
seatunnel version: 1.5.7
spark version: 2.4.8
run shell:
./bin/start-seatunnel-structured-streaming.sh --master local[4]
--deploy-mode client --config ./config/realtimeaggr.conf
happen:
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 1
at
io.github.interestinglab.waterdrop.config.ExposeSparkConf.main(ExposeSparkConf.java:43)
[INFO] spark conf: [ERROR] config file does not exists or cannot be parsed
due to invalid format
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/home/test/spark-2.4.8/jars/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/local/hadoop-client/hadoop-2.6.0-cdh5.8.3/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
1 [main] WARN org.apache.spark.deploy.DependencyUtils - Local jar
/home/test/seatunnel/seatunnel-1.5.7/[ERROR] does not exist, skipping.
3 [main] WARN org.apache.spark.deploy.SparkSubmit$$anon$2 - Failed to
load io.github.interestinglab.waterdrop.WaterdropStructuredStreaming.
java.lang.ClassNotFoundException:
io.github.interestinglab.waterdrop.WaterdropStructuredStreaming
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
at org.apache.spark.util.Utils$.classForName(Utils.scala:238)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:816)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:930)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:939)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
7 [Thread-1] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
8 [Thread-1] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-0f9e0a6d-650a-4bb0-86b9-ac433961fa60
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
