simon824 commented on pull request #885:
URL:
https://github.com/apache/incubator-seatunnel/pull/885#issuecomment-1002417743
> hi @simon824, I checked the `-t` option as your case, seems we got
different Exception.
>
> ```
> [dcadmin@dcadmin seatunnel-dist-2.0.5-SNAPSHOT-2.11.8]$
./bin/start-seatunnel-spark.sh -c config/application.conf -e client -m local -i
app=test -t
>
> [INFO] spark conf: --conf "spark.app.name=seatunnel"
> Warning: Ignoring non-spark config property: "spark.app.name=seatunnel"
> 2021-12-29 13:29:10 WARN NativeCodeLoader:62 - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
> 2021-12-29 13:29:10 INFO ConfigBuilder:78 - Loading config file:
config/application.conf
> 2021-12-29 13:29:10 INFO ConfigBuilder:89 - parsed config file: {
> "env" : {
> "spark.app.name" : "seatunnel"
> },
> "source" : [
> [
> {
> "plugin_name" : "result_table_name"
> },
> "my_dataset"${app}
> ,
> "Fake"
> ]
> ],
> "transform" : [],
> "sink" : [
> [
> "Console"
> ]
> ]
> }
>
> 2021-12-29 13:29:10 ERROR Seatunnel:173 -
>
>
===============================================================================
>
>
> 2021-12-29 13:29:10 ERROR Seatunnel:176 - Fatal Error,
>
> 2021-12-29 13:29:10 ERROR Seatunnel:178 - Please submit issue a bug in
https://github.com/InterestingLab/waterdrop/issues
>
> 2021-12-29 13:29:10 ERROR Seatunnel:180 - Reason:config/application.conf:
6: source has type list of LIST rather than list of OBJECT
>
> 2021-12-29 13:29:10 ERROR Seatunnel:181 - Exception
StackTrace:org.apache.seatunnel.config.ConfigException$WrongType:
config/application.conf: 6: source has type list of LIST rather than list of
OBJECT
> at
org.apache.seatunnel.config.impl.SimpleConfig.getHomogeneousWrappedList(SimpleConfig.java:471)
> at
org.apache.seatunnel.config.impl.SimpleConfig.getObjectList(SimpleConfig.java:480)
> at
org.apache.seatunnel.config.impl.SimpleConfig.getConfigList(SimpleConfig.java:485)
> at
org.apache.seatunnel.config.ConfigBuilder.checkIsStreaming(ConfigBuilder.java:102)
> at
org.apache.seatunnel.config.ConfigBuilder.createEnv(ConfigBuilder.java:185)
> at
org.apache.seatunnel.config.ConfigBuilder.<init>(ConfigBuilder.java:62)
> at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:92)
> at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:59)
> at org.apache.seatunnel.SeatunnelSpark.main(SeatunnelSpark.java:29)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
> at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
> at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
> at
org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
> at
org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
> at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> ```
Your case looks like the config was parsing failed, try this one.
```
env {
spark.app.name="seatunnel"
}
source {
Fake {
result_table_name = "my_dataset"
}
}
}
transform {
sql {
table_name = "user_view"
sql = ${?table_name}"select * from user_view where city = '"${?sql}"'"
}
}
sink {
Console {}
}
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
