Rianico commented on a change in pull request #1459:
URL:
https://github.com/apache/incubator-seatunnel/pull/1459#discussion_r824486115
##########
File path:
seatunnel-connectors/seatunnel-connectors-spark/seatunnel-connector-spark-kudu/src/main/scala/org/apache/seatunnel/spark/source/Kudu.scala
##########
@@ -36,7 +36,6 @@ class Kudu extends SparkBatchSource {
"kudu.table" -> config.getString("kudu_table"))
val ds = env.getSparkSession.read
- .format("org.apache.kudu.spark.kudu")
.options(mapConf)
.kudu
Review comment:
> how about upgrade the kudu-spark version? 1.7.0 seems a little old.
+1. How about `1.12.0` ? I have saw that many problems which belong to high
priority in jira was solved in this version.
There is also two key point about Kudu's version selection:
- From `1.9.0`, Kudu offers a way to do junit test, we can refer to:
[testing-apache-kudu-applications-on-the-jvm](https://kudu.apache.org/2019/03/19/testing-apache-kudu-applications-on-the-jvm.html#testing-apache-kudu-applications-on-the-jvm).
- From `1.10.0`, Kudu supports both full and incremental table backups via a
job implemented using Apache Spark. We can expand more feature about kudu if we
use the version from than `1.10.0`. But maybe we should select the version
newer than `1.10.1` due to
[KUDU-2990](https://issues.apache.org/jira/browse/KUDU-2990).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
