Hi JiaJie, The test environment I use is AWS EMR 6.6.0 distribution. Which is Hive 3.1.2/Spark 3.2.0/Flink 1.14.2/PrestoSQL 0.267 and additional installed Flink 1.12.1.
I’ve test the Spark/Flink task plugin and the Presto datasource plugin and the Enterprise WeChat alert plugin and it works as expected. -- Best Wishes ZiHao > 2022年7月30日 23:04，Chufeng Gao <[email protected]> 写道： > > Hi Jiajie, > > I've tested the zeppelin task plugin of branch 3.0.0-prepare and it works > as expected. > > However, during the test, I encountered something I had never run into > before and it doesn't happen on current dev branch either. > That is, if the length of the path of the log folder is too long, the > worker server seems not to start. We could reproduce this issue by putting > the root directory under some directory with long path name. In the log, > you will see some errors like `Error updating database. Cause: > org.h2.jdbc.JdbcSQLDataException: Value too long for column "log_path > VARCHAR(200)": > "'/Users/ericgao888/workplace/external/dolphin-scheduler/dolphinscheduler/dolphinscheduler-dist/target/apache-dolphinscheduler-3.0.0... > (203)"; SQL statement:`. > > What about increase the threshold a little bit? > > *Best Regards,* > > *Chufeng (Eric) Gao* > > > > Jiajie Zhong <[email protected]> 于2022年7月29日周五 11:34写道： > >> BTW, for some who want to test task type extend `AbstractYarnTask`, we >> have a `need to verify` issue[1] for yarn base task, please test those >> task behavior, if it is pass please let us know in this mail thread >> and related issue[1], thanks >> >> cc: ZiHao >> >> [1]: https://github.com/apache/dolphinscheduler/issues/10809 >> >> On Fri, Jul 29, 2022 at 11:27 AM Jiajie Zhong <[email protected]> >> wrote: >>> >>> The good news is I add new commit to branch `3.0.0-prepare` and add CI >>> pass expect `cluster-test` so you guys can fetch the latest branch and >>> build it locally >>> >>> On Fri, Jul 29, 2022 at 11:19 AM Jiajie Zhong <[email protected]> >> wrote: >>>> >>>> Thank you for your help. You guys can send your test results to this >>>> mail thread after you finish your test, >>>> >>>> BTW, some bad cherry pick by myself cause branch 3.0.0-prepare can >>>> not pass the build process, And I add a new pull requests to correct >>>> it[1], will merge it ASAP >>>> >>>> [1] https://github.com/apache/dolphinscheduler/pull/11194 >>>> >>>> On Thu, Jul 28, 2022 at 5:00 PM <[email protected]> wrote: >>>>> >>>>> Hi Jiajie: >>>>> >>>>> >>>>> I could help test the Telegram alert plugin >>>>> >>>>> Best Wish >>>>> Xuetong Zhu >>>>> >>>>>> 在 2022年7月28日，16:52，Draven Li (qingwli) <[email protected]> >> 写道： >>>>>> >>>>>> Hi Jiajie: >>>>>> >>>>>> >>>>>> I could help test the Webex Teams alert plugin >>>>>> >>>>>> >>>>>> Thanks >>>>>> >>>>>> >>>>>> From: Jiajie Zhong <[email protected]> >>>>>> Date: Thursday, July 28, 2022 at 16:27 >>>>>> To: [email protected] < >> [email protected]> >>>>>> Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early >> August >>>>>> Hey guys, >>>>>> >>>>>> It is close to the day we plan to release version 3.0.0. Some of >> our >>>>>> community are testing the branch 3.0.0-prepare[1]. But we do not >> have >>>>>> all of the environment to the whole task/datasource/alert type. So >> I >>>>>> am here to see whether some of you guys have the environment can >> give >>>>>> me a hand to test whether the plugin work or not: >>>>>> >>>>>> * Task Type: Spark, MapReduce, Flink, EMR, Zeppelin >>>>>> * Datasource: SQL Server, Presto, ClickHouse, DB2 >>>>>> * Alert: Enterprise WeChat, Webex Teams, Telegram >>>>>> >>>>>> If you are interested in testing some of the plugins, please let me >>>>>> know in this mail thread. >>>>>> >>>>>> After you finish your test, you can send another append mail and to >>>>>> tell us the result of your test, and create an issue if it have >> some >>>>>> error >>>>>> >>>>>> [1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare >>>>>> >>>>>>> On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong < >> [email protected]> wrote: >>>>>>> >>>>>>> Hey guys, >>>>>>> >>>>>>> We plan to release DolphinScheduler 3.0.0 in early August. Version >>>>>>> 3.0.0 tries to fix some bugs and correct some docs based on >>>>>>> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we >>>>>>> already create new branch named `3.0.0-prepare` in repository >>>>>>> apache/dolphinscheduler. We invite our community to test this >> prepare >>>>>>> branch. >>>>>>> >>>>>>> Currently, we have some known issues in the link[1], some of them >>>>>>> still not assigned to someone and it is encouraged to reply and >> take >>>>>>> them directly in the issue if you are interested in them. >>>>>>> >>>>>>> If you have other issues you want to fix in version 3.0.0. please >> let >>>>>>> us know in this mail thread >>>>>>> >>>>>>> [1]: https://github.com/apache/dolphinscheduler/milestone/32 >>>>>>> >>>>>>> -- >>>>>>> Best Wish >>>>>>> — Jiajie >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Best Wish >>>>>> — Jiajie >>>>>> >>>>> >>>> >>>> >>>> -- >>>> Best Wish >>>> — Jiajie >>> >>> >>> >>> -- >>> Best Wish >>> — Jiajie >> >> >> >> -- >> Best Wish >> — Jiajie >> >
