good suggestion, I'm looking forward to see this new Project
Best Regards --------------- Apache DolphinScheduler PMC Chair & Apache SeaTunnel PPMC David Linkedin: https://www.linkedin.com/in/davidzollo Twitter: @WorkflowEasy <https://twitter.com/WorkflowEasy> --------------- On Wed, Dec 7, 2022 at 10:01 PM 陈卓宇 <[email protected]> wrote: > Because this project was developed for a data warehouse. That's why it is > named "Warehouse" or "Data Warehouse", so that users will know what it does > at a glance of this name > > 陈卓宇 <[email protected]> 于2022年12月7日周三 21:54写道： > > > Hey guys, > > > > With dolphinscheduler landing on ziroom, we have experienced nearly a > year > > of use and secondary development, summarizing many interesting > experiences. > > 1.dolphinscheduler main use scenario: offline number warehouse field > > 2.dolphinscheduler's webui provides to create DAG by dragging and > > dropping, which is not friendly in the face of business scenarios with > > complex correlations. > > 3.There will be some unique problems for the offline data warehouse > > vertical. We developed a more suitable development platform for offline > > data warehouse based on dolphinscheduler, a scheduling engine. > > 4.Based on the above, we have developed a new platform to achieve: > complex > > Hql automated generation scheduling, data dependency support, more > powerful > > periodic replenishment, more convenient alerts, clearer log display, and > > realized the support of data pedigree and data insight. Currently, we are > > also developing the ability to generate and schedule FlinkSQL pedigree > > analysis with one click > > > > 5.The newly developed platform is designed at the beginning to be > > compatible with multiple versions, so it is completely decoupled from > > dolphinscheduler, only the packaged jar, put into the lib directory of > > dolphinscheduler, and it is done ready. > > > > 6.I would like to contribute it as a sub-project of dolphinscheduler, > > positioning: the offline data warehouse vertical, to achieve a common > > offline data warehouse solution in the industry, to meet the needs of > users > > to build offline data warehouses. > > Related links：https://github.com/apache/dolphinscheduler/issues/12971 > > >
