The new repo is created, and the new repo link is https://github.com/apache/dolphinscheduler-datawarehouse.
you can watch it if you are interested in it On 2022/12/12 13:26:09 Jiajie Zhong wrote: > Seem we have 3 PMC vote +1, I will help to create a sub-project to keep this > code, thanks all > > On 2022/12/12 12:07:57 li gang wrote: > > Great.Looking forward to see it ASAP. > > > > 陈卓宇 <[email protected]> 于2022年12月7日周三 21:55写道： > > > > > Hey guys, > > > > > > With dolphinscheduler landing on ziroom, we have experienced nearly a year > > > of use and secondary development, summarizing many interesting > > > experiences. > > > 1.dolphinscheduler main use scenario: offline number warehouse field > > > 2.dolphinscheduler's webui provides to create DAG by dragging and > > > dropping, > > > which is not friendly in the face of business scenarios with complex > > > correlations. > > > 3.There will be some unique problems for the offline data warehouse > > > vertical. We developed a more suitable development platform for offline > > > data warehouse based on dolphinscheduler, a scheduling engine. > > > 4.Based on the above, we have developed a new platform to achieve: complex > > > Hql automated generation scheduling, data dependency support, more > > > powerful > > > periodic replenishment, more convenient alerts, clearer log display, and > > > realized the support of data pedigree and data insight. Currently, we are > > > also developing the ability to generate and schedule FlinkSQL pedigree > > > analysis with one click > > > > > > 5.The newly developed platform is designed at the beginning to be > > > compatible with multiple versions, so it is completely decoupled from > > > dolphinscheduler, only the packaged jar, put into the lib directory of > > > dolphinscheduler, and it is done ready. > > > > > > 6.I would like to contribute it as a sub-project of dolphinscheduler, > > > positioning: the offline data warehouse vertical, to achieve a common > > > offline data warehouse solution in the industry, to meet the needs of > > > users > > > to build offline data warehouses. > > > Related links：https://github.com/apache/dolphinscheduler/issues/12971 > > > > > > > > > -- > > > > > > ------------------------------ > > Best Regards > > > > DolphinScheduler PMC > > Gang Li 李岗 > > > > [email protected] > > >
