Hi Rumesh:

The first evaluations will take place on July 13,
 I would like to know what is your progress so far and if you have any
problems that I can help you with?

Lidong Dai <[email protected]> 于2021年6月21日周一 下午6:34写道:

> hi Rumesh,
>
> Please subscribe our mailing list first, or this mailing list can't show
> your mail directly
> please referer the instructions:
>
> https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html
> , it is very easy!
>
>
> Best Regards
> ---------------
> DolphinScheduler PMC
> Lidong Dai
> [email protected]
> ---------------
>
>
> On Mon, Jun 21, 2021 at 11:25 AM Calvin Kirs <[email protected]> wrote:
>
> > Rumesh Perera <[email protected]> 于2021年6月21日周一 上午4:42写道:
> >
> > > Hi Mentors/all,
> > >
> > > This is to initiate the design discussion currently I am working on.
> This
> > > project is about introducing parameter injection from java JVM
> arguments
> > to
> > > DolphinScheduler server runtime,  so that one can override a particular
> > > parameter which is externalized to a configuration file. It was
> suggested
> > > that implementation should be extensible so that even if we introduce
> > > another way of parameter injection in future Eg:- configuration center,
> > > we should be able to extend our implementation to accommodate new
> methods
> > > of parameter injection.
> > >
> > > I would like to highlight following design points and request your
> > > feedback,
> > >
> > > 1. Priority of parameter assignment if the same parameter is supplied
> > with
> > > different methods like JVM, configuration file - Should we always treat
> > the
> > > JVM startup parameter to have the highest priority, then configuration
> > file
> > > and other methods and so on. Should these priority levels remain
> > consistent
> > > across all the parameters?
> > >
> >
> > Yes, we need to follow this priority override rule. When jvm starts with
> > parameter A set, then this time even if the configuration file has
> > parameter A set it has no effect. The value of parameter A is determined
> by
> > what the JVM sets.
> >
> >
> > > 2. Validation of parameter - If a parameter validation is failed ( Eg:-
> > > valid data type or valid range ) at JVM startup, Should we just
> log/print
> > > to the console and exit the Java runtime or  default value will be
> > assigned
> > > from the configuration file. or from code and continue the Server
> > process?
> > >
> >
> > In my opinion exit is the best option.
> >
> > > 3. Are there any parameters we should treat as mandatory JVM
> parameters?
> > > If not supplied we basically exit the Java runtime printing to the
> > console
> > > that parameter is mandatory to be supplied at startup.
> > >
> > > I don't think we need to, as a public approach, we don't need to care
> > about specific businesses.
> >
> > > @Calvin Kirs <[email protected]> Can you please provide example for the
> > > point you added - Another point, the valid range of parameters, such as
> > the
> > > A parameter, belongs to the JVM startup parameters, the user-startup
> and
> > > did not set, then even when the configuration file to append this
> > > parameter, this parameter will not take effect.
> > >
> > > Regards
> > > Rumesh
> > >
> > > On Thu, Jun 17, 2021 at 6:55 AM Rumesh Perera <[email protected]>
> > wrote:
> > >
> > >> Hi Calvin,
> > >>
> > >> Thank you for the pointers provided. I will make an update to the
> > >> public thread with all the details of the design I am working on right
> > now.
> > >>
> > >> Regards
> > >> Rumesh
> > >>
> > >> On Wed, Jun 16, 2021 at 8:50 AM Calvin Kirs <[email protected]> wrote:
> > >>
> > >>> Hi Rumesh,
> > >>> Do you have any problems that I can help you with?
> > >>> (BTW, the official coding period has started, so let's discuss it on
> > the
> > >>> mailing list)
> > >>>
> > >>> Calvin Kirs <[email protected]> 于2021年6月9日周三 下午4:11写道:
> > >>>
> > >>>> Hi Rumesh,
> > >>>> You need to pay extra attention to several points.
> > >>>>
> > >>>> Scalability: If we have increased the number of ways to configure
> > >>>> parameters, such as system startup parameters, configuration files,
> > >>>> configuration center settings. How quickly you can expand is a point
> > you
> > >>>> should focus on.
> > >>>>
> > >>>> Another point, the valid range of parameters, such as the A
> parameter,
> > >>>> belongs to the JVM startup parameters, the user-startup and did not
> > set,
> > >>>> then even when the configuration file to append this parameter, this
> > >>>> parameter will not take effect.
> > >>>>
> > >>>> Rumesh Perera <[email protected]> 于2021年5月27日周四 上午3:40写道:
> > >>>>
> > >>>>> Hi Calvin,
> > >>>>>
> > >>>>> Thank you for accepting my proposal. I am working setting up
> > >>>>> DolphinScheduler and playing with the code base. Once I am
> > comfortable with
> > >>>>> design I will start a public thread to discuss the GSoC work.
> > >>>>>
> > >>>>> I am looking forward to working with you two.
> > >>>>>
> > >>>>> Regards
> > >>>>> Rumesh
> > >>>>>
> > >>>>> On Mon, May 24, 2021 at 11:23 PM Calvin Kirs <[email protected]>
> > wrote:
> > >>>>>
> > >>>>>> hi, Rumesh
> > >>>>>>
> > >>>>>> I believe you will have a comprehensive understanding of
> > >>>>>> DolphinScheduler next.
> > >>>>>>
> > >>>>>> If you encounter any problems in the process of getting familiar
> > with
> > >>>>>> the project, you can talk to me or Kevin, Kevin a very
> enthusiastic
> > and
> > >>>>>> professional mentor, who was also the Mentor of DolphinScheduler
> > during the
> > >>>>>> Apache incubator.
> > >>>>>>
> > >>>>>> Your proposal looks good, but before you develop the code, it is
> > >>>>>> better to make the design public and discuss it together, it will
> > make the
> > >>>>>> whole work more efficient.
> > >>>>>>
> > >>>>>> No matter what problems you encounter, please communicate with us
> in
> > >>>>>> time. We'll be happy to help you.
> > >>>>>> We prefer open communication, such as mailing lists [1], or Github
> > >>>>>> issues [2]. Of course, you can also choose the official Slack [3]
> > group (
> > >>>>>> important things must be reflected in the email list).
> > >>>>>>
> > >>>>>>
> > >>>>>> [1]:
> > >>>>>>
> >
> https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html
> > >>>>>> [2]:https://github.com/apache/dolphinscheduler/issues
> > >>>>>> [3]:
> > >>>>>>
> >
> https://join.slack.com/t/asf-dolphinscheduler/shared_invite/zt-omtdhuio-_JISsxYhiVsltmC5h38yfw
> > >>>>>>
> > >>>>>> --
> > >>>>>> Best wishes!
> > >>>>>> Calvin Kirs
> > >>>>>>
> > >>>>>
> > >>>>
> > >>>> --
> > >>>> Best  wishes!
> > >>>> CalvinKirs
> > >>>>
> > >>>
> > >>>
> > >>> --
> > >>> Best  wishes!
> > >>> CalvinKirs
> > >>>
> > >>
> >
> > --
> > Best  wishes!
> > CalvinKirs
> >
>


-- 
Best  wishes!
CalvinKirs

Reply via email to