Hi all,

BackGround:I've been in contact with StreamPark for a while, and I've had a 
pretty good experience in terms of ease of use and stability. At present, 
StreamPark itself supports UDF functions, but it seems that there is no unified 
management menu for UDF, so I would like to add a new menu for UDF management, 
which is used for the management of UDF.

Main implementation ideas:
Currently, we mainly create UDF through restful api, then select UDF when 
creating the job, and associate UDF ids (mainly to get UDF JAR storage path 
later), and finally achieve dynamic loading through yarn.provided.lib.dirs 
parameter.
Note: This feature is currently only implemented based on SQL jobs in Yarn 
Application mode; the JAR is saved on top of HDFS.


Main APIs:
Add UDF

Query UDF (list)
Edit UDF
Delete UDF


Follow up plan:
Basic functional development at the API level is implemented first, followed by 
front-end UI-related development.


Best wishes
tiger

Reply via email to