Hi all, BackGround:I've been in contact with StreamPark for a while, and I've had a pretty good experience in terms of ease of use and stability. At present, StreamPark itself supports UDF functions, but it seems that there is no unified management menu for UDF, so I would like to add a new menu for UDF management, which is used for the management of UDF.
Main implementation ideas: Currently, we mainly create UDF through restful api, then select UDF when creating the job, and associate UDF ids (mainly to get UDF JAR storage path later), and finally achieve dynamic loading through yarn.provided.lib.dirs parameter. Note: This feature is currently only implemented based on SQL jobs in Yarn Application mode; the JAR is saved on top of HDFS. Main APIs: Add UDF Query UDF (list) Edit UDF Delete UDF Follow up plan: Basic functional development at the API level is implemented first, followed by front-end UI-related development. Best wishes tiger
