potiuk commented on PR #22253: URL: https://github.com/apache/airflow/pull/22253#issuecomment-1614446511
> Hi folks! I maintain the flux operator and a few others that launch HPC schedulers as Kubernetes Jobs (Indexed and Jobset) and this caught my eye because we'd like to try launching, for example, a Job from our custom resource definition with AIrflow. I haven't looked at this carefully, but I did see that it is branded for spark, and wanted to step back and see if we might discuss a general implementation that could be a base class for (or just support) any number of custom resource definitions for kubernetes? Thanks! I think this is a very valid concern - I have not looked in detail for the implementation before (was mostly following the build status) but it does look like "almost" generic way to add custom resouces and maybe already making it "generic enough" for other usages is perfectly achievable. BTW. Long time no see @vsoch . Glad you are still using Airflow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
