rickchengx commented on issue #11262: URL: https://github.com/apache/dolphinscheduler/issues/11262#issuecomment-1255845285
Hi, @Radeity @ruanwenjun I agree that the current way of getting the yarn application id from the log is not elegant. Just for discussion, there is another way to get `yarn application id` as below: We can put some **unique tags** on tasks submitted from DS to yarn. E.g., for spark tasks, we can add the configuration `--conf spark.yarn.tags some_unique_tag`. After the task is submitted, DS can query the corresponding yarn application id (or other info) through this unique tag. What do you think? Any comments or discussions are welcome. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
