Radeity commented on issue #11262: URL: https://github.com/apache/dolphinscheduler/issues/11262#issuecomment-1255880142
> Hi, @Radeity @ruanwenjun > > I agree that the current way of getting the yarn application id from the log is not elegant. Just for discussion, there is another way to get `yarn application id` as below: > > 1. We can put some **unique tags** on tasks submitted from DS to yarn. E.g., for spark tasks, we can add the configuration `--conf spark.yarn.tags some_unique_tag`. > 2. After the task is submitted, DS can query the corresponding yarn application id (or other info) through this unique tag. > > What do you think? Any comments or discussions are welcome. Hi, @rickchengx First, thanks for your idea! However, i think this way have two problems as follow: 1. Users may create ShellTask and submit not only one yarn job via command lines which is hard to add configuration. 2. Aop way will simply fetch applicationId and write it into appInfo.log file. I think it's maybe more efficiency than query it through unique tag. In fact, I don't get how your idea work? Would you like to explain more about it? My best wishes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
