simon824 commented on pull request #1119: URL: https://github.com/apache/incubator-kyuubi/pull/1119#issuecomment-926333403
> So far, there are 3 approaches to kill yarn applications > > 1. Execute command `yarn kill $app_name` > 2. Use Yarn RestFul API > 3. Use Yarn client > > Personally, I prefer option 2, then option 1. > > Option 1 requires the user to set up Hadoop client on the Kyuubi server node(s), and also set `HADOOP_HOME`, suppose that the user usually should deploy Kyuubi on the Hadoop node, it's acceptabe. > > If we choose option 3, we need to test with different versions of Yarn cluster to ensure that the compatibility between Kyuubi server bundled Hadoop client jars and Yarn cluster. > > Seems that option 2 has less dependencies and good compatibility. > > @timothy65535 @simon824 @zhouyifan279 @yaooqinn WDYT? Now we have a new option: 4. Use SparkLauncher It requires initializing SparkLauncher Object instead of building spark-submit command , then get appId and killApp by SparkAppHandle. And it is independent of hadoop_version. @zhang1002 @zhouyifan279 @pan3793 WDYT? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
