zhouyifan279 opened a new pull request, #6199: URL: https://github.com/apache/kyuubi/pull/6199
# :mag: Description ## Issue References ๐ This pull request implement a feature - Run HiveSQLEngine on kerberized YARN ## Describe Your Solution ๐ง Introduced two configs: - kyuubi.engine.yarn.principal - kyuubi.engine.yarn.keytab When do submit to a kerberized YARN, submitter uploads `kyuubi.engine.yarn.keytab` to application's staging dir. YARN NodeManager downloads keytab to AM's working directory. AM logins to Kerberos using the principal and keytab Note: I've tried to run HiveSQLEngine with only DelegationTokens but failed. When Hive invokes `FileInputFormat#getSplits`, `java.io.IOException: Delegation Token can be issued only with kerberos or web authentication` will be thrown. Theoretically, it can be solved by add AM DelegationTokens into `org.apache.hadoop.mapred.JobConf#credentials`. But actually, it is impossible without modifying Hive's source code. ## Types of changes :bookmark: <!--- What types of changes does your code introduce? Put an `x` in all the boxes that apply: --> - [ ] Bugfix (non-breaking change which fixes an issue) - [x] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan ๐งช #### Behavior Without This Pull Request :coffin: HiveSQLEngine can not run on a kerberized YARN #### Behavior With This Pull Request :tada: HiveSQLEngine can run on a kerberized YARN #### Related Unit Tests --- # Checklist ๐ <!--- Go over all the following points, and put an `x` in all the boxes that apply. --> <!--- If you're unsure about any of these, don't hesitate to ask. We're here to help! --> - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
