skonto commented on issue #22608: [SPARK-25750][K8S][TESTS] Kerberos Support Integration Tests URL: https://github.com/apache/spark/pull/22608#issuecomment-460601636 @mccheah it is possible to use multiple processes per container for testing: https://cloud.google.com/solutions/best-practices-for-building-containers (several vendors do). Yet it is much cleaner to fail at the container level when debugging stuff so I also think a pod is a better choice (it will be as if we are running all hdfs stuff on the same host). Kdc also should be on its own, at least this is how we tested this with integration tests in the past on mesos and it was much cleaner again. There is an option to use hadoop images: https://hadoop.apache.org/docs/r2.7.3/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html so in the future it might be better to integrate with kerberos there if people want to test with a specific hadoop version (not sure if version matters).
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
