skonto edited a comment on issue #23514: [SPARK-24902][K8s] Add PV integration tests URL: https://github.com/apache/spark/pull/23514#issuecomment-453664557 @erikerlandson we could run some code eg reading the file as a df, process it and expect a result like the what the wordcount example does... The goal of the test is to make sure the integration with Spark works that means make that file available to Spark. So in case of a refactoring or any change issues can be caught, so test target here is to make sure properties and code works fine propagating what is needed to k8s. As with any other dir in the container, the mounted dir should work... unless there are permissions issues etc.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
