abhishekd0907 commented on issue #24934: [SPARK-28124] [SS] SQS source for Structured Streaming URL: https://github.com/apache/spark/pull/24934#issuecomment-516734448 @steveloughran I'm not sure if I should use hadoop 2.9. Spark parent already uses 2.7 as default hadoop version. Adding hadoop 2.9 as a dependency will increase the work of excluding / shading classes to avoid classpath conflicts & seems risky to me. Is it possible for you to backport the changes you want to hadoop 2.7 ?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
