SEZ9 commented on issue #11655: URL: https://github.com/apache/seatunnel/issues/11655#issuecomment-5230719941
Root cause confirmed as a shading mismatch: the Hadoop uber jar relocates Jackson but hadoop-aws is not processed by the same relocation, so org.apache.hadoop.util.JsonSerialization fails to load the original Jackson classes at runtime. Impact is limited to S3A configs exercising RoleModel (fs.s3a.assumed.role.*). Suggested fix: include hadoop-aws in the same maven-shade-plugin relocation as the Hadoop uber jar (so its Jackson references are rewritten consistently), or alternatively stop relocating Jackson / add the unrelocated Jackson classes needed by hadoop-aws. The first option is safest to avoid classpath conflicts. Please add a regression test or CI check that exercises the assumed-role code path (e.g., via localstack or a unit test loading RoleModel/JsonSerialization from the shaded artifact) to catch relocation drift in future Hadoop upgrades such as #11648. <!-- streview-comment:97 --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
