steveloughran commented on PR #39124: URL: https://github.com/apache/spark/pull/39124#issuecomment-1362870963
the real rc0 is up. announcement below. I suspect it will be the transitive jar updates and other lockdown options which create issues...we had to downgrade jackson for tez in HADOOP-18332, then there's jetty. left that alone. i'd like to see if i can get https://github.com/apache/hadoop/pull/4996 ready for an rc1 so we can cut protobuf 2.5 (which was removed, then reinstated as a dependency). once cut only those apps which need it can add it themselves. arm binaries too. I'm also wondering if we should do a lean build without the fat shaded aws sdk. we need that so for classpath reasons, it's just so huge as it contains *everything*, even though nobody is trying to control aws satellite groundstations from big data apps. (analysis, yes. but control. nope, yet it's in `com.amazonaws.services.groundstation` hence the eternal bloat). cut that jar and the distro is half the size ---------------------- From: Steve Loughran Date: Wed, 21 Dec 2022 at 19:28 Subject: [VOTE] Release Apache Hadoop 3.3.5 Mukund and I have put together a release candidate (RC0) for Hadoop 3.3.5. Given the time of year it's a bit unrealistic to run a 5 day vote and expect people to be able to test it thoroughly enough to make this the one we can ship. What we would like is for anyone who can to verify the tarballs, and test the binaries, especially anyone who can try the arm64 binaries. We've got the building of those done and now the build file will incorporate them into the release -but neither of us have actually tested it yet. Maybe I should try it on my pi400 over xmas. The maven artifacts are up on the apache staging repo -they are the ones from x86 build. Building and testing downstream apps will be incredibly helpful. The RC is available at: https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC0/ The git tag is release-3.3.5-RC0, commit 3262495904d The maven artifacts are staged at https://repository.apache.org/content/repositories/orgapachehadoop-1365/ You can find my public key at: https://dist.apache.org/repos/dist/release/hadoop/common/KEYS Change log https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC0/CHANGELOG.md Release notes https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC0/RELEASENOTES.md This is off branch-3.3 and is the first big release since 3.3.2. Key changes include * Big update of dependencies to try and keep those reports of transitive CVEs under control -both genuine and false positive. * HDFS RBF enhancements * Critical fix to ABFS input stream prefetching for correct reading. * Vectored IO API for all FSDataInputStream implementations, with high-performance versions for file:// and s3a:// filesystems. file:// through java native io s3a:// parallel GET requests. * This release includes Arm64 binaries. Please can anyone with compatible systems validate these. Please try the release and vote on it, even though i don't know what is a good timeline here...i'm actually going on holiday in early jan. Mukund is around and so can drive the process while I'm offline. Assuming we do have another iteration, the RC1 will not be before mid jan for that reason Steve (and mukund) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
