+1 with the following clarifications, for my benefit: Once we upload to release, and it's copied by archive, we delete from release right? I know we are meant to keep the files in release minimal as they're mirrored to all ASF mirrors. But if we're uploading some batches and deleting them after, that seems OK. I don't know of another way to upload directly to archive.
We'd also need to create a new link to archived docs on the ASF website somehow. On Mon, Aug 12, 2024 at 4:09 AM Kent Yao <y...@apache.org> wrote: > Archive Spark Documentations in Apache Archives > > Hi dev, > > To address the issue of the Spark website repository size > reaching the storage limit for GitHub-hosted runners [1], I suggest > enhancing step [2] in our release process by relocating the > documentation releases from the dev[3] directory to the release > directory[4]. Then it would captured by the Apache Archives > service[5] to create permanent links, which would be alternative > endpoints for our documentation, like > > > https://dist.apache.org/repos/dist/dev/spark/v3.5.2-rc5-docs/_site/index.html > for > https://spark.apache.org/docs/3.5.2/index.html > > Note that the previous example still uses the staging repository, > which will become > https://archive.apache.org/dist/spark/docs/3.5.2/index.html. > > For older releases hosted on the Spark website [6], we also need to > upload them via SVN manually. > > After that, when we reach the threshold again, we can delete some of > the old ones on page [6], and update their links on page [7] or use > redirection. > > JIRA ticket: https://issues.apache.org/jira/browse/SPARK-49209 > > Please vote on the idea of Archive Spark Documentations in > Apache Archives for the next 72 hours: > > [ ] +1: Accept the proposal > [ ] +0 > [ ] -1: I don’t think this is a good idea because … > > Bests, > Kent Yao > > [1] https://lists.apache.org/thread/o0w4gqoks23xztdmjjj26jkp1yyg2bvq > [2] > https://spark.apache.org/release-process.html#upload-to-apache-release-directory > [3] https://dist.apache.org/repos/dist/dev/spark/v3.5.2-rc5-docs/ > [4] https://dist.apache.org/repos/dist/release/spark/docs/3.5.2 > [5] https://archive.apache.org/dist/spark/ > [6] https://github.com/apache/spark-website/tree/asf-site/site/docs > [7] https://spark.apache.org/documentation.html > > --------------------------------------------------------------------- > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > >
