Re: Download page
Den ons 29 dec. 2021 kl 02:08 skrev Greg Stein : > ezt is indeed used by Subversion, by ViewVC, and a lot of Infra stuff. > It's a great/fast little template engine for Python. The Lua version is in > that infra-p6 directory you linked (visible to ASF committers). Please feel > free to create branches and PRs if you're gutsy enough to make any fixes. > If not, and there is an incompatibility, then open an INFRA ticket, please. > Indeed there was one thing and I'm note sure if it should be a ticket (I'm used the the Subversion way of asking on the ML first (and I realise I'm on the wrong ML)). I couldn't find any support for [else] in the lua version. Is this a known limitation? I also stumbled (I think!) on the fact that http/backup are lists - I wanted to check if http == backup but I don't think [is http backup] handled it correctly, if you have the time I'd appreciate a quick glance at https://svn.apache.org/repos/asf/subversion/site/staging/download.html (check r1896488 which is what I really wanted). Kind regards, Daniel
Re: Download page
On Tue, Dec 28, 2021 at 2:08 PM Daniel Sahlberg wrote: > Den tis 28 dec. 2021 kl 20:06 skrev Nathan Hartman < > hartman.nat...@gmail.com>: > >> On Tue, Dec 28, 2021 at 11:16 AM Daniel Sahlberg >> wrote: >> > >... > > Do you see different mirrors as primary and backup? For me both are the >> dlcdn. But I guess this could vary with location. >> >> Hmm both are showing dlcdn, except one is suffixed "(backup)". I >> assumed there was a difference between these but didn't dig any deeper >> on that. >> > > I've started a thread in users@infra.a.o, but it seems that list is not > public so I cannot link. But it seems that dlcdn.a.o is the only "mirror" > right now, with downloads.a.o being the "backup" (but not a backup in the > script). > dlcdn.a.o is served by the CDN, and is the new/current default. For European users, they may also see downloads.a.o. The Foundation has a ton of bandwidth and "no" data cap (just limited by bandwidth) on a server or two in Europe. So we tend to direct people to downloads.a.o if it appears they are in Europe, too. ezt is indeed used by Subversion, by ViewVC, and a lot of Infra stuff. It's a great/fast little template engine for Python. The Lua version is in that infra-p6 directory you linked (visible to ASF committers). Please feel free to create branches and PRs if you're gutsy enough to make any fixes. If not, and there is an incompatibility, then open an INFRA ticket, please. Cheers, Greg InfraAdmin, ASF; and fellow svn guy
Re: Download page
On Tue, Dec 28, 2021 at 4:20 PM Daniel Sahlberg wrote: > > Den tis 28 dec. 2021 kl 22:13 skrev Nathan Hartman : >> >> What is EZT? > > > EaZy Templating by Greg Stein, a Python templating library: > https://github.com/gstein/ezt > > We use it ourselves, for example in /subversion/trunk/tools/dist/release.py > (the templates are in the aptly named templates directory). > > It seems Infra has created a lua version: > https://github.com/apache/infrastructure-p6/tree/production/modules/closer_cgi/files > > This it what generates the download page from the download.html file. > > Looking at it again, it seems the lua version doesn't support [else]. I also > think I messed up the [http] and [backup] variables, using them as strings > and not arrays. Don't know why it worked on the element and not in > the text above. Oh I see, then the LUA version you mentioned is the template engine that parses the bracketed markup in download.html. For some reason when I tried to dig into the magic behind download.html/.cgi in the past, I couldn't figure out what software was processing that markup. I may have searched for EZT at the time, but an internet search for EZT finds too many irrelevant results. Thanks! Nathan
Re: Download page
Den tis 28 dec. 2021 kl 22:13 skrev Nathan Hartman : > What is EZT? > EaZy Templating by Greg Stein, a Python templating library: https://github.com/gstein/ezt We use it ourselves, for example in /subversion/trunk/tools/dist/release.py (the templates are in the aptly named templates directory). It seems Infra has created a lua version: https://github.com/apache/infrastructure-p6/tree/production/modules/closer_cgi/files This it what generates the download page from the download.html file. Looking at it again, it seems the lua version doesn't support [else]. I also think I messed up the [http] and [backup] variables, using them as strings and not arrays. Don't know why it worked on the element and not in the text above. Kind regards, Daniel
Re: Download page
On Tue, Dec 28, 2021 at 4:01 PM Daniel Sahlberg wrote: > > Den tis 28 dec. 2021 kl 21:08 skrev Daniel Sahlberg > : >> >> Den tis 28 dec. 2021 kl 20:06 skrev Nathan Hartman >> : >>> >>> On Tue, Dec 28, 2021 at 11:16 AM Daniel Sahlberg >>> wrote: >>> > >>> > Den tis 28 dec. 2021 kl 17:07 skrev Nathan Hartman >>> > : >>> >> >>> >> Ah, yes, ASF switched from the mirror system to a CDN. It was my >>> >> understanding that it was supposed to be transparent as far as we're >>> >> concerned, meaning we did not need to make any changes to our download >>> >> pages. But obviously the https://www.apache.org/mirrors/ address is no >>> >> longer valid, so that link should be removed. I wouldn't remove the >>> >> entire Mirror section because it does still list two choices, one >>> >> being the dlcdn and the other being a backup. >>> > >>> > >>> > Do you see different mirrors as primary and backup? For me both are the >>> > dlcdn. But I guess this could vary with location. >>> >>> Hmm both are showing dlcdn, except one is suffixed "(backup)". I >>> assumed there was a difference between these but didn't dig any deeper >>> on that. >> >> >> I've started a thread in users@infra.a.o, but it seems that list is not >> public so I cannot link. But it seems that dlcdn.a.o is the only "mirror" >> right now, with downloads.a.o being the "backup" (but not a backup in the >> script). >> >> I will make some commits to staging and we can review it from there. > > > I didn't quite succeed, see the log. I'm not sure if this is due to a > limitation of the lua version of EZT or if I'm doing something wrong. I'd be > happy for some review before merging to publish. What is EZT? Thanks, Nathan
Re: Download page
Den tis 28 dec. 2021 kl 21:08 skrev Daniel Sahlberg < daniel.l.sahlb...@gmail.com>: > Den tis 28 dec. 2021 kl 20:06 skrev Nathan Hartman < > hartman.nat...@gmail.com>: > >> On Tue, Dec 28, 2021 at 11:16 AM Daniel Sahlberg >> wrote: >> > >> > Den tis 28 dec. 2021 kl 17:07 skrev Nathan Hartman < >> hartman.nat...@gmail.com>: >> >> >> >> Ah, yes, ASF switched from the mirror system to a CDN. It was my >> >> understanding that it was supposed to be transparent as far as we're >> >> concerned, meaning we did not need to make any changes to our download >> >> pages. But obviously the https://www.apache.org/mirrors/ address is no >> >> longer valid, so that link should be removed. I wouldn't remove the >> >> entire Mirror section because it does still list two choices, one >> >> being the dlcdn and the other being a backup. >> > >> > >> > Do you see different mirrors as primary and backup? For me both are the >> dlcdn. But I guess this could vary with location. >> >> Hmm both are showing dlcdn, except one is suffixed "(backup)". I >> assumed there was a difference between these but didn't dig any deeper >> on that. >> > > I've started a thread in users@infra.a.o, but it seems that list is not > public so I cannot link. But it seems that dlcdn.a.o is the only "mirror" > right now, with downloads.a.o being the "backup" (but not a backup in the > script). > > I will make some commits to staging and we can review it from there. > I didn't quite succeed, see the log. I'm not sure if this is due to a limitation of the lua version of EZT or if I'm doing something wrong. I'd be happy for some review before merging to publish. Kind regards, Daniel
Re: Download page
Den tis 28 dec. 2021 kl 20:06 skrev Nathan Hartman : > On Tue, Dec 28, 2021 at 11:16 AM Daniel Sahlberg > wrote: > > > > Den tis 28 dec. 2021 kl 17:07 skrev Nathan Hartman < > hartman.nat...@gmail.com>: > >> > >> Ah, yes, ASF switched from the mirror system to a CDN. It was my > >> understanding that it was supposed to be transparent as far as we're > >> concerned, meaning we did not need to make any changes to our download > >> pages. But obviously the https://www.apache.org/mirrors/ address is no > >> longer valid, so that link should be removed. I wouldn't remove the > >> entire Mirror section because it does still list two choices, one > >> being the dlcdn and the other being a backup. > > > > > > Do you see different mirrors as primary and backup? For me both are the > dlcdn. But I guess this could vary with location. > > Hmm both are showing dlcdn, except one is suffixed "(backup)". I > assumed there was a difference between these but didn't dig any deeper > on that. > I've started a thread in users@infra.a.o, but it seems that list is not public so I cannot link. But it seems that dlcdn.a.o is the only "mirror" right now, with downloads.a.o being the "backup" (but not a backup in the script). I will make some commits to staging and we can review it from there. Kind regards, Daniel
Re: Download page
On Tue, Dec 28, 2021 at 11:16 AM Daniel Sahlberg wrote: > > Den tis 28 dec. 2021 kl 17:07 skrev Nathan Hartman : >> >> Ah, yes, ASF switched from the mirror system to a CDN. It was my >> understanding that it was supposed to be transparent as far as we're >> concerned, meaning we did not need to make any changes to our download >> pages. But obviously the https://www.apache.org/mirrors/ address is no >> longer valid, so that link should be removed. I wouldn't remove the >> entire Mirror section because it does still list two choices, one >> being the dlcdn and the other being a backup. > > > Do you see different mirrors as primary and backup? For me both are the > dlcdn. But I guess this could vary with location. Hmm both are showing dlcdn, except one is suffixed "(backup)". I assumed there was a difference between these but didn't dig any deeper on that. Nathan
Re: Download page
Den tis 28 dec. 2021 kl 17:07 skrev Nathan Hartman : > On Tue, Dec 28, 2021 at 9:22 AM Daniel Sahlberg > wrote: > > > > Hi, > > > > Has anyone seen guidance from ASF on updating the download page? > Apparently the old mirror system has been retired, see > https://apache.org/history/mirror-history.html > > > > We should /at least/ remove the link to https://www.apache.org/mirrors/ > (it is 404). I believe we can remove the complete Mirror section. > > > > Kind regards, > > Daniel > > > > > > PS. It seems we are not the only ones who missed the news. Even httpd > has the same 404 link. > > Ah, yes, ASF switched from the mirror system to a CDN. It was my > understanding that it was supposed to be transparent as far as we're > concerned, meaning we did not need to make any changes to our download > pages. But obviously the https://www.apache.org/mirrors/ address is no > longer valid, so that link should be removed. I wouldn't remove the > entire Mirror section because it does still list two choices, one > being the dlcdn and the other being a backup. > Do you see different mirrors as primary and backup? For me both are the dlcdn. But I guess this could vary with location. Slightly off-topic but worth mentioning: there's some infra magic > sauce in this page code. If you check .htaccess you'll see a > RewriteRule to use download.cgi, while download.html contains special > bracketed markup. I think this mechanism is part of a response to a > DDoS attack that happened back in the day. There's some documentation > at [1], at least on how projects needed to migrate from the old system > to the (then) new one; this might provide some further insights into > how it works. > > [1]: > https://cwiki.apache.org/confluence/display/INFRA/Download+page+(mirror+script)+migration+steps > > Cheers, > Nathan >
Re: Download page
On Tue, Dec 28, 2021 at 9:22 AM Daniel Sahlberg wrote: > > Hi, > > Has anyone seen guidance from ASF on updating the download page? Apparently > the old mirror system has been retired, see > https://apache.org/history/mirror-history.html > > We should /at least/ remove the link to https://www.apache.org/mirrors/ (it > is 404). I believe we can remove the complete Mirror section. > > Kind regards, > Daniel > > > PS. It seems we are not the only ones who missed the news. Even httpd has the > same 404 link. Ah, yes, ASF switched from the mirror system to a CDN. It was my understanding that it was supposed to be transparent as far as we're concerned, meaning we did not need to make any changes to our download pages. But obviously the https://www.apache.org/mirrors/ address is no longer valid, so that link should be removed. I wouldn't remove the entire Mirror section because it does still list two choices, one being the dlcdn and the other being a backup. Slightly off-topic but worth mentioning: there's some infra magic sauce in this page code. If you check .htaccess you'll see a RewriteRule to use download.cgi, while download.html contains special bracketed markup. I think this mechanism is part of a response to a DDoS attack that happened back in the day. There's some documentation at [1], at least on how projects needed to migrate from the old system to the (then) new one; this might provide some further insights into how it works. [1]: https://cwiki.apache.org/confluence/display/INFRA/Download+page+(mirror+script)+migration+steps Cheers, Nathan
