Re: META.json: duty now for the future

2009-05-17 Thread Ask Bjørn Hansen
0) Yay for JSON. 1) Is it really necessary to use ascii instead of just regular utf-8 for the JSON output? 2) The documentation is a little confusing saying If it can be loaded, any META.yml file produced will contain JSON. -- but it looks like the code (correctly) makes the output file

Re: CPAN vs Perl 6

2010-01-05 Thread Ask Bjørn Hansen
As much as I like JSON I agree that for CPAN.pm like programs a variation of the current index really seems like the best match (5 lines of perl for the parser; backwards compatible; easy-ish to make as memory efficient as possible). For other tools having a more complete data structure would

Re: RFC: PGAN

2010-01-08 Thread Ask Bjørn Hansen
On Jan 7, 2010, at 21:29, David E. Wheeler wrote: See File::Rsync::Mirror::Recent Interesting. I especially like the PRE-ALPHA ALERT . www.cpan.org and the search.cpan.org mirrors are all using it, too (some of them indirectly, but still). - ask

Re: Trimming the CPAN - Automatic Purging

2010-03-25 Thread Ask Bjørn Hansen
On Mar 25, 2010, at 8:38, Andy Armstrong wrote: I like that solution better [snip] But solution to what? Are we convinced there's actually a problem here? CPAN has almost 200k files. www.cpan.org says there are 17627 modules. rsyncing a gazillion files doesn't work that well (on the

Re: Trimming the CPAN - Automatic Purging

2010-03-25 Thread Ask Bjørn Hansen
On Mar 25, 2010, at 13:23, Eric Wilhelm wrote: Maybe CPAN mirrors are more easily updated than via a generic rsync? Is the burden only network/cpu for checking whether a bunch of old archives have changed, or does disk matter? Most CPAN mirrors use rsync. It's not realistic to make them

Re: Trimming the CPAN - Automatic Purging

2010-03-26 Thread Ask Bjørn Hansen
On Mar 26, 2010, at 16:02, Arthur Corliss wrote: Why use rsync, then? Why not have checkpointed logs on cpan with additions/removals logged by date so you can roll forward on the client, processing only those files? It would be trivial to set up and a lot more efficient. I find it

Re: Trimming the CPAN - Automatic Purging

2010-03-31 Thread Ask Bjørn Hansen
On Mar 31, 2010, at 6:52, David Nicol wrote: new proposal: Make modules pay rent in order to remain on a mirror. Rent could be in the form of actual user interest, or good reviews. How you are proposing purging useless stuff from CPAN -- that's a lot more radical than Tim's proposal of just

Re: Distributing the CPAN

2010-04-01 Thread Ask Bjørn Hansen
On Apr 1, 2010, at 16:50, Tim Bunce wrote: * The need for widespread mirroring is less significant than it was in years past. (Also using git as the inter-mirror transport of source files means there'll be much less traffic between mirrors. Effectively only the diffs between releases.) The

Re: Trimming the CPAN - Automatic Purging

2010-04-02 Thread Ask Bjørn Hansen
On Apr 2, 2010, at 1:50, Arthur Corliss wrote: And my assertion has been that the excessive stats by the server are a bigger impediment to synchronization than the inode count. Well, then one of us don't understand how file systems etc work. :-) - ask

Re: Distributing the CPAN

2010-04-02 Thread Ask Bjørn Hansen
On Apr 2, 2010, at 14:03, Tim Bunce wrote: Imagine a cpan-all 'superproject' repro that has all the distros as submodules. This repro would be tiny when cloned because it only contains empty directories for the distos plus the metadata for where the upstream distro repro lives and what the

Re: so long, CPAN

2010-09-26 Thread Ask Bjørn Hansen
On Sep 26, 2010, at 5:52, Jarkko Hietaniemi wrote: On a more urgent note: could you and Elaine coordinate on moving/copying stuff out of gargoyle where e.g. the mirrors.cpan.org runs? Yes, of course. I'll send a mail off-list to get started. - ask

Re: Leo is skinning www.cpan.org

2010-09-27 Thread Ask Bjørn Hansen
On Sep 27, 2010, at 8:17, David Cantrell wrote: While we're on the subject of RECENT*, what is RECENT-Z.yaml? And will it ever be updated? At a glance, it appears to be a log of all uploads and deletes from the beginning of time up to some point in recent history, at which point it stops.

Re: How to get the Pause ID

2010-10-02 Thread Ask Bjørn Hansen
On Oct 2, 2010, at 20:52, Parag Kalra wrote: I have been trying to get Pause ID but seems like either the request is getting rejected or something is wrong in the way I am raising the request. You mention sharing scripts in the request -- PAUSE doesn't actually do that; it's only for

Re: How to get the Pause ID

2010-10-03 Thread Ask Bjørn Hansen
On Oct 3, 2010, at 20:31, Andreas J. Koenig wrote: http://www.cpan.org/scripts/submitting.html Yes, I'm not sure that even worked in 2002 when the page was last updated. /scripts/.* should just be redirected somewhere else. I must correct you, Ask, scripts/ is indeed alive, it is

Re: How to get the Pause ID

2010-10-03 Thread Ask Bjørn Hansen
On Oct 3, 2010, at 21:16, Andreas J. Koenig wrote: There's a mirroring bug somewhere then. Ah, I'm sorry -- I completely missed that the index files were pointing to proper PAUSE files! Anyway, I still think we should deprecate it and recommend people create App::foobar modules with a

Re: Can anyone give me access to an authenticating proxy server for testing?

2010-11-02 Thread Ask Bjørn Hansen
On Nov 2, 2010, at 20:12, David Golden wrote: I want to experiment with CPAN.pm and authenticating proxies. Can anyone give me access to a proxy server? Install squid on your laptop? - ask

Re: Adjusting CPAN::Mirrors to make it more useful

2011-02-07 Thread Ask Bjørn Hansen
On Feb 7, 2011, at 22:55, brian d foy wrote: And, who makes the MIRRORED.BY file? I imagine that's something from a script that Jarkko makes, but how does it get the data? Henk Penning (aka the mirror list master since a few months ago) maintains a master mirrors.json file that a script on

Re: Ports list - is it being maintained?

2011-02-17 Thread Ask Bjørn Hansen
On Feb 17, 2011, at 11:43, David Golden wrote: That raises a broader question. Who maintains all of the non tarball content on CPAN and what is the process for getting it changed? We at perl.org took it over recently but haven't gotten this sort of thing setup yet. (First order of

Re: update faq

2011-02-25 Thread Ask Bjørn Hansen
On Feb 25, 2011, at 5:54, Henk P. Penning wrote: .. to see if I got it right ; I forked, cloned, committed, pushed and set a 'pull request' ; please consider the change below. That worked. :-) I think you had some other changes to the how to mirror section, too...

CPAN mirrors list in JSON format

2011-02-27 Thread Ask Bjørn Hansen
The list of mirrors is now available in JSON format: http://log.perl.org/2011/02/cpan-mirrors-list-now-also-in-json-format.html - ask -- Ask Bjørn Hansen, http://askask.com/

CPAN master mirror update / rrr testing

2011-03-15 Thread Ask Bjørn Hansen
, recent uploads, ...); but I hope we'll put up the updated pages within the next few days. - ask -- Ask Bjørn Hansen, http://askask.com/

cpan.org updated

2011-03-20 Thread Ask Bjørn Hansen
Hi everyone, CPAN got its first big update in a while: http://log.perl.org/2011/03/big-cpanorg-update.html - ask -- http://log.perl.org/ - http://askask.com/

Re: Adjusting CPAN::Mirrors to make it more useful

2011-04-29 Thread Ask Bjørn Hansen
On Apr 28, 2011, at 9:19, brian d foy wrote: I think I may have implemented what you're looking for several years ago for JSAN, which has a client that auto-detected appropriate mirrors in a few seconds each time it starts. http://search.cpan.org/~adamk/Mirror-URI-0.90/lib/Mirror/YAML.pm

Re: Adjusting CPAN::Mirrors to make it more useful

2011-05-06 Thread Ask Bjørn Hansen
On May 2, 2011, at 12:54, David Golden wrote: Doesn't a lot of this problem go away with www.cpan.org resolving to tier 1 mirrors? Did I see that Robert/Ask were using some sort of GeoIP-aware DNS? Yeah, though for now only with mirrors in Los Angeles and one in Europe. Somewhat similar

Re: Adjusting CPAN::Mirrors to make it more useful

2011-05-09 Thread Ask Bjørn Hansen
number doing an occasional full rsync (between once a day and every few hours) and the load is basically completely negligible so far. 'rrr' drastically cuts down the IO required and the SSD that's serving the CPAN data can just do a crazy amount of rsync type I/O. - ask -- Ask Bjørn Hansen

Re: new instant mirroring client

2011-06-16 Thread Ask Bjørn Hansen
On Jun 16, 2011, at 1:03, Henk P. Penning wrote: I'm very curious to know what you think ; so, please try it out ; installing and testing should be very easy. It's really great to get another client for the 'instant mirroring' system; it'll suit different people and more importantly it

Re: new instant mirroring client

2011-06-16 Thread Ask Bjørn Hansen
On Jun 16, 2011, at 3:47, David Precious wrote: Incidentally, I've not seen any reports on the progress of instant mirroring for a bit - have I missed anything? No - it's working nicely. You want to upgrade to 0.2.1 if you haven't already. It's fixing deletion of symlinks that weren't

Re: rrr-client using 100% CPU and 300Mb+ memory?

2011-09-03 Thread Ask Bjørn Hansen
On Sep 3, 2011, at 2:08, Pedro Melo m...@simplicidade.org wrote: :) Ok, I'll try and debug it during the weekend. Try to make the batch size (much) larger. (I forget what the parameter is called)

Re: CPAN map

2012-03-24 Thread Ask Bjørn Hansen
On Mar 22, 2012, at 3:38, Henk P. Penning wrote: Hi, The CPAN mirrors map http://mirrors.cpan.org/map.html Neat. What do the blue markers mean?

Re: pause.perl.org seems down - can anyone fix?

2014-01-08 Thread Ask Bjørn Hansen
On Jan 8, 2014, at 9:05 AM, Cosimo Streppone cos...@cpan.org wrote: http://log.perl.org/2014/01/multiple-hard-drive-faliure.html On 01/08/2014 01:08 PM, Leo Lapworth wrote: Pause seems to be down, can anyone help out? I wish I could. Sadly still down. No news on log.perl.org either.

Re: Making www.cpan.org TLS-only

2017-09-05 Thread Ask Bjørn Hansen
> On Sep 5, 2017, at 11:22 , Leo Lapworth wrote: > > Would (at least for the short term) just adding the HSTS header to every > request be the best solution? Then browsers get told to switch to secure and > other clients can do either. HSTS only works on TLS requests, so

Re: Making www.cpan.org TLS-only

2017-09-01 Thread Ask Bjørn Hansen
The Google change was the impetus to get around to it. Clients should use TLS to request content. It limits the trust for downloading CPAN content roughly to: - The author - PAUSE system maintainers - perl.org infrastructure maintainers - Fastly - Global CA infrastructure Without TLS you

Re: Making www.cpan.org TLS-only

2017-08-31 Thread Ask Bjørn Hansen
> On Aug 31, 2017, at 19:44, James E Keenan wrote: > > To be honest, I had no idea what 'TLS' meant when I first read this message. > So I can't say anything one way or the other about your proposal. > > I suspect I'm not alone in this. I would encourage you to post in a

Making www.cpan.org TLS-only

2017-08-31 Thread Ask Bjørn Hansen
Hi everyone, We’re considering how/how-much we can make www.cpan.org TLS-only. http://log.perl.org/2017/08/tls-only-for-wwwcpanorg.html I expect that we can’t make the whole site TLS-only without breaking some CPAN clients, so the conservative version is to force TLS for - any url ending in

Re: Making www.cpan.org TLS-only

2017-08-31 Thread Ask Bjørn Hansen
Uh, there’s no “SSL” anymore. The newer versions of SSL have been “TLS” since the end of the nineties. https://en.wikipedia.org/wiki/Transport_Layer_Security That being said, the suggested change here is to require HTTPS for www.cpan.org by redirecting all plain-text HTTP requests to the HTTPS

Re: What happens to CPAN clients when TLS 1.2 is required?

2018-04-25 Thread Ask Bjørn Hansen
> On Apr 24, 2018, at 18:11 , David Golden wrote: > > But when they do opt into TLS, it's 1.2 required, right? Sure, but … TLS 1.2 is almost ten years old. 1.1 is only barely older. What operating systems don’t support TLS 1.2, but are otherwise functional / reasonable enough

Re: Mirror update - cpan.perl.pt

2019-03-05 Thread Ask Bjørn Hansen
> On Mar 5, 2019, at 15:54, Pedro Melo wrote: > > … every couple of hours to sync our CPAN mirror to backpan, but we would like > to mirror backpan once a week from a master repo with —delete. Any > recommendation on which backpan mirror to use? I don’t think that’s how backpan is supposed

Re: Move dev release tarballs to GitHub?

2022-04-05 Thread Ask Bjørn Hansen
That’d make sense to me, deleting the old images and letting them just be on backpan. That should allow whatever tooling depends on recent releases being in the regular CPAN mirrors to still work. Looking at 3 days of www.cpan.org logs only the most recent development

Re: Stuck module upload for Date::Parse::Modern

2023-01-14 Thread Ask Bjørn Hansen
`curl` on the box can validate the certificate okay (right now), for what it’s worth. Ask > On Jan 14, 2023, at 13:49, Ricardo Signes > wrote: > > I looked at the PAUSE logs: > 2023-01-13 22:50:39 $$3234 v1049: Alert: nosuccesscount[0] error[Can't > connect to www.perturb.org:443