Bug#752384: HEAnet sourceforge mirror is outdated

2014-09-11 Thread Daniel Lintott
Hi Paul, On 11/09/14 04:20, Paul Wise wrote: On Tue, Jul 22, 2014 at 5:29 PM, Daniel Lintott wrote: I shall drop another version of the patch to the bug report that reverts the custom caching mechanism. A yak shaving exercise reminded me that this hasn't been done yet, could you please

Bug#752384: HEAnet sourceforge mirror is outdated

2014-09-11 Thread Paul Wise
On Thu, Sep 11, 2014 at 9:53 PM, Paul Wise wrote: Thanks! Committed and made live: Daniel, there is one bug I'm hoping you can help with since I've mostly forgotten how to write PHP. URLs like this: https://qa.debian.org/watch/sf.php/chromium-bsu Need to be redirected to URLs like this:

Bug#752384: HEAnet sourceforge mirror is outdated

2014-09-11 Thread Daniel Lintott
Hi Paul, On 11/09/14 15:21, Paul Wise wrote: On Thu, Sep 11, 2014 at 9:53 PM, Paul Wise wrote: Thanks! Committed and made live: Daniel, there is one bug I'm hoping you can help with since I've mostly forgotten how to write PHP. URLs like this:

Bug#752384: HEAnet sourceforge mirror is outdated

2014-09-11 Thread Paul Wise
On Fri, Sep 12, 2014 at 12:59 AM, Daniel Lintott wrote: I've attached a patch which should solve this problem, in fact it was already in my script just not used as you'll see. Excellent, applied! BTW: we could always use more help with QA infra, more details here :)

Bug#752384: HEAnet sourceforge mirror is outdated

2014-09-10 Thread Paul Wise
On Tue, Jul 22, 2014 at 5:29 PM, Daniel Lintott wrote: I would say that seems like a sensible suggestion. Using a ready-made system for the caching obviously has major benefits of being well-established and supported. Personally I've never used or setup such a service, but there are several

Bug#752384: HEAnet sourceforge mirror is outdated

2014-07-22 Thread Daniel Lintott
On 22/07/14 02:05, Paul Wise wrote: On Tue, Jul 22, 2014 at 2:50 AM, Daniel Lintott wrote: Okay... It took a bit of thinking of how to work it, but I've come up with a working solution that caches the file list for each project requested. There was some discussion on IRC about the problem

Bug#752384: HEAnet sourceforge mirror is outdated

2014-07-21 Thread Daniel Lintott
On 21/07/14 04:11, Paul Wise wrote: Unfortunately the final word on that is that Debian needs to replace our current redirector with one based on the RSS feature and also to add a cache mechanism (they suggested a 1 hour cache time) so that we don't overload the RSS feature. Do you think it

Re: Bug#752384: HEAnet sourceforge mirror is outdated

2014-07-21 Thread Stuart Prescott
Hi Daniel, many thanks for your work on this! It should definitely be possible to add a caching mechanism to the the new redirector, currently I have a couple of ideas on this but both have drawbacks. 1. Use a Berkeley DB to store the retrieved data, similar to what is currently done.

Bug#752384: HEAnet sourceforge mirror is outdated

2014-07-21 Thread Abou Al Montacir
Hi All, On Mon, 2014-07-21 at 11:02 +0100, Daniel Lintott wrote: On 21/07/14 04:11, Paul Wise wrote: Unfortunately the final word on that is that Debian needs to replace our current redirector with one based on the RSS feature and also to I honestly was expecting such answer! add a cache

Bug#752384: HEAnet sourceforge mirror is outdated

2014-07-21 Thread Paul Wise
On Mon, 2014-07-21 at 15:39 +0200, Abou Al Montacir wrote: Are we really consuming so much bandwidth for that feature? I assume this will happen each time a user or a daemon wants to check a particular package. I'm not convinced this is worth especially they ask for a cache of 1 hour, do we

Bug#752384: HEAnet sourceforge mirror is outdated

2014-07-21 Thread Daniel Lintott
Control: -1 + patch On 21/07/14 14:58, Paul Wise wrote: On Mon, 2014-07-21 at 15:39 +0200, Abou Al Montacir wrote: Are we really consuming so much bandwidth for that feature? I assume this will happen each time a user or a daemon wants to check a particular package. I'm not convinced this

Bug#752384: HEAnet sourceforge mirror is outdated

2014-07-21 Thread Paul Wise
On Tue, Jul 22, 2014 at 2:50 AM, Daniel Lintott wrote: Okay... It took a bit of thinking of how to work it, but I've come up with a working solution that caches the file list for each project requested. There was some discussion on IRC about the problem and a caching proxy was suggested

Bug#752384: HEAnet sourceforge mirror is outdated

2014-07-20 Thread Paul Wise
On Tue, Jul 8, 2014 at 5:26 PM, Daniel Lintott wrote: Indeed... I have managed to replicate the functionality of the current SF redirector using the RSS feed ... Ack... That would be very nice to see. Let's hope they can come up with a nice solution. Unfortunately the final word on that is

Bug#752384: HEAnet sourceforge mirror is outdated (was Re: [Pkg-pascal-devel] Lazarus watch file is broken)

2014-07-13 Thread Abou Al Montacir
Hi Daniel, On Sun, 2014-07-13 at 11:21 +0100, Daniel Lintott wrote: Hi, ... I think your actually the following the bug at [1]. You can see the conversation I had with Paul in that bug report. Regards, Daniel Lintott I have tested your tool for Lazarus and it looks working as

Bug#752384: HEAnet sourceforge mirror is outdated (was Re: [Pkg-pascal-devel] Lazarus watch file is broken)

2014-07-13 Thread Daniel Lintott
Hi Abou, On 13/07/14 12:40, Abou Al Montacir wrote: Hi Daniel, ... I have tested your tool for Lazarus and it looks working as expected. That's always good to know! I'd recommend to use this solution in [2] as it looks really easy to maintain/update with so few php lines. Also I

Bug#752384: HEAnet sourceforge mirror is outdated

2014-07-08 Thread Daniel Lintott
On 07/07/14 12:27, Paul Wise wrote: On Mon, 2014-07-07 at 12:15 +0100, Daniel Lintott wrote: I don't know whether this has been found/investigated before but the appears to be an RSS feed for each project containing the file downloads. So for my package VPCS, the RSS feed is at:

Bug#752384: HEAnet sourceforge mirror is outdated

2014-07-07 Thread Daniel Lintott
Hi Paul, I just hit this same problem with one of my packages that ifs hosted on SF.net and the HEAnet mirror doesn't hold the latest source. I don't know whether this has been found/investigated before but the appears to be an RSS feed for each project containing the file downloads. So for my

Bug#752384: HEAnet sourceforge mirror is outdated

2014-07-07 Thread Paul Wise
On Mon, 2014-07-07 at 12:15 +0100, Daniel Lintott wrote: I don't know whether this has been found/investigated before but the appears to be an RSS feed for each project containing the file downloads. So for my package VPCS, the RSS feed is at: https://sourceforge.net/projects/vpcs/rss

Bug#752384: HEAnet sourceforge mirror is outdated

2014-06-23 Thread Paul Wise
Hi HEAnet mirror operators, The Debian project[1] QA group[2] is currently relying[3] on this command to detect new versions of software that is packaged in Debian: rsync -Pvan --log-file=/dev/null --list-only ftp.heanet.ie::sourceforge We received a report that the HEAnet mirror of SourceForge

Bug#752384: HEAnet sourceforge mirror is outdated

2014-06-23 Thread Mirror Team
On Mon, 23 Jun 2014 17:23:35 +0800 Paul Wise p...@debian.org wrote: Hi HEAnet mirror operators, The Debian project[1] QA group[2] is currently relying[3] on this command to detect new versions of software that is packaged in Debian: rsync -Pvan --log-file=/dev/null --list-only

Bug#752384: HEAnet sourceforge mirror is outdated

2014-06-23 Thread Paul Wise
On Mon, 2014-06-23 at 16:41 +0100, HEAnet Mirror Team wrote: I have contacted the SourceForge mirror admins who have identified a problem on the HEAnet end and we're currently investigating. Thanks. Meanwhile it would seem that bug #752384 is erroneous. It assumes SourceForge sync all files