in, or they can just see the cached pages or the mirrorlist.
We were leaning to wait for after the freeze to push this, but Adrian Reber
reported that the issue of mirrorlist being sometime un-available is causing
problem with the report-mirror script.
So I would like to ask for a freeze-break
On Wed, May 20, 2015 at 06:25:54AM -0600, Kevin Fenzi wrote:
On Wed, 20 May 2015 14:20:47 +0200
Adrian Reber adr...@lisas.de wrote:
Can I get two +1 for this change?
Switch to another URL for mirrormanager haproxy check
The haproxy check URL for the MirrorManager web
Can I get two +1 for this change?
Switch to another URL for mirrormanager haproxy check
The haproxy check URL for the MirrorManager web frontend was a URL
which resulted in a large DB query. Every proxy, every minute. This
resulted in two much memory and CPU consumption. This
On Wed, May 20, 2015 at 06:57:57AM -0600, Kevin Fenzi wrote:
On Wed, 20 May 2015 14:31:28 +0200
Adrian Reber adr...@lisas.de wrote:
Yes, but that was how it was before (I know that is bad argument ;-).
The old MM landing page was a simple login page without any DB access.
The current
:31:28 +0200
Adrian Reber adr...@lisas.de wrote:
Yes, but that was how it was before (I know that is bad argument ;-).
The old MM landing page was a simple login page without any DB access.
The current constellation is good that it tests that the whole thing
is actually working
On Mon, May 18, 2015 at 09:11:11AM -0600, Kevin Fenzi wrote:
On Mon, 18 May 2015 13:03:23 +0200
Adrian Reber adr...@lisas.de wrote:
On Mon, May 18, 2015 at 11:04:45AM +0200, Pierre-Yves Chibon wrote:
On Mon, May 18, 2015 at 09:23:06AM +0200, Adrian Reber wrote:
I am not sure
Author: Adrian Reber adr...@lisas.de
Date: Fri May 15 21:06:18 2015 +
Add rewrite rule to access specific parts of the mirrorlist
The MM1 publiclist links are supposed to still work. If an old
publiclist link tries to directly access a product/version or
product/version
On Mon, May 18, 2015 at 11:04:45AM +0200, Pierre-Yves Chibon wrote:
On Mon, May 18, 2015 at 09:23:06AM +0200, Adrian Reber wrote:
I am not sure if this is necessary, but searching for
'publiclist fedora 20' returns following link:
http://mirrors.fedoraproject.org/publiclist/Fedora/20
On Mon, May 18, 2015 at 11:39:00AM +0200, Pierre-Yves Chibon wrote:
I realized while I had already started running the playbook that I should not
have done this but it was too late.
The changes are minor:
http://infrastructure.fedoraproject.org/cgit/ansible.git/commit/?id=45d8e7e
Changes the
On Fri, May 15, 2015 at 12:02:41PM -0500, Dennis Gilmore wrote:
On Friday, May 15, 2015 09:34:02 AM Adrian Reber wrote:
There have been reports that the old links pointing to the mirrorlist
are no longer working:
$ curl -I http://mirrors.fedoraproject.org/publiclist
There have been reports that the old links pointing to the mirrorlist
are no longer working:
$ curl -I http://mirrors.fedoraproject.org/publiclist/
Location: https://admin.fedoraproject.org/mirrormanager///
This redirect still works but trying to access a specific
On Wed, May 13, 2015 at 03:43:55PM +0200, Pierre-Yves Chibon wrote:
On Wed, May 13, 2015 at 09:40:49AM -0400, Ralph Bean wrote:
On Wed, May 13, 2015 at 02:17:24PM +0200, Adrian Reber wrote:
The new MM2 crawler disables mirrors which have failed to be
successfully crawled for 4 consecutive
. But that is for after the freeze.
Adrian
commit 0dc0b70d9790b95cb6c1f41b4d36fb9aa2c9fbfc
Author: Adrian Reber adr...@lisas.de
Date: Wed May 13 11:23:21 2015 +
Start the crawl later on the second crawler.
Even with rsync as crawl method some hosts are taking
On Fri, Apr 24, 2015 at 07:50:02PM -0400, Chuck Anderson wrote:
Should this go to the mirror-list rather than just infrastructure?
It was actually send to one of the three mirror-lists. But you are
right, I will forward it to the other two mirror-lists.
What units is the Bandwidth parameter
On Sat, Apr 25, 2015 at 09:54:40AM -0600, Kevin Fenzi wrote:
On Sat, 25 Apr 2015 09:35:16 +0200
Adrian Reber adr...@lisas.de wrote:
On Fri, Apr 24, 2015 at 07:50:02PM -0400, Chuck Anderson wrote:
Should this go to the mirror-list rather than just infrastructure?
It was actually send
On Tue, Apr 21, 2015 at 07:33:27AM +0200, Pierre-Yves Chibon wrote:
! Crons: iirc there are still a couple of crons that are not running
properly and returning errors
Which ones?
From this night:
Subject: Cron root@mm-crawler01 /usr/bin/mm2_crawler --threads 50
/dev/null
to DB
hanging.
So here is the current status as far as I see it:
* Mirrorlist - In prod and apparently fine
* MM2 UI - Running in stg and seems all good to me
* Crawler - Adrian Reber has put some great work on this, afaics he
seems to have fixed the biggest issues but I'll let
I have set up a git bisect run on mm-crawler01 in hope to find the
commit which fixes curl. This means that mm-crawler01 will scan our
mirrors in the next few hours continuously. I just want to mention it
here in case one of the mirror admins is asking why their mirror is
scanned over and over
On Thu, Mar 26, 2015 at 08:51:38AM +0100, Pierre-Yves Chibon wrote:
On Wed, Mar 25, 2015 at 07:29:24PM -0600, Stephen John Smoogen wrote:
On 24 March 2015 at 01:31, Adrian Reber adr...@lisas.de wrote:
The xml-rpc interface does not work right now. I get
Error
The xml-rpc interface does not work right now. I get
Error checking in. Connection closed before checkin complete. Please try
again later.
There is no error in the error_log on mm-frontend01 and the access_log
just says:
10.5.126.88 - - [17/Mar/2015:21:51:13 +] POST
On Fri, Mar 20, 2015 at 04:38:24PM +0100, Adrian Reber wrote:
The biggest MM2 problem which currently exists is that the crawler
segfaults when running with more than 10 or 12 threads. The current
configuration runs daily with 75 threads and crashes regularly:
[740512.481002] mm2_crawler
On Mon, Mar 23, 2015 at 10:11:56AM -0600, Stephen John Smoogen wrote:
On 23 March 2015 at 09:59, Adrian Reber adr...@lisas.de wrote:
Additionally the 4GB of RAM on mm-crawler01 are not enough to
crawl all the mirrors in a reasonable time. Even if only
started with 20 crawler threads
The biggest MM2 problem which currently exists is that the crawler
segfaults when running with more than 10 or 12 threads. The current
configuration runs daily with 75 threads and crashes regularly:
[740512.481002] mm2_crawler[18149]: segfault at 30 ip 7ffdd8201557 sp
7ffd787d5250 error
To access the crawler logs from the MM2 web-interface (small code
changes still required) I need a web-server on mm-crawler01 which
exports /var/log/mirrormanager/crawler so that I can access the files
via
https://admin.stg.fedoraproject.org/mirrormanager2/crawler/218.log
for example. I am not
On Thu, Mar 19, 2015 at 12:25:52PM +0100, Pierre-Yves Chibon wrote:
On Thu, Mar 19, 2015 at 10:44:32AM +0100, Adrian Reber wrote:
Right now the MM2 backend and MM2 crawler cronjobs in staging are all
running as root. This seems unnecessary and I would like to change it to
the user
I would like to change the MM2 configuration file to access the real
content instead of the testdata:
commit 06cec996d9ef9a94c428b8f10bd3d2bdc327f279
Author: Adrian Reber adr...@lisas.de
Date: Wed Mar 18 15:20:44 2015 +
Make umdl use the real content
To prepare MM2
On Mon, Mar 16, 2015 at 01:38:41PM +0100, Pierre-Yves Chibon wrote:
One point where you might be of great help is with testing the xml-rpc
endpoint.
It should be 100% backward compatible (but I let you guess what the keyword is
in that sentence :)).
The xml-rpc interface does not work right
On Tue, Mar 17, 2015 at 06:41:12AM -0600, Kevin Fenzi wrote:
How can access the MM2 crawler machine to check the crawler
output. Can I also get access to manually start the crawler for
testing?
Are you in a sysadmin-* group?
Yes, in sysadmin-web.
I've added sysadmin-web
On Mon, Mar 16, 2015 at 07:22:32PM +0100, Pierre-Yves Chibon wrote:
Can you login and look around and see if the data/setup seems ok from a
high level glance?
Is it running on the same data as the production instance or has the
data been imported a few weeks ago? Is there a way I
On Fri, Mar 13, 2015 at 07:16:44AM -0600, Kevin Fenzi wrote:
We could do this... however at this point, I think I'd like to just
push to get mm2 out in production. I'm sure it will have issues too,
but at least they will not be this one hopefully. ;)
So what is actually necessary to get MM2
I know that MirrorManager2 will be coming but I just saw that there were
multiple crawler process killed on bapp02.
I also see in (at least) one of the crawler logs (1995-stderr.log-20150312.gz):
File /usr/lib/python2.6/site-packages/sqlobject/postgres/pgconnection.py,
line 115, in
On Thu, Mar 12, 2015 at 02:30:13PM -0600, Kevin Fenzi wrote:
On Thu, 12 Mar 2015 17:26:40 +0100
Adrian Reber adr...@lisas.de wrote:
It probably does not make much sense to change much in the current
setup as MM2 will be available soon.
yeah, really the only thing we could do is decrease
After the announcement that the I2 mirror will be shutdown
mirror.switch.ch wants to switch to the remaining master mirrors
and needs to be added to the ACLs. As those ACLs are probably also
frozen I would like to get +1s before committing following change:
I also removed an old typo from the ACL
On Tue, Nov 25, 2014 at 07:24:32AM -0700, Kevin Fenzi wrote:
On Tue, 25 Nov 2014 10:27:19 +0100
Adrian Reber adr...@lisas.de wrote:
The OOM killer on bapp02 has terminated a few mirrormanager crawler
processes. It seems it needs more memory or the number of parallel
crawlers has
On Tue, Nov 25, 2014 at 07:24:32AM -0700, Kevin Fenzi wrote:
The OOM killer on bapp02 has terminated a few mirrormanager crawler
processes. It seems it needs more memory or the number of parallel
crawlers has to be further limited.
Well, it's got 16GB now... I can bump it to 24 without
On Mon, Sep 22, 2014 at 10:05:05AM -0600, Kevin Fenzi wrote:
Some folks have been running into timeouts syncing some Fedora targets
from phx2 download servers. In particular Red Hat globalsync that
syncs to places like Brno where we have a lot of Fedora QA folks who
want the latest bits.
Looking at the crawler mirrormanager log files on bapp02 it seems the
last crawler run had some kind of problem:
-rw-r--r--. 1 mirrormanager mirrormanager 0 Sep 11 04:02 crawler.log
-rw-rw-r--. 1 mirrormanager mirrormanager 0 Sep 11 04:02
generate-publiclist.log
Both files have
On Fri, May 16, 2014 at 12:05:31PM -0600, Kevin Fenzi wrote:
On Thu, 15 May 2014 17:22:28 +0200
Adrian Reber adr...@lisas.de wrote:
It seems in modules/rsync/files/rsyncd.conf.download-phx
the second fedora-buffet rsync module should be named fedora-buffet0.
I have problems from my
It seems in modules/rsync/files/rsyncd.conf.download-phx
the second fedora-buffet rsync module should be named fedora-buffet0. I
have problems from my mirror (rhlx01.hs-esslingen.de) to connect to
fedora-buffet0.
[adrian@lockbox01 puppet]$ git grep fedora-buffet
On Sat, Apr 26, 2014 at 09:54:05AM +0700, An Phuoc wrote:
123HOST has been setup a new mirror server for Fedora in Vietnam.
Info:
HTTP: http://mirrors.123host.vn/epel/
Country : Vietnam
City: Ho Chi Minh
Sponsoring Organization : 123HOST
URL of Sponsoring Organization:
On Mon, Jan 27, 2014 at 11:03:24AM +0100, Julien Ippolito wrote:
Hi, we have some problem to get mirror fore epel-6 for all arch.
http://mirrors.fedoraproject.org/mirrorlist?repo=epel-6arch=x86_64
we get this error :
# Bad Request 7373
# {'repo': u'epel-6', 'IP': IP('82.227.12.86'),
This just came on the mirror-admin mailing list. I can confirm that I
get the same results.
Adrian
- Forwarded message from Dan Hawke dan.ha...@canterbury.ac.nz -
Date: Mon, 15 Apr 2013 03:09:11 +
From: Dan Hawke dan.ha...@canterbury.ac.nz
To:
I was just told I changed something during freeze. Sorry. Hope to get
some +1 even it is too late.
Adrian
On Tue, Apr 10, 2012 at 08:47:58PM +, Adrian Reber wrote:
commit c235e1991d5a9675b4f50cd3837cadeb78319fec
Author: Adrian Reber adr...@lisas.de
Date: Tue Apr 10 20
On Wed, Mar 16, 2011 at 09:59:21PM -0600, Stephen John Smoogen wrote:
sysadmin-web adrian
Please do not delete my sysadmin-web account. I need for MirrorManager
admin rights.
Adrian
___
infrastructure mailing list
According to a few hosts I checked in Mirrormanager's web frontend the
crawler has not been running for at least three days. Last run was on
2010-11-12.
Adrian
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
101 - 145 of 145 matches
Mail list logo
