Re: [ZWeb] Re: zope.org - serious caching issues
On Mon, 2007-05-21 at 10:09 -0400, Jim Fulton wrote: I'm adding zope-web to the CC list. I wish you hadn't done that yet. If we keep changing things. it will be hard to figure this out. It would be helpful to show the results of, say wget -S, as in: [EMAIL PROTECTED]:~/tmp$ wget -S http://www.zope.org/news.rss --09:58:05-- http://www.zope.org/news.rss = `news.rss' Resolving www.zope.org... 63.240.213.171 Connecting to www.zope.org|63.240.213.171|:80... connected. HTTP request sent, awaiting response... HTTP/1.0 200 OK Server: Zope/(unreleased version, python 2.2.3, linux2) ZServer/1.1b1 Date: Mon, 21 May 2007 13:57:28 GMT Content-Length: 4011 Content-Type: text/xml Age: 4 X-Cache: HIT from parent-ng2.zmh.zope.net X-Cache: MISS from cache2.zmh.zope.net Connection: close Length: 4,011 (3.9K) [text/xml] 100%[] 4,011 --.--K/s 09:58:05 (365.80 KB/s) - `news.rss' saved [4011/4011] [EMAIL PROTECTED]:~/tmp$ wget --user jim --password xx -S http:// www.zope.org/news.rss --10:00:45-- http://www.zope.org/news.rss = `news.rss.1' Resolving www.zope.org... 63.240.213.171 Connecting to www.zope.org|63.240.213.171|:80... connected. HTTP request sent, awaiting response... HTTP/1.0 200 OK Server: Zope/(unreleased version, python 2.2.3, linux2) ZServer/1.1b1 Date: Mon, 21 May 2007 13:45:20 GMT Content-Length: 4011 Content-Type: text/xml X-Cache: HIT from parent-ng2.zmh.zope.net Age: 892 X-Cache: HIT from cache4.zmh.zope.net Connection: close Length: 4,011 (3.9K) [text/xml] 100%[] 4,011 --.--K/s 10:00:45 (1.85 MB/s) - `news.rss.1' saved [4011/4011] It looks to me like the cache tier has been changed; IIRC zope.org was not in the cache tier I setup for Managed Hostingand didn't have (at least) 4 cache servers in it's request flow. Note that the second request is authenticated (except with a different password :) That won't make any difference...they both resulted in a cache hit. The first time, you hit a front side cache server that didn't have it cached: cache2, the second time, you hit a cache server that did have it cached: cache4. ... The objects do not display any caching policy in ZMI, but the cache manager still shows the enties in different variations. What cache manager? Possibly because it doesn't know about the change. It looks like in issue in Zope. How so? If you look at the wget output above, there don't seem to be any cache headers set. So, data would not be cached unless there is an overriding policy in squid. If the cache tier was changed and relying on the (old) default settings, then it's going to cache for a certain period of time. If you see both te child and the parent MISS, then what you're getting is coming from the app server. Yup. I'm getting a hit from the parent. Also note that both hits have me results for which the most recent entry is from March 29. If I bust the cache with a query string, the most recent entry is for May 15. That would also explain differences based on roles. There is nothing in squid that distinguishes if a user is authenticated, anonymous or manager. I don't follow this, what explains the difference; there should be no difference based on roles. I *think* Andrew Sawyers did something to arrange that non-anonymous users get non-cached results. This doesn't seem to be working any more. This is bad. I'm hoping that however got this working properly at some point can tell us what they did. :) It's been a long time, but IIRC we got rid of all caching for zope.org where a cache header wasn't explicitly being set. Jim Was the cache servers changed around? IIRC the zope.org tier only had 2 measly cachesand if they changed, I bet the rules where not changed along with the cache servers. Andrew ___ Zope-web maillist - Zope-web@zope.org http://mail.zope.org/mailman/listinfo/zope-web
Re: [ZWeb] Re: zope.org - serious caching issues
On Mon, 2007-05-21 at 16:42 -0400, David Lawson wrote: It has, but mostly only in layout and some streamlining of the configuration. The basic rules you established are still in place, since we assumed you had good reasons for them. I haven't been following this discussion terribly closely, but I'll take a closer look at things this evening. Well, trying to figure out what's changed...that would be the first thing I'd check; just verify that the rules are indeed hitting the requests. How long has this problem been evident? When did the changes take place? I presume awhile ago? Andrew ___ Zope-web maillist - Zope-web@zope.org http://mail.zope.org/mailman/listinfo/zope-web
[ZWeb] Re: zope.org
Chris Withers wrote: Gaute Amundsen wrote: Actually, I am starting to think there should be a big notice on the frontpage of the http://www.zope.org/Documentation/ section saying: don't bother with this, just read the source There's actually some merit to this, anyone mind if I implement? All kidding aside, I recently volunteered [1] to put some thought and work into a new documentation section. I've got a few ideas floating in my head and will be posting them on zope-web soon. Zope docs aren't a lost cause. There's lots of stuff out there, we just need to bring it back to zope.org (which requires a zope.org that you can actually work with, of course). Philipp [1] http://www.z3lab.org/sections/blogs/philipp-weitershausen/2006_08_27_sorry-fredrik ___ Zope-web maillist - Zope-web@zope.org http://mail.zope.org/mailman/listinfo/zope-web
Re: [ZWeb] Re: [Zope.org-internal] Re: [Zopeorg-webmaster] Download of Zope 2.8.3 is not possible
Chris Withers wrote: Jim Fulton wrote: I made an attempt to document the hardware setup. I announced this a long time ago. If you have the right privileges, you can: svn co svn+ssh://svn.zope.org/repos/zope.org/system-documentation/trunk I don't think it's up to date, but it does reflect at least a partial reality. I wish this would be kept up to date. :/ Yay! I have system docs now. Apologies to Andrew for not knowing these existed *blush* Anyway, I'm going to go and beat some walls down with my head. Hope the changes I've made help even a little... Much thanks Chris! Michael, have you noticed this making any difference? Works atm, the next zope release will show ... Michael -- http://zope.org/Members/d2m http://planetzope.org ___ Zope-web maillist - Zope-web@zope.org http://mail.zope.org/mailman/listinfo/zope-web
Re: [ZWeb] Re: [Zope.org-internal] Re: [Zopeorg-webmaster] Download of Zope 2.8.3 is not possible
Chris Withers wrote: Sidnei da Silva wrote: On Wed, Oct 19, 2005 at 04:17:02PM -0400, Jim Fulton wrote: | | I don't think that's a CMF 'feature', unless the product is using | | 'contentValues()' which is part of the CMF API. | | BTW, this doesn't mean anything to me. I guess it doesn't. It did to me. I tried to solve this properly by actually going and editing the disk based software. The results are in Products/CMFPackage/SoftwarePackage.py.chrisw.2005-10-20 on app1. It was only after several confusing refreshes on zope.org that I remembered Andrew saying he'd added another app server to Zope.org. *sigh* It'd be REAL nice if even the hardware setup of zope.org was documented SOMEWHERE so that if any of us do get pissed off enough to actually try and fix anything, we have a vague clue of where we need to go to update stuff :-( I made an attempt to document the hardware setup. I announced this a long time ago. If you have the right privileges, you can: svn co svn+ssh://svn.zope.org/repos/zope.org/system-documentation/trunk I don't think it's up to date, but it does reflect at least a partial reality. I wish this would be kept up to date. :/ ... Admittedly, this hides a load of potential other problems, but no-one really cares, right? ;-) Nope. We are just limping along until the ZF can create a new new (or is that new new new) zope.org. :/ Anyway, I'm going to go and beat some walls down with my head. Hope the changes I've made help even a little... Much thanks Chris! Jim -- Jim Fulton mailto:[EMAIL PROTECTED] Python Powered! CTO (540) 361-1714http://www.python.org Zope Corporation http://www.zope.com http://www.zope.org ___ Zope-web maillist - Zope-web@zope.org http://mail.zope.org/mailman/listinfo/zope-web
Re: [ZWeb] Re: [Zope.org-internal] Re: [Zopeorg-webmaster] DownloadofZope 2.8.3 is not possible
Andrew Sawyers wrote: Actually, this is annoying. I increasingly find docs useless for this very reason. I waste my time writing them. People bitch about them not being there or not correct, and they actually never even look. It is documented - and it's documented correctly. I don't know how anyone would look. You have to check something out to look. I announced this a long time ago and it's not surprising to me that people forgot. I mainly remembered because I created it in the first place. Having said that, we who have system access should all, on our local hard drives, have a directory where we keep information relevent to z.o. In that directory, there should be a checkout of the docs. If you don't have one, here's the command you give: svn co svn+ssh://svn.zope.org/repos/zope.org/system-documentation/trunk zope.org-system-docs Then, you will at least have some information that will remind you that the documentation exists. You should periodically update this. Don't count on being able to check it out in an emergency, as the system it's on may be down. (Or it's Berkeley database may be hosed.) Jim -- Jim Fulton mailto:[EMAIL PROTECTED] Python Powered! CTO (540) 361-1714http://www.python.org Zope Corporation http://www.zope.com http://www.zope.org ___ Zope-web maillist - Zope-web@zope.org http://mail.zope.org/mailman/listinfo/zope-web
Re: [ZWeb] Re: [Zope.org-internal] Re: [Zopeorg-webmaster] Downloadof Zope 2.8.3 is not possible
Andrew Sawyers wrote: Ok guys. I'm willing to eat a little crow on this one. I blame it on being on a lap top on prone to mucho interruptions (excuse mode off). The condition for this was actually more then the response I originally thought. When a unauthorized page is accessed on zope.org - you get a 302 to a require_login script, which in turn does a 302 to the login form. The below was the response from the final redirect - not the initial one! The initial redirect actually has a cache hitthus the problem was obvious. The page which generated the intial redirect was a file system skin, which is cache policy manager aware - and thus was getting the default policy applied. As of now, zope.org caches nothing explicity in the cache policy manager EXCEPT for .css and .js files. The squid servers explicitly are configured to NOT cache pages rendered by zope which do not have explicit cache headers already set. So, any further weird caching should be traceable to the various ram caches and/or httpd accelerated caches in the zope.org site and not attributable to the framework cache policy or squid itself. We are caching the release files themselves. I hope. Jim -- Jim Fulton mailto:[EMAIL PROTECTED] Python Powered! CTO (540) 361-1714http://www.python.org Zope Corporation http://www.zope.com http://www.zope.org ___ Zope-web maillist - Zope-web@zope.org http://mail.zope.org/mailman/listinfo/zope-web
Re: [ZWeb] Re: [Zope.org-internal] Re: [Zopeorg-webmaster] Download of Zope 2.8.3 is not possible
Sidnei da Silva wrote: On Wed, Oct 19, 2005 at 03:25:11PM -0400, Jim Fulton wrote: | - The product product has the *insane* policy that if any files aren't | published, the entire product is inaccessible. | | Does anyone know how to fix this? Is there a knob for this somewhere in | CMF? I don't think that's a CMF 'feature', unless the product is using 'contentValues()' which is part of the CMF API. I'm sure that's an easy fix. Can you give us a hint of how to fix it? Is it a knob somewhere? A DTML script? ;) Jim -- Jim Fulton mailto:[EMAIL PROTECTED] Python Powered! CTO (540) 361-1714http://www.python.org Zope Corporation http://www.zope.com http://www.zope.org ___ Zope-web maillist - Zope-web@zope.org http://mail.zope.org/mailman/listinfo/zope-web
