Re: [Server-devel] Web Caching Issues
On Mar 16, 2010, at 11:30 PM, Andra DuPont wrote: > With the internet disconnected, my web browser just says it can't display > anything > because it is not connected to the internet. When I plug the DSL modem back > into > eth0 on the XS, all is fine. > > How do I turn on DNS server logging? You increment the trace level using the remote name daemon controller: Something like: sudo rndc trace 5 > Andy > > On Mar 16, 2010, at 11:06 PM, John Watlington wrote: > >> >> When you turn on offline mode, you are just handling >> the HTTP requests. There are other network operations >> which have to happen before hand which probably aren't >> being "offlined" properly. >> >> What happens to DNS in the offline scenario ? If your clients >> are all properly pointed at the school server's DNS server, >> and the entries aren't timing out, it might resolve properly. >> Otherwise, the HTTP request will never be made. >> >> Once you switch to offline mode, what does squid's access >> log indicate ? error log ? You can turn on logging on the >> DNS server and see if name resolution is being requested. >> >> Cheers, >> wad >> >> On Mar 16, 2010, at 10:38 PM, Andra DuPont wrote: >> >>> I have reconfigured my server so that my internet connection goes straight >>> from my DSL modem to eth0 on the XS. This did not solve the problem (web >>> chaching not working), but it eliminated Windows 7 Firewall as the cause. I >>> have several computer connected both wired and wirelessly to the AP on eth1 >>> of the XS. They can access both the schoolserver and the internet (so long >>> as the internet is active on eth0 of XS). When I disconnect the internet >>> service, the AP computers can still get to the schoolserver, but not to the >>> external web pages that should have been cached from the internet. >>> >>> Internet service at the remote village in Kenya where this server will be >>> installed is poor and intermittent. It is therefore critical to be able to >>> cache whatever content does come in. I am also considering some >>> modifications to the Squid.conf file to accommodate turning the >>> offline_mode on and off depending on the status of the internet connection. >>> See this article for the concept and proposed solution. >> >> See what article ? >> >>> I have tried turning offline_mode "on" after caching a bunch of web pages >>> to see what would happen. When I disconnected the internet service to eth0 >>> on the XS, external web service stopped. In other words, the server would >>> not serve up the cached material, or at least that was my conclusion. >>> >>> Does anyone have a simple diagnostic approach to this problem. I am new to >>> linux, OLPC and XS, so it's like drinking from a fire hose right now. Can >>> someone point me in the right direction. >>> >>> On Mar 16, 2010, at 2:51 PM, Andra DuPont wrote: >>> I have set up an XS server at my home to become familiar with it so I can help an installation in Asilong, Kenya. There server has never been used as no one there understands it. My server is running the latest XS (0.6) and in order to simulate the situation in Asilong, the server is connected to the internet on eth0 from a PC running Windows 7. The PC is connected wirelessly to my home router, and that connection is bridged on the PC to its ethernet port which is then connected to the XS-eth0. The XS-eth1 is connected to a wireless AP and I'm testing performance of the server by connecting an iMac to the AP. The iMac can log into the Schoolserver, and can also access the internet. So far so good. I have enabled squid on my server, but web caching does not seem to be working. I'm wondering if feeding my internet connection to the server from a bridged connection on my Windows 7 computer with Windows Firewall running is interfering with some of the dns information on the cache. "Revisited" pages don't load faster (if I clear the cache on the connected iMac), and if I disconnect the eth0 internet feed, the server is unable to retrieve anything external, even material that should be cached. I am working now on setting up the forwarders correctly in the named-xs.conf.in file, and also playing with the "offline_mode on" setting in the squid-xs.conf file to see what affect it has. Any thoughts from the team? Andy DuPont >>> >>> ___ >>> Server-devel mailing list >>> Server-devel@lists.laptop.org >>> http://lists.laptop.org/listinfo/server-devel >> > > ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel
Re: [Server-devel] Web Caching Issues
How do I "Crank up the debugging/logging options" ??? On Mar 16, 2010, at 11:26 PM, Martin Langhoff wrote: > On Tue, Mar 16, 2010 at 10:38 PM, Andra DuPont wrote: >> I have reconfigured my server so that my internet connection goes straight >> from my DSL modem to eth0 on the XS. This did not solve the problem (web > > That part is strange, probably the logs (cache.log I think) will help. > Crank up the debugging/logging options of Squid... > >> as the internet is active on eth0 of XS). When I disconnect the internet >> service, the AP computers can still get to the schoolserver, but not to the >> external web pages that should have been cached from the internet. > > Well... while I wish that could work, I don't think we can expect it > to work at the moment for various reasons. > > Most websites don't use http caching headers effectively, and Squid > follows them; observing directives like "must-revalidate" means that > offline won't work. > > For the task you are trying to accomplish, wwwoffle is _the_ tool. > http://www.gedanken.demon.co.uk/wwwoffle/ > > Squid and other "conventional" proxies are too "correct" to be useful ;-) > > cheers, > > > > m > -- > martin.langh...@gmail.com > mar...@laptop.org -- School Server Architect > - ask interesting questions > - don't get distracted with shiny stuff - working code first > - http://wiki.laptop.org/go/User:Martinlanghoff ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel
Re: [Server-devel] Web Caching Issues
With the internet disconnected, my web browser just says it can't display anything because it is not connected to the internet. When I plug the DSL modem back into eth0 on the XS, all is fine. How do I turn on DNS server logging? Andy On Mar 16, 2010, at 11:06 PM, John Watlington wrote: > > When you turn on offline mode, you are just handling > the HTTP requests. There are other network operations > which have to happen before hand which probably aren't > being "offlined" properly. > > What happens to DNS in the offline scenario ? If your clients > are all properly pointed at the school server's DNS server, > and the entries aren't timing out, it might resolve properly. > Otherwise, the HTTP request will never be made. > > Once you switch to offline mode, what does squid's access > log indicate ? error log ? You can turn on logging on the > DNS server and see if name resolution is being requested. > > Cheers, > wad > > On Mar 16, 2010, at 10:38 PM, Andra DuPont wrote: > >> I have reconfigured my server so that my internet connection goes straight >> from my DSL modem to eth0 on the XS. This did not solve the problem (web >> chaching not working), but it eliminated Windows 7 Firewall as the cause. I >> have several computer connected both wired and wirelessly to the AP on eth1 >> of the XS. They can access both the schoolserver and the internet (so long >> as the internet is active on eth0 of XS). When I disconnect the internet >> service, the AP computers can still get to the schoolserver, but not to the >> external web pages that should have been cached from the internet. >> >> Internet service at the remote village in Kenya where this server will be >> installed is poor and intermittent. It is therefore critical to be able to >> cache whatever content does come in. I am also considering some >> modifications to the Squid.conf file to accommodate turning the offline_mode >> on and off depending on the status of the internet connection. See this >> article for the concept and proposed solution. > > See what article ? > >> I have tried turning offline_mode "on" after caching a bunch of web pages to >> see what would happen. When I disconnected the internet service to eth0 on >> the XS, external web service stopped. In other words, the server would not >> serve up the cached material, or at least that was my conclusion. >> >> Does anyone have a simple diagnostic approach to this problem. I am new to >> linux, OLPC and XS, so it's like drinking from a fire hose right now. Can >> someone point me in the right direction. >> >> On Mar 16, 2010, at 2:51 PM, Andra DuPont wrote: >> >>> I have set up an XS server at my home to become familiar with it so I can >>> help an installation in Asilong, Kenya. There server has never been used as >>> no one there understands it. >>> >>> My server is running the latest XS (0.6) and in order to simulate the >>> situation in Asilong, the server is connected to the internet on eth0 from >>> a PC running Windows 7. The PC is connected wirelessly to my home router, >>> and that connection is bridged on the PC to its ethernet port which is then >>> connected to the XS-eth0. The XS-eth1 is connected to a wireless AP and I'm >>> testing performance of the server by connecting an iMac to the AP. The iMac >>> can log into the Schoolserver, and can also access the internet. So far so >>> good. >>> >>> I have enabled squid on my server, but web caching does not seem to be >>> working. I'm wondering if feeding my internet connection to the server from >>> a bridged connection on my Windows 7 computer with Windows Firewall running >>> is interfering with some of the dns information on the cache. >>> >>> "Revisited" pages don't load faster (if I clear the cache on the connected >>> iMac), and if I disconnect the eth0 internet feed, the server is unable to >>> retrieve anything external, even material that should be cached. >>> >>> I am working now on setting up the forwarders correctly in the >>> named-xs.conf.in file, and also playing with the "offline_mode on" setting >>> in the squid-xs.conf file to see what affect it has. >>> >>> Any thoughts from the team? >>> >>> Andy DuPont >> >> ___ >> Server-devel mailing list >> Server-devel@lists.laptop.org >> http://lists.laptop.org/listinfo/server-devel > ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel
Re: [Server-devel] Web Caching Issues
On Tue, Mar 16, 2010 at 10:38 PM, Andra DuPont wrote: > I have reconfigured my server so that my internet connection goes straight > from my DSL modem to eth0 on the XS. This did not solve the problem (web That part is strange, probably the logs (cache.log I think) will help. Crank up the debugging/logging options of Squid... > as the internet is active on eth0 of XS). When I disconnect the internet > service, the AP computers can still get to the schoolserver, but not to the > external web pages that should have been cached from the internet. Well... while I wish that could work, I don't think we can expect it to work at the moment for various reasons. Most websites don't use http caching headers effectively, and Squid follows them; observing directives like "must-revalidate" means that offline won't work. For the task you are trying to accomplish, wwwoffle is _the_ tool. http://www.gedanken.demon.co.uk/wwwoffle/ Squid and other "conventional" proxies are too "correct" to be useful ;-) cheers, m -- martin.langh...@gmail.com mar...@laptop.org -- School Server Architect - ask interesting questions - don't get distracted with shiny stuff - working code first - http://wiki.laptop.org/go/User:Martinlanghoff ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel
Re: [Server-devel] Web Caching Issues
When you turn on offline mode, you are just handling the HTTP requests. There are other network operations which have to happen before hand which probably aren't being "offlined" properly. What happens to DNS in the offline scenario ? If your clients are all properly pointed at the school server's DNS server, and the entries aren't timing out, it might resolve properly. Otherwise, the HTTP request will never be made. Once you switch to offline mode, what does squid's access log indicate ? error log ? You can turn on logging on the DNS server and see if name resolution is being requested. Cheers, wad On Mar 16, 2010, at 10:38 PM, Andra DuPont wrote: > I have reconfigured my server so that my internet connection goes straight > from my DSL modem to eth0 on the XS. This did not solve the problem (web > chaching not working), but it eliminated Windows 7 Firewall as the cause. I > have several computer connected both wired and wirelessly to the AP on eth1 > of the XS. They can access both the schoolserver and the internet (so long as > the internet is active on eth0 of XS). When I disconnect the internet > service, the AP computers can still get to the schoolserver, but not to the > external web pages that should have been cached from the internet. > > Internet service at the remote village in Kenya where this server will be > installed is poor and intermittent. It is therefore critical to be able to > cache whatever content does come in. I am also considering some modifications > to the Squid.conf file to accommodate turning the offline_mode on and off > depending on the status of the internet connection. See this article for the > concept and proposed solution. See what article ? > I have tried turning offline_mode "on" after caching a bunch of web pages to > see what would happen. When I disconnected the internet service to eth0 on > the XS, external web service stopped. In other words, the server would not > serve up the cached material, or at least that was my conclusion. > > Does anyone have a simple diagnostic approach to this problem. I am new to > linux, OLPC and XS, so it's like drinking from a fire hose right now. Can > someone point me in the right direction. > > On Mar 16, 2010, at 2:51 PM, Andra DuPont wrote: > >> I have set up an XS server at my home to become familiar with it so I can >> help an installation in Asilong, Kenya. There server has never been used as >> no one there understands it. >> >> My server is running the latest XS (0.6) and in order to simulate the >> situation in Asilong, the server is connected to the internet on eth0 from a >> PC running Windows 7. The PC is connected wirelessly to my home router, and >> that connection is bridged on the PC to its ethernet port which is then >> connected to the XS-eth0. The XS-eth1 is connected to a wireless AP and I'm >> testing performance of the server by connecting an iMac to the AP. The iMac >> can log into the Schoolserver, and can also access the internet. So far so >> good. >> >> I have enabled squid on my server, but web caching does not seem to be >> working. I'm wondering if feeding my internet connection to the server from >> a bridged connection on my Windows 7 computer with Windows Firewall running >> is interfering with some of the dns information on the cache. >> >> "Revisited" pages don't load faster (if I clear the cache on the connected >> iMac), and if I disconnect the eth0 internet feed, the server is unable to >> retrieve anything external, even material that should be cached. >> >> I am working now on setting up the forwarders correctly in the >> named-xs.conf.in file, and also playing with the "offline_mode on" setting >> in the squid-xs.conf file to see what affect it has. >> >> Any thoughts from the team? >> >> Andy DuPont > > ___ > Server-devel mailing list > Server-devel@lists.laptop.org > http://lists.laptop.org/listinfo/server-devel ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel
Re: [Server-devel] Web Caching Issues
I have reconfigured my server so that my internet connection goes straight from my DSL modem to eth0 on the XS. This did not solve the problem (web chaching not working), but it eliminated Windows 7 Firewall as the cause. I have several computer connected both wired and wirelessly to the AP on eth1 of the XS. They can access both the schoolserver and the internet (so long as the internet is active on eth0 of XS). When I disconnect the internet service, the AP computers can still get to the schoolserver, but not to the external web pages that should have been cached from the internet. Internet service at the remote village in Kenya where this server will be installed is poor and intermittent. It is therefore critical to be able to cache whatever content does come in. I am also considering some modifications to the Squid.conf file to accommodate turning the offline_mode on and off depending on the status of the internet connection. See this article for the concept and proposed solution. I have tried turning offline_mode "on" after caching a bunch of web pages to see what would happen. When I disconnected the internet service to eth0 on the XS, external web service stopped. In other words, the server would not serve up the cached material, or at least that was my conclusion. Does anyone have a simple diagnostic approach to this problem. I am new to linux, OLPC and XS, so it's like drinking from a fire hose right now. Can someone point me in the right direction. On Mar 16, 2010, at 2:51 PM, Andra DuPont wrote: > I have set up an XS server at my home to become familiar with it so I can > help an installation in Asilong, Kenya. There server has never been used as > no one there understands it. > > My server is running the latest XS (0.6) and in order to simulate the > situation in Asilong, the server is connected to the internet on eth0 from a > PC running Windows 7. The PC is connected wirelessly to my home router, and > that connection is bridged on the PC to its ethernet port which is then > connected to the XS-eth0. The XS-eth1 is connected to a wireless AP and I'm > testing performance of the server by connecting an iMac to the AP. The iMac > can log into the Schoolserver, and can also access the internet. So far so > good. > > I have enabled squid on my server, but web caching does not seem to be > working. I'm wondering if feeding my internet connection to the server from a > bridged connection on my Windows 7 computer with Windows Firewall running is > interfering with some of the dns information on the cache. > > "Revisited" pages don't load faster (if I clear the cache on the connected > iMac), and if I disconnect the eth0 internet feed, the server is unable to > retrieve anything external, even material that should be cached. > > I am working now on setting up the forwarders correctly in the > named-xs.conf.in file, and also playing with the "offline_mode on" setting in > the squid-xs.conf file to see what affect it has. > > Any thoughts from the team? > > Andy DuPont ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel
Re: [Server-devel] Web Caching Issues
There is data in the /library/cache files. This data has web based info I recognize as being from sites I visited. Which log do you want me to look in? cache.log or access.log? On Mar 16, 2010, at 5:19 PM, Martin Langhoff wrote: > On Tue, Mar 16, 2010 at 2:51 PM, Andra DuPont wrote: >> Any thoughts from the team? > > Any interesting entries in the squid log? Are there any files in the > /library/squid directories? > > cheers, > > > > m > -- > martin.langh...@gmail.com > mar...@laptop.org -- School Server Architect > - ask interesting questions > - don't get distracted with shiny stuff - working code first > - http://wiki.laptop.org/go/User:Martinlanghoff ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel
[Server-devel] Web Caching Issues
I have set up an XS server at my home to become familiar with it so I can help an installation in Asilong, Kenya. There server has never been used as no one there understands it. My server is running the latest XS (0.6) and in order to simulate the situation in Asilong, the server is connected to the internet on eth0 from a PC running Windows 7. The PC is connected wirelessly to my home router, and that connection is bridged on the PC to its ethernet port which is then connected to the XS-eth0. The XS-eth1 is connected to a wireless AP and I'm testing performance of the server by connecting an iMac to the AP. The iMac can log into the Schoolserver, and can also access the internet. So far so good. I have enabled squid on my server, but web caching does not seem to be working. I'm wondering if feeding my internet connection to the server from a bridged connection on my Windows 7 computer with Windows Firewall running is interfering with some of the dns information on the cache. "Revisited" pages don't load faster (if I clear the cache on the connected iMac), and if I disconnect the eth0 internet feed, the server is unable to retrieve anything external, even material that should be cached. I am working now on setting up the forwarders correctly in the named-xs.conf.in file, and also playing with the "offline_mode on" setting in the squid-xs.conf file to see what affect it has. Any thoughts from the team? Andy DuPont ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel
