Build failed in Hudson: 3.0-amd64-CentOS-5.3 #48

2010-02-11 Thread noc
See http://build.squid-cache.org/job/3.0-amd64-CentOS-5.3/48/changes

Changes:

[Amos Jeffries squ...@treenet.co.nz] Author: Kieran Whitbread 
k.j.whitbr...@qmul.ac.uk
Bug 2858: Segment violation in HTCP

[Amos Jeffries amosjeffr...@squid-cache.org] 3.0.STABLE23

--
[...truncated 926 lines...]
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
depbase=`echo negotiate/negotiateScheme.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H -I. -I../../.././test-suite/../src/auth 
-I../../include -I. -I../../include -I../../.././test-suite/../include 
-I../../.././test-suite/../src   -I/usr/include/libxml2 -Werror -Wall 
-Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT 
negotiate/negotiateScheme.o -MD -MP -MF $depbase.Tpo -c -o 
negotiate/negotiateScheme.o 
../../.././test-suite/../src/auth/negotiate/negotiateScheme.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
rm -f libntlm.a
/usr/bin/ar cru libntlm.a ntlm/auth_ntlm.o 
ranlib libntlm.a
rm -f libbasic.a
/usr/bin/ar cru libbasic.a basic/auth_basic.o 
ranlib libbasic.a
rm -f libdigest.a
/usr/bin/ar cru libdigest.a digest/auth_digest.o 
ranlib libdigest.a
rm -f libnegotiate.a
/usr/bin/ar cru libnegotiate.a negotiate/auth_negotiate.o 
negotiate/negotiateScheme.o 
ranlib libnegotiate.a
make[3]: Leaving directory 
`http://build.squid-cache.org/job/3.0-amd64-CentOS-5.3/ws/btlayer-00-default/src/auth'
make[3]: Entering directory 
`http://build.squid-cache.org/job/3.0-amd64-CentOS-5.3/ws/btlayer-00-default/src'
depbase=`echo unlinkd_daemon.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT unlinkd_daemon.o 
-MD -MP -MF $depbase.Tpo -c -o unlinkd_daemon.o 
../.././test-suite/../src/unlinkd_daemon.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
depbase=`echo SquidNew.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT SquidNew.o -MD -MP 
-MF $depbase.Tpo -c -o SquidNew.o ../.././test-suite/../src/SquidNew.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
depbase=`echo int.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT int.o -MD -MP -MF 
$depbase.Tpo -c -o int.o ../.././test-suite/../src/int.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
depbase=`echo mem.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT mem.o -MD -MP -MF 
$depbase.Tpo -c -o mem.o ../.././test-suite/../src/mem.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
depbase=`echo store_key_md5.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT store_key_md5.o 
-MD -MP -MF $depbase.Tpo -c -o store_key_md5.o 
../.././test-suite/../src/store_key_md5.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
depbase=`echo StoreMeta.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT 

Build failed in Hudson: 3.0-amd64-CentOS-5.3 #49

2010-02-11 Thread noc
See http://build.squid-cache.org/job/3.0-amd64-CentOS-5.3/49/changes

Changes:

[Amos Jeffries squ...@treenet.co.nz] Typo in rev9166

[Amos Jeffries squ...@treenet.co.nz] Author: Kieran Whitbread 
k.j.whitbr...@qmul.ac.uk
Bug 2858: Segment violation in HTCP

--
[...truncated 927 lines...]
depbase=`echo negotiate/negotiateScheme.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H -I. -I../../.././test-suite/../src/auth 
-I../../include -I. -I../../include -I../../.././test-suite/../include 
-I../../.././test-suite/../src   -I/usr/include/libxml2 -Werror -Wall 
-Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT 
negotiate/negotiateScheme.o -MD -MP -MF $depbase.Tpo -c -o 
negotiate/negotiateScheme.o 
../../.././test-suite/../src/auth/negotiate/negotiateScheme.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
rm -f libntlm.a
/usr/bin/ar cru libntlm.a ntlm/auth_ntlm.o 
ranlib libntlm.a
rm -f libbasic.a
rm -f libdigest.a
/usr/bin/ar cru libbasic.a basic/auth_basic.o 
/usr/bin/ar cru libdigest.a digest/auth_digest.o 
ranlib libbasic.a
ranlib libdigest.a
rm -f libnegotiate.a
/usr/bin/ar cru libnegotiate.a negotiate/auth_negotiate.o 
negotiate/negotiateScheme.o 
ranlib libnegotiate.a
make[3]: Leaving directory 
`http://build.squid-cache.org/job/3.0-amd64-CentOS-5.3/ws/btlayer-00-default/src/auth'
make[3]: Entering directory 
`http://build.squid-cache.org/job/3.0-amd64-CentOS-5.3/ws/btlayer-00-default/src'
depbase=`echo unlinkd_daemon.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT unlinkd_daemon.o 
-MD -MP -MF $depbase.Tpo -c -o unlinkd_daemon.o 
../.././test-suite/../src/unlinkd_daemon.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
depbase=`echo SquidNew.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT SquidNew.o -MD -MP 
-MF $depbase.Tpo -c -o SquidNew.o ../.././test-suite/../src/SquidNew.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
depbase=`echo int.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT int.o -MD -MP -MF 
$depbase.Tpo -c -o int.o ../.././test-suite/../src/int.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
depbase=`echo mem.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT mem.o -MD -MP -MF 
$depbase.Tpo -c -o mem.o ../.././test-suite/../src/mem.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
depbase=`echo store_key_md5.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT store_key_md5.o 
-MD -MP -MF $depbase.Tpo -c -o store_key_md5.o 
../.././test-suite/../src/store_key_md5.cc; \
then mv -f $depbase.Tpo $depbase.Po; else rm -f $depbase.Tpo; 
exit 1; fi
depbase=`echo StoreMeta.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`; \
if g++ -DHAVE_CONFIG_H 
-DDEFAULT_CONFIG_FILE=\/usr/local/squid/etc/squid.conf\ -I. 
-I../.././test-suite/../src -I../include -I. -I../.././test-suite/../src 
-I../include -I../.././test-suite/../include 
-I../.././test-suite/../lib/libTrie/include-I/usr/include/libxml2 -Werror 
-Wall -Wpointer-arith -Wwrite-strings -Wcomments  -g -O2 -MT StoreMeta.o -MD 
-MP -MF $depbase.Tpo -c -o StoreMeta.o 

Re: [MERGE] acl support for range_offset_limit

2010-02-11 Thread Matthew Morgan

Amos Jeffries wrote:

On Wed, 10 Feb 2010 10:39:18 -0500, Matthew Morgan
atcs.matt...@gmail.com
wrote:
  

Here is the patch to add acl support to range_offset_limit.  It is being



  

parsed using the same data types as reply_body_max_size, which means the



  
limit value gets run through parseBytesLine64, and the acl is optional. 



  
If people are using the old global style of range_offset_limit, they 
shouldn't have to do anything to their configs.


As per Amos' request, getRangeOffsetLimit is now a member of 
HttpRequest, and it caches it's value the same way reply_body_max_size

does.

Sorry it has taken me so long!  Thanks for being patient.



Thank you. Looks good now.
  
Thank *you* for giving me a chance to help out even though I don't have 
much experience!

There are just some doc and polish bits, but I can do that during merge...

 * typedefs.h and cf.data.depend changes appear to be unused now and can
be dropped.

 * use of none in cf.data.pre documentation instead of -1 to indicate
the limit is removed and always download entire object.
  
I may be misunderstanding you here, but not specifying 
range_offset_limit makes it default to 0, which only downloads what the 
client asks for no matter what.  -1 makes it download the whole object 
regardless of the range asked for by the client.

 * mention in cf.data.pre that if units is omitted Bytes will be assumed.

Amos
  




Hudson build is back to normal: 3.1-amd64-CentOS-5.3 #87

2010-02-11 Thread noc
See http://build.squid-cache.org/job/3.1-amd64-CentOS-5.3/87/changes




Re: I need your help for my DESSERTATION (ME - Computer Engineering)

2010-02-11 Thread Dhaval Varia
Dear Sir,

I am very enthu to work on this problem.but i am new in this.

can you please help me initially.so i can understand flow of SQUID.

and also understand code which is related to this problem.

Please Answer me few question.

1. Where do i found source (ln which file??),which is responsible for
creating log when instance of SQUID created??

Thanx and Regards.
Dhaval Varia

On 2/10/10, Amos Jeffries squ...@treenet.co.nz wrote:
 Dhaval Varia wrote:
 Dear Sir,

 I am Doing my *research In SQUID proxy* as a part of my post graduation*
 (Master of Engineering)
 *Just started.but dont have a specific direction so i can move ahed.

 *I need your help in following confusions :-
 *
 1.  What topic / Module (In Squid) i choose to start my research work ?
 2.  Where do I understand the module.
 3.  what initially i have to do? to start my work?

 *Please sir,I will be greatful for your help.*

 Thanks  Best Regards.
 
 Dhaval varia
 (9924343883)


 Greetings,
   It's nice to see more people interested in Squid. (cc'ing to squid-dev
 mailing list, where developer discussions take place)

 Did you have any ideas about what sort of thing you would be most
 interested in?


 The current developer focus for this year is (mostly) on preparing Squid
 3.2 for better traffic scaling via SMP CPU support.  Our planned
 architecture so far is described here:
http://wiki.squid-cache.org/Features/SmpScale

 With Squid becoming multi-instance the most urgent project I'm looking
 for someone to create a daemon for reliable logging of data from N squid
 instances simultaneously to one log file.

 This daemon needs to open its own configurable socket for accepting
 connection requests from various Squid instances.
   On receiving a request it needs to receive the unique hostname from
 the Squid connecting and store it for optional configured pre-pending to
 every log line received via that TCP link.
   It needs to cope cleanly with sockets opening and closing at any time.
 Logging of many thousands of requests per second, ideally a minimum
 10,000/sec per connected Squid instance. Maybe ignore the in-channel log
 rotate commands but rotate whenever the logs reaches a configurable size.

 A module internal to Squid will also need to be created to use the new
 helper. Derived from the src/log/ModUdp.* daemon but using TCP logging
 and setup as well. Possibly to a daemon running on a remote machine.

 Deadline would be mid-year 2010 for something testable. End of year for
 something hopefuly able to be committed for use.

 Interested?

 Amos
 --
 Please be using
Current Stable Squid 2.7.STABLE7 or 3.0.STABLE23
Current Beta Squid 3.1.0.16



-- 
Thanks  Best Regards.

Dhaval varia
(9924343883)


Re: [MERGE] acl support for range_offset_limit

2010-02-11 Thread Henrik Nordström
tor 2010-02-11 klockan 08:33 -0500 skrev Matthew Morgan:

 I may be misunderstanding you here, but not specifying 
 range_offset_limit makes it default to 0, which only downloads what the 
 client asks for no matter what.  -1 makes it download the whole object 
 regardless of the range asked for by the client.

In byte specifications none == -1

range_offset_limit none acl...

means that there is no limit on range requests prefetching for requests
matching the acl...

Regards
Henrik



Re: [MERGE] acl support for range_offset_limit

2010-02-11 Thread Matthew Morgan

Henrik Nordström wrote:

tor 2010-02-11 klockan 08:33 -0500 skrev Matthew Morgan:

  
I may be misunderstanding you here, but not specifying 
range_offset_limit makes it default to 0, which only downloads what the 
client asks for no matter what.  -1 makes it download the whole object 
regardless of the range asked for by the client.



In byte specifications none == -1

range_offset_limit none acl...

means that there is no limit on range requests prefetching for requests
matching the acl...

Regards
Henrik

  

Yeah, I figured I just misunderstood what he was saying.  Thanks, Hendrik.



Hudson build is back to normal: 3.0-amd64-CentOS-5.3 #50

2010-02-11 Thread noc
See http://build.squid-cache.org/job/3.0-amd64-CentOS-5.3/50/changes




Hudson build is back to normal: 3.HEAD-amd64-CentOS-5.3 #355

2010-02-11 Thread noc
See http://build.squid-cache.org/job/3.HEAD-amd64-CentOS-5.3/355/changes




Initial SMP implementation plan

2010-02-11 Thread Alex Rousskov
Hello,

I would like to implement the following changes to add initial SMP
support to Squid. The changes are relatively simple but should allow us
to reap a lot of SMP benefits in many real deployments. I hope to submit
the results for review and trunk inclusion in about 45 days. More
sophisticated changes will follow, guided by real and lab performance data.

The plan is based on the SMP-related discussions we had in the past few
months. I factored in the apparent lack of developers available to
tackle more ambitious designs, the current state of code, and our
historical inability to handle huge projects without slipping off
schedule and creating various disasters along the way.


1. Processes versus threads:

The initial design is process- and not thread-based. Processes may be
converted to threads and/or threads may be added to certain processes
later. If we start with threads now, we may drown in problems caused by
poor encapsulation of some of the major code pieces and
thread-unreadiness of basic Squid libraries.


2. Building blocks:

A Squid process dedicated to a subset of squid.conf options is a
building block. The user can configure Squid to launch multiple such
processes. Option subsets are likely to overlap a lot because many
options would be the same for each process. In the initial
implementation, _all_ subsets will be identical. In other words, all
Squid processes will be identically configured and, hence, do the same
thing.

The main Squid process will need to open http_port(s) and other
listening sockets. It will either do it before forking child Squids or
will pass open socket descriptors to child Squids via sendmsg(2).

In the initial implementation, the admin will be able to specify which
CPU core(s) should be used for Squid. Eventually, it would be possible
to map individual building blocks to individual CPU cores.


3. What is expected to work:

SMP-scalable performance on general workloads. For example, if you have
8 CPU cores, you can utilize all of them.

Squid will behave as a single instance with respect to misses,
reconfiguration, access logging, and mgr:info part of the cache manager
interface.


4. Limitations:

Caching in the initial implementation is not shared and not synchronized.

Options that require exclusive, single-process access such as a single
source port for HTCP queries will not be supported in SMP mode.
Eventually, the associated functionality can be adjusted to work with
multiple processes or threads.

When logging via a pipe to a program, multiple program instances would
be launched.

I am sure other limitations will surface.


5. Next steps:

After the initial design is implemented, we will add support for shared
or at least synchronized cache. Also, more cache manager pages will
aggregate information from all processes.


Please review.

Thank you,

Alex.



Re: Initial SMP implementation plan

2010-02-11 Thread Robert Collins
JFDI :)

-Rob


signature.asc
Description: This is a digitally signed message part