Re: [GENERAL] debugging server connection issue

2016-03-31 Thread Stephen Constable
In case anybody looks back on this thread in the future, I fixed the problem (at least temporarily) by running the following in CentOS 7: # echo "1025 65535" >/proc/sys/net/ipv4/ip_local_port_range # sysctl -w net.ipv4.tcp_timestamps=1 # sysctl -w net.ipv4.tcp_tw_recycle=1 # sysctl -w tcp_tw_reuse=

Re: [GENERAL] debugging server connection issue

2016-03-29 Thread Adrian Klaver
On 03/29/2016 03:25 PM, Stephen Constable wrote: Sorry, my client environment is Linux. Hmm, so I was reading win32.c wrong. It is mapping a Windows error message to that string. My current theory is that my clients are running out of available ephemeral ports, like in this thread: http://

Re: [GENERAL] debugging server connection issue

2016-03-29 Thread John R Pierce
On 3/29/2016 3:25 PM, Stephen Constable wrote: Sorry, my client environment is Linux. My current theory is that my clients are running out of available ephemeral ports, like in this thread: http://dba.stackexchange.com/questions/59650/pgbouncer-works-great-but-occasionally-becomes-unavailable

Re: [GENERAL] debugging server connection issue

2016-03-29 Thread Stephen Constable
Sorry, my client environment is Linux. My current theory is that my clients are running out of available ephemeral ports, like in this thread: http://dba.stackexchange.com/questions/59650/pgbouncer-works-great-but-occasionally-becomes-unavailable (but I"m not currently using pg bouncer). I tried

Re: [GENERAL] debugging server connection issue

2016-03-29 Thread Adrian Klaver
On 03/29/2016 01:28 PM, Stephen Constable wrote: My apologies, I'm not sure what part of the networking stack the messages are coming from. It also states: """ could not connect to server: Cannot assign requested address Is the server running on host "" and accepting TCP/IP connections on port ?

Re: [GENERAL] debugging server connection issue

2016-03-29 Thread John R Pierce
On 3/29/2016 1:28 PM, Stephen Constable wrote: """ This error is only printed under a 32-job load, never a single job load. The processes are indeed connecting over a local network. I have only enabled the logging of connections and disconnections since I figured that would be the most telling

Re: [GENERAL] debugging server connection issue

2016-03-29 Thread Stephen Constable
My apologies, I'm not sure what part of the networking stack the messages are coming from. It also states: """ could not connect to server: Cannot assign requested address Is the server running on host "" and accepting TCP/IP connections on port ? """ This error is only printed under a 32-job load

Re: [GENERAL] debugging server connection issue

2016-03-29 Thread Adrian Klaver
On 03/29/2016 01:10 PM, Stephen Constable wrote: Hi All, I'm a new-ish sysadmin working on porting legacy scientific code from a local server/client to new supercomputer environment. My work is mostly done, except that my postgres database doesn't seem to be able to keep up with the new environ

[GENERAL] debugging server connection issue

2016-03-29 Thread Stephen Constable
Hi All, I'm a new-ish sysadmin working on porting legacy scientific code from a local server/client to new supercomputer environment. My work is mostly done, except that my postgres database doesn't seem to be able to keep up with the new environment. The application is written in-house in a mix