FreeBSD: syslog-ng: I/O error occurred while writing; fd='xx', error='No buffer space available (yy)'

[Traiano Welcome]

Hi List

I've been seeing the following in the messages log of my freebsd syslog
server for quite some time now:

---
Mar 20 12:19:12 syslog2 syslog-ng[35313]: I/O error occurred while
writing; fd='12', error='No buffer space available (55)'
Mar 20 12:19:12 syslog2 syslog-ng[35313]: Connection broken;
time_reopen='60'
Mar 20 12:19:12 syslog2 syslog-ng[35313]: I/O error occurred while
writing; fd='13', error='No buffer space available (55)'
Mar 20 12:19:12 syslog2 syslog-ng[35313]: Connection broken;
time_reopen='60'
---

These happen at a frequency of about 7 per minute on average. See attached
trend graphs for an idea of the volume of traffic we're doing, as well as
the memory and cpu utilisation trends on this server during this period.
As can be seen from the graphs, load does not seem to be the issue.
Occasionally during the week, the system freezes and requires a reboot, I
think it's related to the above message, though I'm not sure.

My question is: What does this error mean, and how can I resolve it?

I have tried to frame this as an operating system kernel resource issue,
and experimented with increasing the freebsd kernel sysctls for UDP
performance:

---
[root@syslog2  /var/log]#
sysctl kern.ipc.nmbclusters=102400
kern.ipc.nmbclusters: 25600 -> 102400

[root@syslog2  /var/log]#
sysctl kern.ipc.maxsockbuf=201326592
kern.ipc.maxsockbuf: 100663296 -> 201326592

[root@syslog2  /var/log]#
sysctl net.inet.udp.recvspace=33554432
net.inet.udp.recvspace: 16777216 -> 33554432
---

This has reduced the frequency of the errors a little, but in general the
problem still remains.

Syslog version:

--
[root@syslog2]# syslog-ng -V
syslog-ng 2.0.10

--

FreeBSD version:

--
FreeBSD 7.2-STABLE #0
--

Any help would be much appreciated!
Traiano


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

Re: FreeBSD: syslog-ng: I/O error occurred while writing; fd='xx', error='No buffer space available (yy)'

[Da Rock]

On 03/22/12 19:00, Traiano Welcome wrote:

Hi List

I've been seeing the following in the messages log of my freebsd syslog
server for quite some time now:

---
Mar 20 12:19:12 syslog2 syslog-ng[35313]: I/O error occurred while
writing; fd='12', error='No buffer space available (55)'
Mar 20 12:19:12 syslog2 syslog-ng[35313]: Connection broken;
time_reopen='60'
Mar 20 12:19:12 syslog2 syslog-ng[35313]: I/O error occurred while
writing; fd='13', error='No buffer space available (55)'
Mar 20 12:19:12 syslog2 syslog-ng[35313]: Connection broken;
time_reopen='60'
---

These happen at a frequency of about 7 per minute on average. See attached
trend graphs for an idea of the volume of traffic we're doing, as well as
the memory and cpu utilisation trends on this server during this period.
As can be seen from the graphs, load does not seem to be the issue.
Occasionally during the week, the system freezes and requires a reboot, I
think it's related to the above message, though I'm not sure.

My question is: What does this error mean, and how can I resolve it?

I have tried to frame this as an operating system kernel resource issue,
and experimented with increasing the freebsd kernel sysctls for UDP
performance:

---
[root@syslog2  /var/log]#
sysctl kern.ipc.nmbclusters=102400
kern.ipc.nmbclusters: 25600 ->  102400

[root@syslog2  /var/log]#
sysctl kern.ipc.maxsockbuf=201326592
kern.ipc.maxsockbuf: 100663296 ->  201326592

[root@syslog2  /var/log]#
sysctl net.inet.udp.recvspace=33554432
net.inet.udp.recvspace: 16777216 ->  33554432
---

This has reduced the frequency of the errors a little, but in general the
problem still remains.

Syslog version:

--
[root@syslog2]# syslog-ng -V
syslog-ng 2.0.10

--

FreeBSD version:

--
FreeBSD 7.2-STABLE #0
--

Any help would be much appreciated!
I'm sorry I can't shed some light on a solution, but this happens on 
ping and some other network related apps and tools for me too; just not 
often enough for me concern with atm due to higher priorities.


Perhaps net@ might be a better resource for an answer to this one?
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

Re: FreeBSD: syslog-ng: I/O error occurred while writing; fd='xx', error='No buffer space available (yy)'

[Mark Blackman]

On 22 Mar 2012, at 09:00, Traiano Welcome wrote:

> 
> 
> My question is: What does this error mean, and how can I resolve it?


From a very casual inspection of the problem, I'd say you're pushing out
syslog messages faster than the kernel can get them out the interface.
How many syslog messages are going in (per second) and what kind of
network interface are you trying to send them out through?

> 
> I have tried to frame this as an operating system kernel resource issue,
> and experimented with increasing the freebsd kernel sysctls for UDP
> performance:


I think you can push nmbclusters up to about 600k, but if your input is
running faster than your output, no amount of buffering will permanently
stave off this problem.

- Mark



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

INN port version 2.4.6 instead of 2.5.X

[Bastien Semene]

Hi,

I can't find an explanation of why the port of INN (news/inn, 
http://www.isc.org/software/inn) is still on version 2.4.6 (EOL) instead 
of 2.5.X.

Is there someone who can enlighten me ?

And how can I find this kind of information on my own ?

Thanks,
Bastien SEMENE
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

about change file mode

[Xavier FreeBSD questions]

Hi tot all,

Why don't change the files mode ?

casa# mount -t msdosfs /dev/da0s1 /mnt/JetFlash\ Transcend\ 1GB/
casa# cd /mnt/JetFlash\ Transcend\ 1GB/
casa# ls -lh
total 21940
-r-xr-xr-x  1 xxavi  wheel16M 21 mar 00:12 COLOR.pdf
-r-xr-xr-x  1 xxavi  wheel   4,7M 21 mar 01:26 COLOR_1.pdf
-r-xr-xr-x  1 xxavi  wheel   124k 21 mar 02:13 COLOR_2.pdf
-r-xr-xr-x  1 xxavi  wheel21k 21 mar 01:16 Untitled 1.pdf
-r-xr-xr-x  1 xxavi  wheel   9,3k 22 mar 00:17 Untitled 2.pdf
-r-xr-xr-x  1 xxavi  wheel   124k 21 mar 02:13 kscan_0002.jpeg.pdf
-r-xr-xr-x  1 xxavi  wheel20k 21 mar 00:12 ocr.txt.pdf
casa# chmod -x *
casa# ls -l
total 21940
-r-xr-xr-x  1 xxavi  wheel  17270757 21 mar 00:12 COLOR.pdf
-r-xr-xr-x  1 xxavi  wheel   4866360 21 mar 01:26 COLOR_1.pdf
-r-xr-xr-x  1 xxavi  wheel127452 21 mar 02:13 COLOR_2.pdf
-r-xr-xr-x  1 xxavi  wheel 21829 21 mar 01:16 Untitled 1.pdf
-r-xr-xr-x  1 xxavi  wheel  9561 22 mar 00:17 Untitled 2.pdf
-r-xr-xr-x  1 xxavi  wheel127452 21 mar 02:13 kscan_0002.jpeg.pdf
-r-xr-xr-x  1 xxavi  wheel 20513 21 mar 00:12 ocr.txt.pdf
casa#

Thanks, see you.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

Re: INN port version 2.4.6 instead of 2.5.X

[Da Rock]

On 03/22/12 20:17, Bastien Semene wrote:

Hi,

I can't find an explanation of why the port of INN (news/inn, 
http://www.isc.org/software/inn) is still on version 2.4.6 (EOL) 
instead of 2.5.X.

Is there someone who can enlighten me ?

And how can I find this kind of information on my own ?

Perhaps try ports@ and an email to the maintainer?
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

Re: about change file mode

[Polytropon]

On Thu, 22 Mar 2012 11:44:18 +0100, Xavier FreeBSD questions wrote:
> Hi tot all,
> 
> Why don't change the files mode ?
> 
> casa# mount -t msdosfs /dev/da0s1 /mnt/JetFlash\ Transcend\ 1GB/

The answer is right in your first command: You're using
a MSDOS file system. That particular file system doesn't
know about rwx attributes. That's why files have +x by
default. You can not remove the x attribute from them
because they actually don't have one.

However, you can mask that "false-positive" attribute
by using the -m option. See "man mount_msdosfs" for
details. You can also use it in your /etc/fstab's
options field to make it a default.



-- 
Polytropon
Magdeburg, Germany
Happy FreeBSD user since 4.0
Andra moi ennepe, Mousa, ...
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

Re: about change file mode

[Da Rock]

On 03/22/12 20:44, Xavier FreeBSD questions wrote:

Hi tot all,

Why don't change the files mode ?

casa# mount -t msdosfs /dev/da0s1 /mnt/JetFlash\ Transcend\ 1GB/
casa# cd /mnt/JetFlash\ Transcend\ 1GB/
casa# ls -lh
total 21940
-r-xr-xr-x  1 xxavi  wheel16M 21 mar 00:12 COLOR.pdf
-r-xr-xr-x  1 xxavi  wheel   4,7M 21 mar 01:26 COLOR_1.pdf
-r-xr-xr-x  1 xxavi  wheel   124k 21 mar 02:13 COLOR_2.pdf
-r-xr-xr-x  1 xxavi  wheel21k 21 mar 01:16 Untitled 1.pdf
-r-xr-xr-x  1 xxavi  wheel   9,3k 22 mar 00:17 Untitled 2.pdf
-r-xr-xr-x  1 xxavi  wheel   124k 21 mar 02:13 kscan_0002.jpeg.pdf
-r-xr-xr-x  1 xxavi  wheel20k 21 mar 00:12 ocr.txt.pdf
casa# chmod -x *
casa# ls -l
total 21940
-r-xr-xr-x  1 xxavi  wheel  17270757 21 mar 00:12 COLOR.pdf
-r-xr-xr-x  1 xxavi  wheel   4866360 21 mar 01:26 COLOR_1.pdf
-r-xr-xr-x  1 xxavi  wheel127452 21 mar 02:13 COLOR_2.pdf
-r-xr-xr-x  1 xxavi  wheel 21829 21 mar 01:16 Untitled 1.pdf
-r-xr-xr-x  1 xxavi  wheel  9561 22 mar 00:17 Untitled 2.pdf
-r-xr-xr-x  1 xxavi  wheel127452 21 mar 02:13 kscan_0002.jpeg.pdf
-r-xr-xr-x  1 xxavi  wheel 20513 21 mar 00:12 ocr.txt.pdf
casa#
For starters the filesystem is FAT with no real sense of user 
permissions, what does ls -l /dev/da0* say? This should be determined by 
the devfs.rules.


This should determine the permissions of the files on the device, and I 
doubt that they can be changed or manipulated once mounted (what would 
be the point?). Please correct me if I'm wrong though :)

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

Re: FreeBSD: syslog-ng: I/O error occurred while writing; fd='xx', error='No buffer space available (yy)'

[Traiano Welcome]

Hi Mark


On 22/03/2012 11:52, "Mark Blackman"  wrote:

>
>On 22 Mar 2012, at 09:00, Traiano Welcome wrote:
>
>> 
>> 
>> My question is: What does this error mean, and how can I resolve it?
>
>
>From a very casual inspection of the problem, I'd say you're pushing out
>syslog messages faster than the kernel can get them out the interface.
>How many syslog messages are going in (per second) and what kind of
>network interface are you trying to send them out through?


That's what I thought as well, but it's the details that evade me. Almost
all traffic to and from this server is UDP (syslog), the graph I sent
earlier shows the kind of volumes and trends that are typical: Peak
traffic during the problem periods averages at about 1 Mbps outbound and
200 Kbps inbound to/from the interface. The interface itself is a
Embedded Broadcom 5708 NIC on a Dell PowerEdge 1950.


Here are a couple of netstat polls during one of the problem periods:


[root@syslog2]# date;netstat -p udp -s |egrep -w
"(received|delivered|dropped)"
Thu Mar 22 12:11:34 SAST 2012
19969 datagrams received
2 dropped due to no socket
0 dropped due to full socket buffers
19967 delivered
.
.
.
[root@syslog2~]# date;netstat -p udp -s |egrep -w
"(received|delivered|dropped)"
Thu Mar 22 13:36:46 SAST 2012
662385 datagrams received
118 dropped due to no socket
0 dropped due to full socket buffers
662267 delivered
---


Somehow this doesn't strike  me as a large volume of throughput ...





>
>> 
>> I have tried to frame this as an operating system kernel resource issue,
>> and experimented with increasing the freebsd kernel sysctls for UDP
>> performance:
>
>
>I think you can push nmbclusters up to about 600k, but if your input is
>running faster than your output, no amount of buffering will permanently
>stave off this problem.



I've done that just in the last 2 hours, though I agree with you that this
is probably a (very) temporary imrovement.



>
>- Mark
>
>
>

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

HRL in FreeBSD Stable

[Alberto Mijares]

Hi list,

Where can I see if resource limits for jails is included in FBSD 8
STABLE or any plan to include it in 8.3?

It'd be great if you don't need to apply the patch[1] manually

[1] http://lists.freebsd.org/pipermail/freebsd-jail/2009-May/000866.html

Thanks in advance.

Regards


Alberto Mijares
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

FreeBSD 9.0 Snapshots

[Dean E. Weimer]

Has anyone been using Snapshots on UFS with journaled soft-updates 
enabled?


I have a couple of new systems built after 9.0 came out, my backup 
scripts take snapshots, and then mount them to backup the files, the 
couple older servers that I upgraded from 8.2 to 9.0 from source are not 
having any problems, a quick check shows their file systems aren't 
running the new journaled Soft-Updates options.  The new systems which 
are, frequently hang up and become unresponsive when taking the 
snapshots.


--
Thanks,
 Dean E. Weimer
 http://www.dweimer.net/
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

Re: FreeBSD 9.0 Snapshots

[Volodymyr Kostyrko]

Dean E. Weimer wrote:

Has anyone been using Snapshots on UFS with journaled soft-updates enabled?

I have a couple of new systems built after 9.0 came out, my backup
scripts take snapshots, and then mount them to backup the files, the
couple older servers that I upgraded from 8.2 to 9.0 from source are not
having any problems, a quick check shows their file systems aren't
running the new journaled Soft-Updates options. The new systems which
are, frequently hang up and become unresponsive when taking the snapshots.


Known issue, don't use SUJ with snapshots on 9.0 for now.

--
Sphinx of black quartz judge my vow.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

Re: FreeBSD 9.0 Snapshots

[Dale Scott]

Has been fixed, but you need to understand release engineering better than me 
if you want the fix now.

--
There are no passengers on spaceship earth. We are all crew.

- Original Message -
From: "Volodymyr Kostyrko" 
To: dwei...@dweimer.net
Cc: freebsd-questions@freebsd.org
Sent: Thursday, March 22, 2012 9:28:25 AM
Subject: Re: FreeBSD 9.0 Snapshots

Dean E. Weimer wrote:
> Has anyone been using Snapshots on UFS with journaled soft-updates enabled?
>
> I have a couple of new systems built after 9.0 came out, my backup
> scripts take snapshots, and then mount them to backup the files, the
> couple older servers that I upgraded from 8.2 to 9.0 from source are not
> having any problems, a quick check shows their file systems aren't
> running the new journaled Soft-Updates options. The new systems which
> are, frequently hang up and become unresponsive when taking the snapshots.

Known issue, don't use SUJ with snapshots on 9.0 for now.

-- 
Sphinx of black quartz judge my vow.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"

Czy dysponujesz dwoma wolnymi godzinami w tygodniu? Oto jak zarobc 185 EUR w tym czasie.

[dd]

   Witamy wszystkich!
   Poszukujemy wspól/pracowników, którzy sa gotowi podjac sie dodatkowej
   pracy.
   Praca zajmie 1-2 godziny w tygodniu i nie wymaga zadnego wkl/adu
   pienieznego.
   Istota pracy jest przetwarzanie napl/ywajacych z Waszego miasta
   zamówien.
   Jest to prosta praca, której mozna nauczyc sie w ciagu 10 minut i
   bedzie mozna regularnie wykonywac ja dla naszej firmy.
   Za kazde przetworzone zamówienie otrzymacie od 200 do 500 EUR.
   Opl/ata - natychmiastowa!
   Jesli jesli tylko panstwo zechca to bedziecie mogli stale zwiekszac
   ilosc przetwarzanych zamówien.
   Niestety my nie mozemy zagwarantowac zatrudnienia dla wszystkich
   chetnych,
   dlatego proponujemy od razu wysl/ac nam swoje zgl/oszenie.
   / Zwiekszy to wasza szanse, aby zostac czl/onkiem naszego zespol/u.
   Co nalezy podac w zgl/oszeniu:
   Imie i nazwisko:
   Adres e-mail:
   Miasto, w którym mieszkacie:
   Zgl/oszenie nalezy wysl/ac na nasz adres e-mail:
   t...@gazetapracapl.com,Odpowiedz otrzymacie w ciagu dwóch dni
   roboczych.
   Z powazaniem,
   Tara Tolbert
   
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"