Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread Scot Kreienkamp
to:rsyslog-boun...@lists.adiscon.com] On Behalf Of David Lang Sent: Thursday, November 9, 2017 3:20 PM To: rsyslog-users Subject: Re: [rsyslog] preserving metadata on message split increase the max message size so that the messages don't get split? what is the source of the messages? (TCP, UDP, imfi

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread David Lang
[mailto:rsyslog-boun...@lists.adiscon.com] On Behalf Of Rainer Gerhards Sent: Thursday, November 9, 2017 11:27 AM To: rsyslog-users Subject: Re: [rsyslog] preserving metadata on message split larger 128k currently seems to be a problem when RELP is used. Otherwise, we have configs which actually have set it to

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread David Lang
on.com] On Behalf Of David Lang Sent: Monday, November 6, 2017 4:49 PM To: rsyslog-users Subject: Re: [rsyslog] preserving metadata on message split No, because when the message hits the max size, the processing of the next message (which is a fragment) is completely independent of the first message

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread deoren
From: rsyslog [mailto:rsyslog-boun...@lists.adiscon.com] On Behalf Of Rainer Gerhards Sent: Thursday, November 9, 2017 11:27 AM To: rsyslog-users Subject: Re: [rsyslog] preserving metadata on message split larger 128k currently seems to be a problem when RELP is used. Otherwise, we have configs w

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread Rainer Gerhards
November 9, 2017 11:27 AM > To: rsyslog-users > Subject: Re: [rsyslog] preserving metadata on message split > > larger 128k currently seems to be a problem when RELP is used. > Otherwise, we have configs which actually have set it to a couple of > MB (and occasionally use it)

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread Scot Kreienkamp
Behalf Of Rainer Gerhards Sent: Thursday, November 9, 2017 11:27 AM To: rsyslog-users Subject: Re: [rsyslog] preserving metadata on message split larger 128k currently seems to be a problem when RELP is used. Otherwise, we have configs which actually have set it to a couple of MB (and occasiona

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread Rainer Gerhards
larger 128k currently seems to be a problem when RELP is used. Otherwise, we have configs which actually have set it to a couple of MB (and occasionally use it). Rainer 2017-11-09 17:25 GMT+01:00 deoren : > On 11/9/2017 10:24 AM, Scot Kreienkamp wrote: >> >> I have it set at 128k now... I thought

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread deoren
On 11/9/2017 10:24 AM, Scot Kreienkamp wrote: I have it set at 128k now... I thought I read in the list archives that was the maximium value? https://github.com/rsyslog/rsyslog/issues/1741 Looks like it (for now). ___ rsyslog mailing list http://li

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread Scot Kreienkamp
-Original Message- From: rsyslog [mailto:rsyslog-boun...@lists.adiscon.com] On Behalf Of Rainer Gerhards Sent: Thursday, November 9, 2017 10:00 AM To: rsyslog-users Subject: Re: [rsyslog] preserving metadata on message split 2017-11-09 14:46 GMT+01:00 Scot Kreienkamp : > Hi David, >

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread Scot Kreienkamp
: rsyslog [mailto:rsyslog-boun...@lists.adiscon.com] On Behalf Of deoren Sent: Thursday, November 9, 2017 10:07 AM To: rsyslog@lists.adiscon.com Subject: Re: [rsyslog] preserving metadata on message split On 11/9/2017 9:00 AM, Rainer Gerhards wrote: > 2017-11-09 14:46 GMT+01:00 Scot Kreienk

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread deoren
On 11/9/2017 9:00 AM, Rainer Gerhards wrote: 2017-11-09 14:46 GMT+01:00 Scot Kreienkamp : Hi David, Any ideas on any way to get around this if there's no way to preserve the metadata on an oversized message? You need to increase the message size. It's a simple config parmater [global(maxmess

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread Rainer Gerhards
ailto:rsyslog-boun...@lists.adiscon.com] On Behalf Of David > Lang > Sent: Monday, November 6, 2017 4:49 PM > To: rsyslog-users > Subject: Re: [rsyslog] preserving metadata on message split > > No, because when the message hits the max size, the processing of the next > me

Re: [rsyslog] preserving metadata on message split

2017-11-09 Thread Scot Kreienkamp
Email: scot.kreienk...@la-z-boy.com -Original Message- From: rsyslog [mailto:rsyslog-boun...@lists.adiscon.com] On Behalf Of David Lang Sent: Monday, November 6, 2017 4:49 PM To: rsyslog-users Subject: Re: [rsyslog] preserving metadata on message split No, because when the message hits the max size

Re: [rsyslog] preserving metadata on message split

2017-11-06 Thread Scot Kreienkamp
ang Sent: Monday, November 6, 2017 4:49 PM To: rsyslog-users Subject: Re: [rsyslog] preserving metadata on message split No, because when the message hits the max size, the processing of the next message (which is a fragment) is completely independent of the first message. now, if this is a message whe

Re: [rsyslog] preserving metadata on message split

2017-11-06 Thread David Lang
No, because when the message hits the max size, the processing of the next message (which is a fragment) is completely independent of the first message. now, if this is a message where the metadata should be available in processing the second fragment, I agree that it should be available. can

[rsyslog] preserving metadata on message split

2017-11-06 Thread Scot Kreienkamp
Hey all, When messages are split due to size the metadata seems to go with the first part of the message. I'm doing hostname based logging, so when a message is split the metadata it needs to log the rest of the message to the correct file is gone. Is there any way to preserve that metadata,