On 12/13/2011 08:26 PM, Mark D. Nagel wrote:
> On 12/13/2011 4:20 AM, Risto Vaarandi wrote:
>> hi all,
>> some months ago, we had a discussion on rewriting input events:
>>
>> http://sourceforge.net/mailarchive/forum.php?thread_name=4E066179.3010304%40willingminds.com&forum_name=simple-evcorr-users
>>
>>
>> Would a similar feature be of interest to the end users? :)
>> I was thinking about attacking the problem in a more general way, but
>> couldn' find a truly elegant solution :(
>
> Obviously, I'd still like that :).  We are in the middle of planning a
> change of Windows Event Log export tools, and of course the format is
> different.  Instead of rewriting all our rules, we could instead
> transform the new input to look like the old input.   Of course, with
> the new cached pattern tools, we could redo our rules once to extract
> the fields we need and then change the extraction rules instead to match
> the new input, using the cached fields in the revised ruleset.
> Regardless, being able to transform input in place with no other changes
> in context, etc. would be a handy tool to have available.
>
> Thanks,
> Mark
>

This discussion has also a wider context around it -- while looking into 
opportunities for modifying data in input buffer, I realized that things 
will get tricky if one attempts to modify several buffered input lines.

This leads to another idea of setting up a separate input buffer for 
each input file. So far, patterns for multiple lines have been 
meaningful and reliable only for "one input file" scenarios. Having 
multiple inputs means that lines from these files can arrive in any 
order, thus patterns like RegExp2 or RegExp7 are not guaranteed to 
always provide the same result on the same set of input lines.

However, if there would be a separate buffer for each input file (plus 
one for synthetic events), multiple line patterns would become lot more 
functional, because the pattern matching is always done strictly for one 
file's data. The downside of this approach is inability to match data 
from different files simultaneously with one pattern. Although this 
mechanism is inherently unreliable, there *might* be some sites which 
are actually using this (for example, deliberately accepting the 30% or 
50% probability for undetected events??)

Therefore, I'd like to ask from the user community if the separation of 
input data into multiple buffers would be acceptable. Please bear in 
mind that as a result, patterns like RegExpN (N > 1) could not be used 
for matching several lines from *multiple* input sources with *one* 
matching operation.

What are the opinions?

(I am not promising to implement this as a new feature, but before 
studying it in more detail, I'd like to know if it's worth to do so.)

kind regards,
risto

------------------------------------------------------------------------------
Learn Windows Azure Live!  Tuesday, Dec 13, 2011
Microsoft is holding a special Learn Windows Azure training event for 
developers. It will provide a great way to learn Windows Azure and what it 
provides. You can attend the event by watching it streamed LIVE online.  
Learn more at http://p.sf.net/sfu/ms-windowsazure
_______________________________________________
Simple-evcorr-users mailing list
Simple-evcorr-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/simple-evcorr-users

Reply via email to