Hi,

sorry for my late response. I was very busy the last days.

On 2014-10-30 15:08, Rainer Gerhards wrote:
> rsyslog has a test suite for many years now, and I am continuously
> expanding it. But it unfortunately covers only a subset of the code pathes.
> Some of this is fixable, but e.g. config option interaction grows
> exponentially, so you can never write (or run) sufficient tests for that.

Every user should be able to run the test suite.

The test suite must be able to run in a sandbox.

That's not possible at the moment. Have a look at mysql, PHP, json-c,
salt... this should be possible for rsyslog, too.

Also, I am more talking about something like a unit testing framework.
This should allow easy module testing.

I am familiar with testing web applications, C# or C++ code on Windows.
I never tried something similar on Linux yet, but this should be nearly
the same. Let's see if I find the time to create a small demo so that
you can get an idea (but don't expect anything before December).

Regarding the last sentence: This *is* testable. Maybe it will require a
rewrite of some components if your architecture never thought about
being testable but this shouldn't be the problem.


> Still, it would be very well to add a couple of hundred test cases, but
> than the problem given above kicks in. Right now, I usually try to add a
> test for any problem that was seen in practice.
> 
> The testbench is invoked via "make check". It is run automatically every
> day around noon CET and I receive notifications of these results.

The most important thing about CI everybody has to understand: Every
commit has to be tested. There are no exceptions. Tests must run
automatically or people will start to ignore/bypass..

I can also help you to set up everything on GitHub. I will do that in my
rsyslog clone. If you like it, you can move everything to the main
repository.

But as said before, don't expect anything before December.


-Thomas
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of 
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE 
THAT.

Reply via email to