Re: Restriction of autocompaction to a time window not working

2020-07-11 Thread Jan Lehnardt
For posterity, this got resolved here: 
https://github.com/apache/couchdb/discussions/2997

Best
Jan

> On 10. Jul 2020, at 20:15, Cluxter  wrote:
> 
> Hi everyone
> 
> I am using the official Docker image of CouchDB, v3.1.0.
> 
> I created a couchdb.ini file in which I put my custom CouchDB parameters. I
> know this file is taken into account by CouchDB because I checked in
> Fauxton/Configuration and my custom settings are shown.
> 
> The configuration is default except that I added this:
> 
> [couchdb]
> single_node = true
> 
> Now, I want to limit autocompaction to a time window from 04:00 am to 5:30
> am, and I want this to be as strict as possible. So I added these
> parameters in the same file:
> 
> [smoosh.overnight_channel]
> from = 04:00
> to = 05:30
> strict_window = true
> 
> 
> Then I started to insert 3 millions of documents in one database one by one
> using ApacheBench like this:
> 
> ab -r -n 300 -c 1000 -p data.json -T "application/json" -A
> admin:password "http://localhost:5984/benchmark;
> 
> and "data.json" contains:
> 
> {
>"text": "Some text"
> }
> 
> 
> It works very well, I get about 10,000 inserts/s.
> But very quickly an autocompaction task is run and slows everything down to
> about 2,000 inserts/s. I checked that in Fauxton/Active tasks/All tasks,
> there are clearly a couple of compaction jobs running that I never asked
> for. The thing is: I'm not doing all this between 4am and 5:30am and the
> time of my computer is right.
> 
> So it looks like the restriction to the time window doesn't work.
> 
> Am I doing something wrong or missing something?
> 
> Thanks.
> 
> Kind regards,
> 
> Baptiste Rebillard



Restriction of autocompaction to a time window not working

2020-07-10 Thread Cluxter
Hi everyone

I am using the official Docker image of CouchDB, v3.1.0.

I created a couchdb.ini file in which I put my custom CouchDB parameters. I
know this file is taken into account by CouchDB because I checked in
Fauxton/Configuration and my custom settings are shown.

The configuration is default except that I added this:

[couchdb]
single_node = true

Now, I want to limit autocompaction to a time window from 04:00 am to 5:30
am, and I want this to be as strict as possible. So I added these
parameters in the same file:

[smoosh.overnight_channel]
from = 04:00
to = 05:30
strict_window = true


Then I started to insert 3 millions of documents in one database one by one
using ApacheBench like this:

ab -r -n 300 -c 1000 -p data.json -T "application/json" -A
admin:password "http://localhost:5984/benchmark;

and "data.json" contains:

{
"text": "Some text"
}


It works very well, I get about 10,000 inserts/s.
But very quickly an autocompaction task is run and slows everything down to
about 2,000 inserts/s. I checked that in Fauxton/Active tasks/All tasks,
there are clearly a couple of compaction jobs running that I never asked
for. The thing is: I'm not doing all this between 4am and 5:30am and the
time of my computer is right.

So it looks like the restriction to the time window doesn't work.

Am I doing something wrong or missing something?

Thanks.

Kind regards,

Baptiste Rebillard