We have a view that is checkpointing on every update and taking a long time to
generate.
Here are the particulars:
* small database, only about 2500 documents. View takes 3+ minutes to generate.
* each document is pretty big, at about 300K, with 1000s of fields. Each field
though only contains a small amount of data. A pretty print of the document
JSON comes out to around 7000 lines.
* view is in its own design document
* no reduce, only the simplest of map functions:
function(doc) {
emit(doc.hXML.form.dispositionDecision['#text'], null);
}
* CouchdDB 1.0 (Mac CouchDBx). I've also tried it on 0.10, and 0.10 checkpoints
once every 10-15 updates, but it's not much faster.
The CouchDB 1.0 log shows:
...
1> [info] [<0.19698.3>] checkpointing view update at seq 1699 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1700 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1701 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1702 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1703 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1704 for test _temp
1> [info] [<0.19698.3>] checkpointing view update at seq 1705 for test _temp
...
These log entries fly by at 10/second or so, never missing a sequence number.
Has anyone seen similar performance? Are my documents too big with too many
fields?
Thanks,
-T