- **status**: review --> fixed
- **Milestone**: future --> 4.5.FC
- **Comment**:
changeset: 5555:af1a54f0920e
tag: tip
parent: 5550:5d7f06631a40
user: Alex Jones <[email protected]>
date: Tue Aug 12 16:27:01 2014 +0530
summary: ckptnd: increase performance when creating and writing large
numbers ofsections [#770]
---
** [tickets:#770] CKPT service performance enhancements**
**Status:** fixed
**Milestone:** 4.5.FC
**Created:** Thu Feb 06, 2014 07:01 PM UTC by Alex Jones
**Last Updated:** Thu Aug 07, 2014 01:49 PM UTC
**Owner:** Alex Jones
The checkpoint service has some major performance problems when using a lot of
sections (greater than 5k).
Attached is a patch which addresses the following problems:
1) section id database is implemented as a linked list, so searching for a
section id takes a long time (make it a C++ STL map)
2) MAX_SYNC_TRANSFER_SIZE is too large, and causes MDS timeouts
3) SectionCreate message should be asynchronous when ACTIVE_REPLICA is specified
There is still one more problem that I haven't delved into yet.
When there are 5 active checkpoints in the cluster, each with 40k sections and
1k worth of data in each section, and a standby node opens all of them (200k
total sections), and iterates through all of them, while those checkpoints are
being actively written, it takes on average 15 seconds to iterate through each
checkpoint, and sometimes the iteration function returns TIMEOUT. Hopefully,
this can be improved.
---
Sent from sourceforge.net because [email protected] is
subscribed to https://sourceforge.net/p/opensaf/tickets/
To unsubscribe from further messages, a project admin can change settings at
https://sourceforge.net/p/opensaf/admin/tickets/options. Or, if this is a
mailing list, you can unsubscribe from the mailing list.
------------------------------------------------------------------------------
_______________________________________________
Opensaf-tickets mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets
