- **status**: assigned --> review


---

** [tickets:#770] CKPT service performance enhancements**

**Status:** review
**Milestone:** future
**Created:** Thu Feb 06, 2014 07:01 PM UTC by Alex Jones
**Last Updated:** Tue Apr 29, 2014 06:05 PM UTC
**Owner:** Alex Jones

The checkpoint service has some major performance problems when using a lot of 
sections (greater than 5k).

Attached is a patch which addresses the following problems:

1) section id database is implemented as a linked list, so searching for a 
section id takes a long time (make it a C++ STL map)
2) MAX_SYNC_TRANSFER_SIZE is too large, and causes MDS timeouts
3) SectionCreate message should be asynchronous when ACTIVE_REPLICA is specified

There is still one more problem that I haven't delved into yet.

When there are 5 active checkpoints in the cluster, each with 40k sections and 
1k worth of data in each section, and a standby node opens all of them (200k 
total sections), and iterates through all of them, while those checkpoints are 
being actively written, it takes on average 15 seconds to iterate through each 
checkpoint, and sometimes the iteration function returns TIMEOUT.  Hopefully, 
this can be improved.


---

Sent from sourceforge.net because [email protected] is 
subscribed to https://sourceforge.net/p/opensaf/tickets/

To unsubscribe from further messages, a project admin can change settings at 
https://sourceforge.net/p/opensaf/admin/tickets/options.  Or, if this is a 
mailing list, you can unsubscribe from the mailing list.
------------------------------------------------------------------------------
"Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE
Instantly run your Selenium tests across 300+ browser/OS combos.
Get unparalleled scalability from the best Selenium testing platform available
Simple to use. Nothing to install. Get started now for free."
http://p.sf.net/sfu/SauceLabs
_______________________________________________
Opensaf-tickets mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets

Reply via email to