So we have created a process for LSC to query SQL only for the entries tagged with "UPDATE" in a new column called "State" that has brought the execution time down to seconds and can be run every hour.
To handle the deletes, we have decided to simply run the clean phase once per night instead of hourly. Now for another question...can the executable plugin be used to query SQL for a column tagged "DELETE" and have that run each hour? I started playin around with the executable scripts but I don't completely understand how it works yet. Thanks! From: [email protected] [mailto:[email protected]] On Behalf Of Clément OUDOT Sent: Friday, October 2, 2015 3:57 AM To: [email protected] Subject: Re: [lsc-users] SQL to LDAP Sync takes several hours Le 01/10/2015 19:50, Parrish, Kyle a écrit : Well there was a small improvement. The total sync time is down to about 40 minutes. Still too long though... I have an idea, let me know if you think it will work. I can add a new column to the SQL table stating weather the entry needs to be "updated", "added" or "removed." How can I configure LSC to just check these entries that have one of these tags and update accordingly? This would solve my time issue since we wouldn't have any more than about 10 changes per day. Eliminating the need to query 100,000 entries each cycle. Hi Kyle, it can be a solution. Add a column "state" with a value of "sync" for all entries that mut be create or update. You can then adapt the SQL query to only select entries for "sync" (with a simple WHERE clause) in the LSC sync phase. But you need to find a way to update this column after the LSC process, because LSC will not modify it (the source is always read-only). Fot the clean phase, I don't see how to proceed. As you know, LSC will query the destination and for all entries found in the destination, it will request the source to see if the entry is present. If not, the entry is removed from the destination. So I don't see here how to use the column "state". -- Clément OUDOT Consultant en logiciels libres, Expert infrastructure et sécurité Savoir-faire Linux
_______________________________________________________________ Ldap Synchronization Connector (LSC) - http://lsc-project.org lsc-users mailing list [email protected] http://lists.lsc-project.org/listinfo/lsc-users
