Hi,
I've experienced some troubles syncing 200k users between two AD
Domain Controllers.
When I try to sync more than about 100k users the sync process dumps
errors like these:
Nov 24 10:36:17 - INFO - Logging configuration successfully loaded
from /home/m.perego/lsc/bin/../etc/logback.xml
Nov 24 10:36:17 - INFO - LSC configuration successfully loaded from
/home/m.perego/lsc/bin/../etc/
Nov 24 10:36:17 - INFO - Connecting to LDAP server
ldaps://dctest1.exampletest.com/OU=people,DC=exampletest,DC=com as
cn=ldaploader,ou=ServiceAccounts,dc=exampletest,DC=example,DC=com
Nov 24 10:36:17 - INFO - Connecting to LDAP server
ldaps://ad1.example.com/DC=example,DC=com as
cn=test1,ou=ServiceAccounts,DC=example,DC=com
Nov 24 10:36:34 - ERROR - Error while synchronizing ID
{distinguishedname=CN=10424854,OU=People,DC=example,DC=com,
samaccountname=10424854}: java.lang.IllegalStateException: NPE,
entry=Identity-100400=org.lsc.utils.ScriptingEvaluator@51a4f310
entryIsHeader=false key=example-100388
value=org.lsc.utils.ScriptingEvaluator@2451c950 size=15 maxSize=15
Please check that your keys are immutable, and that you have used
synchronization properly. If so, then please report this to
[email protected] as a bug.
Nov 24 10:36:34 - ERROR - Error while synchronizing ID
{distinguishedname=CN=10000514,OU=People,DC=example,DC=com,
samaccountname=10000514}: java.lang.IllegalStateException: NPE,
entry=Identity-100258=org.lsc.utils.ScriptingEvaluator@1e4d3904
entryIsHeader=false key=example-100295
value=org.lsc.utils.ScriptingEvaluator@5fda4526 size=15 maxSize=15
Please check that your keys are immutable, and that you have used
synchronization properly. If so, then please report this to
[email protected] as a bug.
Nov 24 10:36:34 - ERROR - Error while synchronizing ID
{distinguishedname=CN=10424636,OU=People,DC=example,DC=com,
samaccountname=10424636}: java.lang.IllegalStateException: NPE,
entry=Identity-100328=org.lsc.utils.ScriptingEvaluator@43e87b75
entryIsHeader=false key=example-100150
value=org.lsc.utils.ScriptingEvaluator@54016127 size=15 maxSize=15
Please check that your keys are immutable, and that you have used
synchronization properly. If so, then please report this to
[email protected] as a bug.
and so on, at the same time the number of threads grows insanely.
In every other sync run, even a 96k users one, I always get a 17 thread
process, when the problem occurs the thread number jumps quickly up to
the OS or RAM limit hanging the process.
I've monitored the RAM usage and neither the heap nor the permgen are
limiting the process, changing RAM and stack parameters (JVM + OS)
simply shifts the moment and the number of threads when the process hangs.
The problem seems strictly related to the number of entries returned by
the filterAll query in the source ldap and not to the number of elements
in the two LDAPs
I'm using sAMAccountName and distinguishedName as pivotAttributes.
I'm wondering if I'm missing something to check/try or I'm experiencing
a bug effect, suggestions ?
--
Best regards,
Matteo Perego
Xego di Perego Matteo & C. s.a.s.
http://www.xego.it
_______________________________________________________________
Ldap Synchronization Connector (LSC) - http://lsc-project.org
lsc-users mailing list
[email protected]
http://lists.lsc-project.org/listinfo/lsc-users
