[ https://issues.apache.org/jira/browse/DIRSERVER-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14344720#comment-14344720 ]
linzhao commented on DIRSERVER-2047: ------------------------------------ The issue seems fixed, but I find another exception may be not related to this issue. The problem occurred when apacheds started. Exception list below: INFO | jvm 1 | 2015/03/03 23:45:19 | [23:45:19] INFO [org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition] - Setting CacheRecondManager's cache size to 100 INFO | jvm 1 | 2015/03/03 23:45:19 | [23:45:19] INFO [org.apache.directory.server.core.api.CacheService] - fetching the cache named root INFO | jvm 1 | 2015/03/03 23:46:25 | Error in WrapperListener.start callback. java.lang.OutOfMemoryError: GC overhead limit exceeded INFO | jvm 1 | 2015/03/03 23:46:25 | java.lang.OutOfMemoryError: GC overhead limit exceeded INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.mavibot.btree.RecordManager.fetchPage(RecordManager.java:3049) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.mavibot.btree.RecordManager.readPageIOs(RecordManager.java:797) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.mavibot.btree.RecordManager.deserialize(RecordManager.java:987) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.mavibot.btree.PersistedPageHolder.fetchElement(PersistedPageHolder.java:133) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.mavibot.btree.PersistedPageHolder.getValue(PersistedPageHolder.java:113) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.mavibot.btree.AbstractPage.get(AbstractPage.java:252) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.mavibot.btree.AbstractBTree.get(AbstractBTree.java:505) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.mavibot.btree.PersistedBTree.get(PersistedBTree.java:43) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.partition.impl.btree.mavibot.MavibotTable.get(MavibotTable.java:317) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.partition.impl.btree.mavibot.MavibotIndex.forwardLookup(MavibotIndex.java:305) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.partition.impl.btree.mavibot.MavibotIndex.forwardLookup(MavibotIndex.java:58) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.partition.impl.btree.AbstractBTreePartition.getEntryId(AbstractBTreePartition.java:2473) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.xdbm.search.impl.DefaultSearchEngine.computeResult(DefaultSearchEngine.java:123) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.partition.impl.btree.AbstractBTreePartition.search(AbstractBTreePartition.java:1141) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.shared.partition.DefaultPartitionNexus.search(DefaultPartitionNexus.java:624) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.shared.ReferralManagerImpl.init(ReferralManagerImpl.java:178) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.shared.ReferralManagerImpl.<init>(ReferralManagerImpl.java:86) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.referral.ReferralInterceptor.init(ReferralInterceptor.java:213) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.DefaultDirectoryService.initInterceptors(DefaultDirectoryService.java:685) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.DefaultDirectoryService.initialize(DefaultDirectoryService.java:1818) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.core.DefaultDirectoryService.startup(DefaultDirectoryService.java:1244) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.ApacheDsService.initDirectoryService(ApacheDsService.java:323) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.ApacheDsService.start(ApacheDsService.java:182) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.apache.directory.server.wrapper.ApacheDsTanukiWrapper.start(ApacheDsTanukiWrapper.java:72) INFO | jvm 1 | 2015/03/03 23:46:25 | at org.tanukisoftware.wrapper.WrapperManager$12.run(WrapperManager.java:2788) STATUS | wrapper | 2015/03/03 23:46:26 | <-- Wrapper Stopped STATUS | wrapper | 2015/03/03 23:47:17 | --> Wrapper Started as Daemon STATUS | wrapper | 2015/03/03 23:47:17 | Launching a JVM... I did't change anything about JVM memory, so what is the default value for wrapper.java.initmemory=1024 and wrapper.java.maxmemory=2048 in wrapper.conf? > Some data can be lost when using ldapadd command to insert data into apacheds > ----------------------------------------------------------------------------- > > Key: DIRSERVER-2047 > URL: https://issues.apache.org/jira/browse/DIRSERVER-2047 > Project: Directory ApacheDS > Issue Type: Bug > Components: ldap > Affects Versions: 2.0.0-M19 > Environment: centOS 6.5 with openldap and apacheds installed > Reporter: linzhao > Priority: Blocker > Labels: LDAP > Fix For: 2.0.0-M20 > > Attachments: data.ldif, ordered-data.ldif, site.ldif, site_new.ldif, > site_simple.ldif, site_topology_schema.ldif, > site_topology_schema_simple.ldif, supercluster_partition.ldif, test.jpg > > > In our system, we need to do data backup and restore for apacheds. For now, > we use the ldapsearch and ldapadd command to do BR function. We use > ldapsearch to backup apacheds data to be a ldif file and use ldapadd to > restore the data. But when the ldif is a little big, I always found that the > data can't be restored successfully, but the ladpadd command showed that the > data can be added successfully. No exceptions for ldapadd command. But the > restored data didn't exist in the node. This bug only happened when the ldif > file is a little big. I mean if the data entry greater than 500 entries. But > the node for backup and restore is using mavibot partition. Because I found > so many problems for jdbm. So I change it to mavibot partition. Another > question is that do you know is there some good way to do the data backup and > restore for apacheds? > May be my mavibot partition has some problems, so someone can tell me how to > create a mavibot partition in APACHEDS? Because the mavibot parttion I > created can't be viewed when click the "Open Configuration" in apacheds > studio. Also I used unboundid JDK to insert many entries apacheds and the > same problem happened. So someone can tell me how to config the mavibot > partition on APACHEDS? That's may be very helpful. > Below is the exceptions from apacheds when problems happened: > [16:21:41] INFO [org.apache.directory.server.ldap.LdapServer] - Ldap service > stopped. > [16:21:41] WARN > [org.apache.directory.server.core.shared.partition.DefaultPartitionNexus] - > Failed to flush partition data out. > org.apache.directory.api.ldap.model.exception.LdapOperationErrorException > at > org.apache.directory.server.core.partition.impl.btree.AbstractBTreePartition.saveContextCsn(AbstractBTreePartition.java:3364) > at > org.apache.directory.server.core.shared.partition.DefaultPartitionNexus.sync(DefaultPartitionNexus.java:319) > at > org.apache.directory.server.core.DefaultDirectoryService.shutdown(DefaultDirectoryService.java:1283) > at org.apache.directory.server.ApacheDsService.stop(ApacheDsService.java:600) > at > org.apache.directory.server.wrapper.ApacheDsTanukiWrapper.stop(ApacheDsTanukiWrapper.java:97) > at org.tanukisoftware.wrapper.WrapperManager$13.run(WrapperManager.java:3134) > Caused by: java.lang.NullPointerException > at > org.apache.directory.server.core.partition.impl.btree.AbstractBTreePartition.saveContextCsn(AbstractBTreePartition.java:3350) > ... 5 more > [16:21:41] ERROR [org.apache.directory.server.wrapper.ApacheDsTanukiWrapper] > - Failed to stop the service. > org.apache.directory.api.util.exception.MultiException: ERR_265 Grouping many > exceptions on root nexus sync() > at > org.apache.directory.server.core.shared.partition.DefaultPartitionNexus.sync(DefaultPartitionNexus.java:328) > at > org.apache.directory.server.core.DefaultDirectoryService.shutdown(DefaultDirectoryService.java:1283) > at org.apache.directory.server.ApacheDsService.stop(ApacheDsService.java:600) > at > org.apache.directory.server.wrapper.ApacheDsTanukiWrapper.stop(ApacheDsTanukiWrapper.java:97) > at org.tanukisoftware.wrapper.WrapperManager$13.run(WrapperManager.java:3134) > Nested exceptions to follow: > INFO | jvm 1 | 2015/02/02 17:11:06 | [17:11:06] WARN > [org.apache.directory.server.ldap.LdapProtocolHandler] - Unexpected exception > forcing session to close: sending disconnect notice to client. > INFO | jvm 1 | 2015/02/02 17:11:06 | java.io.IOException: Connection reset by > peer > INFO | jvm 1 | 2015/02/02 17:11:06 | at > sun.nio.ch.FileDispatcherImpl.read0(Native Method) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > sun.nio.ch.IOUtil.read(IOUtil.java:197) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > org.apache.mina.transport.socket.nio.NioProcessor.read(NioProcessor.java:311) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > org.apache.mina.transport.socket.nio.NioProcessor.read(NioProcessor.java:45) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > org.apache.mina.core.polling.AbstractPollingIoProcessor.read(AbstractPollingIoProcessor.java:694) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > org.apache.mina.core.polling.AbstractPollingIoProcessor.process(AbstractPollingIoProcessor.java:668) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > org.apache.mina.core.polling.AbstractPollingIoProcessor.process(AbstractPollingIoProcessor.java:657) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > org.apache.mina.core.polling.AbstractPollingIoProcessor.access$600(AbstractPollingIoProcessor.java:67) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > org.apache.mina.core.polling.AbstractPollingIoProcessor$Processor.run(AbstractPollingIoProcessor.java:1121) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:64) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > INFO | jvm 1 | 2015/02/02 17:11:06 | at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > INFO | jvm 1 | 2015/02/02 17:11:06 | at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.4#6332)