dave2wave commented on issue #13788: URL: https://github.com/apache/pulsar/issues/13788#issuecomment-1057212665
I'm seeing this error while doing OMB / Offloading tests of Pulsar 2.8.3 rc3. ``` Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: 17:43:46.391 [bookkeeper-ml-scheduler-OrderedScheduler-2-0] WARN org.apache.bookkeeper.mledger.impl.ManagedCursorImpl - [benchmark/ns-Y4Ft4Qc/persistent/test-6Kvlcnk-0004-partition-2][sub-000-0fjC-_4] Failed to flush mark-delete position Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: org.apache.bookkeeper.mledger.ManagedLedgerException: java.lang.IllegalArgumentException: Mark deleting an already mark-deleted position. Current mark-delete: 238:7033 -- attempted mark delete: 238:6933 Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: Caused by: java.lang.IllegalArgumentException: Mark deleting an already mark-deleted position. Current mark-delete: 238:7033 -- attempted mark delete: 238:6933 Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at org.apache.bookkeeper.mledger.impl.ManagedCursorImpl.setAcknowledgedPosition(ManagedCursorImpl.java:1582) ~[org.apache.pulsar-managed-ledger-2.8.3.jar:2.8.3] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at org.apache.bookkeeper.mledger.impl.ManagedCursorImpl.asyncMarkDelete(ManagedCursorImpl.java:1722) ~[org.apache.pulsar-managed-ledger-2.8.3.jar:2.8.3] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at org.apache.bookkeeper.mledger.impl.ManagedCursorImpl.flush(ManagedCursorImpl.java:3044) ~[org.apache.pulsar-managed-ledger-2.8.3.jar:2.8.3] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at org.apache.bookkeeper.mledger.impl.ManagedLedgerFactoryImpl.lambda$flushCursors$1(ManagedLedgerFactoryImpl.java:213) ~[org.apache.pulsar-managed-ledger-2.8.3.jar:2.8.3] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at java.lang.Iterable.forEach(Iterable.java:75) ~[?:?] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at org.apache.bookkeeper.mledger.impl.ManagedLedgerFactoryImpl.lambda$flushCursors$2(ManagedLedgerFactoryImpl.java:213) ~[org.apache.pulsar-managed-ledger-2.8.3.jar:2.8.3] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at java.util.concurrent.ConcurrentHashMap$ValuesView.forEach(ConcurrentHashMap.java:4772) ~[?:?] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at org.apache.bookkeeper.mledger.impl.ManagedLedgerFactoryImpl.flushCursors(ManagedLedgerFactoryImpl.java:209) ~[org.apache.pulsar-managed-ledger-2.8.3.jar:2.8.3] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at org.apache.pulsar.common.util.Runnables$CatchingAndLoggingRunnable.run(Runnables.java:53) [org.apache.pulsar-pulsar-common-2.8.3.jar:2.8.3] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at org.apache.bookkeeper.common.util.OrderedExecutor$TimedRunnable.run(OrderedExecutor.java:203) [org.apache.bookkeeper-bookkeeper-common-4.14.4.jar:4.14.4] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator$NeverSuccessfulListenableFutureTask.run(MoreExecutors.java:705) [com.google.guava-guava-30.1-jre.jar:?] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) [?:?] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) [?:?] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty-netty-common-4.1.74.Final.jar:4.1.74.Final] Mar 2 17:43:46 ip-10-0-0-250 pulsar[20582]: #011at java.lang.Thread.run(Thread.java:829) [?:?] ``` The mark-delete seem to be slightly out of sequence. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
