[
https://issues.apache.org/jira/browse/OAK-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Dürig updated OAK-5001:
-------------------------------
Attachment: temp.patch
I couldn't reproduce this problem with the attached patch ([^temp.pacth]). The
patch sets all snapshot dependencies and includes a fix for OAK-4945.
However for the ua test instance running offline compaction grows the
repository considerably:
{noformat}
Apache Jackrabbit Oak
Compacting /Users/mduerig/Downloads/repos/under armour/upgraded/segmentstore
before
Tue Oct 25 18:23:37 CEST 2016, data00000a.tar
Tue Oct 25 18:23:50 CEST 2016, data00001a.tar
Tue Oct 25 18:25:20 CEST 2016, data00002a.tar
Tue Oct 25 18:25:32 CEST 2016, data00003a.tar
Tue Oct 25 18:25:42 CEST 2016, data00004a.tar
Tue Oct 25 18:25:51 CEST 2016, data00005a.tar
Tue Oct 25 18:25:59 CEST 2016, data00006a.tar
Tue Oct 25 18:26:06 CEST 2016, data00007a.tar
Tue Oct 25 18:26:15 CEST 2016, data00008a.tar
Tue Oct 25 18:26:24 CEST 2016, data00009a.tar
Tue Oct 25 18:26:35 CEST 2016, data00010a.tar
Tue Oct 25 18:26:43 CEST 2016, data00011a.tar
Tue Oct 25 18:26:52 CEST 2016, data00012a.tar
Tue Oct 25 18:27:20 CEST 2016, data00013a.tar
Tue Oct 25 18:27:38 CEST 2016, data00014a.tar
Tue Oct 25 18:27:38 CEST 2016, journal.log
Tue Oct 25 18:22:58 CEST 2016, manifest
Tue Oct 25 18:22:58 CEST 2016, repo.lock
size 4.0 GB (4014879397 bytes)
-> compacting
-> cleaning up
-> writing new journal.log: 6280c816-ba27-4fc6-a8fd-a9d2f62e774b:671 root
1477413509191
after
Tue Oct 25 18:29:10 CEST 2016, data00015a.tar
Tue Oct 25 18:29:41 CEST 2016, data00016a.tar
Tue Oct 25 18:30:01 CEST 2016, data00017a.tar
Tue Oct 25 18:30:15 CEST 2016, data00018a.tar
Tue Oct 25 18:30:23 CEST 2016, data00019a.tar
Tue Oct 25 18:30:34 CEST 2016, data00020a.tar
Tue Oct 25 18:30:43 CEST 2016, data00021a.tar
Tue Oct 25 18:30:51 CEST 2016, data00022a.tar
Tue Oct 25 18:30:58 CEST 2016, data00023a.tar
Tue Oct 25 18:31:05 CEST 2016, data00024a.tar
Tue Oct 25 18:31:15 CEST 2016, data00025a.tar
Tue Oct 25 18:31:26 CEST 2016, data00026a.tar
Tue Oct 25 18:31:33 CEST 2016, data00027a.tar
Tue Oct 25 18:31:41 CEST 2016, data00028a.tar
Tue Oct 25 18:32:08 CEST 2016, data00029a.tar
Tue Oct 25 18:32:29 CEST 2016, data00030a.tar
Tue Oct 25 18:33:05 CEST 2016, data00031a.tar
Tue Oct 25 18:33:21 CEST 2016, data00032a.tar
Tue Oct 25 18:33:38 CEST 2016, data00033a.tar
Tue Oct 25 18:33:46 CEST 2016, data00034a.tar
Tue Oct 25 18:34:00 CEST 2016, data00035a.tar
Tue Oct 25 18:34:07 CEST 2016, data00036a.tar
Tue Oct 25 18:34:15 CEST 2016, data00037a.tar
Tue Oct 25 18:34:23 CEST 2016, data00038a.tar
Tue Oct 25 18:34:30 CEST 2016, data00039a.tar
Tue Oct 25 18:34:38 CEST 2016, data00040a.tar
Tue Oct 25 18:34:47 CEST 2016, data00041a.tar
Tue Oct 25 18:34:54 CEST 2016, data00042a.tar
Tue Oct 25 18:35:03 CEST 2016, data00043a.tar
Tue Oct 25 18:35:30 CEST 2016, data00044a.tar
Tue Oct 25 18:35:49 CEST 2016, data00045a.tar
Tue Oct 25 18:36:22 CEST 2016, data00046a.tar
Tue Oct 25 18:36:35 CEST 2016, data00047a.tar
Tue Oct 25 18:36:46 CEST 2016, data00048a.tar
Tue Oct 25 18:36:53 CEST 2016, data00049a.tar
Tue Oct 25 18:37:04 CEST 2016, data00050a.tar
Tue Oct 25 18:37:14 CEST 2016, data00051a.tar
Tue Oct 25 18:37:22 CEST 2016, data00052a.tar
Tue Oct 25 18:37:29 CEST 2016, data00053a.tar
Tue Oct 25 18:37:35 CEST 2016, data00054a.tar
Tue Oct 25 18:37:44 CEST 2016, data00055a.tar
Tue Oct 25 18:37:54 CEST 2016, data00056a.tar
Tue Oct 25 18:38:01 CEST 2016, data00057a.tar
Tue Oct 25 18:38:11 CEST 2016, data00058a.tar
Tue Oct 25 18:38:23 CEST 2016, data00059a.tar
Tue Oct 25 18:38:29 CEST 2016, gc.log
Tue Oct 25 18:38:29 CEST 2016, journal.log
Tue Oct 25 18:38:28 CEST 2016, manifest
Tue Oct 25 18:22:58 CEST 2016, repo.lock
size 12.0 GB (12042121360 bytes)
removed files [data00003a.tar, data00009a.tar, data00002a.tar,
data00008a.tar, data00010a.tar, data00013a.tar, data00014a.tar, data00000a.tar,
data00006a.tar, data00005a.tar, data00011a.tar, data00001a.tar, data00004a.tar,
data00012a.tar, data00007a.tar]
added files [data00048a.tar, data00046a.tar, data00039a.tar,
data00027a.tar, data00056a.tar, data00055a.tar, gc.log, data00019a.tar,
data00031a.tar, data00045a.tar, data00041a.tar, data00036a.tar, data00047a.tar,
data00022a.tar, data00033a.tar, data00058a.tar, data00035a.tar, data00043a.tar,
data00028a.tar, data00049a.tar, data00038a.tar, data00021a.tar, data00050a.tar,
data00018a.tar, data00023a.tar, data00059a.tar, data00026a.tar, data00053a.tar,
data00015a.tar, data00029a.tar, data00024a.tar, data00044a.tar, data00034a.tar,
data00016a.tar, data00020a.tar, data00025a.tar, data00052a.tar, data00017a.tar,
data00042a.tar, data00032a.tar, data00054a.tar, data00057a.tar, data00051a.tar,
data00040a.tar, data00037a.tar, data00030a.tar]
Compaction succeeded in 9.900 min (593s).
{noformat}
> ISE and SNFE when running offline compaction on sidegraded SegmentStore
> -----------------------------------------------------------------------
>
> Key: OAK-5001
> URL: https://issues.apache.org/jira/browse/OAK-5001
> Project: Jackrabbit Oak
> Issue Type: Bug
> Components: run
> Affects Versions: Segment Tar 0.0.16
> Reporter: Andrei Dulceanu
> Assignee: Andrei Dulceanu
> Priority: Blocker
> Fix For: 1.6, 1.5.13
>
> Attachments: temp.patch
>
>
> {code}
> java -jar oak-run-1.6-SNAPSHOT.jar compact
> some-instance/sidegraded-repository/segmentstore/
> {code}
> {code}
> size 4.4 GB (4435703980 bytes)
> -> compacting
> 11:06:28.253 [main] ERROR o.a.jackrabbit.oak.segment.SegmentId - Segment not
> found: fafea2ad-73c2-457e-a6c4-5578c0ffb20c. SegmentId age=7ms
> org.apache.jackrabbit.oak.segment.SegmentNotFoundException: Segment
> fafea2ad-73c2-457e-a6c4-5578c0ffb20c not found
> at
> org.apache.jackrabbit.oak.segment.file.FileStore.readSegment(FileStore.java:596)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.SegmentId.getSegment(SegmentId.java:123)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.SegmentId.getGcGeneration(SegmentId.java:213)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.file.FileStore.getGcGeneration(FileStore.java:269)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.file.FileStore.access$000(FileStore.java:95)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.file.FileStore$GarbageCollector.compact(FileStore.java:840)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.file.FileStore.compact(FileStore.java:400)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.tool.Compact.compact(Compact.java:117)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.tool.Compact.run(Compact.java:109)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.run.SegmentTarUtils.compact(SegmentTarUtils.java:203)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.run.CompactCommand.execute(CompactCommand.java:76)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at org.apache.jackrabbit.oak.run.Mode.execute(Mode.java:63)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at org.apache.jackrabbit.oak.run.Main.main(Main.java:49)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.ArrayIndexOutOfBoundsException: -81
> at
> org.apache.jackrabbit.oak.segment.SegmentCache.getSegment(SegmentCache.java:103)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.file.FileStore.readSegment(FileStore.java:531)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> ... 12 common frames omitted
> Caused by: java.lang.ArrayIndexOutOfBoundsException: -81
> at
> org.apache.jackrabbit.oak.segment.Segment.readRecordNumberOffsets(Segment.java:242)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at org.apache.jackrabbit.oak.segment.Segment.<init>(Segment.java:201)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.file.FileStore$8.call(FileStore.java:548)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.file.FileStore$8.call(FileStore.java:531)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.SegmentCache.getSegment(SegmentCache.java:98)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> ... 13 common frames omitted
> {code}
> {code}
> 11:09:47.047 [main] ERROR o.a.j.oak.segment.file.FileStore - TarMK GC #0:
> compaction encountered an error
> java.lang.IllegalStateException: invalid record number
> at org.apache.jackrabbit.oak.segment.Segment.pos(Segment.java:338)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.Segment.readRecordId(Segment.java:462)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.SegmentNodeState.getTemplateId(SegmentNodeState.java:93)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.SegmentNodeState.getTemplate(SegmentNodeState.java:102)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.SegmentNodeState.getProperties(SegmentNodeState.java:222)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.plugins.memory.EmptyNodeState.compareAgainstEmptyState(EmptyNodeState.java:155)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:460)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.Compactor$CompactDiff.diff(Compactor.java:200)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.Compactor.process(Compactor.java:145)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.Compactor.compact(Compactor.java:164)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.file.FileStore$GarbageCollector.compact(FileStore.java:957)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.file.FileStore$GarbageCollector.compact(FileStore.java:844)
> ~[oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.file.FileStore.compact(FileStore.java:400)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.tool.Compact.compact(Compact.java:117)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.segment.tool.Compact.run(Compact.java:109)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.run.SegmentTarUtils.compact(SegmentTarUtils.java:203)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at
> org.apache.jackrabbit.oak.run.CompactCommand.execute(CompactCommand.java:76)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at org.apache.jackrabbit.oak.run.Mode.execute(Mode.java:63)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> at org.apache.jackrabbit.oak.run.Main.main(Main.java:49)
> [oak-run-1.6-SNAPSHOT.jar:1.6-SNAPSHOT]
> -> cleaning up
> -> writing new journal.log: ae60415f-6a8c-4705-ac5f-fd8cf83ca361:241152
> root 1477393787365
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
