[jira] [Updated] (OAK-10636) Tar recovery unsuccessful in oak-segment-tar during initialisation of FileStore

2024-02-02 Thread Miroslav Smiljanic (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Miroslav Smiljanic updated OAK-10636:
-
Attachment: (was: OAK-10636_test.patch)

> Tar recovery unsuccessful in oak-segment-tar during initialisation of 
> FileStore
> ---
>
> Key: OAK-10636
> URL: https://issues.apache.org/jira/browse/OAK-10636
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: segment-tar
>Affects Versions: 1.60.0
>Reporter: Miroslav Smiljanic
>Assignee: Miroslav Smiljanic
>Priority: Major
> Attachments: OAK-10636_test.patch
>
>
> The initialization of FileStore is unsuccessful if tar archive is not closed 
> properly and is missing index, graph and binary reference. 
> {noformat}
> java.lang.NullPointerException: null
>   at 
> org.apache.jackrabbit.oak.segment.file.FileStore.readSegment(FileStore.java:517)
>   at 
> org.apache.jackrabbit.oak.segment.SegmentId.getSegment(SegmentId.java:153)
>   at 
> org.apache.jackrabbit.oak.segment.RecordId.getSegment(RecordId.java:98)
>   at 
> org.apache.jackrabbit.oak.segment.SegmentBlob.readLongBlobId(SegmentBlob.java:236)
>   at 
> org.apache.jackrabbit.oak.segment.SegmentBlob.readBlobId(SegmentBlob.java:174)
>   at 
> org.apache.jackrabbit.oak.segment.file.AbstractFileStore.lambda$populateTarBinaryReferences$0(AbstractFileStore.java:253)
>   at 
> org.apache.jackrabbit.oak.segment.Segment.forEachRecord(Segment.java:601)
>   at 
> org.apache.jackrabbit.oak.segment.file.AbstractFileStore.populateTarBinaryReferences(AbstractFileStore.java:251)
>   at 
> org.apache.jackrabbit.oak.segment.file.AbstractFileStore.writeSegment(AbstractFileStore.java:237)
>   at 
> org.apache.jackrabbit.oak.segment.file.AbstractFileStore$1.recoverEntry(AbstractFileStore.java:122)
>   at 
> org.apache.jackrabbit.oak.segment.file.tar.TarReader.generateTarFile(TarReader.java:183)
>   at 
> org.apache.jackrabbit.oak.segment.file.tar.TarReader.open(TarReader.java:106)
>   at 
> org.apache.jackrabbit.oak.segment.file.tar.TarFiles.(TarFiles.java:396)
>   at 
> org.apache.jackrabbit.oak.segment.file.tar.TarFiles$Builder.build(TarFiles.java:214)
>   at 
> org.apache.jackrabbit.oak.segment.file.FileStore.(FileStore.java:172)
>   at 
> org.apache.jackrabbit.oak.segment.file.FileStoreBuilder.build(FileStoreBuilder.java:445)
>   at 
> org.apache.jackrabbit.oak.segment.file.FileStoreTest.testRecovery_FileStore_withExternalBlobStore(FileStoreTest.java:201)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
>   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
>   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>   at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
>   at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
>   at 
> org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
>   at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
>   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
>   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
>   at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
>   at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
>   at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
>   at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
>   at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
>   at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
>   at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
>   at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
>   at 
> com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:69)
>   at 
> com.intellij.rt.junit.IdeaTestRunner$Repeater$1.execute(IdeaTestRunner.java:38)
>   at 
> com.intellij.rt.execution.junit.TestsRepeater.repeat(TestsRepeater.java:11)
>   at 
> 

[jira] [Updated] (OAK-10636) Tar recovery unsuccessful in oak-segment-tar during initialisation of FileStore

2024-02-02 Thread Miroslav Smiljanic (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Miroslav Smiljanic updated OAK-10636:
-
Attachment: OAK-10636_test.patch

> Tar recovery unsuccessful in oak-segment-tar during initialisation of 
> FileStore
> ---
>
> Key: OAK-10636
> URL: https://issues.apache.org/jira/browse/OAK-10636
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: segment-tar
>Affects Versions: 1.60.0
>Reporter: Miroslav Smiljanic
>Assignee: Miroslav Smiljanic
>Priority: Major
> Attachments: OAK-10636_test.patch
>
>
> The initialization of FileStore is unsuccessful if tar archive is not closed 
> properly and is missing index, graph and binary reference. 
> {noformat}
> java.lang.NullPointerException: null
>   at 
> org.apache.jackrabbit.oak.segment.file.FileStore.readSegment(FileStore.java:517)
>   at 
> org.apache.jackrabbit.oak.segment.SegmentId.getSegment(SegmentId.java:153)
>   at 
> org.apache.jackrabbit.oak.segment.RecordId.getSegment(RecordId.java:98)
>   at 
> org.apache.jackrabbit.oak.segment.SegmentBlob.readLongBlobId(SegmentBlob.java:236)
>   at 
> org.apache.jackrabbit.oak.segment.SegmentBlob.readBlobId(SegmentBlob.java:174)
>   at 
> org.apache.jackrabbit.oak.segment.file.AbstractFileStore.lambda$populateTarBinaryReferences$0(AbstractFileStore.java:253)
>   at 
> org.apache.jackrabbit.oak.segment.Segment.forEachRecord(Segment.java:601)
>   at 
> org.apache.jackrabbit.oak.segment.file.AbstractFileStore.populateTarBinaryReferences(AbstractFileStore.java:251)
>   at 
> org.apache.jackrabbit.oak.segment.file.AbstractFileStore.writeSegment(AbstractFileStore.java:237)
>   at 
> org.apache.jackrabbit.oak.segment.file.AbstractFileStore$1.recoverEntry(AbstractFileStore.java:122)
>   at 
> org.apache.jackrabbit.oak.segment.file.tar.TarReader.generateTarFile(TarReader.java:183)
>   at 
> org.apache.jackrabbit.oak.segment.file.tar.TarReader.open(TarReader.java:106)
>   at 
> org.apache.jackrabbit.oak.segment.file.tar.TarFiles.(TarFiles.java:396)
>   at 
> org.apache.jackrabbit.oak.segment.file.tar.TarFiles$Builder.build(TarFiles.java:214)
>   at 
> org.apache.jackrabbit.oak.segment.file.FileStore.(FileStore.java:172)
>   at 
> org.apache.jackrabbit.oak.segment.file.FileStoreBuilder.build(FileStoreBuilder.java:445)
>   at 
> org.apache.jackrabbit.oak.segment.file.FileStoreTest.testRecovery_FileStore_withExternalBlobStore(FileStoreTest.java:201)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
>   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
>   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>   at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
>   at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
>   at 
> org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
>   at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
>   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
>   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
>   at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
>   at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
>   at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
>   at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
>   at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
>   at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
>   at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
>   at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
>   at 
> com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:69)
>   at 
> com.intellij.rt.junit.IdeaTestRunner$Repeater$1.execute(IdeaTestRunner.java:38)
>   at 
> com.intellij.rt.execution.junit.TestsRepeater.repeat(TestsRepeater.java:11)
>   at 
> 

[jira] [Resolved] (OAK-10620) Print summary at the end of the indexing job

2024-02-02 Thread Nuno Santos (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nuno Santos resolved OAK-10620.
---
Fix Version/s: 1.62.0
   Resolution: Done

> Print summary at the end of the indexing job
> 
>
> Key: OAK-10620
> URL: https://issues.apache.org/jira/browse/OAK-10620
> Project: Jackrabbit Oak
>  Issue Type: Improvement
>  Components: indexing
>Reporter: Nuno Santos
>Priority: Major
> Fix For: 1.62.0
>
>
> This summary is intended to have an easy way of copy'n'paste all the relevant 
> information from a run for keeping a record. With this summary, it should not 
> be needed to grep/search the logs just to get an overview of the job.
> The summary should include:
>  - Coordinates of the enviroment
>  - Name of indexes that were indexed
>  - Time of the different phases (download, sort, index)
>  - Complete configuration
>  - Version of the indexing job (aem-ethos-tools and Oak)
>  - All the metrics collected during the run of the job



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (OAK-10637) Indexing job/regex path filtering - when / is the only included path, do not add an explicit filter

2024-02-02 Thread Nuno Santos (Jira)
Nuno Santos created OAK-10637:
-

 Summary: Indexing job/regex path filtering - when / is the only 
included path, do not add an explicit filter
 Key: OAK-10637
 URL: https://issues.apache.org/jira/browse/OAK-10637
 Project: Jackrabbit Oak
  Issue Type: Improvement
  Components: indexing
Reporter: Nuno Santos






--
This message was sent by Atlassian Jira
(v8.20.10#820010)