[jira] [Resolved] (OAK-10147) Many move operations may consume a lot of memory

2023-06-12 Thread Marcel Reutegger (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-10147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marcel Reutegger resolved OAK-10147.

Fix Version/s: 1.54.0
   Resolution: Fixed

Merged the PR.

> Many move operations may consume a lot of memory
> 
>
> Key: OAK-10147
> URL: https://issues.apache.org/jira/browse/OAK-10147
> Project: Jackrabbit Oak
>  Issue Type: Task
>  Components: core
>Reporter: Julian Reschke
>Assignee: Marcel Reutegger
>Priority: Major
> Fix For: 1.54.0
>
>
> We have encountered an issue where a component did a huge number of move 
> operations in transient space, and oak-core's "MutableRoot" class consumed 
> ~800 MB for ca 3000 move operations. This seems to be a lot.
> We should:
> 1. Write a test / benchmark that reproduces the issue
> 2. Check whether it's specific to a certain store implemention
> 3. See whether the memory footprint can be reduced



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OAK-10296) Build Jackrabbit/jackrabbit-oak-trunk #987 failed

2023-06-12 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/OAK-10296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731776#comment-17731776
 ] 

Hudson commented on OAK-10296:
--

Previously failing build now is OK.
 Passed run: [Jackrabbit/jackrabbit-oak-trunk 
#988|https://ci-builds.apache.org/job/Jackrabbit/job/jackrabbit-oak-trunk/988/] 
[console 
log|https://ci-builds.apache.org/job/Jackrabbit/job/jackrabbit-oak-trunk/988/console]

> Build Jackrabbit/jackrabbit-oak-trunk #987 failed
> -
>
> Key: OAK-10296
> URL: https://issues.apache.org/jira/browse/OAK-10296
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: continuous integration
>Reporter: Hudson
>Priority: Major
>
> No description is provided
> The build Jackrabbit/jackrabbit-oak-trunk #987 has failed.
> First failed run: [Jackrabbit/jackrabbit-oak-trunk 
> #987|https://ci-builds.apache.org/job/Jackrabbit/job/jackrabbit-oak-trunk/987/]
>  [console 
> log|https://ci-builds.apache.org/job/Jackrabbit/job/jackrabbit-oak-trunk/987/console]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (OAK-10297) Update (shaded) Guava to 32.0.1

2023-06-12 Thread Julian Reschke (Jira)
Julian Reschke created OAK-10297:


 Summary: Update (shaded) Guava to 32.0.1
 Key: OAK-10297
 URL: https://issues.apache.org/jira/browse/OAK-10297
 Project: Jackrabbit Oak
  Issue Type: Task
  Components: shaded-guava
Reporter: Julian Reschke
Assignee: Julian Reschke
 Fix For: 1.54.0






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OAK-10293) AzureTarRevisionsTest fails occasionally

2023-06-12 Thread Julian Reschke (Jira)


[ 
https://issues.apache.org/jira/browse/OAK-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731622#comment-17731622
 ] 

Julian Reschke commented on OAK-10293:
--

Same here.

 

> AzureTarRevisionsTest fails occasionally
> 
>
> Key: OAK-10293
> URL: https://issues.apache.org/jira/browse/OAK-10293
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: segment-azure
>Reporter: Marcel Reutegger
>Priority: Minor
>
> {noformat}
> [ERROR] Tests run: 7, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.395 
> s <<< FAILURE! - in 
> org.apache.jackrabbit.oak.segment.azure.journal.AzureTarRevisionsTest
> [ERROR] 
> setHeadFromFunction(org.apache.jackrabbit.oak.segment.azure.journal.AzureTarRevisionsTest)
>   Time elapsed: 0.043 s  <<< ERROR!
> org.apache.jackrabbit.oak.segment.file.InvalidFileStoreVersionException: 
> Using oak-segment-tar, but oak-segment should be used
>   at 
> org.apache.jackrabbit.oak.segment.file.ManifestChecker.openManifest(ManifestChecker.java:65)
>   at 
> org.apache.jackrabbit.oak.segment.file.ManifestChecker.checkAndUpdateManifest(ManifestChecker.java:51)
>   at 
> org.apache.jackrabbit.oak.segment.file.FileStore.(FileStore.java:153)
>   at 
> org.apache.jackrabbit.oak.segment.file.FileStoreBuilder.build(FileStoreBuilder.java:445)
>   at 
> org.apache.jackrabbit.oak.segment.file.TarRevisionsTest.setup(TarRevisionsTest.java:74)
>   at 
> org.apache.jackrabbit.oak.segment.azure.journal.AzureTarRevisionsTest.setup(AzureTarRevisionsTest.java:41)
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (OAK-10274) oak-core-spi: remove Guava from public API

2023-06-12 Thread Julian Reschke (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julian Reschke updated OAK-10274:
-
Fix Version/s: 1.56.0

> oak-core-spi: remove Guava from public API
> --
>
> Key: OAK-10274
> URL: https://issues.apache.org/jira/browse/OAK-10274
> Project: Jackrabbit Oak
>  Issue Type: Technical task
>  Components: core-spi
>Reporter: Julian Reschke
>Assignee: Julian Reschke
>Priority: Major
> Fix For: 1.56.0
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (OAK-10247) oak-commons: remove Guava from public API

2023-06-12 Thread Julian Reschke (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julian Reschke updated OAK-10247:
-
Fix Version/s: 1.54.0

> oak-commons: remove Guava from public API
> -
>
> Key: OAK-10247
> URL: https://issues.apache.org/jira/browse/OAK-10247
> Project: Jackrabbit Oak
>  Issue Type: Technical task
>  Components: commons
>Reporter: Julian Reschke
>Assignee: Julian Reschke
>Priority: Major
> Fix For: 1.54.0
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (OAK-9660) NullPointerException When Moving Transient node

2023-06-12 Thread Marcel Reutegger (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marcel Reutegger updated OAK-9660:
--
Labels: candidate_oak_1_22  (was: )

> NullPointerException When Moving Transient node
> ---
>
> Key: OAK-9660
> URL: https://issues.apache.org/jira/browse/OAK-9660
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: core
>Affects Versions: 1.8.8, 1.40.0
>Reporter: Bryan Stopp
>Assignee: Marcel Reutegger
>Priority: Major
>  Labels: candidate_oak_1_22
> Fix For: 1.54.0
>
>
> When a node is moved in a uncommitted Session1 (S), that was previously moved 
> in a closed/committed Session0 (S'), any transient children nodes that are 
> moved throw NPEs in the node memory manager tracking the uncommitted state.
>  
> Steps to reproduce:
>  # Start Sling docker container
>  ## ` docker run -p 8080:8080 apache/sling`
>  # Install [demo project|https://github.com/bstopp/oak-move-bug] 
>  # Disable administrative login security, or create a rule for the servlet.
>  # Navigate to the [Demo servlet|http://localhost:8080/bin/bug/test]
>  
> The servlet will catch the NPE and display it. The error occurs 
> [here|https://github.com/apache/jackrabbit-oak/blob/74a1a686635be76b74abd57ebc0ef1dd4bb44889/oak-store-spi/src/main/java/org/apache/jackrabbit/oak/plugins/memory/MemoryNodeBuilder.java#L449].
>  `base` is not null, but `head` is.
> It seems that the `base` look up finds the segment metadata from Session0 
> (S') that has been dispatched (before the current session was created), and 
> not recognizing that the parent is now a transient node in Session1 (S).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (OAK-10294) Pipelined Mongo dump for indexing job (WIP - Do Not Merge)

2023-06-12 Thread Nuno Santos (Jira)
Nuno Santos created OAK-10294:
-

 Summary: Pipelined Mongo dump for indexing job (WIP - Do Not Merge)
 Key: OAK-10294
 URL: https://issues.apache.org/jira/browse/OAK-10294
 Project: Jackrabbit Oak
  Issue Type: Improvement
  Components: indexing
Reporter: Nuno Santos






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (OAK-9660) NullPointerException When Moving Transient node

2023-06-12 Thread Marcel Reutegger (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marcel Reutegger resolved OAK-9660.
---
Fix Version/s: 1.54.0
   Resolution: Fixed

Merged PR https://github.com/apache/jackrabbit-oak/pull/975

Bryan, thank you for reporting this issue and the excellent instructions how to 
reproduce it.

> NullPointerException When Moving Transient node
> ---
>
> Key: OAK-9660
> URL: https://issues.apache.org/jira/browse/OAK-9660
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: core
>Affects Versions: 1.8.8, 1.40.0
>Reporter: Bryan Stopp
>Assignee: Marcel Reutegger
>Priority: Major
> Fix For: 1.54.0
>
>
> When a node is moved in a uncommitted Session1 (S), that was previously moved 
> in a closed/committed Session0 (S'), any transient children nodes that are 
> moved throw NPEs in the node memory manager tracking the uncommitted state.
>  
> Steps to reproduce:
>  # Start Sling docker container
>  ## ` docker run -p 8080:8080 apache/sling`
>  # Install [demo project|https://github.com/bstopp/oak-move-bug] 
>  # Disable administrative login security, or create a rule for the servlet.
>  # Navigate to the [Demo servlet|http://localhost:8080/bin/bug/test]
>  
> The servlet will catch the NPE and display it. The error occurs 
> [here|https://github.com/apache/jackrabbit-oak/blob/74a1a686635be76b74abd57ebc0ef1dd4bb44889/oak-store-spi/src/main/java/org/apache/jackrabbit/oak/plugins/memory/MemoryNodeBuilder.java#L449].
>  `base` is not null, but `head` is.
> It seems that the `base` look up finds the segment metadata from Session0 
> (S') that has been dispatched (before the current session was created), and 
> not recognizing that the parent is now a transient node in Session1 (S).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (OAK-10295) KeyDataType does not define or inherit an implementation of the resolved method 'abstract void write()

2023-06-12 Thread Wallace Howery (Jira)
Wallace Howery created OAK-10295:


 Summary: KeyDataType does not define or inherit an implementation 
of the resolved method 'abstract void write()
 Key: OAK-10295
 URL: https://issues.apache.org/jira/browse/OAK-10295
 Project: Jackrabbit Oak
  Issue Type: Bug
  Components: jackrabbit-api
Affects Versions: 1.50.0
Reporter: Wallace Howery


I'm getting the warning below in a JCR Oak project, using postgres for storage, 
and using oak-lucene and oak-store-composite dependencies (to get JCR 
functionality), using version 1.50.0 of those dependencies. 

 

It looks like 
org.apache.jackrabbit.oak.plugins.document.persistentCache.KeyDataType needs to 
be updated to implement method 'abstract void write(org.h2.mvstore.WriteBuffer, 
java.lang.Object[], int, boolean)' of interface org.h2.mvstore.type.DataType.

 

Could this be looked into be the jackrabbit team?

 

{"@timestamp":"2023-05-26T11:26:41.994-04:00","@version":"1","message":"Error 
in the background thread of the persistent cache: 
java.lang.IllegalStateException: java.lang.AbstractMethodError: Receiver class 
org.apache.jackrabbit.oak.plugins.document.persistentCache.KeyDataType does not 
define or inherit an implementation of the resolved method 'abstract void 
write(org.h2.mvstore.WriteBuffer, java.lang.Object[], int, boolean)' of 
interface org.h2.mvstore.type.DataType. 
[1.4.200/3]","logger_name":"org.apache.jackrabbit.oak.plugins.document.persistentCache.MapFactory","thread_name":"MVStore
 background writer 
nio:/data/ace/app/summons/oak/repository/cache/cache-0.data","level":"WARN","level_value":3}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (OAK-10296) Build Jackrabbit/jackrabbit-oak-trunk #987 failed

2023-06-12 Thread Hudson (Jira)
Hudson created OAK-10296:


 Summary: Build Jackrabbit/jackrabbit-oak-trunk #987 failed
 Key: OAK-10296
 URL: https://issues.apache.org/jira/browse/OAK-10296
 Project: Jackrabbit Oak
  Issue Type: Bug
  Components: continuous integration
Reporter: Hudson


No description is provided

The build Jackrabbit/jackrabbit-oak-trunk #987 has failed.
First failed run: [Jackrabbit/jackrabbit-oak-trunk 
#987|https://ci-builds.apache.org/job/Jackrabbit/job/jackrabbit-oak-trunk/987/] 
[console 
log|https://ci-builds.apache.org/job/Jackrabbit/job/jackrabbit-oak-trunk/987/console]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (OAK-10295) KeyDataType does not define or inherit an implementation of the resolved method 'abstract void write()

2023-06-12 Thread Wallace Howery (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-10295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wallace Howery updated OAK-10295:
-
Description: 
I'm getting the warning below in a JCR Oak project, using postgres for storage, 
and using oak-lucene and oak-store-composite dependencies (to get JCR 
functionality), using version 1.50.0 of those dependencies. 

Also, I'm using JDK 17 and spring-boot 2.5.12.

 

It looks like 
org.apache.jackrabbit.oak.plugins.document.persistentCache.KeyDataType needs to 
be updated to implement method 'abstract void write(org.h2.mvstore.WriteBuffer, 
java.lang.Object[], int, boolean)' of interface org.h2.mvstore.type.DataType.

 

Could this be looked into be the jackrabbit team?

 

{"@timestamp":"2023-05-26T11:26:41.994-04:00","@version":"1","message":"Error 
in the background thread of the persistent cache: 
java.lang.IllegalStateException: java.lang.AbstractMethodError: Receiver class 
org.apache.jackrabbit.oak.plugins.document.persistentCache.KeyDataType does not 
define or inherit an implementation of the resolved method 'abstract void 
write(org.h2.mvstore.WriteBuffer, java.lang.Object[], int, boolean)' of 
interface org.h2.mvstore.type.DataType. 
[1.4.200/3]","logger_name":"org.apache.jackrabbit.oak.plugins.document.persistentCache.MapFactory","thread_name":"MVStore
 background writer 
nio:/data/ace/app/summons/oak/repository/cache/cache-0.data","level":"WARN","level_value":3}

  was:
I'm getting the warning below in a JCR Oak project, using postgres for storage, 
and using oak-lucene and oak-store-composite dependencies (to get JCR 
functionality), using version 1.50.0 of those dependencies. 

 

It looks like 
org.apache.jackrabbit.oak.plugins.document.persistentCache.KeyDataType needs to 
be updated to implement method 'abstract void write(org.h2.mvstore.WriteBuffer, 
java.lang.Object[], int, boolean)' of interface org.h2.mvstore.type.DataType.

 

Could this be looked into be the jackrabbit team?

 

{"@timestamp":"2023-05-26T11:26:41.994-04:00","@version":"1","message":"Error 
in the background thread of the persistent cache: 
java.lang.IllegalStateException: java.lang.AbstractMethodError: Receiver class 
org.apache.jackrabbit.oak.plugins.document.persistentCache.KeyDataType does not 
define or inherit an implementation of the resolved method 'abstract void 
write(org.h2.mvstore.WriteBuffer, java.lang.Object[], int, boolean)' of 
interface org.h2.mvstore.type.DataType. 
[1.4.200/3]","logger_name":"org.apache.jackrabbit.oak.plugins.document.persistentCache.MapFactory","thread_name":"MVStore
 background writer 
nio:/data/ace/app/summons/oak/repository/cache/cache-0.data","level":"WARN","level_value":3}


> KeyDataType does not define or inherit an implementation of the resolved 
> method 'abstract void write()
> --
>
> Key: OAK-10295
> URL: https://issues.apache.org/jira/browse/OAK-10295
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: jackrabbit-api
>Affects Versions: 1.50.0
>Reporter: Wallace Howery
>Priority: Critical
>
> I'm getting the warning below in a JCR Oak project, using postgres for 
> storage, and using oak-lucene and oak-store-composite dependencies (to get 
> JCR functionality), using version 1.50.0 of those dependencies. 
> Also, I'm using JDK 17 and spring-boot 2.5.12.
>  
> It looks like 
> org.apache.jackrabbit.oak.plugins.document.persistentCache.KeyDataType needs 
> to be updated to implement method 'abstract void 
> write(org.h2.mvstore.WriteBuffer, java.lang.Object[], int, boolean)' of 
> interface org.h2.mvstore.type.DataType.
>  
> Could this be looked into be the jackrabbit team?
>  
> {"@timestamp":"2023-05-26T11:26:41.994-04:00","@version":"1","message":"Error 
> in the background thread of the persistent cache: 
> java.lang.IllegalStateException: java.lang.AbstractMethodError: Receiver 
> class org.apache.jackrabbit.oak.plugins.document.persistentCache.KeyDataType 
> does not define or inherit an implementation of the resolved method 'abstract 
> void write(org.h2.mvstore.WriteBuffer, java.lang.Object[], int, boolean)' of 
> interface org.h2.mvstore.type.DataType. 
> [1.4.200/3]","logger_name":"org.apache.jackrabbit.oak.plugins.document.persistentCache.MapFactory","thread_name":"MVStore
>  background writer 
> nio:/data/ace/app/summons/oak/repository/cache/cache-0.data","level":"WARN","level_value":3}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)