R: R: critical question about oak: db connection

2016-03-19 Thread Ancona Francesco 
Hello,
i send you a maven project to connect with postgres.

As i told you in other messages i know that oak test cases work; but they start 
always with RDBDocumentStore and use UpdateOp and other Oak methods to add 
nodes.

Instead we'd like to use RDBDocumentNodeStore and we'd like to have 
jcrRepository and jcr methods to manage documents (nodes).

I hope the project can be useful.

Thanks in advance,
best regards.

-Messaggio originale-
Da: Julian Reschke [mailto:julian.resc...@gmx.de] 
Inviato: mercoledì 16 marzo 2016 17:21
A: oak-dev@jackrabbit.apache.org
Oggetto: Re: R: critical question about oak: db connection

Ancona,

you keep asking for more help but seem to ignore the feedback that you get.

1) oak-jcr and oak-run demonstrate that it is possible to run on RDBs; just run 
the tests. All the information that you need should be in the test cases.

2) Don't throw code snippets at us. Without complete classes we can try 
ourselves there is no way how we can find out what's wrong.

So either start from the existing working code, or send self-contained test 
code we can compile and run ourselves.

Best regards, Julian


On 2016-03-16 16:28, Ancona Francesco wrote:
> Hi,
> Oak configuration with RDBMS doesn't work yet.
>
> I use the latest release 1.4.0 but i have the same problem
>
> In particular this is the code i use to initialize Oak
>   
>  final DocumentMK.Builder builder = new DocumentMK.Builder();
>  builder.setBlobStore(createFileSystemBlobStore());
>  final DocumentNodeStore ns = 
> getRDBDocumentNodeStore(builder);
>
> // ds is datasource form postgres 9.4
> DocumentStore documentStore = new RDBDocumentStore(ds, builder);
>  builder.setDocumentStore(documentStore);
>  DocumentNodeStore ns = new DocumentNodeStore(builder);
>  DocumentNodeStore ns1 = new 
> DocumentMK.Builder().setDocumentStore(documentStore).getNodeStore();
>  InitialContent ic = new InitialContent();
>  Oak oak = new Oak(ns1).with(ic);
>  Jcr jcr = new Jcr(oak);
>  Repository repo = jcr.createRepository();
>
>
> and this is the stack trace:
> java.lang.IllegalStateException: This tree does not exist
>  at 
> org.apache.jackrabbit.oak.core.MutableTree.beforeWrite(MutableTree.java:353)
>  at 
> org.apache.jackrabbit.oak.core.MutableTree.setProperty(MutableTree.java:232)
>  at 
> org.apache.jackrabbit.oak.plugins.name.ReadWriteNamespaceRegistry.registerNamespace(ReadWriteNamespaceRegistry.java:92)
>  at 
> org.apache.jackrabbit.commons.cnd.TemplateBuilderFactory.setNamespace(TemplateBuilderFactory.java:92)
>  at 
> org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.doNameSpace(CompactNodeTypeDefReader.java:246)
>  at 
> org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.parse(CompactNodeTypeDefReader.java:200)
>  at 
> org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.(CompactNodeTypeDefReader.java:163)
>  at 
> org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.(CompactNodeTypeDefReader.java:139)
>  at 
> org.apache.jackrabbit.commons.cnd.CndImporter.registerNodeTypes(CndImporter.java:147)
>  at 
> org.apache.jackrabbit.oak.plugins.nodetype.write.NodeTypeRegistry.registerNodeTypes(NodeTypeRegistry.java:109)
>  at 
> org.apache.jackrabbit.oak.plugins.nodetype.write.NodeTypeRegistry.register(NodeTypeRegistry.java:104)
>  at 
> org.apache.jackrabbit.oak.plugins.nodetype.write.NodeTypeRegistry.registerBuiltIn(NodeTypeRegistry.java:86)
>  at 
> org.apache.jackrabbit.oak.plugins.nodetype.write.InitialContent.initialize(InitialContent.java:120)
>  at 
> org.apache.jackrabbit.oak.spi.lifecycle.CompositeInitializer.initialize(CompositeInitializer.java:48)
>  at 
> org.apache.jackrabbit.oak.spi.lifecycle.OakInitializer.initialize(OakInitializer.java:42)
>  at org.apache.jackrabbit.oak.Oak.createNewContentRepository(Oak.java:628)
>  at org.apache.jackrabbit.oak.Oak.createContentRepository(Oak.java:616)
>  at 
> org.apache.jackrabbit.oak.jcr.Jcr.createContentRepository(Jcr.java:367)
>  at org.apache.jackrabbit.oak.jcr.Jcr.createRepository(Jcr.java:375)
>  at 
> it.siav.jarvis.testplatform.ecm.common.OakRDBMSTest.test(OakRDBMSTest.java:74)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:497)
>  at 
> org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:85)
>  at 
> org.testng.internal.MethodInvocationHelper$1.runTestMethod(MethodInvocationHelper.java:196)
>  at 
> org.springframework.test.context.testng.AbstractTestNGSpringContextTests.run(AbstractTestNGSpringContextTests.java:175)
>  at 
>

R: critical question about oak: db connection

2016-03-19 Thread Ancona Francesco 
Done.

https://github.com/francescoancona/oaktest.git

Thanks in advance,
best regards


-Messaggio originale-
Da: Tomek Rekawek [mailto:reka...@adobe.com] 
Inviato: giovedì 17 marzo 2016 15:32
A: oak-dev@jackrabbit.apache.org
Oggetto: Re: critical question about oak: db connection

Hello Ancona,

the mailing list didn’t allow to add an attachment. Could you post it somewhere 
online or (even better) put the code into github?

Best regards,
Tomek

--
Tomek Rękawek | Adobe Research | www.adobe.com reka...@adobe.com

> On 17 Mar 2016, at 14:46, Ancona Francesco  wrote:
> 
> Hello,
> i send you a maven project to connect with postgres.
> 
> As i told you in other messages i know that oak test cases work; but they 
> start always with RDBDocumentStore and use UpdateOp and other Oak methods to 
> add nodes.
> 
> Instead we'd like to use RDBDocumentNodeStore and we'd like to have 
> jcrRepository and jcr methods to manage documents (nodes).
> 
> I hope the project can be useful.
> 
> Thanks in advance,
> best regards.
> 
> -Messaggio originale-
> Da: Julian Reschke [mailto:julian.resc...@gmx.de]
> Inviato: mercoledì 16 marzo 2016 17:21
> A: oak-dev@jackrabbit.apache.org
> Oggetto: Re: R: critical question about oak: db connection
> 
> Ancona,
> 
> you keep asking for more help but seem to ignore the feedback that you get.
> 
> 1) oak-jcr and oak-run demonstrate that it is possible to run on RDBs; just 
> run the tests. All the information that you need should be in the test cases.
> 
> 2) Don't throw code snippets at us. Without complete classes we can try 
> ourselves there is no way how we can find out what's wrong.
> 
> So either start from the existing working code, or send self-contained test 
> code we can compile and run ourselves.
> 
> Best regards, Julian
> 
> 
> On 2016-03-16 16:28, Ancona Francesco wrote:
>> Hi,
>> Oak configuration with RDBMS doesn't work yet.
>> 
>> I use the latest release 1.4.0 but i have the same problem
>> 
>> In particular this is the code i use to initialize Oak
>>  
>> final DocumentMK.Builder builder = new DocumentMK.Builder();
>> builder.setBlobStore(createFileSystemBlobStore());
>> final DocumentNodeStore ns = 
>> getRDBDocumentNodeStore(builder);
>> 
>> // ds is datasource form postgres 9.4 DocumentStore documentStore = 
>> new RDBDocumentStore(ds, builder);
>> builder.setDocumentStore(documentStore);
>> DocumentNodeStore ns = new DocumentNodeStore(builder);
>> DocumentNodeStore ns1 = new 
>> DocumentMK.Builder().setDocumentStore(documentStore).getNodeStore();
>> InitialContent ic = new InitialContent();
>> Oak oak = new Oak(ns1).with(ic);
>> Jcr jcr = new Jcr(oak);
>> Repository repo = jcr.createRepository();
>> 
>> 
>> and this is the stack trace:
>> java.lang.IllegalStateException: This tree does not exist
>> at 
>> org.apache.jackrabbit.oak.core.MutableTree.beforeWrite(MutableTree.java:353)
>> at 
>> org.apache.jackrabbit.oak.core.MutableTree.setProperty(MutableTree.java:232)
>> at 
>> org.apache.jackrabbit.oak.plugins.name.ReadWriteNamespaceRegistry.registerNamespace(ReadWriteNamespaceRegistry.java:92)
>> at 
>> org.apache.jackrabbit.commons.cnd.TemplateBuilderFactory.setNamespace(TemplateBuilderFactory.java:92)
>> at 
>> org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.doNameSpace(CompactNodeTypeDefReader.java:246)
>> at 
>> org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.parse(CompactNodeTypeDefReader.java:200)
>> at 
>> org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.(CompactNodeTypeDefReader.java:163)
>> at 
>> org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.(CompactNodeTypeDefReader.java:139)
>> at 
>> org.apache.jackrabbit.commons.cnd.CndImporter.registerNodeTypes(CndImporter.java:147)
>> at 
>> org.apache.jackrabbit.oak.plugins.nodetype.write.NodeTypeRegistry.registerNodeTypes(NodeTypeRegistry.java:109)
>> at 
>> org.apache.jackrabbit.oak.plugins.nodetype.write.NodeTypeRegistry.register(NodeTypeRegistry.java:104)
>> at 
>> org.apache.jackrabbit.oak.plugins.nodetype.write.NodeTypeRegistry.registerBuiltIn(NodeTypeRegistry.java:86)
>> at 
>> org.apache.jackrabbit.oak.plugins.nodetype.write.InitialContent.initialize(InitialContent.java:120)
>> at 
>> org.apache.jackrabbit.oak.spi.lifecycle.CompositeInitializer.initialize(CompositeInitializer.java:48)
>> at 
>> org.apache.jackrabbit.oak.spi.lifecycle.OakInitializer.initialize(OakInitializer.java:42)
>> at org.apache.jackrabbit.oak.Oak.createNewContentRepository(Oak.java:628)
>> at org.apache.jackrabbit.oak.Oak.createContentRepository(Oak.java:616)
>> at 
>> org.apache.jackrabbit.oak.jcr.Jcr.createContentRepository(Jcr.java:367)
>> at org.apache.jackrabbit.oak.jcr.Jcr.createRepository(Jcr.java:375)
>> at 
>>

Re: R: R: critical question about oak: db connection

2016-03-19 Thread Julian Reschke 

On 2016-03-17 14:46, Ancona Francesco wrote:

Hello,
i send you a maven project to connect with postgres.

As i told you in other messages i know that oak test cases work; but they start 
always with RDBDocumentStore and use UpdateOp and other Oak methods to add 
nodes.
...


Both oak-jcr and oak-run contain tests that use JCR->OAK->RDB sucessfully.

Best regards, Julian

Re: Failing SegmentToJdbcTest.validateMigration

2016-03-19 Thread Tomek Rekawek 
Hello Angela,

> On 16 Mar 2016, at 12:39, Angela Schreiber  wrote:
> 
> stepping into the AbstractOak2OakTest and finally
> RepositorySidegrade.copyState i actually see that the target NodeBuilder
> that results from copyWorkspace doesn't have the jcr:mixinTypes
> property copied from the src to the target, which consequently

Indeed, it seems there’s a bug, which causes the RepositorySidegrade to skip 
the root node properties. I think the reason lies in the 
calculateEffectiveIncludePaths() method, which produces an effective list of 
paths to migrate. If we have a ‘/‘ in the input list, the method will replace 
it with a list of ‘/‘ children and the root itself is removed from the list.

Similar issue is present in the RepositoryUpgrade, but it isn’t so dangerous 
there, as we create the root node anyway using an initializer.

Created OAK-4128 to track this.

However, the OAK-4128 is reproducible and present not only on the JDBC 
destination, so I guess the random failures (including the ones on Jenkins) are 
related to something else.

Best regards,
Tomek

-- 
Tomek Rękawek | Adobe Research | www.adobe.com
reka...@adobe.com

Re: LuceneIndexEditor message in error.log

2016-03-19 Thread Christopher Rockwell 
Hello. My apologies all. I missed the responses to my group email from Nov 
2015. I saw responses and follow-up questions in mail archive… so I’m trying to 
circle back since this index errors are still occurring.
Amit. I’m not sure whether indexing fails or not. The content json is included 
below [2] along with a stacktrace
Julian. The type of cq:lastModified is Date. I’m not sure what the index 
definition looks like. The indexes I’ve set do not use this value or page type. 
It should be one of the AEM indexes. For what it’s worth, I see the following 
from 
/system/console/jmx/org.apache.jackrabbit.oak%3Aid%3D10%2Cname%3D"Lucene+Index+statistics"%2Ctype%3D"LuceneIndex"
 

Attribute Name  Attribute Value
IndexStats  
org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexMBeanImpl
indexSize   indexSizeStrmaxDoc  numDeletedDocs  numDocs path
8238737 8.2 MB  39943   140 39803   /oak:index/lsaNews
1947451319.5 MB 36272   240 36032   /oak:index/lsaPeople
125057  125.1 kB833 2   831 /oak:index/cqTagLucene
329174  329.2 kB34553   3452/oak:index/workflowDataLucene
106259  106.3 kB334 0   334 /oak:index/authorizables
2341765 2.3 MB  21031   0   21031   /oak:index/ntBaseLucene
156566  156.6 kB416 0   416 /oak:index/cqPageLucene
9014717 9.0 MB  45401   4539/oak:index/damLucene
9695674 9.7 MB  45401   4539/oak:index/damAssetLucene
259904911   259.9 MB448741  10837   437904  /oak:index/lucene


Tue, 24 Nov 2015 12:12:43 GMT
Hi Chris,

Does the lucene indexing process fail after this warning? As you pointed
out this sounds similar to OAK-3020, which was fixed in Oak 1.2.3.
In addition can you also post the json for one of the nodes.

Thanks 
Amit
---
On Tue, Nov 24, 2015 at 3:07 AM, Julian Sedding  wrote:
> Hi Chris
>
> Two questions:
>
> 1. What is the property type of
> /content/michigan-lsa/classics/en/graduate-students/current-students/jcr:content/cq:lastModified?
> 2. Do you have an idea what the index definition looks like that is used for 
> indexing this property
>
> Regards
> Julian


[2] Here is another error message example ... 
17.03.2016 12:20:03.660 *WARN* [pool-10-thread-1] 
org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor Failed to 
index the node [/content/michigan-lsa/mcdb/en/alumni-friends/newsletter]
java.lang.IllegalArgumentException: DocValuesField 
":dvjcr:content/cq:lastModified" appears more than once in this document (only 
one value is allowed per field)
at 
org.apache.lucene.index.NumericDocValuesWriter.addValue(NumericDocValuesWriter.java:54)
at 
org.apache.lucene.index.DocValuesProcessor.addNumericField(DocValuesProcessor.java:153)
at 
org.apache.lucene.index.DocValuesProcessor.addField(DocValuesProcessor.java:66)
at 
org.apache.lucene.index.TwoStoredFieldsConsumers.addField(TwoStoredFieldsConsumers.java:36)
at 
org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:236)
at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:253)
at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:455)
at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1534)
at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1507)
at 
org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor.addOrUpdate(LuceneIndexEditor.java:302)
at 
org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor.leave(LuceneIndexEditor.java:198)
at 
org.apache.jackrabbit.oak.spi.commit.CompositeEditor.leave(CompositeEditor.java:74)
at 
org.apache.jackrabbit.oak.spi.commit.VisibleEditor.leave(VisibleEditor.java:63)
at 
org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:153)
at 
org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
at 
org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
at 
org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
at 
org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
at 
org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
at 
org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
at 
org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
at 
org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
at 
org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
at

[Oak origin/1.4] Apache Jackrabbit Oak matrix - Build # 797 - Failure

2016-03-19 Thread Apache Jenkins Server 
The Apache Jenkins build system has built Apache Jackrabbit Oak matrix (build 
#797)

Status: Failure

Check console output at 
https://builds.apache.org/job/Apache%20Jackrabbit%20Oak%20matrix/797/ to view 
the results.

Changes:
[reschke] OAK-4100: ClusterNodeInfo lease renewal: add DEBUG level logging 
(ported

[mreutegg] OAK-4131: LastRevisionRecoveryAgent may throw ClassCastException

 

Test results:
2 tests failed.
FAILED:  
org.apache.jackrabbit.oak.plugins.segment.standby.ExternalPrivateStoreIT.testProxyFlippedIntermediateByteChange2

Error Message:
expected:<{ root = { ... } }> but was:<{ root : { } }>

Stack Trace:
java.lang.AssertionError: expected:<{ root = { ... } }> but was:<{ root : { } }>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.jackrabbit.oak.plugins.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:193)
at 
org.apache.jackrabbit.oak.plugins.segment.standby.DataStoreTestBase.testProxyFlippedIntermediateByteChange2(DataStoreTestBase.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
at 
org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
at 
org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
at 
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)


FAILED:  
org.apache.jackrabbit.oak.plugins.document.BulkCreateOrUpdateClusterTest.testConcurrentWithConflict[RDBFixture:
 RDB-Derby(embedded)]

Error Message:
Thread hasn't finished in 10s

Stack Trace:
java.lang.AssertionError: Thread hasn't finished in 10s
at org.junit.Assert.fail(Assert.java:88)
at 
org.apache.jackrabbit.oak.plugins.document.BulkCreateOrUpdateClusterTest.testConcurrentWithConflict(BulkCreateOrUpdateClusterTest.java:177)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at

Re: Failing SegmentToJdbcTest.validateMigration

2016-03-19 Thread Angela Schreiber 
Hi Tomek

Thanks a lot for the confirmation and the issue!

Just as a side node: our Adobe internal repositories
_always_ have a policy node at the root. If the sidegrade
is likely to be used in real, productive environments
this should IMO be considered a critical bug.

Thanks and kind regards
Angela


On 16/03/16 14:00, "Tomek Rekawek"  wrote:

>Hello Angela,
>
>> On 16 Mar 2016, at 12:39, Angela Schreiber  wrote:
>> 
>> stepping into the AbstractOak2OakTest and finally
>> RepositorySidegrade.copyState i actually see that the target NodeBuilder
>> that results from copyWorkspace doesn't have the jcr:mixinTypes
>> property copied from the src to the target, which consequently
>
>Indeed, it seems there's a bug, which causes the RepositorySidegrade to
>skip the root node properties. I think the reason lies in the
>calculateEffectiveIncludePaths() method, which produces an effective list
>of paths to migrate. If we have a '/' in the input list, the method will
>replace it with a list of '/' children and the root itself is removed
>from the list.
>
>Similar issue is present in the RepositoryUpgrade, but it isn't so
>dangerous there, as we create the root node anyway using an initializer.
>
>Created OAK-4128 to track this.
>
>However, the OAK-4128 is reproducible and present not only on the JDBC
>destination, so I guess the random failures (including the ones on
>Jenkins) are related to something else.
>
>Best regards,
>Tomek
>
>-- 
>Tomek Rękawek | Adobe Research | www.adobe.com
>reka...@adobe.com
>

Failing SegmentToJdbcTest.validateMigration

2016-03-19 Thread Angela Schreiber 
hi oak devs

i keep getting test failure with SegmentToJdbcTest.validateMigration
every now and then but can't reliably reproduce it when debugging
the test (as thomas can confirm ;-)).

stepping into the AbstractOak2OakTest and finally
RepositorySidegrade.copyState i actually see that the target NodeBuilder
that results from copyWorkspace doesn't have the jcr:mixinTypes
property copied from the src to the target, which consequently
(and rightfully) results in the first Root.commit to fail, because
the rep:policy node present in the test-content is considered
isolated (i.e. the /-tree doesn't have the mix:AccessControllable
mixin type set, which is pretty obvious if jcr:mixinTypes property
is not copied over).

who is familiar with RepositorySidegrade and could take a closer
look what is going wrong here? i run into this when testing the changes
attached to OAK-4119 but i fail to see how those changes should impact
the copy performed by RepositorySidegrade.

kind regards
angela

PS: i also found https://issues.apache.org/jira/browse/OAK-2714
mentioning the exact same test to fail on Jenkins.

Re: R: critical question about oak: db connection

2016-03-19 Thread Julian Reschke 

Ancona,

you keep asking for more help but seem to ignore the feedback that you get.

1) oak-jcr and oak-run demonstrate that it is possible to run on RDBs; 
just run the tests. All the information that you need should be in the 
test cases.


2) Don't throw code snippets at us. Without complete classes we can try 
ourselves there is no way how we can find out what's wrong.


So either start from the existing working code, or send self-contained 
test code we can compile and run ourselves.


Best regards, Julian


On 2016-03-16 16:28, Ancona Francesco wrote:

Hi,
Oak configuration with RDBMS doesn't work yet.

I use the latest release 1.4.0 but i have the same problem

In particular this is the code i use to initialize Oak

 final DocumentMK.Builder builder = new DocumentMK.Builder();
 builder.setBlobStore(createFileSystemBlobStore());
 final DocumentNodeStore ns = getRDBDocumentNodeStore(builder);

// ds is datasource form postgres 9.4
DocumentStore documentStore = new RDBDocumentStore(ds, builder);
 builder.setDocumentStore(documentStore);
 DocumentNodeStore ns = new DocumentNodeStore(builder);
 DocumentNodeStore ns1 = new 
DocumentMK.Builder().setDocumentStore(documentStore).getNodeStore();
 InitialContent ic = new InitialContent();
 Oak oak = new Oak(ns1).with(ic);
 Jcr jcr = new Jcr(oak);
 Repository repo = jcr.createRepository();


and this is the stack trace:
java.lang.IllegalStateException: This tree does not exist
 at 
org.apache.jackrabbit.oak.core.MutableTree.beforeWrite(MutableTree.java:353)
 at 
org.apache.jackrabbit.oak.core.MutableTree.setProperty(MutableTree.java:232)
 at 
org.apache.jackrabbit.oak.plugins.name.ReadWriteNamespaceRegistry.registerNamespace(ReadWriteNamespaceRegistry.java:92)
 at 
org.apache.jackrabbit.commons.cnd.TemplateBuilderFactory.setNamespace(TemplateBuilderFactory.java:92)
 at 
org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.doNameSpace(CompactNodeTypeDefReader.java:246)
 at 
org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.parse(CompactNodeTypeDefReader.java:200)
 at 
org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.(CompactNodeTypeDefReader.java:163)
 at 
org.apache.jackrabbit.commons.cnd.CompactNodeTypeDefReader.(CompactNodeTypeDefReader.java:139)
 at 
org.apache.jackrabbit.commons.cnd.CndImporter.registerNodeTypes(CndImporter.java:147)
 at 
org.apache.jackrabbit.oak.plugins.nodetype.write.NodeTypeRegistry.registerNodeTypes(NodeTypeRegistry.java:109)
 at 
org.apache.jackrabbit.oak.plugins.nodetype.write.NodeTypeRegistry.register(NodeTypeRegistry.java:104)
 at 
org.apache.jackrabbit.oak.plugins.nodetype.write.NodeTypeRegistry.registerBuiltIn(NodeTypeRegistry.java:86)
 at 
org.apache.jackrabbit.oak.plugins.nodetype.write.InitialContent.initialize(InitialContent.java:120)
 at 
org.apache.jackrabbit.oak.spi.lifecycle.CompositeInitializer.initialize(CompositeInitializer.java:48)
 at 
org.apache.jackrabbit.oak.spi.lifecycle.OakInitializer.initialize(OakInitializer.java:42)
 at org.apache.jackrabbit.oak.Oak.createNewContentRepository(Oak.java:628)
 at org.apache.jackrabbit.oak.Oak.createContentRepository(Oak.java:616)
 at org.apache.jackrabbit.oak.jcr.Jcr.createContentRepository(Jcr.java:367)
 at org.apache.jackrabbit.oak.jcr.Jcr.createRepository(Jcr.java:375)
 at 
it.siav.jarvis.testplatform.ecm.common.OakRDBMSTest.test(OakRDBMSTest.java:74)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:497)
 at 
org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:85)
 at 
org.testng.internal.MethodInvocationHelper$1.runTestMethod(MethodInvocationHelper.java:196)
 at 
org.springframework.test.context.testng.AbstractTestNGSpringContextTests.run(AbstractTestNGSpringContextTests.java:175)
 at 
org.testng.internal.MethodInvocationHelper.invokeHookable(MethodInvocationHelper.java:208)
 at org.testng.internal.Invoker.invokeMethod(Invoker.java:641)
 at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:834)
 at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1142)
 at 
org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:124)
 at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:108)
 at org.testng.TestRunner.privateRun(TestRunner.java:771)
 at org.testng.TestRunner.run(TestRunner.java:621)
 at org.testng.SuiteRunner.runTest(SuiteRunner.java:357)
 at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:352)
 at org.testng.SuiteRunner.privateRun(SuiteRunner.java:310)
 at

[Oak origin/trunk] Apache Jackrabbit Oak matrix - Build # 794 - Still Failing

2016-03-19 Thread Apache Jenkins Server 
The Apache Jenkins build system has built Apache Jackrabbit Oak matrix (build 
#794)

Status: Still Failing

Check console output at 
https://builds.apache.org/job/Apache%20Jackrabbit%20Oak%20matrix/794/ to view 
the results.

Changes:
[angela] OAK-4118 : Benchmarks for Membership Operations (enhance

[catholicon] OAK-4126: Sugesstion and spellcheck queries throw exception if 
result

[angela] minor improvement: refactor code duplication

[angela] minor improvement

[angela] minor improvement: move ExternalLoginModuleFactoryTest to external.impl

[thomasm] OAK-4123 Persistent cache: allow to configure the add data concurrency

[angela] OAK-3563 : Improve DefaultSyncContext

[thomasm] OAK-4065 Counter index can get out of sync

[reschke] OAK-4125: fix potential timing issue in RDBBlobStoreTest

[angela] OAK-3886 : Delegate supported Credentials types to

 

Test results:
2 tests failed.
FAILED:  
org.apache.jackrabbit.oak.plugins.segment.standby.FailoverSslTestIT.testFailoverSecure

Error Message:
expected:<{ root = { ... } }> but was:<{ root : { } }>

Stack Trace:
java.lang.AssertionError: expected:<{ root = { ... } }> but was:<{ root : { } }>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.jackrabbit.oak.plugins.segment.standby.FailoverSslTestIT.testFailoverSecure(FailoverSslTestIT.java:58)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
at 
org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
at 
org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
at 
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)


FAILED:  
org.apache.jackrabbit.oak.plugins.segment.standby.ExternalPrivateStoreIT.testProxyFlippedStartByte

Error Message:
expected:<{ root = { ... } }> but was:<{ root : { } }>

Stack Trace:
java.lang.AssertionError: expected:<{ root = { ... } }> but was:<{ root : { } }>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.jackrabbit.oak.plugins.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:193)
at