Hello. My apologies all. I missed the responses to my group email from Nov 2015. I saw responses and follow-up questions in mail archive… so I’m trying to circle back since this index errors are still occurring. Amit. I’m not sure whether indexing fails or not. The content json is included below [2] along with a stacktrace Julian. The type of cq:lastModified is Date. I’m not sure what the index definition looks like. The indexes I’ve set do not use this value or page type. It should be one of the AEM indexes. For what it’s worth, I see the following from /system/console/jmx/org.apache.jackrabbit.oak%3Aid%3D10%2Cname%3D"Lucene+Index+statistics"%2Ctype%3D"LuceneIndex"
Attribute Name Attribute Value IndexStats org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexMBeanImpl indexSize indexSizeStr maxDoc numDeletedDocs numDocs path 8238737 8.2 MB 39943 140 39803 /oak:index/lsaNews 19474513 19.5 MB 36272 240 36032 /oak:index/lsaPeople 125057 125.1 kB 833 2 831 /oak:index/cqTagLucene 329174 329.2 kB 3455 3 3452 /oak:index/workflowDataLucene 106259 106.3 kB 334 0 334 /oak:index/authorizables 2341765 2.3 MB 21031 0 21031 /oak:index/ntBaseLucene 156566 156.6 kB 416 0 416 /oak:index/cqPageLucene 9014717 9.0 MB 4540 1 4539 /oak:index/damLucene 9695674 9.7 MB 4540 1 4539 /oak:index/damAssetLucene 259904911 259.9 MB 448741 10837 437904 /oak:index/lucene -------- Tue, 24 Nov 2015 12:12:43 GMT Hi Chris, Does the lucene indexing process fail after this warning? As you pointed out this sounds similar to OAK-3020, which was fixed in Oak 1.2.3. In addition can you also post the json for one of the nodes. Thanks Amit ------- On Tue, Nov 24, 2015 at 3:07 AM, Julian Sedding <[email protected]> wrote: > Hi Chris > > Two questions: > > 1. What is the property type of > /content/michigan-lsa/classics/en/graduate-students/current-students/jcr:content/cq:lastModified? > 2. Do you have an idea what the index definition looks like that is used for > indexing this property > > Regards > Julian ---- [2] Here is another error message example ... 17.03.2016 12:20:03.660 *WARN* [pool-10-thread-1] org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor Failed to index the node [/content/michigan-lsa/mcdb/en/alumni-friends/newsletter] java.lang.IllegalArgumentException: DocValuesField ":dvjcr:content/cq:lastModified" appears more than once in this document (only one value is allowed per field) at org.apache.lucene.index.NumericDocValuesWriter.addValue(NumericDocValuesWriter.java:54) at org.apache.lucene.index.DocValuesProcessor.addNumericField(DocValuesProcessor.java:153) at org.apache.lucene.index.DocValuesProcessor.addField(DocValuesProcessor.java:66) at org.apache.lucene.index.TwoStoredFieldsConsumers.addField(TwoStoredFieldsConsumers.java:36) at org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:236) at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:253) at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:455) at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1534) at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1507) at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor.addOrUpdate(LuceneIndexEditor.java:302) at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor.leave(LuceneIndexEditor.java:198) at org.apache.jackrabbit.oak.spi.commit.CompositeEditor.leave(CompositeEditor.java:74) at org.apache.jackrabbit.oak.spi.commit.VisibleEditor.leave(VisibleEditor.java:63) at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:153) at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418) at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148) at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418) at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148) at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418) at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148) at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418) at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148) at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418) at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148) at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:487) at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) at org.apache.jackrabbit.oak.spi.commit.EditorDiff.process(EditorDiff.java:52) at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.updateIndex(AsyncIndexUpdate.java:376) at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.run(AsyncIndexUpdate.java:318) at org.apache.sling.commons.scheduler.impl.QuartzJobExecutor.execute(QuartzJobExecutor.java:105) at org.quartz.core.JobRunShell.run(JobRunShell.java:202) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) And here is an example json content for a page that had the problem… { jcr:primaryType: "cq:Page", jcr:createdBy: "ksumrall", jcr:created: "Thu Mar 17 2016 12:08:28 GMT-0400", jcr:content: { jcr:primaryType: "cq:PageContent", jcr:createdBy: "ksuddmrall", jcr:title: "Newsletter", cq:template: "/apps/michigan-lsa/templates/department_sub", jcr:created: "Thu Mar 17 2016 12:08:28 GMT-0400", cq:lastModified: "Thu Mar 17 2016 12:20:25 GMT-0400", sling:resourceType: "michigan-lsa/components/pages/department_sub", cq:designPath: "/etc/designs/michigan-lsa", cq:lastModifiedBy: "ksumrall", par: { jcr:primaryType: "nt:unstructured", sling:resourceType: "wcm/foundation/components/parsys", button: { jcr:primaryType: "nt:unstructured", wrapping: true, jcr:createdBy: "ksumrall", jcr:lastModifiedBy: "ksumrall", jcr:created: "Thu Mar 17 2016 12:09:40 GMT-0400", link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2012.pdf", text: "2012 MCDB Newsletter", width: "normal", textPosition: "left", jcr:lastModified: "Thu Mar 17 2016 12:12:31 GMT-0400", sling:resourceType: "michigan-lsa/components/button" }, button_1102522790: { jcr:primaryType: "nt:unstructured", wrapping: true, jcr:createdBy: "ksumrall", jcr:lastModifiedBy: "ksumrall", jcr:created: "Thu Mar 17 2016 12:12:39 GMT-0400", link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2011.pdf", text: "2011 MCDB Newsletter", width: "normal", textPosition: "left", jcr:lastModified: "Thu Mar 17 2016 12:14:57 GMT-0400", sling:resourceType: "michigan-lsa/components/button" }, button_475415812: { jcr:primaryType: "nt:unstructured", wrapping: true, jcr:createdBy: "ksumrall", jcr:lastModifiedBy: "ksumrall", jcr:created: "Thu Mar 17 2016 12:14:25 GMT-0400", link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2009.pdf", text: "2009 MCDB Newsletter", width: "normal", textPosition: "left", jcr:lastModified: "Thu Mar 17 2016 12:15:21 GMT-0400", sling:resourceType: "michigan-lsa/components/button" }, button_850480106: { jcr:primaryType: "nt:unstructured", wrapping: true, jcr:createdBy: "ksumrall", jcr:lastModifiedBy: "ksumrall", jcr:created: "Thu Mar 17 2016 12:14:26 GMT-0400", link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2008.pdf", text: "2008 MCDB Newsletter", width: "normal", textPosition: "left", jcr:lastModified: "Thu Mar 17 2016 12:15:44 GMT-0400", sling:resourceType: "michigan-lsa/components/button" }, button_1316341457: { jcr:primaryType: "nt:unstructured", wrapping: true, jcr:createdBy: "ksumrall", jcr:lastModifiedBy: "ksumrall", jcr:created: "Thu Mar 17 2016 12:14:34 GMT-0400", link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2007.pdf", text: "2007 MCDB Newsletter", width: "normal", textPosition: "left", jcr:lastModified: "Thu Mar 17 2016 12:17:05 GMT-0400", sling:resourceType: "michigan-lsa/components/button" }, button_1888841713: { jcr:primaryType: "nt:unstructured", wrapping: true, jcr:createdBy: "ksumrall", jcr:lastModifiedBy: "ksumrall", jcr:created: "Thu Mar 17 2016 12:14:35 GMT-0400", link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2006.pdf", text: "2006 MCDB Newsletter", width: "normal", textPosition: "left", jcr:lastModified: "Thu Mar 17 2016 12:17:23 GMT-0400", sling:resourceType: "michigan-lsa/components/button" }, button_1741156277: { jcr:primaryType: "nt:unstructured", wrapping: true, jcr:createdBy: "ksumrall", jcr:lastModifiedBy: "ksumrall", jcr:created: "Thu Mar 17 2016 12:14:35 GMT-0400", link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2005.pdf", text: "2005 MCDB Newsletter", width: "normal", textPosition: "left", jcr:lastModified: "Thu Mar 17 2016 12:17:42 GMT-0400", sling:resourceType: "michigan-lsa/components/button" }, button_156841819: { jcr:primaryType: "nt:unstructured", wrapping: true, jcr:createdBy: "ksumrall", jcr:lastModifiedBy: "ksumrall", jcr:created: "Thu Mar 17 2016 12:14:35 GMT-0400", link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2004.pdf", text: "2004 MCDB Newsletter", width: "normal", textPosition: "left", jcr:lastModified: "Thu Mar 17 2016 12:17:59 GMT-0400", sling:resourceType: "michigan-lsa/components/button" }, button_842469556: { jcr:primaryType: "nt:unstructured", wrapping: true, jcr:createdBy: "ksumrall", jcr:lastModifiedBy: "ksumrall", jcr:created: "Thu Mar 17 2016 12:18:12 GMT-0400", link: "/content/dam/mcdb-assets/mcdb-documents/newsletter03.pdf", text: "2003 MCDB Newsletter", width: "normal", textPosition: "left", jcr:lastModified: "Thu Mar 17 2016 12:20:01 GMT-0400", sling:resourceType: "michigan-lsa/components/button" }, button_1413621409: { jcr:primaryType: "nt:unstructured", wrapping: true, jcr:createdBy: "ksumrall", jcr:lastModifiedBy: "ksumrall", jcr:created: "Thu Mar 17 2016 12:18:12 GMT-0400", link: "/content/dam/mcdb-assets/mcdb-documents/newsletter01.pdf", text: "2001 MCDB Newsletter", width: "normal", textPosition: "left", jcr:lastModified: "Thu Mar 17 2016 12:20:25 GMT-0400", sling:resourceType: "michigan-lsa/components/button" } } } } > On Nov 23, 2015, at 1:38 PM, Chris <[email protected]> wrote: > > Hello. We are running Oak v1.2.4 in AEM6.1. After upgrading to AEM6.1 I see > the error message below repeated 1000+ times a day in the error log. The logs > refer to many different content nodes, not just this example. We have also > have already requested Daycare support. The response indicated that this log > message might be related to OAK-3020 [1]. So far the system continues to > operate, but it seems like a major warning sign if indexing continues to fail > at this rate. Can anyone provide suggestions? > > 19.11.2015 10:08:37.561 *WARN* [pool-9-thread-4] > org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor Failed to > index the node > [/content/michigan-lsa/classics/en/graduate-students/current-students] > java.lang.IllegalArgumentException: DocValuesField > ":dvjcr:content/cq:lastModified" appears more than once in this document > (only one value is allowed per field) > at > org.apache.lucene.index.NumericDocValuesWriter.addValue(NumericDocValuesWriter.java:54) > at > org.apache.lucene.index.DocValuesProcessor.addNumericField(DocValuesProcessor.java:153) > at > org.apache.lucene.index.DocValuesProcessor.addField(DocValuesProcessor.java:66) > at > org.apache.lucene.index.TwoStoredFieldsConsumers.addField(TwoStoredFieldsConsumers.java:36) > at > org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:236) > at > org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:253) > at > org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:455) > at > org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1534) > at > org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1507) > at > org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor.addOrUpdate(LuceneIndexEditor.java:302) > at > org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor.leave(LuceneIndexEditor.java:198) > at > org.apache.jackrabbit.oak.spi.commit.CompositeEditor.leave(CompositeEditor.java:74) > at > org.apache.jackrabbit.oak.spi.commit.VisibleEditor.leave(VisibleEditor.java:63) > at > org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:153) > at > org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418) > at > org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) > at > org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148) > at > org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418) > at > org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) > at > org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148) > at > org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418) > at > org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) > at > org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148) > at > org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418) > at > org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) > at > org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148) > at > org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418) > at > org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) > at > org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148) > at > org.apache.jackrabbit.oak.plugins.segment.MapRecord$2.childNodeChanged(MapRecord.java:403) > at > org.apache.jackrabbit.oak.plugins.segment.MapRecord$3.childNodeChanged(MapRecord.java:444) > at > org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:487) > at > org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:436) > at > org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:394) > at > org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583) > at > org.apache.jackrabbit.oak.spi.commit.EditorDiff.process(EditorDiff.java:52) > at > org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.updateIndex(AsyncIndexUpdate.java:376) > at > org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.run(AsyncIndexUpdate.java:318) > at > org.apache.sling.commons.scheduler.impl.QuartzJobExecutor.execute(QuartzJobExecutor.java:105) > at org.quartz.core.JobRunShell.run(JobRunShell.java:202) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > > [1] with https://issues.apache.org/jira/browse/OAK-3020
