[jira] [Commented] (SOLR-5514) atomic update throws exception if the schema contains uuid fields: Invalid UUID String: 'java.util.UUID:e26c4d56-e98d-41de-9b7f-f63192089670'
[ https://issues.apache.org/jira/browse/SOLR-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879794#comment-13879794 ] Arun Kumar commented on SOLR-5514: -- Hi Dirk, Is this still an issue? I am not able to reproduce. Can you please confirm? atomic update throws exception if the schema contains uuid fields: Invalid UUID String: 'java.util.UUID:e26c4d56-e98d-41de-9b7f-f63192089670' - Key: SOLR-5514 URL: https://issues.apache.org/jira/browse/SOLR-5514 Project: Solr Issue Type: Bug Affects Versions: 4.5.1 Environment: unix and windows Reporter: Dirk Reuss Assignee: Shalin Shekhar Mangar I am updating an exiting document with the statement adddocfield name='name' update='set'newvalue/field All fields are stored and I have several UUID fields. About 10-20% of the update commands will fail with the message: (example) Invalid UUID String: 'java.util.UUID:532c9353-d391-4a04-8618-dc2fa1ef8b35' the point is that java.util.UUID seems to be prepended to the original uuid stored in the field and when the value is written this error occours. I tried to check if this specific uuid field was the problem and added the uuid field in the update xml with(field name='id1' update='set'...). But the error simply moved to an other uuid field. here is the original exception: lst name=responseHeaderint name=status500/intint name=QTime34/int/lstlst name=errorstr name=msgError while creating field 'MyUUIDField{type=uuid,properties=indexed,stored,omitTermFreqAndPositions,required, required=true}' from value 'java.util.UUID:e26c4d56-e98d-41de-9b7f-f63192089670'/strstr name=traceorg.apache.solr.common.SolrException: Error while creating field 'MyUUIDField{type=uuid,properties=indexed,stored,omitTermFreqAndPositions,required, required=true}' from value 'java.util.UUID:e26c4d56-e98d-41de-9b7f-f63192089670' at org.apache.solr.schema.FieldType.createField(FieldType.java:259) at org.apache.solr.schema.StrField.createFields(StrField.java:56) at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:47) at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:118) at org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:77) at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:215) at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:556) at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:692) at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:435) at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100) at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247) at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:703) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:406) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:195) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) at
[jira] [Updated] (SOLR-5477) Async execution of OverseerCollectionProcessor tasks
[ https://issues.apache.org/jira/browse/SOLR-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5477: --- Attachment: SOLR-5477.patch Still a lot of stuff to be added/fixed but here's another patch so that if someone is interested, he/she could get some idea on the direction in which I'm moving. Here's what's been fixed/changed in this patch: * Standardized the request parameters for CoreAdmin and Collection level request status. Parameters now are : action=REQUESTSTATUSrequestid=XX * Added async option for all other calls (not just splitshard and createcollection). * Fixed the encoding related stuff and the potential NPEs where ever I could spot those. * Removed unused code and cleaned up some debugging stuff. * Used a ThreadPool in case of coreadmin in a rather raw manner i.e. static (and without the mode check etc). Have added todo's to add those checks and to also call shutdown for the threadpool. * Changed names of the queues to the ones suggested by Shalin. * Items are no longer being put in the completed queue in Overseer. * Ran ant check-forbidden-apis to fix reported issues. Here's what still lies with me incomplete/not-working: * Make shard requests async (pass the param to coreadmin requests and poll for completion/failure) from the OverseerCollectionProcessor. * Have a threadpool for OverseerCollectionProcessor so that the long running tasks don't block everything else. * Improve current tests and add more tests. Async execution of OverseerCollectionProcessor tasks Key: SOLR-5477 URL: https://issues.apache.org/jira/browse/SOLR-5477 Project: Solr Issue Type: Sub-task Components: SolrCloud Reporter: Noble Paul Assignee: Anshum Gupta Attachments: SOLR-5477-CoreAdminStatus.patch, SOLR-5477.patch, SOLR-5477.patch, SOLR-5477.patch Typical collection admin commands are long running and it is very common to have the requests get timed out. It is more of a problem if the cluster is very large.Add an option to run these commands asynchronously add an extra param async=true for all collection commands the task is written to ZK and the caller is returned a task id. as separate collection admin command will be added to poll the status of the task command=statusid=7657668909 if id is not passed all running async tasks should be listed A separate queue is created to store in-process tasks . After the tasks are completed the queue entry is removed. OverSeerColectionProcessor will perform these tasks in multiple threads -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Created] (SOLR-5658) commitWithin does not reflect the new documents added
Varun Thacker created SOLR-5658: --- Summary: commitWithin does not reflect the new documents added Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 Node 2: 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush Node 3: Node 4: 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@36137e08 main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)} 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 384554 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@36137e08 main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)} 389545 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start
[jira] [Assigned] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shalin Shekhar Mangar reassigned SOLR-5658: --- Assignee: Shalin Shekhar Mangar commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 Node 2: 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush Node 3: Node 4: 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@36137e08 main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)} 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore –
[jira] [Updated] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shalin Shekhar Mangar updated SOLR-5658: Description: I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@36137e08 main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)} 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 384554 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@36137e08 main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)} 389545 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 389549
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879844#comment-13879844 ] Shalin Shekhar Mangar commented on SOLR-5658: - Thanks for reporting this Varun. The thing to note between the 4.5 logs and the 4.6.x logs is that in 4.5, there are two commit statements per node (1 soft commit with openSearcher=true and another hard commit with openSearcher=false) whereas in 4.6.x there is only one commit (hard commit with openSearcher=false). We need to find out why. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879849#comment-13879849 ] Shalin Shekhar Mangar commented on SOLR-5658: - Also reported by a user (thanks Varun for pointing it out to me privately): http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553
Re: [VOTE] Release Lucene/Solr 4.6.1 RC3
+1 SUCCESS! [0:38:52.784699] Mike McCandless http://blog.mikemccandless.com On Thu, Jan 23, 2014 at 1:10 AM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: +1 SUCCESS! [1:08:11.734266] On Thu, Jan 23, 2014 at 9:32 AM, Mark Miller markrmil...@gmail.com wrote: Please vote to release the following artifacts: http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560491/ Here is my +1. SUCCESS! [0:50:55.923056] -- - Mark -- Regards, Shalin Shekhar Mangar. - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5409) ToParentBlockJoinCollector.getTopGroups returns empty Groups
[ https://issues.apache.org/jira/browse/LUCENE-5409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879858#comment-13879858 ] Michael McCandless commented on LUCENE-5409: Hmm, maybe a BooleanQuery containing just a single TermQuery? Or, maybe create a custom Query for this test that wraps another query but has its own unusual hashCode() impl... ToParentBlockJoinCollector.getTopGroups returns empty Groups Key: LUCENE-5409 URL: https://issues.apache.org/jira/browse/LUCENE-5409 Project: Lucene - Core Issue Type: Bug Components: core/search Affects Versions: 4.6 Environment: Ubuntu 12.04 Reporter: Peng Cheng Assignee: Michael McCandless Priority: Critical Fix For: 4.7 Original Estimate: 168h Remaining Estimate: 168h A bug is observed to cause unstable results returned by the getTopGroups function of class ToParentBlockJoinCollector. In the scorer generation stage, the ToParentBlockJoinCollector will automatically rewrite all the associated ToParentBlockJoinQuery (and their subqueries), and save them into its in-memory Look-up table, namely joinQueryID (see enroll() method for detail). Unfortunately, in the getTopGroups method, the new ToParentBlockJoinQuery parameter is not rewritten (at least users are not expected to do so). When the new one is searched in the old lookup table (considering the impact of rewrite() on hashCode()), the lookup will largely fail and eventually end up with a topGroup collection consisting of only empty groups (their hitCounts are guaranteed to be zero). An easy fix would be to rewrite the original BlockJoinQuery before invoking getTopGroups method. However, the computational cost of this is not optimal. A better but slightly more complex solution would be to save unrewrited Queries into the lookup table. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser
[ https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879868#comment-13879868 ] Upayavira commented on LUCENE-5410: --- If the point of this query parser is to support the sort of thing that users type into search boxes, are they likely to enter fuzzy or phrase slop searches? This seems unlikely to me, and seems to take a SimpleQueryParser away from being simple. I'd suggest that if that functionality is to be added, it should be added somewhere where it is under programmatic control, not user control, such as how the edismax query parser accepts additional request parameters. Thus ps=2 would set a phrase slop. fs=2 could set a value of 2 for fuzzy search also. This would seem more in keeping with the goal of a clean, simple query parser. Add fuzziness support to SimpleQueryParser -- Key: LUCENE-5410 URL: https://issues.apache.org/jira/browse/LUCENE-5410 Project: Lucene - Core Issue Type: Improvement Components: core/queryparser Affects Versions: 4.7 Reporter: Lee Hinman Priority: Minor Attachments: LUCENE-5410.patch Original Estimate: 168h Remaining Estimate: 168h It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so that: {{foo~2}} generates a {{FuzzyQuery}} with an max edit distance of 2 and: {{foo bar~2}} generates a {{PhraseQuery}} with a slop of 2. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-5473) Make one state.json per collection
[ https://issues.apache.org/jira/browse/SOLR-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noble Paul updated SOLR-5473: - Attachment: SOLR-5473.patch updated to trunk Make one state.json per collection -- Key: SOLR-5473 URL: https://issues.apache.org/jira/browse/SOLR-5473 Project: Solr Issue Type: Sub-task Components: SolrCloud Reporter: Noble Paul Assignee: Noble Paul Attachments: SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch As defined in the parent issue, store the states of each collection under /collections/collectionname/state.json node -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Created] (SOLR-5659) Ignore or throw proper error message for bad delete containing bad composite ID
Markus Jelsma created SOLR-5659: --- Summary: Ignore or throw proper error message for bad delete containing bad composite ID Key: SOLR-5659 URL: https://issues.apache.org/jira/browse/SOLR-5659 Project: Solr Issue Type: Bug Components: SolrCloud Affects Versions: 5.0 Environment: 5.0-SNAPSHOT 1480985:1559676M - markus - 2014-01-20 13:48:08 Reporter: Markus Jelsma Fix For: 5.0 The following error is thrown when sending deleteById via SolrJ with ID ending with an exclamation mark, it is also the case for deletes by id via the URL. For some curious reason delete by query using the id field does not fail, but i would expect the same behaviour. * fails: /solr/update?commit=truestream.body=deleteida!/id/delete * ok: /solr/update?commit=truestream.body=deletequeryid:a!/query/delete {code} 2014-01-22 15:32:48,826 ERROR [solr.core.SolrCore] - [http-8080-exec-5] - : java.lang.ArrayIndexOutOfBoundsException: 1 at org.apache.solr.common.cloud.CompositeIdRouter$KeyParser.getHash(CompositeIdRouter.java:291) at org.apache.solr.common.cloud.CompositeIdRouter.sliceHash(CompositeIdRouter.java:58) at org.apache.solr.common.cloud.HashBasedRouter.getTargetSlice(HashBasedRouter.java:33) at org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:218) at org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:961) at org.apache.solr.update.processor.UpdateRequestProcessor.processDelete(UpdateRequestProcessor.java:55) at org.apache.solr.handler.loader.XMLLoader.processDelete(XMLLoader.java:347) at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:278) at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1915) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:785) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:203) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889) at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:744) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2282) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) {code} See also: http://lucene.472066.n3.nabble.com/AIOOBException-on-trunk-since-21st-or-22nd-build-td4112753.html -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [VOTE] Release Lucene/Solr 4.6.1 RC3
+1 SUCCESS! [0:37:34.283758] On Wed, Jan 22, 2014 at 11:02 PM, Mark Miller markrmil...@gmail.com wrote: Please vote to release the following artifacts: http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560491/ Here is my +1. SUCCESS! [0:50:55.923056] -- - Mark
[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser
[ https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879952#comment-13879952 ] Robert Muir commented on LUCENE-5410: - Upayavira: I see your point, however one of the key advantages of this parser is the ability to selectively enable or disable any operator. The same arguments could be made for prefix queries or even the NOT operator (-), so it was added with that in mind (as well as to provide a way to do multiword synonyms: disable WHITESPACE). As far as setting a parameter to make every term fuzzy, I don't think thats a good idea. In such a case I really think you should do n-gram indexing :) Add fuzziness support to SimpleQueryParser -- Key: LUCENE-5410 URL: https://issues.apache.org/jira/browse/LUCENE-5410 Project: Lucene - Core Issue Type: Improvement Components: core/queryparser Affects Versions: 4.7 Reporter: Lee Hinman Priority: Minor Attachments: LUCENE-5410.patch Original Estimate: 168h Remaining Estimate: 168h It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so that: {{foo~2}} generates a {{FuzzyQuery}} with an max edit distance of 2 and: {{foo bar~2}} generates a {{PhraseQuery}} with a slop of 2. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879998#comment-13879998 ] Mark Miller commented on SOLR-5658: --- This is probably related to what params we pass on and which we filter out in DistributedUpdateProcessor. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@36137e08
[jira] [Updated] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller updated SOLR-5658: -- Attachment: SOLR-5658.patch commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@36137e08 main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)} 384553 [searcherExecutor-5-thread-1]
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880013#comment-13880013 ] Mark Miller commented on SOLR-5658: --- Patch adds a test and forwards on the commitWithin param. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@36137e08
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880073#comment-13880073 ] Shalin Shekhar Mangar commented on SOLR-5658: - Thanks Mark. Should we re-spin 4.6.1 for this? commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@36137e08
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880086#comment-13880086 ] Mark Miller commented on SOLR-5658: --- I don't know. If there is support for it, I'm certainly willing to do it, but I'm not sure it's worth an RC4 myself. I think this issue has been around a very long time, and it's just random luck something seemed like it worked on 4.5.1 or older in any simple testing. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880114#comment-13880114 ] Daniel Collins commented on SOLR-5658: -- Mark, what's the impact of this issue? Are you saying that soft commits were never distributed (which seems quite a big deal!), or is it more subtle than that? commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO
[jira] [Comment Edited] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880114#comment-13880114 ] Daniel Collins edited comment on SOLR-5658 at 1/23/14 5:38 PM: --- Mark, what's the impact of this issue? Are you saying that CommitWithin was never distributed (which seems quite a big deal!), or is it more subtle than that? was (Author: dancollins): Mark, what's the impact of this issue? Are you saying that soft commits were never distributed (which seems quite a big deal!), or is it more subtle than that? commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880117#comment-13880117 ] Mark Miller commented on SOLR-5658: --- Right - it was not distributed. Not since we started filtering most parameters, which was a very long time ago. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener
Re: [VOTE] Release Lucene/Solr 4.6.1 RC3
There is some discussion around an RC4 at https://issues.apache.org/jira/browse/SOLR-5658 if anyone wants to weigh in. - Mark On Jan 22, 2014, at 11:02 PM, Mark Miller markrmil...@gmail.com wrote: Please vote to release the following artifacts: http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560491/ Here is my +1. SUCCESS! [0:50:55.923056] -- - Mark
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880139#comment-13880139 ] Daniel Collins commented on SOLR-5658: -- Ok, was just puzzled about how our system is working then (4.4.0), we consistently see softCommits running on the replicas, maybe it is autoCommit firing instead... commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1]
[jira] [Commented] (SOLR-5488) Fix up test failures for Analytics Component
[ https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880182#comment-13880182 ] Steven Bower commented on SOLR-5488: [~erike4...@yahoo.com] Sorry for the delay.. I am looking at this today.. I think i was able to reproduce on my windows box using the 10k iters above... Fix up test failures for Analytics Component Key: SOLR-5488 URL: https://issues.apache.org/jira/browse/SOLR-5488 Project: Solr Issue Type: Bug Affects Versions: 5.0, 4.7 Reporter: Erick Erickson Assignee: Erick Erickson Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch The analytics component has a few test failures, perhaps environment-dependent. This is just to collect the test fixes in one place for convenience when we merge back into 4.x -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...
[ https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Rowe updated SOLR-5652: - Attachment: 129.log On OS X Mavericks with Apple Java 1.6.0_65 on branch_4x I ran {{ant -Dtestcase=DistribCursorPaginTest}} in {{solr/core/}} in a bash loop to try to find failures with reproducible seeds. Out of a little over 400 trials, 5 failed. Below is the repro line from one I picked at random (trial #129) to attempt to reproduce. I've re-run it six times, and the failure reproduced the first time, but the test succeeded each of the following five times. (I tried a seventh time, but performed {{ant clean}} at the top-level directory first, and it still didn't reproduce.) {noformat} ant test -Dtestcase=DistribCursorPagingTest -Dtests.method=testDistribSearch -Dtests.seed=55FB0127DC22CD98 -Dtests.slow=true -Dtests.locale=en_AU -Dtests.timezone=Atlantic/Madeira -Dtests.file.encoding=US-ASCII {noformat} I'm attaching the test log ({{129.log}}) from the original failure with the above seed. Heisenbug in DistribCursorPagingTest: walk already seen ... - Key: SOLR-5652 URL: https://issues.apache.org/jira/browse/SOLR-5652 Project: Solr Issue Type: Bug Reporter: Hoss Man Assignee: Hoss Man Attachments: 129.log, jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1200.log.txt, jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1217.log.txt Twice now, Uwe's jenkins has encountered a walk already seen ... assertion failure from DistribCursorPagingTest that I've been unable to fathom, let alone reproduce. Using this as a tracking issue to try and make sense of it. Summary of things noticed so far (in 2 failures): * So far only seen on http://jenkins.thetaphi.de * So far only seen on MacOSX * So far only seen on branch 4x * So far seen on both Java6 and Java7 * fails occured in first block of randomized testing: ** we've indexed a small number of randomized docs ** we're explicitly looping over every field and sorting in both directions * fails were both when sorting on one of the \*_dv_last desc fields (docValues=true, sortMissingLast=true) ** sort on same field asc has always worked fine just before this (fields are in arbitrary order, but asc always tried before desc) ** sorting on some other random fields has sometimes been tried before this and worked (specifics of each failure seen in the wild recorded in comments) -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2366) Facet Range Gaps
[ https://issues.apache.org/jira/browse/SOLR-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880220#comment-13880220 ] Ted Sullivan commented on SOLR-2366: At the very least, we should revise the discussion of this feature on the SimpleFacetParameters Wiki page. The Wiki page does contain a disclaimer The following section on variable width gaps discusses uncommitted code but the comment is anchored to Solr 3.6, Solr4.0 so person might reasonably expect that it has been released by now (Solr 4.6). Facet Range Gaps Key: SOLR-2366 URL: https://issues.apache.org/jira/browse/SOLR-2366 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Shalin Shekhar Mangar Priority: Minor Fix For: 4.7 Attachments: SOLR-2366.patch, SOLR-2366.patch There really is no reason why the range gap for date and numeric faceting needs to be evenly spaced. For instance, if and when SOLR-1581 is completed and one were doing spatial distance calculations, one could facet by function into 3 different sized buckets: walking distance (0-5KM), driving distance (5KM-150KM) and everything else (150KM+), for instance. We should be able to quantize the results into arbitrarily sized buckets. (Original syntax proposal removed, see discussion for concrete syntax) -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880226#comment-13880226 ] Shalin Shekhar Mangar commented on SOLR-5658: - bq. I think this issue has been around a very long time, and it's just random luck something seemed like it worked on 4.5.1 or older in any simple testing. I'm not sure about that. The commitWithin is also set in the AddUpdateCommand in addition to the request params. I ran your test against 4.5 without the fix for 5 times and it didn't fail. But it never passes with trunk (without the fix) so I think there may be another bug introduced with the streaming changes. I'll look at this again tomorrow my time. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880244#comment-13880244 ] Mark Miller commented on SOLR-5658: --- I think it just depends on if it's a request wide or document level commitWithin? If it was request level, the only way it would have worked previously is if there was some code that looked for the commitWithin param explicitly and set the commitWithin on the AddUpdateCommand - I don't recall something like that. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08
[jira] [Commented] (SOLR-5488) Fix up test failures for Analytics Component
[ https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880248#comment-13880248 ] Steven Bower commented on SOLR-5488: one thing i noticed in the output above is this: {noformat} [junit4] lst name=mr [junit4] long name=count100/long [junit4] null name=mcm/ [junit4] null name=mean/ [junit4] null name=median/ [junit4] null name=su/ [junit4] null name=sum/ [junit4] null name=unique/ [junit4] /lst {noformat} notice the {{null}} in the response... trying to track this down now Fix up test failures for Analytics Component Key: SOLR-5488 URL: https://issues.apache.org/jira/browse/SOLR-5488 Project: Solr Issue Type: Bug Affects Versions: 5.0, 4.7 Reporter: Erick Erickson Assignee: Erick Erickson Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch The analytics component has a few test failures, perhaps environment-dependent. This is just to collect the test fixes in one place for convenience when we merge back into 4.x -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Comment Edited] (SOLR-5488) Fix up test failures for Analytics Component
[ https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880248#comment-13880248 ] Steven Bower edited comment on SOLR-5488 at 1/23/14 7:19 PM: - one thing i noticed in the output above is this: {noformat} [junit4] lst name=mr [junit4] long name=count100/long [junit4] null name=mcm/ [junit4] null name=mean/ [junit4] null name=median/ [junit4] null name=su/ [junit4] null name=sum/ [junit4] null name=unique/ [junit4] /lst {noformat} notice the {{null}} in the response... trying to track this down now.. this is certainly why the test is failing.. was (Author: sbower): one thing i noticed in the output above is this: {noformat} [junit4] lst name=mr [junit4] long name=count100/long [junit4] null name=mcm/ [junit4] null name=mean/ [junit4] null name=median/ [junit4] null name=su/ [junit4] null name=sum/ [junit4] null name=unique/ [junit4] /lst {noformat} notice the {{null}} in the response... trying to track this down now Fix up test failures for Analytics Component Key: SOLR-5488 URL: https://issues.apache.org/jira/browse/SOLR-5488 Project: Solr Issue Type: Bug Affects Versions: 5.0, 4.7 Reporter: Erick Erickson Assignee: Erick Erickson Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch The analytics component has a few test failures, perhaps environment-dependent. This is just to collect the test fixes in one place for convenience when we merge back into 4.x -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880253#comment-13880253 ] Mark Miller commented on SOLR-5658: --- Okay, outside of the distributed code, Solr does setup the cmd object with a request level commitWithin. That is how this used to work, that is why we didn't have to propagate the param. Perhaps the commitWithin is being lost when parsing the javabin. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880256#comment-13880256 ] Mark Miller commented on SOLR-5658: --- I see the bug. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@36137e08 main{StandardDirectoryReader(segments_2:7:nrt
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880298#comment-13880298 ] Mark Miller commented on SOLR-5658: --- I'm still look at the details, but the cause in the change of behavior is the switch from xml to binary update requests. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore –
[jira] [Updated] (SOLR-5641) REST API to modify request handlers
[ https://issues.apache.org/jira/browse/SOLR-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willy Solaligue updated SOLR-5641: -- Attachment: SolrConfigApiDocumentation.pdf REST API to modify request handlers --- Key: SOLR-5641 URL: https://issues.apache.org/jira/browse/SOLR-5641 Project: Solr Issue Type: Sub-task Reporter: Willy Solaligue Attachments: SOLR-5641.patch, SolrConfigApiDocumentation.pdf There should be a REST API to allow modify request handlers. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (LUCENE-5414) suggest module should not depend on expression module
[ https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Willnauer updated LUCENE-5414: Attachment: LUCENE-5414.patch here is a start - I am still after all these years not familiar with how we manage the maven stuff but I guess it somehow figures this out? suggest module should not depend on expression module - Key: LUCENE-5414 URL: https://issues.apache.org/jira/browse/LUCENE-5414 Project: Lucene - Core Issue Type: Wish Affects Versions: 4.6, 5.0 Reporter: Simon Willnauer Fix For: 5.0, 4.7 Attachments: LUCENE-5414.patch Currently our suggest module depends on the expression module just because the DocumentExpressionDictionary provides some util ctor to pass in an expression directly. That is a lot of dependency for little value IMO and pulls in lots of JARs. DocumentExpressionDictionary should only take a ValueSource instead. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Created] (LUCENE-5414) suggest module should not depend on expression module
Simon Willnauer created LUCENE-5414: --- Summary: suggest module should not depend on expression module Key: LUCENE-5414 URL: https://issues.apache.org/jira/browse/LUCENE-5414 Project: Lucene - Core Issue Type: Wish Affects Versions: 4.6, 5.0 Reporter: Simon Willnauer Fix For: 5.0, 4.7 Attachments: LUCENE-5414.patch Currently our suggest module depends on the expression module just because the DocumentExpressionDictionary provides some util ctor to pass in an expression directly. That is a lot of dependency for little value IMO and pulls in lots of JARs. DocumentExpressionDictionary should only take a ValueSource instead. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5414) suggest module should not depend on expression module
[ https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880323#comment-13880323 ] Simon Willnauer commented on LUCENE-5414: - I wonder actually if we should rename that dictionary now seems like the wrong name for it if it doesn't take an expression anymore? suggest module should not depend on expression module - Key: LUCENE-5414 URL: https://issues.apache.org/jira/browse/LUCENE-5414 Project: Lucene - Core Issue Type: Wish Affects Versions: 4.6, 5.0 Reporter: Simon Willnauer Fix For: 5.0, 4.7 Attachments: LUCENE-5414.patch Currently our suggest module depends on the expression module just because the DocumentExpressionDictionary provides some util ctor to pass in an expression directly. That is a lot of dependency for little value IMO and pulls in lots of JARs. DocumentExpressionDictionary should only take a ValueSource instead. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5414) suggest module should not depend on expression module
[ https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880328#comment-13880328 ] Robert Muir commented on LUCENE-5414: - +1 to just take ValueSource like this patch, I think it keeps our dependencies simpler and cleaner. I also think we could remove the test dep too (in the future or whatever), because the test only needs to show it consumes valuesource correctly. suggest module should not depend on expression module - Key: LUCENE-5414 URL: https://issues.apache.org/jira/browse/LUCENE-5414 Project: Lucene - Core Issue Type: Wish Affects Versions: 4.6, 5.0 Reporter: Simon Willnauer Fix For: 5.0, 4.7 Attachments: LUCENE-5414.patch Currently our suggest module depends on the expression module just because the DocumentExpressionDictionary provides some util ctor to pass in an expression directly. That is a lot of dependency for little value IMO and pulls in lots of JARs. DocumentExpressionDictionary should only take a ValueSource instead. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5414) suggest module should not depend on expression module
[ https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880338#comment-13880338 ] Michael McCandless commented on LUCENE-5414: +1 suggest module should not depend on expression module - Key: LUCENE-5414 URL: https://issues.apache.org/jira/browse/LUCENE-5414 Project: Lucene - Core Issue Type: Wish Affects Versions: 4.6, 5.0 Reporter: Simon Willnauer Fix For: 5.0, 4.7 Attachments: LUCENE-5414.patch Currently our suggest module depends on the expression module just because the DocumentExpressionDictionary provides some util ctor to pass in an expression directly. That is a lot of dependency for little value IMO and pulls in lots of JARs. DocumentExpressionDictionary should only take a ValueSource instead. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser
[ https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880350#comment-13880350 ] Lee Hinman commented on LUCENE-5410: Upayavira: That does bring up a good point, how should the extra fuzzy characters be treated if fuzziness is turned off? Currently the patch treats the token {{foo~2}} as a TermQuery for foo~2 if {{FUZZINESS_OPERATOR}} is disabled. Should it be changed to silently swallow the ~2 even if fuzziness is disabled? Add fuzziness support to SimpleQueryParser -- Key: LUCENE-5410 URL: https://issues.apache.org/jira/browse/LUCENE-5410 Project: Lucene - Core Issue Type: Improvement Components: core/queryparser Affects Versions: 4.7 Reporter: Lee Hinman Priority: Minor Attachments: LUCENE-5410.patch Original Estimate: 168h Remaining Estimate: 168h It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so that: {{foo~2}} generates a {{FuzzyQuery}} with an max edit distance of 2 and: {{foo bar~2}} generates a {{PhraseQuery}} with a slop of 2. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (LUCENE-5414) suggest module should not depend on expression module
[ https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Willnauer updated LUCENE-5414: Attachment: LUCENE-5414.patch another iteration... removed the deps to expression entirely. I will need to fix the javadocs and the class name still... suggest module should not depend on expression module - Key: LUCENE-5414 URL: https://issues.apache.org/jira/browse/LUCENE-5414 Project: Lucene - Core Issue Type: Wish Affects Versions: 4.6, 5.0 Reporter: Simon Willnauer Fix For: 5.0, 4.7 Attachments: LUCENE-5414.patch, LUCENE-5414.patch Currently our suggest module depends on the expression module just because the DocumentExpressionDictionary provides some util ctor to pass in an expression directly. That is a lot of dependency for little value IMO and pulls in lots of JARs. DocumentExpressionDictionary should only take a ValueSource instead. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser
[ https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880360#comment-13880360 ] Upayavira commented on LUCENE-5410: --- If fuzziness is disabled, then that should mean that the ~2 syntax has no meaning whatever, and should be treated as a regular token. Otherwise, you're turning the feature off, but not the syntax, and that will catch people out, and make the component more complex than necessary. Add fuzziness support to SimpleQueryParser -- Key: LUCENE-5410 URL: https://issues.apache.org/jira/browse/LUCENE-5410 Project: Lucene - Core Issue Type: Improvement Components: core/queryparser Affects Versions: 4.7 Reporter: Lee Hinman Priority: Minor Attachments: LUCENE-5410.patch Original Estimate: 168h Remaining Estimate: 168h It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so that: {{foo~2}} generates a {{FuzzyQuery}} with an max edit distance of 2 and: {{foo bar~2}} generates a {{PhraseQuery}} with a slop of 2. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser
[ https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880364#comment-13880364 ] Lee Hinman commented on LUCENE-5410: Gotcha. Next version of the patch will swallow {{~XXX}} if fuzziness is disabled, and won't touch QueryBuilder.java, as per Roberts comments. Add fuzziness support to SimpleQueryParser -- Key: LUCENE-5410 URL: https://issues.apache.org/jira/browse/LUCENE-5410 Project: Lucene - Core Issue Type: Improvement Components: core/queryparser Affects Versions: 4.7 Reporter: Lee Hinman Priority: Minor Attachments: LUCENE-5410.patch Original Estimate: 168h Remaining Estimate: 168h It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so that: {{foo~2}} generates a {{FuzzyQuery}} with an max edit distance of 2 and: {{foo bar~2}} generates a {{PhraseQuery}} with a slop of 2. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser
[ https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880374#comment-13880374 ] Robert Muir commented on LUCENE-5410: - Wait, why swallow it? When disabling an operator, it means its treated as it does not exist (no special meaning). E.g. for PREFIX today, if you disable that operator, it means it will literally make a term of foo* I think this is also agrees with Upayavira's thoughts, but maybe I'm missing something. Add fuzziness support to SimpleQueryParser -- Key: LUCENE-5410 URL: https://issues.apache.org/jira/browse/LUCENE-5410 Project: Lucene - Core Issue Type: Improvement Components: core/queryparser Affects Versions: 4.7 Reporter: Lee Hinman Priority: Minor Attachments: LUCENE-5410.patch Original Estimate: 168h Remaining Estimate: 168h It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so that: {{foo~2}} generates a {{FuzzyQuery}} with an max edit distance of 2 and: {{foo bar~2}} generates a {{PhraseQuery}} with a slop of 2. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...
[ https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hoss Man updated SOLR-5652: --- Description: Twice now, Uwe's jenkins has encountered a walk already seen ... assertion failure from DistribCursorPagingTest that I've been unable to fathom, let alone reproduce (although sarowe was able to trigger a similar, non-reproducible seed, failure on his machine) Using this as a tracking issue to try and make sense of it. Summary of things noticed so far (in 3 failures): * So far only seen on http://jenkins.thetaphi.de sarowe's mac * So far only seen on MacOSX * So far only seen on branch 4x * So far seen on both Java6 and Java7 * fails occured in first block of randomized testing: ** we've indexed a small number of randomized docs ** we're explicitly looping over every field and sorting in both directions * fails were both when doing a desc sorting on one of the \*_dv_last or \*_dv_first fields (docValues=true, either sortMissingLast=true OR sortMissingFirst=true) ** sort on same field asc has always worked fine just before this (fields are in arbitrary order, but asc always tried before desc) ** sorting on some other random fields has sometimes been tried before this and worked (specifics of each failure seen in the wild recorded in comments) was: Twice now, Uwe's jenkins has encountered a walk already seen ... assertion failure from DistribCursorPagingTest that I've been unable to fathom, let alone reproduce. Using this as a tracking issue to try and make sense of it. Summary of things noticed so far (in 2 failures): * So far only seen on http://jenkins.thetaphi.de * So far only seen on MacOSX * So far only seen on branch 4x * So far seen on both Java6 and Java7 * fails occured in first block of randomized testing: ** we've indexed a small number of randomized docs ** we're explicitly looping over every field and sorting in both directions * fails were both when sorting on one of the \*_dv_last desc fields (docValues=true, sortMissingLast=true) ** sort on same field asc has always worked fine just before this (fields are in arbitrary order, but asc always tried before desc) ** sorting on some other random fields has sometimes been tried before this and worked (specifics of each failure seen in the wild recorded in comments) updating description based on variables seen in sarowe's failure Heisenbug in DistribCursorPagingTest: walk already seen ... - Key: SOLR-5652 URL: https://issues.apache.org/jira/browse/SOLR-5652 Project: Solr Issue Type: Bug Reporter: Hoss Man Assignee: Hoss Man Attachments: 129.log, jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1200.log.txt, jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1217.log.txt Twice now, Uwe's jenkins has encountered a walk already seen ... assertion failure from DistribCursorPagingTest that I've been unable to fathom, let alone reproduce (although sarowe was able to trigger a similar, non-reproducible seed, failure on his machine) Using this as a tracking issue to try and make sense of it. Summary of things noticed so far (in 3 failures): * So far only seen on http://jenkins.thetaphi.de sarowe's mac * So far only seen on MacOSX * So far only seen on branch 4x * So far seen on both Java6 and Java7 * fails occured in first block of randomized testing: ** we've indexed a small number of randomized docs ** we're explicitly looping over every field and sorting in both directions * fails were both when doing a desc sorting on one of the \*_dv_last or \*_dv_first fields (docValues=true, either sortMissingLast=true OR sortMissingFirst=true) ** sort on same field asc has always worked fine just before this (fields are in arbitrary order, but asc always tried before desc) ** sorting on some other random fields has sometimes been tried before this and worked (specifics of each failure seen in the wild recorded in comments) -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Comment Edited] (LUCENE-5410) Add fuzziness support to SimpleQueryParser
[ https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880384#comment-13880384 ] Lee Hinman edited comment on LUCENE-5410 at 1/23/14 9:30 PM: - Okay, I misunderstood then, I was thinking the ~2 syntax has no meaning whatever meant *no* meaning (ie, ignore it entirely). I will keep the current behavior of {{foo~2}} being a TermQuery for foo~2 and {{foo bar~2}} being a BooleanQuery of the PhraseQuery foo bar and a TermQuery for ~2. was (Author: dakrone): Okay, I misunderstood then, I was thinking the ~2 syntax has no meaning whatever meant *no* meaning (ie, ignore it entirely). I will keep the current behavior of {{foo~2}} being a TermQuery for foo~2 and {{{foo bar~2}}} being a BooleanQuery of the PhraseQuery foo bar and a TermQuery for ~2. Add fuzziness support to SimpleQueryParser -- Key: LUCENE-5410 URL: https://issues.apache.org/jira/browse/LUCENE-5410 Project: Lucene - Core Issue Type: Improvement Components: core/queryparser Affects Versions: 4.7 Reporter: Lee Hinman Priority: Minor Attachments: LUCENE-5410.patch Original Estimate: 168h Remaining Estimate: 168h It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so that: {{foo~2}} generates a {{FuzzyQuery}} with an max edit distance of 2 and: {{foo bar~2}} generates a {{PhraseQuery}} with a slop of 2. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser
[ https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880384#comment-13880384 ] Lee Hinman commented on LUCENE-5410: Okay, I misunderstood then, I was thinking the ~2 syntax has no meaning whatever meant *no* meaning (ie, ignore it entirely). I will keep the current behavior of {{foo~2}} being a TermQuery for foo~2 and {{{foo bar~2}}} being a BooleanQuery of the PhraseQuery foo bar and a TermQuery for ~2. Add fuzziness support to SimpleQueryParser -- Key: LUCENE-5410 URL: https://issues.apache.org/jira/browse/LUCENE-5410 Project: Lucene - Core Issue Type: Improvement Components: core/queryparser Affects Versions: 4.7 Reporter: Lee Hinman Priority: Minor Attachments: LUCENE-5410.patch Original Estimate: 168h Remaining Estimate: 168h It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so that: {{foo~2}} generates a {{FuzzyQuery}} with an max edit distance of 2 and: {{foo bar~2}} generates a {{PhraseQuery}} with a slop of 2. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (LUCENE-5410) Add fuzziness support to SimpleQueryParser
[ https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lee Hinman updated LUCENE-5410: --- Attachment: LUCENE-5410.patch New version of the patch with these changes: - No changes made to QueryBuilder.java - Only a single method for newPhraseQuery instead of two - Add ~ to testRandomQueries2 Add fuzziness support to SimpleQueryParser -- Key: LUCENE-5410 URL: https://issues.apache.org/jira/browse/LUCENE-5410 Project: Lucene - Core Issue Type: Improvement Components: core/queryparser Affects Versions: 4.7 Reporter: Lee Hinman Priority: Minor Attachments: LUCENE-5410.patch, LUCENE-5410.patch Original Estimate: 168h Remaining Estimate: 168h It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so that: {{foo~2}} generates a {{FuzzyQuery}} with an max edit distance of 2 and: {{foo bar~2}} generates a {{PhraseQuery}} with a slop of 2. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-5488) Fix up test failures for Analytics Component
[ https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Bower updated SOLR-5488: --- Attachment: SOLR-5488.patch Attached is a patch (to trunk) that fixes a few issues as well as adding some additional checks/exceptions/logging: * check that getStatResult resturns non-null/empty strings. There were a few tests that were actually failing but not reporting as such (eg get to string stats and concat them but when both werent there it would concat 2 empty strings and succeed * When we fail to create an accumulator it was just println'ing the exception vs logging it so we can see a full stack trace * Moved call to docs.getTopFilter() out of the loop through analytics request. There is no need to rebuild this each time. In fact I may refactor this entire section in the future (once this all works) * Updated FunctionTest as some date based tests where using the STRING VAL_TYPE instead of DATE Fix up test failures for Analytics Component Key: SOLR-5488 URL: https://issues.apache.org/jira/browse/SOLR-5488 Project: Solr Issue Type: Bug Affects Versions: 5.0, 4.7 Reporter: Erick Erickson Assignee: Erick Erickson Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch The analytics component has a few test failures, perhaps environment-dependent. This is just to collect the test fixes in one place for convenience when we merge back into 4.x -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5488) Fix up test failures for Analytics Component
[ https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880444#comment-13880444 ] Steven Bower commented on SOLR-5488: The output above (ie the {{null}} items in the response) I am quite certain is caused by the return null in the MinMaxStatsCollector. I have turned this into an IllegalArgException that should lead us to why this is happening. Note: I have not been able to actually repro this on my side (i thought I had but it was something else failing).. But I traced down when/how the nulls could propagate to the response .. hopefully this puts this issue to bed.. Fix up test failures for Analytics Component Key: SOLR-5488 URL: https://issues.apache.org/jira/browse/SOLR-5488 Project: Solr Issue Type: Bug Affects Versions: 5.0, 4.7 Reporter: Erick Erickson Assignee: Erick Erickson Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch The analytics component has a few test failures, perhaps environment-dependent. This is just to collect the test fixes in one place for convenience when we merge back into 4.x -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880472#comment-13880472 ] Mark Miller commented on SOLR-5658: --- Kind of ugly - the real fix will take a bit of work. The patch might be a decent partial fix / workaround for 4.6.1 if we respin. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore –
[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser
[ https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880507#comment-13880507 ] Jack Conradson commented on LUCENE-5410: I think this patch is a good start. Personally, there's two changes I'd like to see. * The first was discussed briefly before, but I'm strongly in favor of having phrase slop be a different operator from fuzzy terms. I can see users wanting phrase slop without wanting fuzzy terms. * The second is I'd strongly prefer to see a separate method for the parsing logic related to slop/fuzzy where it would account for checking if there's a '~' and the integer afterwards. I think it will help clean up the consumeTerm and consumePhrase methods significantly. Once a term/phrase has been found, if fuzzy/slop is on, the method can be called to check for it. Add fuzziness support to SimpleQueryParser -- Key: LUCENE-5410 URL: https://issues.apache.org/jira/browse/LUCENE-5410 Project: Lucene - Core Issue Type: Improvement Components: core/queryparser Affects Versions: 4.7 Reporter: Lee Hinman Priority: Minor Attachments: LUCENE-5410.patch, LUCENE-5410.patch Original Estimate: 168h Remaining Estimate: 168h It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so that: {{foo~2}} generates a {{FuzzyQuery}} with an max edit distance of 2 and: {{foo bar~2}} generates a {{PhraseQuery}} with a slop of 2. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser
[ https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880511#comment-13880511 ] Lee Hinman commented on LUCENE-5410: Okay, the first is very simple (I'll add a {{SLOP_OPERATOR}} flag and make {{FUZZINESS_OPERATOR}} only work for fuzzy terms. As for the second, I think this is doable, but I think it will still require a bit of special logic in consumeTerm and consumePhrase based on the differences in how they consume/increment state.data and state.index. I'll work on another revision doing this. Add fuzziness support to SimpleQueryParser -- Key: LUCENE-5410 URL: https://issues.apache.org/jira/browse/LUCENE-5410 Project: Lucene - Core Issue Type: Improvement Components: core/queryparser Affects Versions: 4.7 Reporter: Lee Hinman Priority: Minor Attachments: LUCENE-5410.patch, LUCENE-5410.patch Original Estimate: 168h Remaining Estimate: 168h It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so that: {{foo~2}} generates a {{FuzzyQuery}} with an max edit distance of 2 and: {{foo bar~2}} generates a {{PhraseQuery}} with a slop of 2. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller updated SOLR-5658: -- Attachment: SOLR-5658.patch Here is a full fix patch. So previously, we still didn't propagate request level commitWithin at the request level, but each document add would pick up the request level commitWithin. This per document level commitWithin support was not working with javabin. This has to do with how javabin handles adds for streaming, and some funny code that I have improved with a comment and cleanup. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch, SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO
[jira] [Commented] (LUCENE-5414) suggest module should not depend on expression module
[ https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880555#comment-13880555 ] Steve Rowe commented on LUCENE-5414: bq. I am still after all these years not familiar with how we manage the maven stuff but I guess it somehow figures this out? LUCENE-5217 recently added an Ant+Ivy-Maven dependencies converter that also defeats Maven's transitive dependency resolution mechanism by excluding all dependencies' direct dependencies in the {{dependencyManagement}} section of the grandparent POM. I ran {{ant get-maven-poms}} before and after the latest patch on this issue and compared the resulting suggest module's POMs. With the patch, the following dependencies are no longer present: {code:xml} dependency groupIdorg.apache.lucene/groupId artifactIdlucene-expressions/artifactId /dependency ... dependency groupIdorg.antlr/groupId artifactIdantlr-runtime/artifactId /dependency dependency groupIdorg.ow2.asm/groupId artifactIdasm/artifactId /dependency dependency groupIdorg.ow2.asm/groupId artifactIdasm-commons/artifactId /dependency {code} Those last three dependencies are direct dependencies of the expressions module; since the Ant build currently pulls in everything from {{expressions/lib/}}, the Ant-Maven dependencies converter interprets them as direct dependencies of the suggest module. After applying the latest patch, all Lucene/Solr tests pass under Maven. suggest module should not depend on expression module - Key: LUCENE-5414 URL: https://issues.apache.org/jira/browse/LUCENE-5414 Project: Lucene - Core Issue Type: Wish Affects Versions: 4.6, 5.0 Reporter: Simon Willnauer Fix For: 5.0, 4.7 Attachments: LUCENE-5414.patch, LUCENE-5414.patch Currently our suggest module depends on the expression module just because the DocumentExpressionDictionary provides some util ctor to pass in an expression directly. That is a lot of dependency for little value IMO and pulls in lots of JARs. DocumentExpressionDictionary should only take a ValueSource instead. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880569#comment-13880569 ] ASF subversion and git services commented on SOLR-5658: --- Commit 1560859 from [~markrmil...@gmail.com] in branch 'dev/trunk' [ https://svn.apache.org/r1560859 ] SOLR-5658: commitWithin and overwrite are not being distributed to replicas now that SolrCloud uses javabin to distribute updates. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Attachments: SOLR-5658.patch, SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553
[jira] [Commented] (SOLR-5488) Fix up test failures for Analytics Component
[ https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880570#comment-13880570 ] Erick Erickson commented on SOLR-5488: -- OK, I'll run it through my local tests, then commit it if I don't see a test failure in a couple of runs with iters set. I wasn't able to get failures the other day but Jenkins seems to fail pretty regularly More later. Fix up test failures for Analytics Component Key: SOLR-5488 URL: https://issues.apache.org/jira/browse/SOLR-5488 Project: Solr Issue Type: Bug Affects Versions: 5.0, 4.7 Reporter: Erick Erickson Assignee: Erick Erickson Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch The analytics component has a few test failures, perhaps environment-dependent. This is just to collect the test fixes in one place for convenience when we merge back into 4.x -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Assigned] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller reassigned SOLR-5658: - Assignee: Mark Miller (was: Shalin Shekhar Mangar) commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Mark Miller Fix For: 5.0, 4.7, 4.6.1 Attachments: SOLR-5658.patch, SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@36137e08
[jira] [Updated] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller updated SOLR-5658: -- Priority: Critical (was: Major) Fix Version/s: 4.6.1 4.7 5.0 commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Mark Miller Priority: Critical Fix For: 5.0, 4.7, 4.6.1 Attachments: SOLR-5658.patch, SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 384553 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore –
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880573#comment-13880573 ] ASF subversion and git services commented on SOLR-5658: --- Commit 1560860 from [~markrmil...@gmail.com] in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1560860 ] SOLR-5658: commitWithin and overwrite are not being distributed to replicas now that SolrCloud uses javabin to distribute updates. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Shalin Shekhar Mangar Fix For: 5.0, 4.7, 4.6.1 Attachments: SOLR-5658.patch, SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher –
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880588#comment-13880588 ] ASF subversion and git services commented on SOLR-5658: --- Commit 1560866 from [~markrmil...@gmail.com] in branch 'dev/branches/lucene_solr_4_6' [ https://svn.apache.org/r1560866 ] SOLR-5658: commitWithin and overwrite are not being distributed to replicas now that SolrCloud uses javabin to distribute updates. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Mark Miller Priority: Critical Fix For: 5.0, 4.7, 4.6.1 Attachments: SOLR-5658.patch, SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO
Re: [VOTE] Release Lucene/Solr 4.6.1 RC3
Okay, I’ve decided to respin now that I understand the issue. It’s worse than delaying the release by one day for users as it’s new in 4.6 and quite a bad bug for those using commitWithin. - Mark On Jan 23, 2014, at 12:43 PM, Mark Miller markrmil...@gmail.com wrote: There is some discussion around an RC4 at https://issues.apache.org/jira/browse/SOLR-5658 if anyone wants to weigh in. - Mark On Jan 22, 2014, at 11:02 PM, Mark Miller markrmil...@gmail.com wrote: Please vote to release the following artifacts: http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560491/ Here is my +1. SUCCESS! [0:50:55.923056] -- - Mark
[jira] [Commented] (LUCENE-5409) ToParentBlockJoinCollector.getTopGroups returns empty Groups
[ https://issues.apache.org/jira/browse/LUCENE-5409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880597#comment-13880597 ] Peng Cheng commented on LUCENE-5409: Still doesn't work, this is my test case: public void testRewriteHash() throws IOException { final Directory dir = newDirectory(); final RandomIndexWriter w = new RandomIndexWriter(random(), dir); final ListDocument docs = new ArrayListDocument(); docs.add(makeJob(java, 2007)); docs.add(makeJob(python, 2010)); docs.add(makeResume(Lisa, United Kingdom)); w.addDocuments(docs); docs.clear(); docs.add(makeJob(ruby, 2005)); docs.add(makeJob(java, 2006)); docs.add(makeResume(Frank, United States)); w.addDocuments(docs); IndexReader r = w.getReader(); w.close(); IndexSearcher s = newSearcher(r); Query q = new TermQuery(new Term(skill,rudy)); BooleanQuery qc = new BooleanQuery(); qc.add(q,Occur.SHOULD); Filter parentsFilter = new FixedBitSetCachingWrapperFilter(new QueryWrapperFilter(new TermQuery(new Term(docType, resume; Query qp = new ToParentBlockJoinQuery(qc,parentsFilter,ScoreMode.Max); int hash1 = qp.hashCode(); Query qw = s.rewrite(qp); int hash2 = qp.hashCode(); assertTrue(hash1 != hash2); } ToParentBlockJoinCollector.getTopGroups returns empty Groups Key: LUCENE-5409 URL: https://issues.apache.org/jira/browse/LUCENE-5409 Project: Lucene - Core Issue Type: Bug Components: core/search Affects Versions: 4.6 Environment: Ubuntu 12.04 Reporter: Peng Cheng Assignee: Michael McCandless Priority: Critical Fix For: 4.7 Original Estimate: 168h Remaining Estimate: 168h A bug is observed to cause unstable results returned by the getTopGroups function of class ToParentBlockJoinCollector. In the scorer generation stage, the ToParentBlockJoinCollector will automatically rewrite all the associated ToParentBlockJoinQuery (and their subqueries), and save them into its in-memory Look-up table, namely joinQueryID (see enroll() method for detail). Unfortunately, in the getTopGroups method, the new ToParentBlockJoinQuery parameter is not rewritten (at least users are not expected to do so). When the new one is searched in the old lookup table (considering the impact of rewrite() on hashCode()), the lookup will largely fail and eventually end up with a topGroup collection consisting of only empty groups (their hitCounts are guaranteed to be zero). An easy fix would be to rewrite the original BlockJoinQuery before invoking getTopGroups method. However, the computational cost of this is not optimal. A better but slightly more complex solution would be to save unrewrited Queries into the lookup table. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Comment Edited] (LUCENE-5409) ToParentBlockJoinCollector.getTopGroups returns empty Groups
[ https://issues.apache.org/jira/browse/LUCENE-5409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880597#comment-13880597 ] Peng Cheng edited comment on LUCENE-5409 at 1/24/14 1:24 AM: - Still doesn't work, this is my test case, perhaps I still need to implement a Query with custom rewrite and hashcode public void testRewriteHash() throws IOException { final Directory dir = newDirectory(); final RandomIndexWriter w = new RandomIndexWriter(random(), dir); final ListDocument docs = new ArrayListDocument(); docs.add(makeJob(java, 2007)); docs.add(makeJob(python, 2010)); docs.add(makeResume(Lisa, United Kingdom)); w.addDocuments(docs); docs.clear(); docs.add(makeJob(ruby, 2005)); docs.add(makeJob(java, 2006)); docs.add(makeResume(Frank, United States)); w.addDocuments(docs); IndexReader r = w.getReader(); w.close(); IndexSearcher s = newSearcher(r); Query q = new TermQuery(new Term(skill,rudy)); BooleanQuery qc = new BooleanQuery(); qc.add(q,Occur.SHOULD); Filter parentsFilter = new FixedBitSetCachingWrapperFilter(new QueryWrapperFilter(new TermQuery(new Term(docType, resume; Query qp = new ToParentBlockJoinQuery(qc,parentsFilter,ScoreMode.Max); int hash1 = qp.hashCode(); Query qw = s.rewrite(qp); int hash2 = qp.hashCode(); assertTrue(hash1 != hash2); } was (Author: peng): Still doesn't work, this is my test case: public void testRewriteHash() throws IOException { final Directory dir = newDirectory(); final RandomIndexWriter w = new RandomIndexWriter(random(), dir); final ListDocument docs = new ArrayListDocument(); docs.add(makeJob(java, 2007)); docs.add(makeJob(python, 2010)); docs.add(makeResume(Lisa, United Kingdom)); w.addDocuments(docs); docs.clear(); docs.add(makeJob(ruby, 2005)); docs.add(makeJob(java, 2006)); docs.add(makeResume(Frank, United States)); w.addDocuments(docs); IndexReader r = w.getReader(); w.close(); IndexSearcher s = newSearcher(r); Query q = new TermQuery(new Term(skill,rudy)); BooleanQuery qc = new BooleanQuery(); qc.add(q,Occur.SHOULD); Filter parentsFilter = new FixedBitSetCachingWrapperFilter(new QueryWrapperFilter(new TermQuery(new Term(docType, resume; Query qp = new ToParentBlockJoinQuery(qc,parentsFilter,ScoreMode.Max); int hash1 = qp.hashCode(); Query qw = s.rewrite(qp); int hash2 = qp.hashCode(); assertTrue(hash1 != hash2); } ToParentBlockJoinCollector.getTopGroups returns empty Groups Key: LUCENE-5409 URL: https://issues.apache.org/jira/browse/LUCENE-5409 Project: Lucene - Core Issue Type: Bug Components: core/search Affects Versions: 4.6 Environment: Ubuntu 12.04 Reporter: Peng Cheng Assignee: Michael McCandless Priority: Critical Fix For: 4.7 Original Estimate: 168h Remaining Estimate: 168h A bug is observed to cause unstable results returned by the getTopGroups function of class ToParentBlockJoinCollector. In the scorer generation stage, the ToParentBlockJoinCollector will automatically rewrite all the associated ToParentBlockJoinQuery (and their subqueries), and save them into its in-memory Look-up table, namely joinQueryID (see enroll() method for detail). Unfortunately, in the getTopGroups method, the new ToParentBlockJoinQuery parameter is not rewritten (at least users are not expected to do so). When the new one is searched in the old lookup table (considering the impact of rewrite() on hashCode()), the lookup will largely fail and eventually end up with a topGroup collection consisting of only empty groups (their hitCounts are guaranteed to be zero). An easy fix would be to rewrite the original BlockJoinQuery before invoking getTopGroups method. However, the computational cost of this is not optimal. A better but slightly more complex solution would be to save unrewrited Queries into the lookup table. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...
[ https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880639#comment-13880639 ] Steve Rowe commented on SOLR-5652: -- I tried reproducing the other four seeds I found by running each of them ten times, but they all passed. Here's the output of {{egrep 'Throwable|SOLR\-5652: \[\^(]'}} over the other four failed trials' log files: {noformat} 25.log: [junit4] 2 19647 T10 oasc.DistribCursorPagingTest.doRandomSortsOnLargeIndex SOLR-5652: Begining Loop over smallish num of docs 25.log: [junit4] Throwable #1: java.lang.AssertionError: ({params(q=*%3A*fl=id%2Cint_dv_lastrows=50sort=int_dv_last+desc%2C+id+desc),defaults(cursorMark=AoIGycP9Cl8B)}) walk already seen: 53, don't know why; q=id:53 gives: {responseHeader={status=0,QTime=7},response={numFound=1,start=0,maxScore=4.3672957,docs=[SolrDocument{id=53, long=-176257813861916, long_last=-176257813861916, long_first=-176257813861916, long_dv_last=-176257813861916, long_dv_first=-176257813861916, float=7.8670176E8, float_last=7.8670176E8, float_first=7.8670176E8, float_dv_last=7.8670176E8, float_dv_first=7.8670176E8, double=-5.708345229626098E8, double_last=-5.708345229626098E8, double_first=-5.708345229626098E8, double_dv_last=-5.708345229626098E8, double_dv_first=-5.708345229626098E8, str=さおれん, str_last=さおれん, str_first=さおれん, str_dv_last=さおれん, str_dv_first=さおれん, bin=O69Ees9vzo65vMxdlD794IAfqQgcvHEy+6USZ9bEELcM4PnS, bin_last=O69Ees9vzo65vMxdlD794IAfqQgcvHEy+6USZ9bEELcM4PnS, bin_first=O69Ees9vzo65vMxdlD794IAfqQgcvHEy+6USZ9bEELcM4PnS, bin_dv_last=O69Ees9vzo65vMxdlD794IAfqQgcvHEy+6USZ9bEELcM4PnS, bin_dv_first=O69Ees9vzo65vMxdlD794IAfqQgcvHEy+6USZ9bEELcM4PnS, _version_=1457993135883812864}]}} 330.log: [junit4] 2 19366 T10 oasc.DistribCursorPagingTest.doRandomSortsOnLargeIndex SOLR-5652: Begining Loop over smallish num of docs 330.log: [junit4] Throwable #1: java.lang.AssertionError: ({params(q=*%3A*fl=id%2Cdouble_dv_firstrows=33sort=double_dv_first+desc%2C+id+desc),defaults(cursorMark=AoIFP6OxOxOxOxRRAQ%3D%3D)}) walk already seen: 53, don't know why; q=id:53 gives: {responseHeader={status=0,QTime=6},response={numFound=1,start=0,maxScore=4.5409594,docs=[SolrDocument{id=53, int=1280166143, int_last=1280166143, int_first=1280166143, int_dv_last=1280166143, int_dv_first=1280166143, long=-9052102457621824595, long_last=-9052102457621824595, long_first=-9052102457621824595, long_dv_last=-9052102457621824595, long_dv_first=-9052102457621824595, float=3.0276464E8, float_last=3.0276464E8, float_first=3.0276464E8, float_dv_last=3.0276464E8, float_dv_first=3.0276464E8, str=⟉⟑, str_last=⟉⟑, str_first=⟉⟑, str_dv_last=⟉⟑, str_dv_first=⟉⟑, bin=rS4=, bin_last=rS4=, bin_first=rS4=, bin_dv_last=rS4=, bin_dv_first=rS4=, _version_=1458022773190295552}]}} 358.log: [junit4] 2 20392 T10 oasc.DistribCursorPagingTest.doRandomSortsOnLargeIndex SOLR-5652: Begining Loop over smallish num of docs 358.log: [junit4] Throwable #1: java.lang.AssertionError: ({params(q=*%3A*fl=id%2Cdouble_dv_lastrows=26sort=double_dv_last+asc%2C+id+asc),defaults(cursorMark=AoIFQcxu1GR52DdbBQ%3D%3D)}) walk already seen: 53, don't know why; q=id:53 gives: {responseHeader={status=0,QTime=6},response={numFound=1,start=0,maxScore=4.713572,docs=[SolrDocument{id=53, int=326151412, int_last=326151412, int_first=326151412, int_dv_last=326151412, int_dv_first=326151412, long=2982275399264847435, long_last=2982275399264847435, long_first=2982275399264847435, long_dv_last=2982275399264847435, long_dv_first=2982275399264847435, float=-4.07416768E8, float_last=-4.07416768E8, float_first=-4.07416768E8, float_dv_last=-4.07416768E8, float_dv_first=-4.07416768E8, str=s, str_last=s, str_first=s, str_dv_last=s, str_dv_first=s, bin=XR3Lrq5HZ64ra30SYdaN4EkoTS0jNYojEq+1McIN6T4QD136dLnbj4v/fp1VK+lN, bin_last=XR3Lrq5HZ64ra30SYdaN4EkoTS0jNYojEq+1McIN6T4QD136dLnbj4v/fp1VK+lN, bin_first=XR3Lrq5HZ64ra30SYdaN4EkoTS0jNYojEq+1McIN6T4QD136dLnbj4v/fp1VK+lN, bin_dv_last=XR3Lrq5HZ64ra30SYdaN4EkoTS0jNYojEq+1McIN6T4QD136dLnbj4v/fp1VK+lN, bin_dv_first=XR3Lrq5HZ64ra30SYdaN4EkoTS0jNYojEq+1McIN6T4QD136dLnbj4v/fp1VK+lN, _version_=1458025403210792960}]}} 372.log: [junit4] 2 20889 T10 oasc.DistribCursorPagingTest.doRandomSortsOnLargeIndex SOLR-5652: Begining Loop over smallish num of docs 372.log: [junit4] Throwable #1: java.lang.AssertionError: ({params(q=*%3A*fl=id%2Cstr_dv_lastrows=18sort=str_dv_last+desc%2C+id+desc),defaults(cursorMark=AoIgSg%3D%3D)}) walk already seen: 45, don't know why; q=id:45 gives: {responseHeader={status=0,QTime=10},response={numFound=1,start=0,maxScore=4.8394523,docs=[SolrDocument{id=45, int=55600073, int_last=55600073, int_first=55600073, int_dv_last=55600073, int_dv_first=55600073, long=-5726302924934473981, long_last=-5726302924934473981, long_first=-5726302924934473981,
[jira] [Commented] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...
[ https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880659#comment-13880659 ] Steve Rowe commented on SOLR-5652: -- In the trial #129 failure, the second (failing) page is sorted wrong - the sort field is long_dv_first, but multiple docs with missing values (including the walk already seen doc: id=53) are not sorted first. Below is the output of {{egrep 'SOLR-5652: \[\^(]|id=53'}} over {{129.log}} - note that the first page has the id=53 doc sorted properly: {noformat} [junit4] 2 21647 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups SOLR-5652: ({params(q=*%3A*fl=id%2Clong_dv_firstrows=24sort=long_dv_first+desc%2C+id+desc),defaults(cursorMark=*)}) gave us these docs: {id=53}; {id=25, long_dv_first=9028609258260341288}; {id=1, long_dv_first=8079898934015269594}; {id=21, long_dv_first=7851701882515113803}; {id=62, long_dv_first=7838548354468740764}; {id=15, long_dv_first=7703783121293450688}; {id=77, long_dv_first=7259374194906229471}; {id=59, long_dv_first=7109412730326436803}; {id=29, long_dv_first=6983226518504627711}; {id=69, long_dv_first=6894002903936490262}; {id=108, long_dv_first=6425678483825374576}; {id=48, long_dv_first=6162850160620829991}; {id=18, long_dv_first=6050872288145443429}; {id=10, long_dv_first=5639159091440117036}; {id=49, long_dv_first=5585109074321704897}; {id=121, long_dv_first=5564641483351446975}; {id=73, long_dv_first=5557697725656376716}; {id=124, long_dv_first=5515795054987553907}; {id=91, long_dv_first=5446634527267601359}; {id=66, long_dv_first=5412453097925579481}; {id=57, long_dv_first=5391575838257268802}; {id=67, long_dv_first=5285225733925278855}; {id=76, long_dv_first=5196111855800982134}; {id=118, long_dv_first=4962434967015612730}; [junit4] 2 21673 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups SOLR-5652: ({params(q=*%3A*fl=id%2Clong_dv_firstrows=24sort=long_dv_first+desc%2C+id+desc),defaults(cursorMark=AoJ%2FvAJZAg%3D%3D)}) gave us these docs: {id=94, long_dv_first=5064}; {id=74, long_dv_first=5045}; {id=100, long_dv_first=5038}; {id=95, long_dv_first=5024}; {id=71, long_dv_first=5010}; {id=117}; {id=53}; {id=46}; {id=99, long_dv_first=-57033495908952210}; {id=84, long_dv_first=-369682029177105515}; {id=51, long_dv_first=-571619284359424369}; {id=33, long_dv_first=-89016127771765}; {id=89, long_dv_first=-827568794981027330}; {id=27, long_dv_first=-874200373569477439}; {id=32, long_dv_first=-897758339419136464}; {id=37, long_dv_first=-1097686452252701951}; {id=20, long_dv_first=-1142352694920116441}; {id=60, long_dv_first=-1237791953129111727}; {id=78, long_dv_first=-1381169508523349434}; {id=58, long_dv_first=-1427953974149921646}; {id=104, long_dv_first=-1433781337878484605}; {id=8, long_dv_first=-1778050783003838576}; {id=55, long_dv_first=-1879894088937473264}; {id=38, long_dv_first=-1955827817437289663}; {noformat} Heisenbug in DistribCursorPagingTest: walk already seen ... - Key: SOLR-5652 URL: https://issues.apache.org/jira/browse/SOLR-5652 Project: Solr Issue Type: Bug Reporter: Hoss Man Assignee: Hoss Man Attachments: 129.log, jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1200.log.txt, jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1217.log.txt Twice now, Uwe's jenkins has encountered a walk already seen ... assertion failure from DistribCursorPagingTest that I've been unable to fathom, let alone reproduce (although sarowe was able to trigger a similar, non-reproducible seed, failure on his machine) Using this as a tracking issue to try and make sense of it. Summary of things noticed so far (in 3 failures): * So far only seen on http://jenkins.thetaphi.de sarowe's mac * So far only seen on MacOSX * So far only seen on branch 4x * So far seen on both Java6 and Java7 * fails occured in first block of randomized testing: ** we've indexed a small number of randomized docs ** we're explicitly looping over every field and sorting in both directions * fails were both when doing a desc sorting on one of the \*_dv_last or \*_dv_first fields (docValues=true, either sortMissingLast=true OR sortMissingFirst=true) ** sort on same field asc has always worked fine just before this (fields are in arbitrary order, but asc always tried before desc) ** sorting on some other random fields has sometimes been tried before this and worked (specifics of each failure seen in the wild recorded in comments) -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[VOTE] Release Lucene/Solr 4.6.1 RC4
Here we go, hopefully for that last time now…thanks everyone for bearing with us. Please vote to release the following artifacts: http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/ Here is my +1. SUCCESS! [0:56:37.409716] -- - Mark
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880692#comment-13880692 ] Mark Miller commented on SOLR-5658: --- As a separate issue, it probably makes sense to send request level commitWithin as a param rather than setting it per doc - that would mean less repeated data in the request. We still need to properly support per doc like this as well though, because that is the level cmd objects support and we are distributing cmd objects. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Mark Miller Priority: Critical Fix For: 5.0, 4.7, 4.6.1 Attachments: SOLR-5658.patch, SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552
Re: [VOTE] Release Lucene/Solr 4.6.1 RC4
Sorry - watch out for that link - I’m seeing the text correctly, but the underlying link incorrectly when I look at it in my send folder. The evils of html mail I guess. To be sure you have the right artifacts, make sure you are looking at the following location: http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/ - Mark On Jan 23, 2014, at 9:57 PM, Mark Miller markrmil...@gmail.com wrote: Here we go, hopefully for that last time now…thanks everyone for bearing with us. Please vote to release the following artifacts: http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/ Here is my +1. SUCCESS! [0:56:37.409716] -- - Mark
[jira] [Created] (SOLR-5660) Send request level commitWithin as a param rather than setting it per doc
Shalin Shekhar Mangar created SOLR-5660: --- Summary: Send request level commitWithin as a param rather than setting it per doc Key: SOLR-5660 URL: https://issues.apache.org/jira/browse/SOLR-5660 Project: Solr Issue Type: Improvement Components: Response Writers, SolrCloud Reporter: Shalin Shekhar Mangar Fix For: 5.0, 4.7 In SolrCloud the commitWithin parameter is sent per-document even if it is set on the entire request. We should send request level commitWithin as a param rather than setting it per doc - that would mean less repeated data in the request. We still need to properly support per doc like this as well though, because that is the level cmd objects support and we are distributing cmd objects. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880716#comment-13880716 ] Shalin Shekhar Mangar commented on SOLR-5658: - This was nasty. Thanks for fixing and back-porting this, Mark! I opened SOLR-5660 to send request level commitWithin as a param. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Mark Miller Priority: Critical Fix For: 5.0, 4.7, 4.6.1 Attachments: SOLR-5658.patch, SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler –
[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added
[ https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880726#comment-13880726 ] Mark Miller commented on SOLR-5658: --- Another issue this fixed is that the documents were being serialized and sent twice - though they were not processed twice, so just wasteful and not functionally problematic. commitWithin does not reflect the new documents added - Key: SOLR-5658 URL: https://issues.apache.org/jira/browse/SOLR-5658 Project: Solr Issue Type: Bug Affects Versions: 4.6, 5.0 Reporter: Varun Thacker Assignee: Mark Miller Priority: Critical Fix For: 5.0, 4.7, 4.6.1 Attachments: SOLR-5658.patch, SOLR-5658.patch I start 4 nodes using the setup mentioned on - https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud I added a document using - curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add' In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit with openSearcher=false In Solr 4.6.x there is there is only one commit hard commit with openSearcher=false So even after 10 seconds queries on none of the shards reflect the added document. This was also reported on the solr-user list ( http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html ) Here are the relevant logs Logs from Solr 4.5.1 Node 1: {code} 420021 [qtp619011445-12] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45 {code} Node 2: {code} 119896 [qtp1608701025-10] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2} {add=[testdoc (1458003295513608192)]} 0 348 129648 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 129679 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@e174f70 main 129680 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 129681 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCore – [collection1] Registered new searcher Searcher@e174f70 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)} 134648 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3} commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} 134658 [commitScheduler-7-thread-1] INFO org.apache.solr.core.SolrCore – newest commit generation = 4 134660 [commitScheduler-7-thread-1] INFO org.apache.solr.update.UpdateHandler – end_commit_flush {code} Node 3: Node 4: {code} 374545 [qtp1608701025-16] INFO org.apache.solr.update.processor.LogUpdateProcessor – [collection1] webapp=/solr path=/update params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2} {add=[testdoc (1458002133233172480)]} 0 20 384545 [commitScheduler-8-thread-1] INFO org.apache.solr.update.UpdateHandler – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false} 384552 [commitScheduler-8-thread-1] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@36137e08 main 384553 [commitScheduler-8-thread-1] INFO
[jira] [Commented] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...
[ https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880735#comment-13880735 ] Steve Rowe commented on SOLR-5652: -- Uh, the trial #129 failure isn't just sorted wrong on the second page, the whole thing is sorted wrong: all the missing-value docs should be on the first page. On the second page, the three missing value docs are sorted as if they had the value 0. The same thing happened on trial #25 - on the second page, missing value doc id=53 is sorted as if its int_dv_last value were zero, rather than missing, and then it shows up again as the final doc on the third page, where it belongs: {noformat} [junit4] 2 19917 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups SOLR-5652: ({params(q=*%3A*fl=id%2Cint_dv_lastrows=50sort=int_dv_last+desc%2C+id+desc),defaults(cursorMark=*)}) gave us these docs: {id=115, int_dv_last=2091290595}; {id=113, int_dv_last=2037908394}; {id=41, int_dv_last=2010364276}; {id=55, int_dv_last=1998540267}; {id=61, int_dv_last=1928174044}; {id=10, int_dv_last=1926002179}; {id=6, int_dv_last=1860315269}; {id=68, int_dv_last=181298}; {id=72, int_dv_last=1788709893}; {id=94, int_dv_last=1775138667}; {id=103, int_dv_last=1759722924}; {id=19, int_dv_last=1708818408}; {id=62, int_dv_last=1702707874}; {id=95, int_dv_last=1575599582}; {id=18, int_dv_last=1539900646}; {id=3, int_dv_last=1534894477}; {id=16, int_dv_last=1513487396}; {id=122, int_dv_last=1512368828}; {id=91, int_dv_last=1490726417}; {id=100, int_dv_last=1369044665}; {id=129, int_dv_last=1366930639}; {id=2, int_dv_last=1335797630}; {id=12, int_dv_last=1311171495}; {id=17, int_dv_last=1197587669}; {id=71, int_dv_last=1075041470}; {id=14, int_dv_last=1062057736}; {id=87, int_dv_last=1062050843}; {id=98, int_dv_last=1026760294}; {id=32, int_dv_last=987606417}; {id=48, int_dv_last=971706716}; {id=25, int_dv_last=860420389}; {id=58, int_dv_last=844256726}; {id=120, int_dv_last=784821778}; {id=26, int_dv_last=778495105}; {id=89, int_dv_last=759861936}; {id=42, int_dv_last=731134129}; {id=38, int_dv_last=507728088}; {id=66, int_dv_last=504369368}; {id=88, int_dv_last=461655530}; {id=127, int_dv_last=443109475}; {id=28, int_dv_last=395812574}; {id=76, int_dv_last=390559531}; {id=27, int_dv_last=388277668}; {id=128, int_dv_last=312954617}; {id=101, int_dv_last=288358140}; {id=36, int_dv_last=262776063}; {id=8, int_dv_last=258137179}; {id=49, int_dv_last=203957872}; {id=104, int_dv_last=193961933}; {id=70, int_dv_last=177134041}; [junit4] 2 19936 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups SOLR-5652: ({params(q=*%3A*fl=id%2Cint_dv_lastrows=50sort=int_dv_last+desc%2C+id+desc),defaults(cursorMark=AoJZndujBVYE)}) gave us these docs: {id=4, int_dv_last=159428848}; {id=109, int_dv_last=146424475}; {id=82, int_dv_last=118282228}; {id=54, int_dv_last=85706438}; {id=5, int_dv_last=53954157}; {id=90, int_dv_last=34653341}; {id=125, int_dv_last=22280683}; {id=74, int_dv_last=49}; {id=84, int_dv_last=47}; {id=44, int_dv_last=45}; {id=40, int_dv_last=40}; {id=126, int_dv_last=39}; {id=79, int_dv_last=38}; {id=96, int_dv_last=36}; {id=77, int_dv_last=29}; {id=124, int_dv_last=26}; {id=52, int_dv_last=26}; {id=99, int_dv_last=24}; {id=51, int_dv_last=22}; {id=92, int_dv_last=20}; {id=53}; {id=86, int_dv_last=-27969262}; {id=63, int_dv_last=-64632197}; {id=111, int_dv_last=-65674043}; {id=78, int_dv_last=-92357840}; {id=69, int_dv_last=-128203234}; {id=118, int_dv_last=-174163156}; {id=56, int_dv_last=-213598056}; {id=64, int_dv_last=-250673657}; {id=116, int_dv_last=-349965047}; {id=73, int_dv_last=-363194086}; {id=112, int_dv_last=-365330802}; {id=97, int_dv_last=-378023587}; {id=20, int_dv_last=-425200925}; {id=22, int_dv_last=-447702352}; {id=110, int_dv_last=-457782308}; {id=50, int_dv_last=-458057913}; {id=65, int_dv_last=-464626829}; {id=43, int_dv_last=-479019126}; {id=81, int_dv_last=-490373572}; {id=46, int_dv_last=-491310745}; {id=35, int_dv_last=-524855567}; {id=93, int_dv_last=-562980068}; {id=102, int_dv_last=-603711742}; {id=106, int_dv_last=-664725432}; {id=37, int_dv_last=-861444535}; {id=30, int_dv_last=-872755266}; {id=108, int_dv_last=-905452841}; {id=85, int_dv_last=-908362401}; {id=31, int_dv_last=-909902582}; [junit4] 2 19950 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups SOLR-5652: ({params(q=*%3A*fl=id%2Cint_dv_lastrows=50sort=int_dv_last+desc%2C+id+desc),defaults(cursorMark=AoIGycP9Cl8B)}) gave us these docs: {id=39, int_dv_last=-1040495703}; {id=83, int_dv_last=-1098867850}; {id=60, int_dv_last=-1130244120}; {id=75, int_dv_last=-1241745669}; {id=9, int_dv_last=-1248082530}; {id=29, int_dv_last=-1263869241}; {id=121, int_dv_last=-1269818264}; {id=67, int_dv_last=-1368223478}; {id=24, int_dv_last=-1402120260}; {id=117, int_dv_last=-1432445507}; {id=21, int_dv_last=-1445804798}; {id=13,
Re: [VOTE] Release Lucene/Solr 4.6.1 RC4
+1 for http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/ SUCCESS! [1:09:59.249629] On Fri, Jan 24, 2014 at 8:56 AM, Mark Miller markrmil...@gmail.com wrote: Sorry - watch out for that link - I’m seeing the text correctly, but the underlying link incorrectly when I look at it in my send folder. The evils of html mail I guess. To be sure you have the right artifacts, make sure you are looking at the following location: http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/ - Mark On Jan 23, 2014, at 9:57 PM, Mark Miller markrmil...@gmail.com wrote: Here we go, hopefully for that last time now…thanks everyone for bearing with us. Please vote to release the following artifacts: http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/ Here is my +1. SUCCESS! [0:56:37.409716] -- - Mark -- Regards, Shalin Shekhar Mangar. - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...
[ https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Rowe updated SOLR-5652: - Attachment: 372.log I see the same pattern (missing value docvalue sorting as if it had a value of zero, or zero-length in the string case) in all the other failed trials: trial #330: sort=double_dv_first+desc; missing value doc id=53 is the first doc on page one, and is also given as one of six missing value docs at the zero position on page three. trial #358: sort=double_dv_last+asc; missing value doc id=53 is given as one of five missing value docs at the zero position on page three, and then again as the last doc on page seven. trial #372: sort=str_dv_last+desc; missing value doc id=45 is mentioned on two different pages, and missing str_dv_last value docs are sorted at the same position as, and interleaved with, zero-length value docs. I've attached the full log for this one ({{372.log}}). Heisenbug in DistribCursorPagingTest: walk already seen ... - Key: SOLR-5652 URL: https://issues.apache.org/jira/browse/SOLR-5652 Project: Solr Issue Type: Bug Reporter: Hoss Man Assignee: Hoss Man Attachments: 129.log, 372.log, jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1200.log.txt, jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1217.log.txt Twice now, Uwe's jenkins has encountered a walk already seen ... assertion failure from DistribCursorPagingTest that I've been unable to fathom, let alone reproduce (although sarowe was able to trigger a similar, non-reproducible seed, failure on his machine) Using this as a tracking issue to try and make sense of it. Summary of things noticed so far (in 3 failures): * So far only seen on http://jenkins.thetaphi.de sarowe's mac * So far only seen on MacOSX * So far only seen on branch 4x * So far seen on both Java6 and Java7 * fails occured in first block of randomized testing: ** we've indexed a small number of randomized docs ** we're explicitly looping over every field and sorting in both directions * fails were both when doing a desc sorting on one of the \*_dv_last or \*_dv_first fields (docValues=true, either sortMissingLast=true OR sortMissingFirst=true) ** sort on same field asc has always worked fine just before this (fields are in arbitrary order, but asc always tried before desc) ** sorting on some other random fields has sometimes been tried before this and worked (specifics of each failure seen in the wild recorded in comments) -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [VOTE] Release Lucene/Solr 4.6.1 RC4
+1 Please pay close attention to Mark's followup email! Load release URL http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/;... ... SUCCESS! [0:38:51.100830] On Thu, Jan 23, 2014 at 10:26 PM, Mark Miller markrmil...@gmail.com wrote: Sorry - watch out for that link - I’m seeing the text correctly, but the underlying link incorrectly when I look at it in my send folder. The evils of html mail I guess. To be sure you have the right artifacts, make sure you are looking at the following location: http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/ - Mark On Jan 23, 2014, at 9:57 PM, Mark Miller markrmil...@gmail.com wrote: Here we go, hopefully for that last time now…thanks everyone for bearing with us. Please vote to release the following artifacts: http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560491/ Here is my +1. SUCCESS! [0:56:37.409716] -- - Mark
[jira] [Commented] (SOLR-5648) SolrCore#getStatistics() should nest open searchers' stats
[ https://issues.apache.org/jira/browse/SOLR-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880789#comment-13880789 ] Otis Gospodnetic commented on SOLR-5648: Does this end up being exposed in JMX, too? SolrCore#getStatistics() should nest open searchers' stats -- Key: SOLR-5648 URL: https://issues.apache.org/jira/browse/SOLR-5648 Project: Solr Issue Type: Task Reporter: Shikhar Bhushan Priority: Minor Fix For: 4.7 Attachments: SOLR-5648.patch, oldestSearcherStaleness.gif, openSearchers.gif {{SolrIndexSearcher}} leaks are a notable cause of garbage collection issues in codebases with custom components. So it is useful to be able to access monitoring information about what searchers are currently open, and in turn access their stats e.g. {{openedAt}}. This can be nested via {{SolrCore#getStatistics()}} which has a {{_searchers}} collection of all open searchers. -- This message was sent by Atlassian JIRA (v6.1.5#6160) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org