[jira] [Commented] (SOLR-5514) atomic update throws exception if the schema contains uuid fields: Invalid UUID String: 'java.util.UUID:e26c4d56-e98d-41de-9b7f-f63192089670'

2014-01-23 Thread Arun Kumar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879794#comment-13879794
 ] 

Arun Kumar commented on SOLR-5514:
--

Hi Dirk, Is this still an issue? I am not able to reproduce. Can you please 
confirm?

 atomic update throws exception if the schema contains uuid fields: Invalid 
 UUID String: 'java.util.UUID:e26c4d56-e98d-41de-9b7f-f63192089670'
 -

 Key: SOLR-5514
 URL: https://issues.apache.org/jira/browse/SOLR-5514
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.5.1
 Environment: unix and windows
Reporter: Dirk Reuss 
Assignee: Shalin Shekhar Mangar

 I am updating an exiting document with the statement 
 adddocfield name='name' update='set'newvalue/field
 All fields are stored and I have several UUID fields. About 10-20% of the 
 update commands will fail with the message: (example)
 Invalid UUID String: 'java.util.UUID:532c9353-d391-4a04-8618-dc2fa1ef8b35'
 the point is that java.util.UUID seems to be prepended to the original uuid 
 stored in the field and when the value is written this error occours.
 I tried to check if this specific uuid field was the problem and
 added the uuid field in the update xml with(field name='id1' 
 update='set'...). But the error simply moved to an other uuid field.
 here is the original exception:
 lst name=responseHeaderint name=status500/intint 
 name=QTime34/int/lstlst name=errorstr name=msgError while 
 creating field 
 'MyUUIDField{type=uuid,properties=indexed,stored,omitTermFreqAndPositions,required,
  required=true}' from value 
 'java.util.UUID:e26c4d56-e98d-41de-9b7f-f63192089670'/strstr 
 name=traceorg.apache.solr.common.SolrException: Error while creating field 
 'MyUUIDField{type=uuid,properties=indexed,stored,omitTermFreqAndPositions,required,
  required=true}' from value 
 'java.util.UUID:e26c4d56-e98d-41de-9b7f-f63192089670'
   at org.apache.solr.schema.FieldType.createField(FieldType.java:259)
   at org.apache.solr.schema.StrField.createFields(StrField.java:56)
   at 
 org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:47)
   at 
 org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:118)
   at 
 org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:77)
   at 
 org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:215)
   at 
 org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
   at 
 org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
   at 
 org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:556)
   at 
 org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:692)
   at 
 org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:435)
   at 
 org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100)
   at 
 org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247)
   at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174)
   at 
 org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)
   at 
 org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
   at 
 org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
   at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859)
   at 
 org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:703)
   at 
 org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:406)
   at 
 org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:195)
   at 
 org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
   at 
 org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
   at 
 org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
   at 
 org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
   at 
 org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
   at 
 org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
   at 
 org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
   at 
 org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
   at 
 

[jira] [Updated] (SOLR-5477) Async execution of OverseerCollectionProcessor tasks

2014-01-23 Thread Anshum Gupta (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anshum Gupta updated SOLR-5477:
---

Attachment: SOLR-5477.patch

Still a lot of stuff to be added/fixed but here's another patch so that if 
someone is interested, he/she could get some idea on the direction in which I'm 
moving.

Here's what's been fixed/changed in this patch:
* Standardized the request parameters for CoreAdmin and Collection level 
request status. Parameters now are : action=REQUESTSTATUSrequestid=XX 
* Added async option for all other calls (not just splitshard and 
createcollection).
* Fixed the encoding related stuff and the potential NPEs where ever I could 
spot those.
* Removed unused code and cleaned up some debugging stuff.
* Used a ThreadPool in case of coreadmin in a rather raw manner i.e. static 
(and without the mode check etc). Have added todo's to add those checks and to 
also call shutdown for the threadpool.
* Changed names of the queues to the ones suggested by Shalin.
* Items are no longer being put in the completed queue in Overseer.
* Ran ant check-forbidden-apis to fix reported issues.

Here's what still lies with me incomplete/not-working:
* Make shard requests async (pass the param to coreadmin requests and poll for 
completion/failure) from the OverseerCollectionProcessor.
* Have a threadpool for OverseerCollectionProcessor so that the long running 
tasks don't block everything else.
* Improve current tests and add more tests.

 Async execution of OverseerCollectionProcessor tasks
 

 Key: SOLR-5477
 URL: https://issues.apache.org/jira/browse/SOLR-5477
 Project: Solr
  Issue Type: Sub-task
  Components: SolrCloud
Reporter: Noble Paul
Assignee: Anshum Gupta
 Attachments: SOLR-5477-CoreAdminStatus.patch, SOLR-5477.patch, 
 SOLR-5477.patch, SOLR-5477.patch


 Typical collection admin commands are long running and it is very common to 
 have the requests get timed out.  It is more of a problem if the cluster is 
 very large.Add an option to run these commands asynchronously
 add an extra param async=true for all collection commands
 the task is written to ZK and the caller is returned a task id. 
 as separate collection admin command will be added to poll the status of the 
 task
 command=statusid=7657668909
 if id is not passed all running async tasks should be listed
 A separate queue is created to store in-process tasks . After the tasks are 
 completed the queue entry is removed. OverSeerColectionProcessor will perform 
 these tasks in multiple threads



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Varun Thacker (JIRA)
Varun Thacker created SOLR-5658:
---

 Summary: commitWithin does not reflect the new documents added
 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker


I start 4 nodes using the setup mentioned on - 
https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
 
I added a document using - 
curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add'

In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
with openSearcher=false
In Solr 4.6.x there is there is only one commit hard commit with 
openSearcher=false
 
So even after 10 seconds queries on none of the shards reflect the added 
document. 

This was also reported on the solr-user list ( 
http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
 )

Here are the relevant logs 

Logs from Solr 4.5.1
Node 1:
420021 [qtp619011445-12] INFO  
org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 
Node 2:
119896 [qtp1608701025-10] INFO  
org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
webapp=/solr path=/update 
params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
 {add=[testdoc (1458003295513608192)]} 0 348
129648 [commitScheduler-8-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
129679 [commitScheduler-8-thread-1] INFO  
org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
129680 [commitScheduler-8-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– end_commit_flush
129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
QuerySenderListener sending requests to Searcher@e174f70 
main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
QuerySenderListener done.
129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
[collection1] Registered new searcher Searcher@e174f70 
main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
134648 [commitScheduler-7-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– start 
commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
SolrDeletionPolicy.onCommit: commits: num=2

commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}

commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
newest commit generation = 4
134660 [commitScheduler-7-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– end_commit_flush
 
 
Node 3:
 
Node 4:
374545 [qtp1608701025-16] INFO  
org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
webapp=/solr path=/update 
params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
 {add=[testdoc (1458002133233172480)]} 0 20
384545 [commitScheduler-8-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
384552 [commitScheduler-8-thread-1] INFO  
org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
384553 [commitScheduler-8-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– end_commit_flush
384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
QuerySenderListener sending requests to Searcher@36137e08 
main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)}
384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
QuerySenderListener done.
384554 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
[collection1] Registered new searcher Searcher@36137e08 
main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)}
389545 [commitScheduler-7-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– start 

[jira] [Assigned] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Shalin Shekhar Mangar (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shalin Shekhar Mangar reassigned SOLR-5658:
---

Assignee: Shalin Shekhar Mangar

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar

 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
  
 Node 2:
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  
  
 Node 3:
  
 Node 4:
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@36137e08 
 main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)}
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 

[jira] [Updated] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Shalin Shekhar Mangar (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shalin Shekhar Mangar updated SOLR-5658:


Description: 
I start 4 nodes using the setup mentioned on - 
https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
 
I added a document using - 
curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
text/xml --data-binary 'adddocfield name=idtestdoc/field/doc/add'

In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
with openSearcher=false
In Solr 4.6.x there is there is only one commit hard commit with 
openSearcher=false
 
So even after 10 seconds queries on none of the shards reflect the added 
document. 

This was also reported on the solr-user list ( 
http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
 )

Here are the relevant logs 

Logs from Solr 4.5.1
Node 1:
{code}
420021 [qtp619011445-12] INFO  
org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
{code}
 
Node 2:
{code}
119896 [qtp1608701025-10] INFO  
org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
webapp=/solr path=/update 
params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
 {add=[testdoc (1458003295513608192)]} 0 348
129648 [commitScheduler-8-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
129679 [commitScheduler-8-thread-1] INFO  
org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
129680 [commitScheduler-8-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– end_commit_flush
129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
QuerySenderListener sending requests to Searcher@e174f70 
main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
QuerySenderListener done.
129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
[collection1] Registered new searcher Searcher@e174f70 
main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
134648 [commitScheduler-7-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– start 
commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
SolrDeletionPolicy.onCommit: commits: num=2

commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}

commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
newest commit generation = 4
134660 [commitScheduler-7-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– end_commit_flush
 {code}
 
Node 3:
 
Node 4:
{code}
374545 [qtp1608701025-16] INFO  
org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
webapp=/solr path=/update 
params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
 {add=[testdoc (1458002133233172480)]} 0 20
384545 [commitScheduler-8-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
384552 [commitScheduler-8-thread-1] INFO  
org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
384553 [commitScheduler-8-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– end_commit_flush
384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
QuerySenderListener sending requests to Searcher@36137e08 
main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)}
384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
QuerySenderListener done.
384554 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
[collection1] Registered new searcher Searcher@36137e08 
main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)}
389545 [commitScheduler-7-thread-1] INFO  org.apache.solr.update.UpdateHandler  
– start 
commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
389549 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Shalin Shekhar Mangar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879844#comment-13879844
 ] 

Shalin Shekhar Mangar commented on SOLR-5658:
-

Thanks for reporting this Varun.

The thing to note between the 4.5 logs and the 4.6.x logs is that in 4.5, there 
are two commit statements per node (1 soft commit with openSearcher=true and 
another hard commit with openSearcher=false) whereas in 4.6.x there is only one 
commit (hard commit with openSearcher=false). We need to find out why.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar

 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Shalin Shekhar Mangar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879849#comment-13879849
 ] 

Shalin Shekhar Mangar commented on SOLR-5658:
-

Also reported by a user (thanks Varun for pointing it out to me privately):

http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar

 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 

Re: [VOTE] Release Lucene/Solr 4.6.1 RC3

2014-01-23 Thread Michael McCandless
+1

SUCCESS! [0:38:52.784699]

Mike McCandless

http://blog.mikemccandless.com


On Thu, Jan 23, 2014 at 1:10 AM, Shalin Shekhar Mangar
shalinman...@gmail.com wrote:
 +1

 SUCCESS! [1:08:11.734266]

 On Thu, Jan 23, 2014 at 9:32 AM, Mark Miller markrmil...@gmail.com wrote:
 Please vote to release the following artifacts:

 http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560491/

 Here is my +1.

 SUCCESS! [0:50:55.923056]

 --
 - Mark



 --
 Regards,
 Shalin Shekhar Mangar.

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5409) ToParentBlockJoinCollector.getTopGroups returns empty Groups

2014-01-23 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879858#comment-13879858
 ] 

Michael McCandless commented on LUCENE-5409:


Hmm, maybe a BooleanQuery containing just a single TermQuery?

Or, maybe create a custom Query for this test that wraps another query but has 
its own unusual hashCode() impl...

 ToParentBlockJoinCollector.getTopGroups returns empty Groups
 

 Key: LUCENE-5409
 URL: https://issues.apache.org/jira/browse/LUCENE-5409
 Project: Lucene - Core
  Issue Type: Bug
  Components: core/search
Affects Versions: 4.6
 Environment: Ubuntu 12.04
Reporter: Peng Cheng
Assignee: Michael McCandless
Priority: Critical
 Fix For: 4.7

   Original Estimate: 168h
  Remaining Estimate: 168h

 A bug is observed to cause unstable results returned by the getTopGroups 
 function of class ToParentBlockJoinCollector.
 In the scorer generation stage, the ToParentBlockJoinCollector will 
 automatically rewrite all the associated ToParentBlockJoinQuery (and their 
 subqueries), and save them into its in-memory Look-up table, namely 
 joinQueryID (see enroll() method for detail). Unfortunately, in the 
 getTopGroups method, the new ToParentBlockJoinQuery parameter is not 
 rewritten (at least users are not expected to do so). When the new one is 
 searched in the old lookup table (considering the impact of rewrite() on 
 hashCode()), the lookup will largely fail and eventually end up with a 
 topGroup collection consisting of only empty groups (their hitCounts are 
 guaranteed to be zero).
 An easy fix would be to rewrite the original BlockJoinQuery before invoking 
 getTopGroups method. However, the computational cost of this is not optimal. 
 A better but slightly more complex solution would be to save unrewrited 
 Queries into the lookup table.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser

2014-01-23 Thread Upayavira (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879868#comment-13879868
 ] 

Upayavira commented on LUCENE-5410:
---

If the point of this query parser is to support the sort of thing that users 
type into search boxes, are they likely to enter fuzzy or phrase slop searches? 
This seems unlikely to me, and seems to take a SimpleQueryParser away from 
being simple. I'd suggest that if that functionality is to be added, it 
should be added somewhere where it is under programmatic control, not user 
control, such as how the edismax query parser accepts additional request 
parameters.

Thus ps=2 would set a phrase slop. fs=2 could set a value of 2 for fuzzy search 
also. This would seem more in keeping with the goal of a clean, simple query 
parser.


 Add fuzziness support to SimpleQueryParser
 --

 Key: LUCENE-5410
 URL: https://issues.apache.org/jira/browse/LUCENE-5410
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/queryparser
Affects Versions: 4.7
Reporter: Lee Hinman
Priority: Minor
 Attachments: LUCENE-5410.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so 
 that:
 {{foo~2}}
 generates a {{FuzzyQuery}} with an max edit distance of 2 and:
 {{foo bar~2}}
 generates a {{PhraseQuery}} with a slop of 2.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-5473) Make one state.json per collection

2014-01-23 Thread Noble Paul (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Noble Paul updated SOLR-5473:
-

Attachment: SOLR-5473.patch

updated to trunk

 Make one state.json per collection
 --

 Key: SOLR-5473
 URL: https://issues.apache.org/jira/browse/SOLR-5473
 Project: Solr
  Issue Type: Sub-task
  Components: SolrCloud
Reporter: Noble Paul
Assignee: Noble Paul
 Attachments: SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, 
 SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, 
 SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, 
 SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch, SOLR-5473.patch


 As defined in the parent issue, store the states of each collection under 
 /collections/collectionname/state.json node



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-5659) Ignore or throw proper error message for bad delete containing bad composite ID

2014-01-23 Thread Markus Jelsma (JIRA)
Markus Jelsma created SOLR-5659:
---

 Summary: Ignore or throw proper error message for bad delete 
containing bad composite ID
 Key: SOLR-5659
 URL: https://issues.apache.org/jira/browse/SOLR-5659
 Project: Solr
  Issue Type: Bug
  Components: SolrCloud
Affects Versions: 5.0
 Environment: 5.0-SNAPSHOT 1480985:1559676M - markus - 2014-01-20 
13:48:08
Reporter: Markus Jelsma
 Fix For: 5.0


The following error is thrown when sending deleteById via SolrJ with ID ending 
with an exclamation mark, it is also the case for deletes by id via the URL. 
For some curious reason delete by query using the id field does not fail, but i 
would expect the same behaviour.

* fails: /solr/update?commit=truestream.body=deleteida!/id/delete
* ok: /solr/update?commit=truestream.body=deletequeryid:a!/query/delete

{code}
2014-01-22 15:32:48,826 ERROR [solr.core.SolrCore] - [http-8080-exec-5] - : 
java.lang.ArrayIndexOutOfBoundsException: 1
at 
org.apache.solr.common.cloud.CompositeIdRouter$KeyParser.getHash(CompositeIdRouter.java:291)
at 
org.apache.solr.common.cloud.CompositeIdRouter.sliceHash(CompositeIdRouter.java:58)
at 
org.apache.solr.common.cloud.HashBasedRouter.getTargetSlice(HashBasedRouter.java:33)
at 
org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:218)
at 
org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:961)
at 
org.apache.solr.update.processor.UpdateRequestProcessor.processDelete(UpdateRequestProcessor.java:55)
at 
org.apache.solr.handler.loader.XMLLoader.processDelete(XMLLoader.java:347)
at 
org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:278)
at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174)
at 
org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)
at 
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1915)
at 
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:785)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:203)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at 
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at 
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:744)
at 
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2282)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724) 
{code}

See also: 
http://lucene.472066.n3.nabble.com/AIOOBException-on-trunk-since-21st-or-22nd-build-td4112753.html



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [VOTE] Release Lucene/Solr 4.6.1 RC3

2014-01-23 Thread Robert Muir
+1

SUCCESS! [0:37:34.283758]



On Wed, Jan 22, 2014 at 11:02 PM, Mark Miller markrmil...@gmail.com wrote:

 Please vote to release the following artifacts:

 http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560491/

 Here is my +1.

 SUCCESS! [0:50:55.923056]

 --
 - Mark



[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser

2014-01-23 Thread Robert Muir (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879952#comment-13879952
 ] 

Robert Muir commented on LUCENE-5410:
-

Upayavira: I see your point, however one of the key advantages of this parser 
is the ability to selectively enable or disable any operator. The same 
arguments could be made for prefix queries or even the NOT operator (-), so it 
was added with that in mind (as well as to provide a way to do multiword 
synonyms: disable WHITESPACE).

As far as setting a parameter to make every term fuzzy, I don't think thats a 
good idea. In such a case I really think you should do n-gram indexing :)

 Add fuzziness support to SimpleQueryParser
 --

 Key: LUCENE-5410
 URL: https://issues.apache.org/jira/browse/LUCENE-5410
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/queryparser
Affects Versions: 4.7
Reporter: Lee Hinman
Priority: Minor
 Attachments: LUCENE-5410.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so 
 that:
 {{foo~2}}
 generates a {{FuzzyQuery}} with an max edit distance of 2 and:
 {{foo bar~2}}
 generates a {{PhraseQuery}} with a slop of 2.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879998#comment-13879998
 ] 

Mark Miller commented on SOLR-5658:
---

This is probably related to what params we pass on and which we filter out in 
DistributedUpdateProcessor.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar

 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@36137e08 
 

[jira] [Updated] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Miller updated SOLR-5658:
--

Attachment: SOLR-5658.patch

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@36137e08 
 main{StandardDirectoryReader(segments_2:7:nrt _1(4.5.1):C1)}
 384553 [searcherExecutor-5-thread-1] 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880013#comment-13880013
 ] 

Mark Miller commented on SOLR-5658:
---

Patch adds a test and forwards on the commitWithin param.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@36137e08 
 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Shalin Shekhar Mangar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880073#comment-13880073
 ] 

Shalin Shekhar Mangar commented on SOLR-5658:
-

Thanks Mark. Should we re-spin 4.6.1 for this?

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@36137e08 
 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880086#comment-13880086
 ] 

Mark Miller commented on SOLR-5658:
---

I don't know. If there is support for it, I'm certainly willing to do it, but 
I'm not sure it's worth an RC4 myself. I think this issue has been around a 
very long time, and it's just random luck something seemed like it worked on 
4.5.1 or older in any simple testing.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Daniel Collins (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880114#comment-13880114
 ] 

Daniel Collins commented on SOLR-5658:
--

Mark, what's the impact of this issue? Are you saying that soft commits were 
never distributed (which seems quite a big deal!), or is it more subtle than 
that?

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  

[jira] [Comment Edited] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Daniel Collins (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880114#comment-13880114
 ] 

Daniel Collins edited comment on SOLR-5658 at 1/23/14 5:38 PM:
---

Mark, what's the impact of this issue? Are you saying that CommitWithin was 
never distributed (which seems quite a big deal!), or is it more subtle than 
that?


was (Author: dancollins):
Mark, what's the impact of this issue? Are you saying that soft commits were 
never distributed (which seems quite a big deal!), or is it more subtle than 
that?

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880117#comment-13880117
 ] 

Mark Miller commented on SOLR-5658:
---

Right - it was not distributed. Not since we started filtering most parameters, 
which was a very long time ago.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener 

Re: [VOTE] Release Lucene/Solr 4.6.1 RC3

2014-01-23 Thread Mark Miller
There is some discussion around an RC4 at  
https://issues.apache.org/jira/browse/SOLR-5658 if anyone wants to weigh in.

- Mark

On Jan 22, 2014, at 11:02 PM, Mark Miller markrmil...@gmail.com wrote:

 Please vote to release the following artifacts:
 
 http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560491/
 
 Here is my +1.
 
 SUCCESS! [0:50:55.923056]
 
 --
 - Mark



[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Daniel Collins (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880139#comment-13880139
 ] 

Daniel Collins commented on SOLR-5658:
--

Ok, was just puzzled about how our system is working then (4.4.0), we 
consistently see softCommits running on the replicas, maybe it is autoCommit 
firing instead...

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] 

[jira] [Commented] (SOLR-5488) Fix up test failures for Analytics Component

2014-01-23 Thread Steven Bower (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880182#comment-13880182
 ] 

Steven Bower commented on SOLR-5488:


[~erike4...@yahoo.com] Sorry for the delay.. I am looking at this today.. I 
think i was able to reproduce on my windows box using the 10k iters above...

 Fix up test failures for Analytics Component
 

 Key: SOLR-5488
 URL: https://issues.apache.org/jira/browse/SOLR-5488
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.0, 4.7
Reporter: Erick Erickson
Assignee: Erick Erickson
 Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch


 The analytics component has a few test failures, perhaps 
 environment-dependent. This is just to collect the test fixes in one place 
 for convenience when we merge back into 4.x



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...

2014-01-23 Thread Steve Rowe (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Rowe updated SOLR-5652:
-

Attachment: 129.log

On OS X Mavericks with Apple Java 1.6.0_65 on branch_4x I ran {{ant 
-Dtestcase=DistribCursorPaginTest}} in {{solr/core/}} in a bash loop to try to 
find failures with reproducible seeds.  Out of a little over 400 trials, 5 
failed.

Below is the repro line from one I picked at random (trial #129) to attempt to 
reproduce.  I've re-run it six times, and the failure reproduced the first 
time, but the test succeeded each of the following five times.  (I tried a 
seventh time, but performed {{ant clean}} at the top-level directory first, and 
it still didn't reproduce.) 

{noformat}
ant test  -Dtestcase=DistribCursorPagingTest -Dtests.method=testDistribSearch 
-Dtests.seed=55FB0127DC22CD98 -Dtests.slow=true -Dtests.locale=en_AU 
-Dtests.timezone=Atlantic/Madeira -Dtests.file.encoding=US-ASCII
{noformat}

I'm attaching the test log ({{129.log}}) from the original failure with the 
above seed.

 Heisenbug in DistribCursorPagingTest: walk already seen ...
 -

 Key: SOLR-5652
 URL: https://issues.apache.org/jira/browse/SOLR-5652
 Project: Solr
  Issue Type: Bug
Reporter: Hoss Man
Assignee: Hoss Man
 Attachments: 129.log, 
 jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1200.log.txt, 
 jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1217.log.txt


 Twice now, Uwe's jenkins has encountered a walk already seen ... assertion 
 failure from DistribCursorPagingTest that I've been unable to fathom, let 
 alone reproduce.
 Using this as a tracking issue to try and make sense of it.
 Summary of things noticed so far (in 2 failures):
 * So far only seen on http://jenkins.thetaphi.de
 * So far only seen on MacOSX
 * So far only seen on branch 4x
 * So far seen on both Java6 and Java7
 * fails occured in first block of randomized testing: 
 ** we've indexed a small number of randomized docs
 ** we're explicitly looping over every field and sorting in both directions
 * fails were both when sorting on one of the \*_dv_last desc fields 
 (docValues=true, sortMissingLast=true) 
 ** sort on same field asc has always worked fine just before this (fields are 
 in arbitrary order, but asc always tried before desc)
 ** sorting on some other random fields has sometimes been tried before this 
 and worked
 (specifics of each failure seen in the wild recorded in comments)



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2366) Facet Range Gaps

2014-01-23 Thread Ted Sullivan (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880220#comment-13880220
 ] 

Ted Sullivan commented on SOLR-2366:


At the very least, we should revise the discussion of this feature on the 
SimpleFacetParameters Wiki page. The Wiki page does contain a disclaimer The 
following section on variable width gaps discusses uncommitted code but the 
comment is anchored to Solr 3.6, Solr4.0 so person might reasonably expect 
that it has been released by now (Solr 4.6).  

 Facet Range Gaps
 

 Key: SOLR-2366
 URL: https://issues.apache.org/jira/browse/SOLR-2366
 Project: Solr
  Issue Type: Improvement
Reporter: Grant Ingersoll
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 4.7

 Attachments: SOLR-2366.patch, SOLR-2366.patch


 There really is no reason why the range gap for date and numeric faceting 
 needs to be evenly spaced.  For instance, if and when SOLR-1581 is completed 
 and one were doing spatial distance calculations, one could facet by function 
 into 3 different sized buckets: walking distance (0-5KM), driving distance 
 (5KM-150KM) and everything else (150KM+), for instance.  We should be able to 
 quantize the results into arbitrarily sized buckets.
 (Original syntax proposal removed, see discussion for concrete syntax)



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Shalin Shekhar Mangar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880226#comment-13880226
 ] 

Shalin Shekhar Mangar commented on SOLR-5658:
-

bq. I think this issue has been around a very long time, and it's just random 
luck something seemed like it worked on 4.5.1 or older in any simple testing.

I'm not sure about that. The commitWithin is also set in the AddUpdateCommand 
in addition to the request params. I ran your test against 4.5 without the fix 
for 5 times and it didn't fail. But it never passes with trunk (without the 
fix) so I think there may be another bug introduced with the streaming changes. 
I'll look at this again tomorrow my time.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880244#comment-13880244
 ] 

Mark Miller commented on SOLR-5658:
---

I think it just depends on if it's a request wide or document level 
commitWithin? If it was request level, the only way it would have worked 
previously is if there was some code that looked for the commitWithin param 
explicitly and set the commitWithin on the AddUpdateCommand - I don't recall 
something like that.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 

[jira] [Commented] (SOLR-5488) Fix up test failures for Analytics Component

2014-01-23 Thread Steven Bower (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880248#comment-13880248
 ] 

Steven Bower commented on SOLR-5488:


one thing i noticed in the output above is this:

{noformat}
[junit4]  lst name=mr
[junit4]  long name=count100/long
[junit4]  null name=mcm/
[junit4]  null name=mean/
[junit4]  null name=median/
[junit4]  null name=su/
[junit4]  null name=sum/
[junit4]  null name=unique/
[junit4]  /lst
{noformat}

notice the {{null}} in the response... trying to track this down now

 Fix up test failures for Analytics Component
 

 Key: SOLR-5488
 URL: https://issues.apache.org/jira/browse/SOLR-5488
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.0, 4.7
Reporter: Erick Erickson
Assignee: Erick Erickson
 Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch


 The analytics component has a few test failures, perhaps 
 environment-dependent. This is just to collect the test fixes in one place 
 for convenience when we merge back into 4.x



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (SOLR-5488) Fix up test failures for Analytics Component

2014-01-23 Thread Steven Bower (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880248#comment-13880248
 ] 

Steven Bower edited comment on SOLR-5488 at 1/23/14 7:19 PM:
-

one thing i noticed in the output above is this:

{noformat}
[junit4]  lst name=mr
[junit4]  long name=count100/long
[junit4]  null name=mcm/
[junit4]  null name=mean/
[junit4]  null name=median/
[junit4]  null name=su/
[junit4]  null name=sum/
[junit4]  null name=unique/
[junit4]  /lst
{noformat}

notice the {{null}} in the response... trying to track this down now.. this is 
certainly why the test is failing..


was (Author: sbower):
one thing i noticed in the output above is this:

{noformat}
[junit4]  lst name=mr
[junit4]  long name=count100/long
[junit4]  null name=mcm/
[junit4]  null name=mean/
[junit4]  null name=median/
[junit4]  null name=su/
[junit4]  null name=sum/
[junit4]  null name=unique/
[junit4]  /lst
{noformat}

notice the {{null}} in the response... trying to track this down now

 Fix up test failures for Analytics Component
 

 Key: SOLR-5488
 URL: https://issues.apache.org/jira/browse/SOLR-5488
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.0, 4.7
Reporter: Erick Erickson
Assignee: Erick Erickson
 Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch


 The analytics component has a few test failures, perhaps 
 environment-dependent. This is just to collect the test fixes in one place 
 for convenience when we merge back into 4.x



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880253#comment-13880253
 ] 

Mark Miller commented on SOLR-5658:
---

Okay, outside of the distributed code, Solr does setup the cmd object with a 
request level commitWithin. That is how this used to work, that is why we 
didn't have to propagate the param.

Perhaps the commitWithin is being lost when parsing the javabin.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880256#comment-13880256
 ] 

Mark Miller commented on SOLR-5658:
---

I see the bug.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@36137e08 
 main{StandardDirectoryReader(segments_2:7:nrt 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880298#comment-13880298
 ] 

Mark Miller commented on SOLR-5658:
---

I'm still look at the details, but the cause in the change of behavior is the 
switch from xml to binary update requests.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 

[jira] [Updated] (SOLR-5641) REST API to modify request handlers

2014-01-23 Thread Willy Solaligue (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Willy Solaligue updated SOLR-5641:
--

Attachment: SolrConfigApiDocumentation.pdf

 REST API to modify request handlers
 ---

 Key: SOLR-5641
 URL: https://issues.apache.org/jira/browse/SOLR-5641
 Project: Solr
  Issue Type: Sub-task
Reporter: Willy Solaligue
 Attachments: SOLR-5641.patch, SolrConfigApiDocumentation.pdf


 There should be a REST API to allow modify request handlers.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-5414) suggest module should not depend on expression module

2014-01-23 Thread Simon Willnauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Simon Willnauer updated LUCENE-5414:


Attachment: LUCENE-5414.patch

here is a start - I am still after all these years not familiar with how we 
manage the maven stuff but I guess it somehow figures this out?

 suggest module should not depend on expression module
 -

 Key: LUCENE-5414
 URL: https://issues.apache.org/jira/browse/LUCENE-5414
 Project: Lucene - Core
  Issue Type: Wish
Affects Versions: 4.6, 5.0
Reporter: Simon Willnauer
 Fix For: 5.0, 4.7

 Attachments: LUCENE-5414.patch


 Currently our suggest module depends on the expression module just because 
 the DocumentExpressionDictionary provides some util ctor to pass in an 
 expression directly. That is a lot of dependency for little value IMO and 
 pulls in lots of JARs. DocumentExpressionDictionary should only take a 
 ValueSource instead.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (LUCENE-5414) suggest module should not depend on expression module

2014-01-23 Thread Simon Willnauer (JIRA)
Simon Willnauer created LUCENE-5414:
---

 Summary: suggest module should not depend on expression module
 Key: LUCENE-5414
 URL: https://issues.apache.org/jira/browse/LUCENE-5414
 Project: Lucene - Core
  Issue Type: Wish
Affects Versions: 4.6, 5.0
Reporter: Simon Willnauer
 Fix For: 5.0, 4.7
 Attachments: LUCENE-5414.patch

Currently our suggest module depends on the expression module just because the 
DocumentExpressionDictionary provides some util ctor to pass in an expression 
directly. That is a lot of dependency for little value IMO and pulls in lots of 
JARs. DocumentExpressionDictionary should only take a ValueSource instead.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5414) suggest module should not depend on expression module

2014-01-23 Thread Simon Willnauer (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880323#comment-13880323
 ] 

Simon Willnauer commented on LUCENE-5414:
-

I wonder actually if we should rename that dictionary now seems like the wrong 
name for it if it doesn't take an expression anymore?

 suggest module should not depend on expression module
 -

 Key: LUCENE-5414
 URL: https://issues.apache.org/jira/browse/LUCENE-5414
 Project: Lucene - Core
  Issue Type: Wish
Affects Versions: 4.6, 5.0
Reporter: Simon Willnauer
 Fix For: 5.0, 4.7

 Attachments: LUCENE-5414.patch


 Currently our suggest module depends on the expression module just because 
 the DocumentExpressionDictionary provides some util ctor to pass in an 
 expression directly. That is a lot of dependency for little value IMO and 
 pulls in lots of JARs. DocumentExpressionDictionary should only take a 
 ValueSource instead.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5414) suggest module should not depend on expression module

2014-01-23 Thread Robert Muir (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880328#comment-13880328
 ] 

Robert Muir commented on LUCENE-5414:
-

+1 to just take ValueSource like this patch, I think it keeps our dependencies 
simpler and cleaner.

I also think we could remove the test dep too (in the future or whatever), 
because the test only needs to show it consumes valuesource correctly.



 suggest module should not depend on expression module
 -

 Key: LUCENE-5414
 URL: https://issues.apache.org/jira/browse/LUCENE-5414
 Project: Lucene - Core
  Issue Type: Wish
Affects Versions: 4.6, 5.0
Reporter: Simon Willnauer
 Fix For: 5.0, 4.7

 Attachments: LUCENE-5414.patch


 Currently our suggest module depends on the expression module just because 
 the DocumentExpressionDictionary provides some util ctor to pass in an 
 expression directly. That is a lot of dependency for little value IMO and 
 pulls in lots of JARs. DocumentExpressionDictionary should only take a 
 ValueSource instead.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5414) suggest module should not depend on expression module

2014-01-23 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880338#comment-13880338
 ] 

Michael McCandless commented on LUCENE-5414:


+1

 suggest module should not depend on expression module
 -

 Key: LUCENE-5414
 URL: https://issues.apache.org/jira/browse/LUCENE-5414
 Project: Lucene - Core
  Issue Type: Wish
Affects Versions: 4.6, 5.0
Reporter: Simon Willnauer
 Fix For: 5.0, 4.7

 Attachments: LUCENE-5414.patch


 Currently our suggest module depends on the expression module just because 
 the DocumentExpressionDictionary provides some util ctor to pass in an 
 expression directly. That is a lot of dependency for little value IMO and 
 pulls in lots of JARs. DocumentExpressionDictionary should only take a 
 ValueSource instead.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser

2014-01-23 Thread Lee Hinman (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880350#comment-13880350
 ] 

Lee Hinman commented on LUCENE-5410:


Upayavira: That does bring up a good point, how should the extra fuzzy 
characters be treated if fuzziness is turned off? Currently the patch treats 
the token {{foo~2}} as a TermQuery for foo~2 if {{FUZZINESS_OPERATOR}} is 
disabled. Should it be changed to silently swallow the ~2 even if fuzziness 
is disabled?

 Add fuzziness support to SimpleQueryParser
 --

 Key: LUCENE-5410
 URL: https://issues.apache.org/jira/browse/LUCENE-5410
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/queryparser
Affects Versions: 4.7
Reporter: Lee Hinman
Priority: Minor
 Attachments: LUCENE-5410.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so 
 that:
 {{foo~2}}
 generates a {{FuzzyQuery}} with an max edit distance of 2 and:
 {{foo bar~2}}
 generates a {{PhraseQuery}} with a slop of 2.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-5414) suggest module should not depend on expression module

2014-01-23 Thread Simon Willnauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Simon Willnauer updated LUCENE-5414:


Attachment: LUCENE-5414.patch

another iteration... removed the deps to expression entirely. I will need to 
fix the javadocs and the class name still...

 suggest module should not depend on expression module
 -

 Key: LUCENE-5414
 URL: https://issues.apache.org/jira/browse/LUCENE-5414
 Project: Lucene - Core
  Issue Type: Wish
Affects Versions: 4.6, 5.0
Reporter: Simon Willnauer
 Fix For: 5.0, 4.7

 Attachments: LUCENE-5414.patch, LUCENE-5414.patch


 Currently our suggest module depends on the expression module just because 
 the DocumentExpressionDictionary provides some util ctor to pass in an 
 expression directly. That is a lot of dependency for little value IMO and 
 pulls in lots of JARs. DocumentExpressionDictionary should only take a 
 ValueSource instead.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser

2014-01-23 Thread Upayavira (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880360#comment-13880360
 ] 

Upayavira commented on LUCENE-5410:
---

If fuzziness is disabled, then that should mean that the ~2 syntax has no 
meaning whatever, and should be treated as a regular token. Otherwise, you're 
turning the feature off, but not the syntax, and that will catch people out, 
and make the component more complex than necessary.

 Add fuzziness support to SimpleQueryParser
 --

 Key: LUCENE-5410
 URL: https://issues.apache.org/jira/browse/LUCENE-5410
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/queryparser
Affects Versions: 4.7
Reporter: Lee Hinman
Priority: Minor
 Attachments: LUCENE-5410.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so 
 that:
 {{foo~2}}
 generates a {{FuzzyQuery}} with an max edit distance of 2 and:
 {{foo bar~2}}
 generates a {{PhraseQuery}} with a slop of 2.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser

2014-01-23 Thread Lee Hinman (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880364#comment-13880364
 ] 

Lee Hinman commented on LUCENE-5410:


Gotcha. Next version of the patch will swallow {{~XXX}} if fuzziness is 
disabled, and won't touch QueryBuilder.java, as per Roberts comments.

 Add fuzziness support to SimpleQueryParser
 --

 Key: LUCENE-5410
 URL: https://issues.apache.org/jira/browse/LUCENE-5410
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/queryparser
Affects Versions: 4.7
Reporter: Lee Hinman
Priority: Minor
 Attachments: LUCENE-5410.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so 
 that:
 {{foo~2}}
 generates a {{FuzzyQuery}} with an max edit distance of 2 and:
 {{foo bar~2}}
 generates a {{PhraseQuery}} with a slop of 2.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser

2014-01-23 Thread Robert Muir (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880374#comment-13880374
 ] 

Robert Muir commented on LUCENE-5410:
-

Wait, why swallow it? When disabling an operator, it means its treated as it 
does not exist (no special meaning).

E.g. for PREFIX today, if you disable that operator, it means it will literally 
make a term of foo*

I think this is also agrees with Upayavira's thoughts, but maybe I'm missing 
something.

 Add fuzziness support to SimpleQueryParser
 --

 Key: LUCENE-5410
 URL: https://issues.apache.org/jira/browse/LUCENE-5410
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/queryparser
Affects Versions: 4.7
Reporter: Lee Hinman
Priority: Minor
 Attachments: LUCENE-5410.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so 
 that:
 {{foo~2}}
 generates a {{FuzzyQuery}} with an max edit distance of 2 and:
 {{foo bar~2}}
 generates a {{PhraseQuery}} with a slop of 2.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...

2014-01-23 Thread Hoss Man (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hoss Man updated SOLR-5652:
---

Description: 
Twice now, Uwe's jenkins has encountered a walk already seen ... assertion 
failure from DistribCursorPagingTest that I've been unable to fathom, let alone 
reproduce (although sarowe was able to trigger a similar, non-reproducible 
seed, failure on his machine)

Using this as a tracking issue to try and make sense of it.

Summary of things noticed so far (in 3 failures):
* So far only seen on http://jenkins.thetaphi.de  sarowe's mac
* So far only seen on MacOSX
* So far only seen on branch 4x
* So far seen on both Java6 and Java7
* fails occured in first block of randomized testing: 
** we've indexed a small number of randomized docs
** we're explicitly looping over every field and sorting in both directions
* fails were both when doing a desc sorting on one of the \*_dv_last or 
\*_dv_first fields (docValues=true, either sortMissingLast=true OR 
sortMissingFirst=true) 
** sort on same field asc has always worked fine just before this (fields are 
in arbitrary order, but asc always tried before desc)
** sorting on some other random fields has sometimes been tried before this and 
worked


(specifics of each failure seen in the wild recorded in comments)

  was:
Twice now, Uwe's jenkins has encountered a walk already seen ... assertion 
failure from DistribCursorPagingTest that I've been unable to fathom, let alone 
reproduce.

Using this as a tracking issue to try and make sense of it.

Summary of things noticed so far (in 2 failures):
* So far only seen on http://jenkins.thetaphi.de
* So far only seen on MacOSX
* So far only seen on branch 4x
* So far seen on both Java6 and Java7
* fails occured in first block of randomized testing: 
** we've indexed a small number of randomized docs
** we're explicitly looping over every field and sorting in both directions
* fails were both when sorting on one of the \*_dv_last desc fields 
(docValues=true, sortMissingLast=true) 
** sort on same field asc has always worked fine just before this (fields are 
in arbitrary order, but asc always tried before desc)
** sorting on some other random fields has sometimes been tried before this and 
worked


(specifics of each failure seen in the wild recorded in comments)


updating description based on variables seen in sarowe's failure

 Heisenbug in DistribCursorPagingTest: walk already seen ...
 -

 Key: SOLR-5652
 URL: https://issues.apache.org/jira/browse/SOLR-5652
 Project: Solr
  Issue Type: Bug
Reporter: Hoss Man
Assignee: Hoss Man
 Attachments: 129.log, 
 jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1200.log.txt, 
 jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1217.log.txt


 Twice now, Uwe's jenkins has encountered a walk already seen ... assertion 
 failure from DistribCursorPagingTest that I've been unable to fathom, let 
 alone reproduce (although sarowe was able to trigger a similar, 
 non-reproducible seed, failure on his machine)
 Using this as a tracking issue to try and make sense of it.
 Summary of things noticed so far (in 3 failures):
 * So far only seen on http://jenkins.thetaphi.de  sarowe's mac
 * So far only seen on MacOSX
 * So far only seen on branch 4x
 * So far seen on both Java6 and Java7
 * fails occured in first block of randomized testing: 
 ** we've indexed a small number of randomized docs
 ** we're explicitly looping over every field and sorting in both directions
 * fails were both when doing a desc sorting on one of the \*_dv_last or 
 \*_dv_first fields (docValues=true, either sortMissingLast=true OR 
 sortMissingFirst=true) 
 ** sort on same field asc has always worked fine just before this (fields are 
 in arbitrary order, but asc always tried before desc)
 ** sorting on some other random fields has sometimes been tried before this 
 and worked
 (specifics of each failure seen in the wild recorded in comments)



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (LUCENE-5410) Add fuzziness support to SimpleQueryParser

2014-01-23 Thread Lee Hinman (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880384#comment-13880384
 ] 

Lee Hinman edited comment on LUCENE-5410 at 1/23/14 9:30 PM:
-

Okay, I misunderstood then, I was thinking the ~2 syntax has no meaning 
whatever meant *no* meaning (ie, ignore it entirely). I will keep the current 
behavior of {{foo~2}} being a TermQuery for foo~2 and {{foo bar~2}} being a 
BooleanQuery of the PhraseQuery foo bar and a TermQuery for ~2.


was (Author: dakrone):
Okay, I misunderstood then, I was thinking the ~2 syntax has no meaning 
whatever meant *no* meaning (ie, ignore it entirely). I will keep the current 
behavior of {{foo~2}} being a TermQuery for foo~2 and {{{foo bar~2}}} being 
a BooleanQuery of the PhraseQuery foo bar and a TermQuery for ~2.

 Add fuzziness support to SimpleQueryParser
 --

 Key: LUCENE-5410
 URL: https://issues.apache.org/jira/browse/LUCENE-5410
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/queryparser
Affects Versions: 4.7
Reporter: Lee Hinman
Priority: Minor
 Attachments: LUCENE-5410.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so 
 that:
 {{foo~2}}
 generates a {{FuzzyQuery}} with an max edit distance of 2 and:
 {{foo bar~2}}
 generates a {{PhraseQuery}} with a slop of 2.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser

2014-01-23 Thread Lee Hinman (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880384#comment-13880384
 ] 

Lee Hinman commented on LUCENE-5410:


Okay, I misunderstood then, I was thinking the ~2 syntax has no meaning 
whatever meant *no* meaning (ie, ignore it entirely). I will keep the current 
behavior of {{foo~2}} being a TermQuery for foo~2 and {{{foo bar~2}}} being 
a BooleanQuery of the PhraseQuery foo bar and a TermQuery for ~2.

 Add fuzziness support to SimpleQueryParser
 --

 Key: LUCENE-5410
 URL: https://issues.apache.org/jira/browse/LUCENE-5410
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/queryparser
Affects Versions: 4.7
Reporter: Lee Hinman
Priority: Minor
 Attachments: LUCENE-5410.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so 
 that:
 {{foo~2}}
 generates a {{FuzzyQuery}} with an max edit distance of 2 and:
 {{foo bar~2}}
 generates a {{PhraseQuery}} with a slop of 2.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-5410) Add fuzziness support to SimpleQueryParser

2014-01-23 Thread Lee Hinman (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lee Hinman updated LUCENE-5410:
---

Attachment: LUCENE-5410.patch

New version of the patch with these changes:

- No changes made to QueryBuilder.java
- Only a single method for newPhraseQuery instead of two
- Add ~ to testRandomQueries2

 Add fuzziness support to SimpleQueryParser
 --

 Key: LUCENE-5410
 URL: https://issues.apache.org/jira/browse/LUCENE-5410
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/queryparser
Affects Versions: 4.7
Reporter: Lee Hinman
Priority: Minor
 Attachments: LUCENE-5410.patch, LUCENE-5410.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so 
 that:
 {{foo~2}}
 generates a {{FuzzyQuery}} with an max edit distance of 2 and:
 {{foo bar~2}}
 generates a {{PhraseQuery}} with a slop of 2.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-5488) Fix up test failures for Analytics Component

2014-01-23 Thread Steven Bower (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steven Bower updated SOLR-5488:
---

Attachment: SOLR-5488.patch

Attached is a patch (to trunk) that fixes a few issues as well as adding some 
additional checks/exceptions/logging:

* check that getStatResult resturns non-null/empty strings. There were a few 
tests that were actually failing but not reporting as such (eg get to string 
stats and concat them but when both werent there it would concat 2 empty 
strings and succeed
* When we fail to create an accumulator it was just println'ing the exception 
vs logging it so we can see a full stack trace
* Moved call to docs.getTopFilter() out of the loop through analytics request. 
There is no need to rebuild this each time. In fact I may refactor this entire 
section in the future (once this all works)
* Updated FunctionTest as some date based tests where using the STRING VAL_TYPE 
instead of DATE

 Fix up test failures for Analytics Component
 

 Key: SOLR-5488
 URL: https://issues.apache.org/jira/browse/SOLR-5488
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.0, 4.7
Reporter: Erick Erickson
Assignee: Erick Erickson
 Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch, 
 SOLR-5488.patch


 The analytics component has a few test failures, perhaps 
 environment-dependent. This is just to collect the test fixes in one place 
 for convenience when we merge back into 4.x



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5488) Fix up test failures for Analytics Component

2014-01-23 Thread Steven Bower (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880444#comment-13880444
 ] 

Steven Bower commented on SOLR-5488:


The output above (ie the {{null}} items in the response) I am quite certain is 
caused by the return null in the MinMaxStatsCollector. I have turned this 
into an IllegalArgException that should lead us to why this is happening.

Note: I have not been able to actually repro this on my side (i thought I had 
but it was something else failing).. But I traced down when/how the nulls could 
propagate to the response .. hopefully this puts this issue to bed..

 Fix up test failures for Analytics Component
 

 Key: SOLR-5488
 URL: https://issues.apache.org/jira/browse/SOLR-5488
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.0, 4.7
Reporter: Erick Erickson
Assignee: Erick Erickson
 Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch, 
 SOLR-5488.patch


 The analytics component has a few test failures, perhaps 
 environment-dependent. This is just to collect the test fixes in one place 
 for convenience when we merge back into 4.x



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880472#comment-13880472
 ] 

Mark Miller commented on SOLR-5658:
---

Kind of ugly - the real fix will take a bit of work. The patch might be a 
decent partial fix / workaround for 4.6.1 if we respin.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 

[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser

2014-01-23 Thread Jack Conradson (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880507#comment-13880507
 ] 

Jack Conradson commented on LUCENE-5410:


I think this patch is a good start.  Personally, there's two changes I'd like 
to see.  

* The first was discussed briefly before, but I'm strongly in favor of having 
phrase slop be a different operator from fuzzy terms.  I can see users wanting 
phrase slop without wanting fuzzy terms.
* The second is I'd strongly prefer to see a separate method for the parsing 
logic related to slop/fuzzy where it would account for checking if there's a 
'~' and the integer afterwards.  I think it will help clean up the consumeTerm 
and consumePhrase methods significantly.  Once a term/phrase has been found, if 
fuzzy/slop is on, the method can be called to check for it.

 Add fuzziness support to SimpleQueryParser
 --

 Key: LUCENE-5410
 URL: https://issues.apache.org/jira/browse/LUCENE-5410
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/queryparser
Affects Versions: 4.7
Reporter: Lee Hinman
Priority: Minor
 Attachments: LUCENE-5410.patch, LUCENE-5410.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so 
 that:
 {{foo~2}}
 generates a {{FuzzyQuery}} with an max edit distance of 2 and:
 {{foo bar~2}}
 generates a {{PhraseQuery}} with a slop of 2.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5410) Add fuzziness support to SimpleQueryParser

2014-01-23 Thread Lee Hinman (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880511#comment-13880511
 ] 

Lee Hinman commented on LUCENE-5410:


Okay, the first is very simple (I'll add a {{SLOP_OPERATOR}} flag and make 
{{FUZZINESS_OPERATOR}} only work for fuzzy terms.

As for the second, I think this is doable, but I think it will still require a 
bit of special logic in consumeTerm and consumePhrase based on the differences 
in how they consume/increment state.data and state.index. I'll work on another 
revision doing this.

 Add fuzziness support to SimpleQueryParser
 --

 Key: LUCENE-5410
 URL: https://issues.apache.org/jira/browse/LUCENE-5410
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/queryparser
Affects Versions: 4.7
Reporter: Lee Hinman
Priority: Minor
 Attachments: LUCENE-5410.patch, LUCENE-5410.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 It would be nice to add fuzzy query support to the {{SimpleQueryParser}} so 
 that:
 {{foo~2}}
 generates a {{FuzzyQuery}} with an max edit distance of 2 and:
 {{foo bar~2}}
 generates a {{PhraseQuery}} with a slop of 2.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Miller updated SOLR-5658:
--

Attachment: SOLR-5658.patch

Here is a full fix patch.

So previously, we still didn't propagate request level commitWithin at the 
request level, but each document add would pick up the request level 
commitWithin.

This per document level commitWithin support was not working with javabin.

This has to do with how javabin handles adds for streaming, and some funny code 
that I have improved with a comment and cleanup.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch, SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 

[jira] [Commented] (LUCENE-5414) suggest module should not depend on expression module

2014-01-23 Thread Steve Rowe (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880555#comment-13880555
 ] 

Steve Rowe commented on LUCENE-5414:


bq. I am still after all these years not familiar with how we manage the maven 
stuff but I guess it somehow figures this out?

LUCENE-5217 recently added an Ant+Ivy-Maven dependencies converter that also 
defeats Maven's transitive dependency resolution mechanism by excluding all 
dependencies' direct dependencies in the {{dependencyManagement}} section of 
the grandparent POM.

I ran {{ant get-maven-poms}} before and after the latest patch on this issue 
and compared the resulting suggest module's POMs.  With the patch, the 
following dependencies are no longer present:

{code:xml}
dependency
  groupIdorg.apache.lucene/groupId
  artifactIdlucene-expressions/artifactId
/dependency
...
dependency
  groupIdorg.antlr/groupId
  artifactIdantlr-runtime/artifactId
/dependency
dependency
  groupIdorg.ow2.asm/groupId
  artifactIdasm/artifactId
/dependency
dependency
  groupIdorg.ow2.asm/groupId
  artifactIdasm-commons/artifactId
/dependency
{code}

Those last three dependencies are direct dependencies of the expressions 
module; since the Ant build currently pulls in everything from 
{{expressions/lib/}}, the Ant-Maven dependencies converter interprets them as 
direct dependencies of the suggest module.

After applying the latest patch, all Lucene/Solr tests pass under Maven.

 suggest module should not depend on expression module
 -

 Key: LUCENE-5414
 URL: https://issues.apache.org/jira/browse/LUCENE-5414
 Project: Lucene - Core
  Issue Type: Wish
Affects Versions: 4.6, 5.0
Reporter: Simon Willnauer
 Fix For: 5.0, 4.7

 Attachments: LUCENE-5414.patch, LUCENE-5414.patch


 Currently our suggest module depends on the expression module just because 
 the DocumentExpressionDictionary provides some util ctor to pass in an 
 expression directly. That is a lot of dependency for little value IMO and 
 pulls in lots of JARs. DocumentExpressionDictionary should only take a 
 ValueSource instead.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880569#comment-13880569
 ] 

ASF subversion and git services commented on SOLR-5658:
---

Commit 1560859 from [~markrmil...@gmail.com] in branch 'dev/trunk'
[ https://svn.apache.org/r1560859 ]

SOLR-5658: commitWithin and overwrite are not being distributed to replicas now 
that SolrCloud uses javabin to distribute updates.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5658.patch, SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 

[jira] [Commented] (SOLR-5488) Fix up test failures for Analytics Component

2014-01-23 Thread Erick Erickson (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880570#comment-13880570
 ] 

Erick Erickson commented on SOLR-5488:
--

OK, I'll run it through my local tests, then commit it if I don't see a test 
failure in a couple of runs with iters set. I wasn't able to get failures the 
other day but Jenkins seems to fail pretty regularly

More later.


 Fix up test failures for Analytics Component
 

 Key: SOLR-5488
 URL: https://issues.apache.org/jira/browse/SOLR-5488
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.0, 4.7
Reporter: Erick Erickson
Assignee: Erick Erickson
 Attachments: SOLR-5488.patch, SOLR-5488.patch, SOLR-5488.patch, 
 SOLR-5488.patch


 The analytics component has a few test failures, perhaps 
 environment-dependent. This is just to collect the test fixes in one place 
 for convenience when we merge back into 4.x



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Assigned] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Miller reassigned SOLR-5658:
-

Assignee: Mark Miller  (was: Shalin Shekhar Mangar)

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Mark Miller
 Fix For: 5.0, 4.7, 4.6.1

 Attachments: SOLR-5658.patch, SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@36137e08 
 

[jira] [Updated] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Miller updated SOLR-5658:
--

 Priority: Critical  (was: Major)
Fix Version/s: 4.6.1
   4.7
   5.0

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Mark Miller
Priority: Critical
 Fix For: 5.0, 4.7, 4.6.1

 Attachments: SOLR-5658.patch, SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 384553 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880573#comment-13880573
 ] 

ASF subversion and git services commented on SOLR-5658:
---

Commit 1560860 from [~markrmil...@gmail.com] in branch 'dev/branches/branch_4x'
[ https://svn.apache.org/r1560860 ]

SOLR-5658: commitWithin and overwrite are not being distributed to replicas now 
that SolrCloud uses javabin to distribute updates.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Shalin Shekhar Mangar
 Fix For: 5.0, 4.7, 4.6.1

 Attachments: SOLR-5658.patch, SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880588#comment-13880588
 ] 

ASF subversion and git services commented on SOLR-5658:
---

Commit 1560866 from [~markrmil...@gmail.com] in branch 
'dev/branches/lucene_solr_4_6'
[ https://svn.apache.org/r1560866 ]

SOLR-5658: commitWithin and overwrite are not being distributed to replicas now 
that SolrCloud uses javabin to distribute updates.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Mark Miller
Priority: Critical
 Fix For: 5.0, 4.7, 4.6.1

 Attachments: SOLR-5658.patch, SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 

Re: [VOTE] Release Lucene/Solr 4.6.1 RC3

2014-01-23 Thread Mark Miller
Okay, I’ve decided to respin now that I understand the issue. It’s worse than 
delaying the release by one day for users as it’s new in 4.6 and quite a bad 
bug for those using commitWithin.

- Mark

On Jan 23, 2014, at 12:43 PM, Mark Miller markrmil...@gmail.com wrote:

 There is some discussion around an RC4 at  
 https://issues.apache.org/jira/browse/SOLR-5658 if anyone wants to weigh in.
 
 - Mark
 
 On Jan 22, 2014, at 11:02 PM, Mark Miller markrmil...@gmail.com wrote:
 
 Please vote to release the following artifacts:
 
 http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560491/
 
 Here is my +1.
 
 SUCCESS! [0:50:55.923056]
 
 --
 - Mark
 



[jira] [Commented] (LUCENE-5409) ToParentBlockJoinCollector.getTopGroups returns empty Groups

2014-01-23 Thread Peng Cheng (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880597#comment-13880597
 ] 

Peng Cheng commented on LUCENE-5409:


Still doesn't work, this is my test case:

  public void testRewriteHash() throws IOException
  {
final Directory dir = newDirectory();
final RandomIndexWriter w = new RandomIndexWriter(random(), dir);

final ListDocument docs = new ArrayListDocument();

docs.add(makeJob(java, 2007));
docs.add(makeJob(python, 2010));
docs.add(makeResume(Lisa, United Kingdom));
w.addDocuments(docs);

docs.clear();
docs.add(makeJob(ruby, 2005));
docs.add(makeJob(java, 2006));
docs.add(makeResume(Frank, United States));
w.addDocuments(docs);

IndexReader r = w.getReader();
w.close();
IndexSearcher s = newSearcher(r);

Query q = new TermQuery(new Term(skill,rudy));
BooleanQuery qc = new BooleanQuery();
qc.add(q,Occur.SHOULD);
Filter parentsFilter = new FixedBitSetCachingWrapperFilter(new 
QueryWrapperFilter(new TermQuery(new Term(docType, resume;

Query qp = new ToParentBlockJoinQuery(qc,parentsFilter,ScoreMode.Max);
int hash1 = qp.hashCode();
Query qw = s.rewrite(qp);
int hash2 = qp.hashCode();

assertTrue(hash1 != hash2);
  }

 ToParentBlockJoinCollector.getTopGroups returns empty Groups
 

 Key: LUCENE-5409
 URL: https://issues.apache.org/jira/browse/LUCENE-5409
 Project: Lucene - Core
  Issue Type: Bug
  Components: core/search
Affects Versions: 4.6
 Environment: Ubuntu 12.04
Reporter: Peng Cheng
Assignee: Michael McCandless
Priority: Critical
 Fix For: 4.7

   Original Estimate: 168h
  Remaining Estimate: 168h

 A bug is observed to cause unstable results returned by the getTopGroups 
 function of class ToParentBlockJoinCollector.
 In the scorer generation stage, the ToParentBlockJoinCollector will 
 automatically rewrite all the associated ToParentBlockJoinQuery (and their 
 subqueries), and save them into its in-memory Look-up table, namely 
 joinQueryID (see enroll() method for detail). Unfortunately, in the 
 getTopGroups method, the new ToParentBlockJoinQuery parameter is not 
 rewritten (at least users are not expected to do so). When the new one is 
 searched in the old lookup table (considering the impact of rewrite() on 
 hashCode()), the lookup will largely fail and eventually end up with a 
 topGroup collection consisting of only empty groups (their hitCounts are 
 guaranteed to be zero).
 An easy fix would be to rewrite the original BlockJoinQuery before invoking 
 getTopGroups method. However, the computational cost of this is not optimal. 
 A better but slightly more complex solution would be to save unrewrited 
 Queries into the lookup table.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (LUCENE-5409) ToParentBlockJoinCollector.getTopGroups returns empty Groups

2014-01-23 Thread Peng Cheng (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880597#comment-13880597
 ] 

Peng Cheng edited comment on LUCENE-5409 at 1/24/14 1:24 AM:
-

Still doesn't work, this is my test case, perhaps I still need to implement a 
Query with custom rewrite and hashcode

  public void testRewriteHash() throws IOException
  {
final Directory dir = newDirectory();
final RandomIndexWriter w = new RandomIndexWriter(random(), dir);

final ListDocument docs = new ArrayListDocument();

docs.add(makeJob(java, 2007));
docs.add(makeJob(python, 2010));
docs.add(makeResume(Lisa, United Kingdom));
w.addDocuments(docs);

docs.clear();
docs.add(makeJob(ruby, 2005));
docs.add(makeJob(java, 2006));
docs.add(makeResume(Frank, United States));
w.addDocuments(docs);

IndexReader r = w.getReader();
w.close();
IndexSearcher s = newSearcher(r);

Query q = new TermQuery(new Term(skill,rudy));
BooleanQuery qc = new BooleanQuery();
qc.add(q,Occur.SHOULD);
Filter parentsFilter = new FixedBitSetCachingWrapperFilter(new 
QueryWrapperFilter(new TermQuery(new Term(docType, resume;

Query qp = new ToParentBlockJoinQuery(qc,parentsFilter,ScoreMode.Max);
int hash1 = qp.hashCode();
Query qw = s.rewrite(qp);
int hash2 = qp.hashCode();

assertTrue(hash1 != hash2);
  }


was (Author: peng):
Still doesn't work, this is my test case:

  public void testRewriteHash() throws IOException
  {
final Directory dir = newDirectory();
final RandomIndexWriter w = new RandomIndexWriter(random(), dir);

final ListDocument docs = new ArrayListDocument();

docs.add(makeJob(java, 2007));
docs.add(makeJob(python, 2010));
docs.add(makeResume(Lisa, United Kingdom));
w.addDocuments(docs);

docs.clear();
docs.add(makeJob(ruby, 2005));
docs.add(makeJob(java, 2006));
docs.add(makeResume(Frank, United States));
w.addDocuments(docs);

IndexReader r = w.getReader();
w.close();
IndexSearcher s = newSearcher(r);

Query q = new TermQuery(new Term(skill,rudy));
BooleanQuery qc = new BooleanQuery();
qc.add(q,Occur.SHOULD);
Filter parentsFilter = new FixedBitSetCachingWrapperFilter(new 
QueryWrapperFilter(new TermQuery(new Term(docType, resume;

Query qp = new ToParentBlockJoinQuery(qc,parentsFilter,ScoreMode.Max);
int hash1 = qp.hashCode();
Query qw = s.rewrite(qp);
int hash2 = qp.hashCode();

assertTrue(hash1 != hash2);
  }

 ToParentBlockJoinCollector.getTopGroups returns empty Groups
 

 Key: LUCENE-5409
 URL: https://issues.apache.org/jira/browse/LUCENE-5409
 Project: Lucene - Core
  Issue Type: Bug
  Components: core/search
Affects Versions: 4.6
 Environment: Ubuntu 12.04
Reporter: Peng Cheng
Assignee: Michael McCandless
Priority: Critical
 Fix For: 4.7

   Original Estimate: 168h
  Remaining Estimate: 168h

 A bug is observed to cause unstable results returned by the getTopGroups 
 function of class ToParentBlockJoinCollector.
 In the scorer generation stage, the ToParentBlockJoinCollector will 
 automatically rewrite all the associated ToParentBlockJoinQuery (and their 
 subqueries), and save them into its in-memory Look-up table, namely 
 joinQueryID (see enroll() method for detail). Unfortunately, in the 
 getTopGroups method, the new ToParentBlockJoinQuery parameter is not 
 rewritten (at least users are not expected to do so). When the new one is 
 searched in the old lookup table (considering the impact of rewrite() on 
 hashCode()), the lookup will largely fail and eventually end up with a 
 topGroup collection consisting of only empty groups (their hitCounts are 
 guaranteed to be zero).
 An easy fix would be to rewrite the original BlockJoinQuery before invoking 
 getTopGroups method. However, the computational cost of this is not optimal. 
 A better but slightly more complex solution would be to save unrewrited 
 Queries into the lookup table.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...

2014-01-23 Thread Steve Rowe (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880639#comment-13880639
 ] 

Steve Rowe commented on SOLR-5652:
--

I tried reproducing the other four seeds I found by running each of them ten 
times, but they all passed.

Here's the output of {{egrep 'Throwable|SOLR\-5652: \[\^(]'}} over the other 
four failed trials' log files:

{noformat}
25.log:   [junit4]   2 19647 T10 
oasc.DistribCursorPagingTest.doRandomSortsOnLargeIndex SOLR-5652: Begining Loop 
over smallish num of docs
25.log:   [junit4] Throwable #1: java.lang.AssertionError: 
({params(q=*%3A*fl=id%2Cint_dv_lastrows=50sort=int_dv_last+desc%2C+id+desc),defaults(cursorMark=AoIGycP9Cl8B)})
 walk already seen: 53, don't know why; q=id:53 gives: 
{responseHeader={status=0,QTime=7},response={numFound=1,start=0,maxScore=4.3672957,docs=[SolrDocument{id=53,
 long=-176257813861916, long_last=-176257813861916, 
long_first=-176257813861916, long_dv_last=-176257813861916, 
long_dv_first=-176257813861916, float=7.8670176E8, float_last=7.8670176E8, 
float_first=7.8670176E8, float_dv_last=7.8670176E8, float_dv_first=7.8670176E8, 
double=-5.708345229626098E8, double_last=-5.708345229626098E8, 
double_first=-5.708345229626098E8, double_dv_last=-5.708345229626098E8, 
double_dv_first=-5.708345229626098E8, str=さおれん, str_last=さおれん, str_first=さおれん, 
str_dv_last=さおれん, str_dv_first=さおれん, 
bin=O69Ees9vzo65vMxdlD794IAfqQgcvHEy+6USZ9bEELcM4PnS, 
bin_last=O69Ees9vzo65vMxdlD794IAfqQgcvHEy+6USZ9bEELcM4PnS, 
bin_first=O69Ees9vzo65vMxdlD794IAfqQgcvHEy+6USZ9bEELcM4PnS, 
bin_dv_last=O69Ees9vzo65vMxdlD794IAfqQgcvHEy+6USZ9bEELcM4PnS, 
bin_dv_first=O69Ees9vzo65vMxdlD794IAfqQgcvHEy+6USZ9bEELcM4PnS, 
_version_=1457993135883812864}]}}
330.log:   [junit4]   2 19366 T10 
oasc.DistribCursorPagingTest.doRandomSortsOnLargeIndex SOLR-5652: Begining Loop 
over smallish num of docs
330.log:   [junit4] Throwable #1: java.lang.AssertionError: 
({params(q=*%3A*fl=id%2Cdouble_dv_firstrows=33sort=double_dv_first+desc%2C+id+desc),defaults(cursorMark=AoIFP6OxOxOxOxRRAQ%3D%3D)})
 walk already seen: 53, don't know why; q=id:53 gives: 
{responseHeader={status=0,QTime=6},response={numFound=1,start=0,maxScore=4.5409594,docs=[SolrDocument{id=53,
 int=1280166143, int_last=1280166143, int_first=1280166143, 
int_dv_last=1280166143, int_dv_first=1280166143, long=-9052102457621824595, 
long_last=-9052102457621824595, long_first=-9052102457621824595, 
long_dv_last=-9052102457621824595, long_dv_first=-9052102457621824595, 
float=3.0276464E8, float_last=3.0276464E8, float_first=3.0276464E8, 
float_dv_last=3.0276464E8, float_dv_first=3.0276464E8, str=⟉⟑, str_last=⟉⟑, 
str_first=⟉⟑, str_dv_last=⟉⟑, str_dv_first=⟉⟑, bin=rS4=, bin_last=rS4=, 
bin_first=rS4=, bin_dv_last=rS4=, bin_dv_first=rS4=, 
_version_=1458022773190295552}]}}
358.log:   [junit4]   2 20392 T10 
oasc.DistribCursorPagingTest.doRandomSortsOnLargeIndex SOLR-5652: Begining Loop 
over smallish num of docs
358.log:   [junit4] Throwable #1: java.lang.AssertionError: 
({params(q=*%3A*fl=id%2Cdouble_dv_lastrows=26sort=double_dv_last+asc%2C+id+asc),defaults(cursorMark=AoIFQcxu1GR52DdbBQ%3D%3D)})
 walk already seen: 53, don't know why; q=id:53 gives: 
{responseHeader={status=0,QTime=6},response={numFound=1,start=0,maxScore=4.713572,docs=[SolrDocument{id=53,
 int=326151412, int_last=326151412, int_first=326151412, int_dv_last=326151412, 
int_dv_first=326151412, long=2982275399264847435, 
long_last=2982275399264847435, long_first=2982275399264847435, 
long_dv_last=2982275399264847435, long_dv_first=2982275399264847435, 
float=-4.07416768E8, float_last=-4.07416768E8, float_first=-4.07416768E8, 
float_dv_last=-4.07416768E8, float_dv_first=-4.07416768E8, str=s, str_last=s, 
str_first=s, str_dv_last=s, str_dv_first=s, 
bin=XR3Lrq5HZ64ra30SYdaN4EkoTS0jNYojEq+1McIN6T4QD136dLnbj4v/fp1VK+lN, 
bin_last=XR3Lrq5HZ64ra30SYdaN4EkoTS0jNYojEq+1McIN6T4QD136dLnbj4v/fp1VK+lN, 
bin_first=XR3Lrq5HZ64ra30SYdaN4EkoTS0jNYojEq+1McIN6T4QD136dLnbj4v/fp1VK+lN, 
bin_dv_last=XR3Lrq5HZ64ra30SYdaN4EkoTS0jNYojEq+1McIN6T4QD136dLnbj4v/fp1VK+lN, 
bin_dv_first=XR3Lrq5HZ64ra30SYdaN4EkoTS0jNYojEq+1McIN6T4QD136dLnbj4v/fp1VK+lN, 
_version_=1458025403210792960}]}}
372.log:   [junit4]   2 20889 T10 
oasc.DistribCursorPagingTest.doRandomSortsOnLargeIndex SOLR-5652: Begining Loop 
over smallish num of docs
372.log:   [junit4] Throwable #1: java.lang.AssertionError: 
({params(q=*%3A*fl=id%2Cstr_dv_lastrows=18sort=str_dv_last+desc%2C+id+desc),defaults(cursorMark=AoIgSg%3D%3D)})
 walk already seen: 45, don't know why; q=id:45 gives: 
{responseHeader={status=0,QTime=10},response={numFound=1,start=0,maxScore=4.8394523,docs=[SolrDocument{id=45,
 int=55600073, int_last=55600073, int_first=55600073, int_dv_last=55600073, 
int_dv_first=55600073, long=-5726302924934473981, 
long_last=-5726302924934473981, long_first=-5726302924934473981, 

[jira] [Commented] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...

2014-01-23 Thread Steve Rowe (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880659#comment-13880659
 ] 

Steve Rowe commented on SOLR-5652:
--

In the trial #129 failure, the second (failing) page is sorted wrong - the sort 
field is long_dv_first, but multiple docs with missing values (including the 
walk already seen doc: id=53) are not sorted first.  Below is the output of 
{{egrep 'SOLR-5652: \[\^(]|id=53'}} over {{129.log}} - note that the first page 
has the id=53 doc sorted properly:

{noformat}
   [junit4]   2 21647 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups 
SOLR-5652: 
({params(q=*%3A*fl=id%2Clong_dv_firstrows=24sort=long_dv_first+desc%2C+id+desc),defaults(cursorMark=*)})
 gave us these docs: {id=53}; {id=25, long_dv_first=9028609258260341288}; 
{id=1, long_dv_first=8079898934015269594}; {id=21, 
long_dv_first=7851701882515113803}; {id=62, long_dv_first=7838548354468740764}; 
{id=15, long_dv_first=7703783121293450688}; {id=77, 
long_dv_first=7259374194906229471}; {id=59, long_dv_first=7109412730326436803}; 
{id=29, long_dv_first=6983226518504627711}; {id=69, 
long_dv_first=6894002903936490262}; {id=108, 
long_dv_first=6425678483825374576}; {id=48, long_dv_first=6162850160620829991}; 
{id=18, long_dv_first=6050872288145443429}; {id=10, 
long_dv_first=5639159091440117036}; {id=49, long_dv_first=5585109074321704897}; 
{id=121, long_dv_first=5564641483351446975}; {id=73, 
long_dv_first=5557697725656376716}; {id=124, 
long_dv_first=5515795054987553907}; {id=91, long_dv_first=5446634527267601359}; 
{id=66, long_dv_first=5412453097925579481}; {id=57, 
long_dv_first=5391575838257268802}; {id=67, long_dv_first=5285225733925278855}; 
{id=76, long_dv_first=5196111855800982134}; {id=118, 
long_dv_first=4962434967015612730}; 
   [junit4]   2 21673 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups 
SOLR-5652: 
({params(q=*%3A*fl=id%2Clong_dv_firstrows=24sort=long_dv_first+desc%2C+id+desc),defaults(cursorMark=AoJ%2FvAJZAg%3D%3D)})
 gave us these docs: {id=94, long_dv_first=5064}; {id=74, long_dv_first=5045}; 
{id=100, long_dv_first=5038}; {id=95, long_dv_first=5024}; {id=71, 
long_dv_first=5010}; {id=117}; {id=53}; {id=46}; {id=99, 
long_dv_first=-57033495908952210}; {id=84, long_dv_first=-369682029177105515}; 
{id=51, long_dv_first=-571619284359424369}; {id=33, 
long_dv_first=-89016127771765}; {id=89, long_dv_first=-827568794981027330}; 
{id=27, long_dv_first=-874200373569477439}; {id=32, 
long_dv_first=-897758339419136464}; {id=37, 
long_dv_first=-1097686452252701951}; {id=20, 
long_dv_first=-1142352694920116441}; {id=60, 
long_dv_first=-1237791953129111727}; {id=78, 
long_dv_first=-1381169508523349434}; {id=58, 
long_dv_first=-1427953974149921646}; {id=104, 
long_dv_first=-1433781337878484605}; {id=8, 
long_dv_first=-1778050783003838576}; {id=55, 
long_dv_first=-1879894088937473264}; {id=38, 
long_dv_first=-1955827817437289663}; 
{noformat}

 Heisenbug in DistribCursorPagingTest: walk already seen ...
 -

 Key: SOLR-5652
 URL: https://issues.apache.org/jira/browse/SOLR-5652
 Project: Solr
  Issue Type: Bug
Reporter: Hoss Man
Assignee: Hoss Man
 Attachments: 129.log, 
 jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1200.log.txt, 
 jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1217.log.txt


 Twice now, Uwe's jenkins has encountered a walk already seen ... assertion 
 failure from DistribCursorPagingTest that I've been unable to fathom, let 
 alone reproduce (although sarowe was able to trigger a similar, 
 non-reproducible seed, failure on his machine)
 Using this as a tracking issue to try and make sense of it.
 Summary of things noticed so far (in 3 failures):
 * So far only seen on http://jenkins.thetaphi.de  sarowe's mac
 * So far only seen on MacOSX
 * So far only seen on branch 4x
 * So far seen on both Java6 and Java7
 * fails occured in first block of randomized testing: 
 ** we've indexed a small number of randomized docs
 ** we're explicitly looping over every field and sorting in both directions
 * fails were both when doing a desc sorting on one of the \*_dv_last or 
 \*_dv_first fields (docValues=true, either sortMissingLast=true OR 
 sortMissingFirst=true) 
 ** sort on same field asc has always worked fine just before this (fields are 
 in arbitrary order, but asc always tried before desc)
 ** sorting on some other random fields has sometimes been tried before this 
 and worked
 (specifics of each failure seen in the wild recorded in comments)



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[VOTE] Release Lucene/Solr 4.6.1 RC4

2014-01-23 Thread Mark Miller
Here we go, hopefully for that last time now…thanks everyone for bearing with 
us.

Please vote to release the following artifacts:

http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/

Here is my +1.

SUCCESS! [0:56:37.409716]

--
- Mark

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880692#comment-13880692
 ] 

Mark Miller commented on SOLR-5658:
---

As a separate issue, it probably makes sense to send request level commitWithin 
as a param rather than setting it per doc - that would mean less repeated data 
in the request. We still need to properly support per doc like this as well 
though, because that is the level cmd objects support and we are distributing 
cmd objects.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Mark Miller
Priority: Critical
 Fix For: 5.0, 4.7, 4.6.1

 Attachments: SOLR-5658.patch, SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 

Re: [VOTE] Release Lucene/Solr 4.6.1 RC4

2014-01-23 Thread Mark Miller
Sorry - watch out for that link - I’m seeing the text correctly, but the 
underlying link incorrectly when I look at it in my send folder. The evils of 
html mail I guess.

To be sure you have the right artifacts, make sure you are looking at the 
following location:

http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/

- Mark

On Jan 23, 2014, at 9:57 PM, Mark Miller markrmil...@gmail.com wrote:

 Here we go, hopefully for that last time now…thanks everyone for bearing with 
 us.
 
 Please vote to release the following artifacts:
 
 http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/
 
 Here is my +1.
 
 SUCCESS! [0:56:37.409716]
 
 --
 - Mark



[jira] [Created] (SOLR-5660) Send request level commitWithin as a param rather than setting it per doc

2014-01-23 Thread Shalin Shekhar Mangar (JIRA)
Shalin Shekhar Mangar created SOLR-5660:
---

 Summary: Send request level commitWithin as a param rather than 
setting it per doc
 Key: SOLR-5660
 URL: https://issues.apache.org/jira/browse/SOLR-5660
 Project: Solr
  Issue Type: Improvement
  Components: Response Writers, SolrCloud
Reporter: Shalin Shekhar Mangar
 Fix For: 5.0, 4.7


In SolrCloud the commitWithin parameter is sent per-document even if it is set 
on the entire request.

We should send request level commitWithin as a param rather than setting it per 
doc - that would mean less repeated data in the request. We still need to 
properly support per doc like this as well though, because that is the level 
cmd objects support and we are distributing cmd objects.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Shalin Shekhar Mangar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880716#comment-13880716
 ] 

Shalin Shekhar Mangar commented on SOLR-5658:
-

This was nasty. Thanks for fixing and back-porting this, Mark!

I opened SOLR-5660 to send request level commitWithin as a param.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Mark Miller
Priority: Critical
 Fix For: 5.0, 4.7, 4.6.1

 Attachments: SOLR-5658.patch, SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – 

[jira] [Commented] (SOLR-5658) commitWithin does not reflect the new documents added

2014-01-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880726#comment-13880726
 ] 

Mark Miller commented on SOLR-5658:
---

Another issue this fixed is that the documents were being serialized and sent 
twice - though they were not processed twice, so just wasteful and not 
functionally problematic.

 commitWithin does not reflect the new documents added
 -

 Key: SOLR-5658
 URL: https://issues.apache.org/jira/browse/SOLR-5658
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.6, 5.0
Reporter: Varun Thacker
Assignee: Mark Miller
Priority: Critical
 Fix For: 5.0, 4.7, 4.6.1

 Attachments: SOLR-5658.patch, SOLR-5658.patch


 I start 4 nodes using the setup mentioned on - 
 https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
  
 I added a document using - 
 curl http://localhost:8983/solr/update?commitWithin=1 -H Content-Type: 
 text/xml --data-binary 'adddocfield 
 name=idtestdoc/field/doc/add'
 In Solr 4.5.1 there is 1 soft commit with openSearcher=true and 1 hard commit 
 with openSearcher=false
 In Solr 4.6.x there is there is only one commit hard commit with 
 openSearcher=false
  
 So even after 10 seconds queries on none of the shards reflect the added 
 document. 
 This was also reported on the solr-user list ( 
 http://lucene.472066.n3.nabble.com/Possible-regression-for-Solr-4-6-0-commitWithin-does-not-work-with-replicas-td4106102.html
  )
 Here are the relevant logs 
 Logs from Solr 4.5.1
 Node 1:
 {code}
 420021 [qtp619011445-12] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update params={commitWithin=1} {add=[testdoc]} 0 45
 {code}
  
 Node 2:
 {code}
 119896 [qtp1608701025-10] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:8983/solr/collection1/update.distrib=TOLEADERwt=javabinversion=2}
  {add=[testdoc (1458003295513608192)]} 0 348
 129648 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 129679 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@e174f70 main
 129680 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener sending requests to Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 QuerySenderListener done.
 129681 [searcherExecutor-5-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 [collection1] Registered new searcher Searcher@e174f70 
 main{StandardDirectoryReader(segments_3:11:nrt _2(4.5.1):C1)}
 134648 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 SolrDeletionPolicy.onCommit: commits: num=2
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
   
 commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/varun/solr-4.5.1/node2/solr/collection1/data/index
  lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a394a3; 
 maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
 134658 [commitScheduler-7-thread-1] INFO  org.apache.solr.core.SolrCore  – 
 newest commit generation = 4
 134660 [commitScheduler-7-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – end_commit_flush
  {code}
  
 Node 3:
  
 Node 4:
 {code}
 374545 [qtp1608701025-16] INFO  
 org.apache.solr.update.processor.LogUpdateProcessor  – [collection1] 
 webapp=/solr path=/update 
 params={distrib.from=http://192.168.1.103:7574/solr/collection1/update.distrib=FROMLEADERwt=javabinversion=2}
  {add=[testdoc (1458002133233172480)]} 0 20
 384545 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.update.UpdateHandler  – start 
 commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
 384552 [commitScheduler-8-thread-1] INFO  
 org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@36137e08 main
 384553 [commitScheduler-8-thread-1] INFO  
 

[jira] [Commented] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...

2014-01-23 Thread Steve Rowe (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880735#comment-13880735
 ] 

Steve Rowe commented on SOLR-5652:
--

Uh, the trial #129 failure isn't just sorted wrong on the second page, the 
whole thing is sorted wrong: all the missing-value docs should be on the first 
page.  On the second page, the three missing value docs are sorted as if they 
had the value 0.

The same thing happened on trial #25 - on the second page, missing value doc 
id=53 is sorted as if its int_dv_last value were zero, rather than missing, and 
then it shows up again as the final doc on the third page, where it belongs:

{noformat}
   [junit4]   2 19917 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups 
SOLR-5652: 
({params(q=*%3A*fl=id%2Cint_dv_lastrows=50sort=int_dv_last+desc%2C+id+desc),defaults(cursorMark=*)})
 gave us these docs: {id=115, int_dv_last=2091290595}; {id=113, 
int_dv_last=2037908394}; {id=41, int_dv_last=2010364276}; {id=55, 
int_dv_last=1998540267}; {id=61, int_dv_last=1928174044}; {id=10, 
int_dv_last=1926002179}; {id=6, int_dv_last=1860315269}; {id=68, 
int_dv_last=181298}; {id=72, int_dv_last=1788709893}; {id=94, 
int_dv_last=1775138667}; {id=103, int_dv_last=1759722924}; {id=19, 
int_dv_last=1708818408}; {id=62, int_dv_last=1702707874}; {id=95, 
int_dv_last=1575599582}; {id=18, int_dv_last=1539900646}; {id=3, 
int_dv_last=1534894477}; {id=16, int_dv_last=1513487396}; {id=122, 
int_dv_last=1512368828}; {id=91, int_dv_last=1490726417}; {id=100, 
int_dv_last=1369044665}; {id=129, int_dv_last=1366930639}; {id=2, 
int_dv_last=1335797630}; {id=12, int_dv_last=1311171495}; {id=17, 
int_dv_last=1197587669}; {id=71, int_dv_last=1075041470}; {id=14, 
int_dv_last=1062057736}; {id=87, int_dv_last=1062050843}; {id=98, 
int_dv_last=1026760294}; {id=32, int_dv_last=987606417}; {id=48, 
int_dv_last=971706716}; {id=25, int_dv_last=860420389}; {id=58, 
int_dv_last=844256726}; {id=120, int_dv_last=784821778}; {id=26, 
int_dv_last=778495105}; {id=89, int_dv_last=759861936}; {id=42, 
int_dv_last=731134129}; {id=38, int_dv_last=507728088}; {id=66, 
int_dv_last=504369368}; {id=88, int_dv_last=461655530}; {id=127, 
int_dv_last=443109475}; {id=28, int_dv_last=395812574}; {id=76, 
int_dv_last=390559531}; {id=27, int_dv_last=388277668}; {id=128, 
int_dv_last=312954617}; {id=101, int_dv_last=288358140}; {id=36, 
int_dv_last=262776063}; {id=8, int_dv_last=258137179}; {id=49, 
int_dv_last=203957872}; {id=104, int_dv_last=193961933}; {id=70, 
int_dv_last=177134041}; 
   [junit4]   2 19936 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups 
SOLR-5652: 
({params(q=*%3A*fl=id%2Cint_dv_lastrows=50sort=int_dv_last+desc%2C+id+desc),defaults(cursorMark=AoJZndujBVYE)})
 gave us these docs: {id=4, int_dv_last=159428848}; {id=109, 
int_dv_last=146424475}; {id=82, int_dv_last=118282228}; {id=54, 
int_dv_last=85706438}; {id=5, int_dv_last=53954157}; {id=90, 
int_dv_last=34653341}; {id=125, int_dv_last=22280683}; {id=74, int_dv_last=49}; 
{id=84, int_dv_last=47}; {id=44, int_dv_last=45}; {id=40, int_dv_last=40}; 
{id=126, int_dv_last=39}; {id=79, int_dv_last=38}; {id=96, int_dv_last=36}; 
{id=77, int_dv_last=29}; {id=124, int_dv_last=26}; {id=52, int_dv_last=26}; 
{id=99, int_dv_last=24}; {id=51, int_dv_last=22}; {id=92, int_dv_last=20}; 
{id=53}; {id=86, int_dv_last=-27969262}; {id=63, int_dv_last=-64632197}; 
{id=111, int_dv_last=-65674043}; {id=78, int_dv_last=-92357840}; {id=69, 
int_dv_last=-128203234}; {id=118, int_dv_last=-174163156}; {id=56, 
int_dv_last=-213598056}; {id=64, int_dv_last=-250673657}; {id=116, 
int_dv_last=-349965047}; {id=73, int_dv_last=-363194086}; {id=112, 
int_dv_last=-365330802}; {id=97, int_dv_last=-378023587}; {id=20, 
int_dv_last=-425200925}; {id=22, int_dv_last=-447702352}; {id=110, 
int_dv_last=-457782308}; {id=50, int_dv_last=-458057913}; {id=65, 
int_dv_last=-464626829}; {id=43, int_dv_last=-479019126}; {id=81, 
int_dv_last=-490373572}; {id=46, int_dv_last=-491310745}; {id=35, 
int_dv_last=-524855567}; {id=93, int_dv_last=-562980068}; {id=102, 
int_dv_last=-603711742}; {id=106, int_dv_last=-664725432}; {id=37, 
int_dv_last=-861444535}; {id=30, int_dv_last=-872755266}; {id=108, 
int_dv_last=-905452841}; {id=85, int_dv_last=-908362401}; {id=31, 
int_dv_last=-909902582}; 
   [junit4]   2 19950 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups 
SOLR-5652: 
({params(q=*%3A*fl=id%2Cint_dv_lastrows=50sort=int_dv_last+desc%2C+id+desc),defaults(cursorMark=AoIGycP9Cl8B)})
 gave us these docs: {id=39, int_dv_last=-1040495703}; {id=83, 
int_dv_last=-1098867850}; {id=60, int_dv_last=-1130244120}; {id=75, 
int_dv_last=-1241745669}; {id=9, int_dv_last=-1248082530}; {id=29, 
int_dv_last=-1263869241}; {id=121, int_dv_last=-1269818264}; {id=67, 
int_dv_last=-1368223478}; {id=24, int_dv_last=-1402120260}; {id=117, 
int_dv_last=-1432445507}; {id=21, int_dv_last=-1445804798}; {id=13, 

Re: [VOTE] Release Lucene/Solr 4.6.1 RC4

2014-01-23 Thread Shalin Shekhar Mangar
+1 for http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/

SUCCESS! [1:09:59.249629]

On Fri, Jan 24, 2014 at 8:56 AM, Mark Miller markrmil...@gmail.com wrote:
 Sorry - watch out for that link - I’m seeing the text correctly, but the
 underlying link incorrectly when I look at it in my send folder. The evils
 of html mail I guess.

 To be sure you have the right artifacts, make sure you are looking at the
 following location:

 http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/

 - Mark

 On Jan 23, 2014, at 9:57 PM, Mark Miller markrmil...@gmail.com wrote:

 Here we go, hopefully for that last time now…thanks everyone for bearing
 with us.

 Please vote to release the following artifacts:

 http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/

 Here is my +1.

 SUCCESS! [0:56:37.409716]

 --
 - Mark





-- 
Regards,
Shalin Shekhar Mangar.

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-5652) Heisenbug in DistribCursorPagingTest: walk already seen ...

2014-01-23 Thread Steve Rowe (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Rowe updated SOLR-5652:
-

Attachment: 372.log

I see the same pattern (missing value docvalue sorting as if it had a value of 
zero, or zero-length in the string case) in all the other failed trials:

trial #330: sort=double_dv_first+desc; missing value doc id=53 is the first doc 
on page one, and is also given as one of six missing value docs at the zero 
position on page three.

trial #358: sort=double_dv_last+asc; missing value doc id=53 is given as one of 
five missing value docs at the zero position on page three, and then again as 
the last doc on page seven. 

trial #372: sort=str_dv_last+desc; missing value doc id=45 is mentioned on two 
different pages, and missing str_dv_last value docs are sorted at the same 
position as, and interleaved with, zero-length value docs.  I've attached the 
full log for this one ({{372.log}}).

 Heisenbug in DistribCursorPagingTest: walk already seen ...
 -

 Key: SOLR-5652
 URL: https://issues.apache.org/jira/browse/SOLR-5652
 Project: Solr
  Issue Type: Bug
Reporter: Hoss Man
Assignee: Hoss Man
 Attachments: 129.log, 372.log, 
 jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1200.log.txt, 
 jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1217.log.txt


 Twice now, Uwe's jenkins has encountered a walk already seen ... assertion 
 failure from DistribCursorPagingTest that I've been unable to fathom, let 
 alone reproduce (although sarowe was able to trigger a similar, 
 non-reproducible seed, failure on his machine)
 Using this as a tracking issue to try and make sense of it.
 Summary of things noticed so far (in 3 failures):
 * So far only seen on http://jenkins.thetaphi.de  sarowe's mac
 * So far only seen on MacOSX
 * So far only seen on branch 4x
 * So far seen on both Java6 and Java7
 * fails occured in first block of randomized testing: 
 ** we've indexed a small number of randomized docs
 ** we're explicitly looping over every field and sorting in both directions
 * fails were both when doing a desc sorting on one of the \*_dv_last or 
 \*_dv_first fields (docValues=true, either sortMissingLast=true OR 
 sortMissingFirst=true) 
 ** sort on same field asc has always worked fine just before this (fields are 
 in arbitrary order, but asc always tried before desc)
 ** sorting on some other random fields has sometimes been tried before this 
 and worked
 (specifics of each failure seen in the wild recorded in comments)



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [VOTE] Release Lucene/Solr 4.6.1 RC4

2014-01-23 Thread Robert Muir
+1

Please pay close attention to Mark's followup email!

Load release URL 
http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/;...
...
SUCCESS! [0:38:51.100830]



On Thu, Jan 23, 2014 at 10:26 PM, Mark Miller markrmil...@gmail.com wrote:

 Sorry - watch out for that link - I’m seeing the text correctly, but the
 underlying link incorrectly when I look at it in my send folder. The evils
 of html mail I guess.

 To be sure you have the right artifacts, make sure you are looking at the
 following location:

 http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/

 - Mark

 On Jan 23, 2014, at 9:57 PM, Mark Miller markrmil...@gmail.com wrote:

 Here we go, hopefully for that last time now…thanks everyone for bearing
 with us.

 Please vote to release the following artifacts:

 http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560866/http://people.apache.org/~markrmiller/lucene_solr_4_6_1r1560491/

 Here is my +1.

 SUCCESS! [0:56:37.409716]

 --
 - Mark





[jira] [Commented] (SOLR-5648) SolrCore#getStatistics() should nest open searchers' stats

2014-01-23 Thread Otis Gospodnetic (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880789#comment-13880789
 ] 

Otis Gospodnetic commented on SOLR-5648:


Does this end up being exposed in JMX, too?

 SolrCore#getStatistics() should nest open searchers' stats
 --

 Key: SOLR-5648
 URL: https://issues.apache.org/jira/browse/SOLR-5648
 Project: Solr
  Issue Type: Task
Reporter: Shikhar Bhushan
Priority: Minor
 Fix For: 4.7

 Attachments: SOLR-5648.patch, oldestSearcherStaleness.gif, 
 openSearchers.gif


 {{SolrIndexSearcher}} leaks are a notable cause of garbage collection issues 
 in codebases with custom components.
 So it is useful to be able to access monitoring information about what 
 searchers are currently open, and in turn access their stats e.g. 
 {{openedAt}}.
 This can be nested via {{SolrCore#getStatistics()}} which has a 
 {{_searchers}} collection of all open searchers.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org