potential accuracy degradation due to approximation of document length in BM25 (and other similarities)

2016-07-03 Thread Leo Boytsov
Hi everybody, Some time ago, I had to re-implement some Lucene similarities (in particular BM25 and the older cosine). I noticed that the re-implemented version (despite using the same formula) performed better on my data set. The main difference was that my version *did not approximate *document

[JENKINS] Lucene-Solr-6.x-Linux (32bit/jdk1.8.0_92) - Build # 1047 - Failure!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Linux/1047/ Java: 32bit/jdk1.8.0_92 -server -XX:+UseConcMarkSweepGC 1 tests failed. FAILED: org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh Error Message: Could not find collection : c1 Stack

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_92) - Build # 17142 - Failure!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/17142/ Java: 32bit/jdk1.8.0_92 -client -XX:+UseParallelGC 3 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.cloud.AsyncMigrateRouteKeyTest Error Message: ObjectTracker found 1 object(s) that were not released!!!

[JENKINS] Lucene-Solr-6.x-Solaris (64bit/jdk1.8.0) - Build # 242 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Solaris/242/ Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC 1 tests failed. FAILED: org.apache.solr.cloud.overseer.ZkStateWriterTest.testExternalModificationToStateFormat2 Error Message: Stack Trace: java.lang.AssertionError

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 692 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/692/ Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC 1 tests failed. FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testDeletionsTriggerWatches Error Message: Error from server at

[JENKINS] Lucene-Solr-Tests-master - Build # 1253 - Still Failing

2016-07-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1253/ 2 tests failed. FAILED: org.apache.solr.cloud.overseer.ZkStateReaderTest.testExternalCollectionWatchedNotWatched Error Message: Stack Trace: java.lang.NullPointerException at

[JENKINS-EA] Lucene-Solr-6.x-Linux (32bit/jdk-9-ea+124) - Build # 1045 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Linux/1045/ Java: 32bit/jdk-9-ea+124 -server -XX:+UseParallelGC 1 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestSolrConfigHandlerCloud Error Message: 1 thread leaked from SUITE scope at

[jira] [Commented] (SOLR-9194) Enhance the bin/solr script to perform file operations to/from Zookeeper

2016-07-03 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360723#comment-15360723 ] ASF subversion and git services commented on SOLR-9194: --- Commit

[jira] [Commented] (SOLR-9194) Enhance the bin/solr script to perform file operations to/from Zookeeper

2016-07-03 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360720#comment-15360720 ] ASF subversion and git services commented on SOLR-9194: --- Commit

[jira] [Updated] (SOLR-9194) Enhance the bin/solr script to perform file operations to/from Zookeeper

2016-07-03 Thread Erick Erickson (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erick Erickson updated SOLR-9194: - Attachment: SOLR-9194-windows_fix2.patch Another patch to account for Windows differences, plus a

[JENKINS] Lucene-Solr-Tests-6.x - Build # 311 - Still Failing

2016-07-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/311/ 4 tests failed. FAILED: org.apache.solr.cloud.overseer.ZkStateReaderTest.testExternalCollectionWatchedNotWatched Error Message: Stack Trace: java.lang.NullPointerException at

[JENKINS] Lucene-Solr-Tests-master - Build # 1252 - Still Failing

2016-07-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1252/ 1 tests failed. FAILED: org.apache.solr.handler.TestReqParamsAPI.test Error Message: Could not get expected value 'CY val' for path 'params/c' full output: { "responseHeader":{ "status":0, "QTime":0}, "params":{

[JENKINS] Lucene-Solr-6.x-Windows (64bit/jdk1.8.0_92) - Build # 293 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Windows/293/ Java: 64bit/jdk1.8.0_92 -XX:+UseCompressedOops -XX:+UseSerialGC 5 tests failed. FAILED: org.apache.solr.cloud.SolrCLIZkUtilsTest.testCp Error Message: Copy should have succeeded. expected:<0> but was:<1> Stack Trace:

[JENKINS] Lucene-Solr-6.x-Linux (64bit/jdk1.8.0_92) - Build # 1044 - Failure!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Linux/1044/ Java: 64bit/jdk1.8.0_92 -XX:+UseCompressedOops -XX:+UseParallelGC 1 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.schema.TestManagedSchemaAPI Error Message: ObjectTracker found 0 object(s) that were not

[JENKINS] Lucene-Solr-SmokeRelease-master - Build # 533 - Still Failing

2016-07-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-master/533/ No tests ran. Build Log: [...truncated 40560 lines...] prepare-release-no-sign: [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-SmokeRelease-master/lucene/build/smokeTestRelease/dist [copy]

[jira] [Assigned] (SOLR-9208) ConcurrentModificationException on SolrCore.close() resulting in abnormal CPU consumption

2016-07-03 Thread Mikhail Khludnev (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Khludnev reassigned SOLR-9208: -- Assignee: Mikhail Khludnev > ConcurrentModificationException on SolrCore.close()

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+124) - Build # 17139 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/17139/ Java: 64bit/jdk-9-ea+124 -XX:-UseCompressedOops -XX:+UseG1GC 3 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler Error Message: ObjectTracker found 1 object(s) that were not

[jira] [Commented] (SOLR-9181) ZkStateReaderTest failure

2016-07-03 Thread Alan Woodward (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360672#comment-15360672 ] Alan Woodward commented on SOLR-9181: - Thanks Steve. I'll take a look at this tomorrow. >

[jira] [Commented] (SOLR-9181) ZkStateReaderTest failure

2016-07-03 Thread Steve Rowe (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360671#comment-15360671 ] Steve Rowe commented on SOLR-9181: -- Around the cefab1dfff commit under this issue, my Jenkins master

[JENKINS] Lucene-Solr-master-Windows (32bit/jdk1.8.0_92) - Build # 5955 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/5955/ Java: 32bit/jdk1.8.0_92 -client -XX:+UseG1GC 1 tests failed. FAILED: org.apache.lucene.replicator.IndexReplicationClientTest.testConsistencyOnExceptions Error Message: Captured an uncaught exception in thread: Thread[id=37,

[JENKINS] Lucene-Solr-Tests-6.x - Build # 310 - Failure

2016-07-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/310/ 1 tests failed. FAILED: org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithTimeDelay Error Message: expected:<2> but was:<1> Stack Trace: java.lang.AssertionError: expected:<2> but was:<1> at

[jira] [Commented] (SOLR-9208) ConcurrentModificationException on SolrCore.close() resulting in abnormal CPU consumption

2016-07-03 Thread Fabrizio Fortino (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360653#comment-15360653 ] Fabrizio Fortino commented on SOLR-9208: [~mkhludnev] yes. The exception is thrown when I try to

[JENKINS] Lucene-Solr-6.x-Solaris (64bit/jdk1.8.0) - Build # 241 - Failure!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Solaris/241/ Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC 2 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.io.graph.GraphExpressionTest Error Message: 1 thread leaked from SUITE scope at

[jira] [Commented] (SOLR-9208) ConcurrentModificationException on SolrCore.close() resulting in abnormal CPU consumption

2016-07-03 Thread Mikhail Khludnev (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360647#comment-15360647 ] Mikhail Khludnev commented on SOLR-9208: [~fabrizio.fort...@gmail.com], what do you mean in closing

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+124) - Build # 17138 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/17138/ Java: 64bit/jdk-9-ea+124 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC 3 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.TestSolrCoreProperties Error Message: ObjectTracker found 1 object(s) that were not

[JENKINS] Lucene-Solr-SmokeRelease-6.x - Build # 101 - Still Failing

2016-07-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-6.x/101/ No tests ran. Build Log: [...truncated 40567 lines...] prepare-release-no-sign: [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-SmokeRelease-6.x/lucene/build/smokeTestRelease/dist [copy] Copying

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 691 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/691/ Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC 7 tests failed. FAILED: org.apache.solr.cloud.overseer.ZkStateReaderTest.testExternalCollectionWatchedNotWatched Error Message: Stack Trace:

Re: [JENKINS] Lucene-Solr-6.x-Windows (64bit/jdk1.8.0_92) - Build # 292 - Still Failing!

2016-07-03 Thread Erick Erickson
Well, this is annoying. I'll have a patch up in an hour or two (running precommit and tests on it now). This is a test failure when constructing znodes to check, not a functional problem. So I can push my new changes and hope or put the patch up and have some kind person apply it to trunk and run

[JENKINS] Lucene-Solr-Tests-master - Build # 1251 - Still Failing

2016-07-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1251/ 1 tests failed. FAILED: org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithTimeDelay Error Message: expected:<2> but was:<1> Stack Trace: java.lang.AssertionError: expected:<2> but was:<1> at

[JENKINS-EA] Lucene-Solr-master-Linux (32bit/jdk-9-ea+124) - Build # 17137 - Failure!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/17137/ Java: 32bit/jdk-9-ea+124 -client -XX:+UseSerialGC 1 tests failed. FAILED: org.apache.solr.handler.TestReqParamsAPI.test Error Message: Could not get expected value 'CY val modified' for path 'response/params/y/c' full

[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 109 - Still Failing

2016-07-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/109/ 8 tests failed. FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test Error Message: Captured an uncaught exception in thread: Thread[id=113565, name=collection0, state=RUNNABLE,

[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk1.8.0) - Build # 3383 - Failure!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/3383/ Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC 1 tests failed. FAILED: org.apache.solr.spelling.SpellCheckCollatorTest.testEstimatedHitCounts Error Message: Exception during query Stack Trace:

[jira] [Commented] (SOLR-8998) JSON Facet API child roll-ups

2016-07-03 Thread Mikhail Khludnev (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360550#comment-15360550 ] Mikhail Khludnev commented on SOLR-8998: following this way: bq. field facet (a sub-facet) on the

[JENKINS] Lucene-Solr-6.x-Windows (64bit/jdk1.8.0_92) - Build # 292 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Windows/292/ Java: 64bit/jdk1.8.0_92 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC 5 tests failed. FAILED: org.apache.solr.cloud.SolrCLIZkUtilsTest.testRm Error Message: Should have found /configs/rm1\schema.xml on Zookeeper Stack Trace:

[JENKINS] Lucene-Solr-6.x-Linux (64bit/jdk1.8.0_92) - Build # 1040 - Failure!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Linux/1040/ Java: 64bit/jdk1.8.0_92 -XX:+UseCompressedOops -XX:+UseG1GC 1 tests failed. FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test Error Message: Timeout occured while waiting response from server at:

[JENKINS] Lucene-Solr-master-Windows (32bit/jdk1.8.0_92) - Build # 5954 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/5954/ Java: 32bit/jdk1.8.0_92 -server -XX:+UseParallelGC 5 tests failed. FAILED: org.apache.solr.cloud.SolrCLIZkUtilsTest.testDownconfig Error Message: Should have found /configs/downconfig1\schema.xml on Zookeeper Stack Trace:

[JENKINS-EA] Lucene-Solr-master-Linux (32bit/jdk-9-ea+124) - Build # 17134 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/17134/ Java: 32bit/jdk-9-ea+124 -client -XX:+UseG1GC 1 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler Error Message: ObjectTracker found 1 object(s) that were not released!!!

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 690 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/690/ Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC 1 tests failed. FAILED: org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh Error Message: Could not find collection : c1

[jira] [Commented] (SOLR-5043) hostanme lookup in SystemInfoHandler should be refactored to not block core (re)load

2016-07-03 Thread JIRA
[ https://issues.apache.org/jira/browse/SOLR-5043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360469#comment-15360469 ] Robert Krüger commented on SOLR-5043: - I would offer a bounty to have this fixed. Is there a

[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1060 - Still Failing

2016-07-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1060/ 7 tests failed. FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test Error Message: Timeout occured while waiting response from server at: https://127.0.0.1:59829/nzq/e Stack Trace:

[JENKINS-EA] Lucene-Solr-master-Linux (32bit/jdk-9-ea+124) - Build # 17133 - Still Failing!

2016-07-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/17133/ Java: 32bit/jdk-9-ea+124 -client -XX:+UseG1GC 1 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestSolrConfigHandlerCloud Error Message: 2 threads leaked from SUITE scope at