[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2577 - Failure!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2577/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:
Timeout while trying to assert update logs @ collection=source_collection

Stack Trace:
java.lang.AssertionError: Timeout while trying to assert update logs @ 
collection=source_collection
at 
__randomizedtesting.SeedInfo.seed([BFB2B76258017827:B7D2C24E570F502C]:0)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.assertNumberOfTlogFiles(CdcrReplicationDistributedZkTest.java:644)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestUpdateLogSynchronisation(CdcrReplicationDistributedZkTest.java:384)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
 

[jira] [Created] (LUCENE-6714) Expose version and resource description in CorruptIndexException and friends

2015-08-03 Thread Simon Willnauer (JIRA)
Simon Willnauer created LUCENE-6714:
---

 Summary: Expose version and resource description in 
CorruptIndexException and friends
 Key: LUCENE-6714
 URL: https://issues.apache.org/jira/browse/LUCENE-6714
 Project: Lucene - Core
  Issue Type: Improvement
Affects Versions: 5.2.1
Reporter: Simon Willnauer
Priority: Minor
 Fix For: 5.3, Trunk
 Attachments: LUCENE-6714.patch

It would be nice to access the minVersion, maxVersion in IndexTooNewException 
and IndexTooOldException as well as the resoruce description in 
CorruptIndexException programmatically. I'd love to use this to support better 
serialization on top of those exception as well as structured responses from 
the individual values. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6714) Expose version and resource description in CorruptIndexException and friends

2015-08-03 Thread Simon Willnauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Simon Willnauer updated LUCENE-6714:

Attachment: LUCENE-6714.patch

here is a simple patch

 Expose version and resource description in CorruptIndexException and friends
 

 Key: LUCENE-6714
 URL: https://issues.apache.org/jira/browse/LUCENE-6714
 Project: Lucene - Core
  Issue Type: Improvement
Affects Versions: 5.2.1
Reporter: Simon Willnauer
Priority: Minor
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6714.patch


 It would be nice to access the minVersion, maxVersion in IndexTooNewException 
 and IndexTooOldException as well as the resoruce description in 
 CorruptIndexException programmatically. I'd love to use this to support 
 better serialization on top of those exception as well as structured 
 responses from the individual values. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7796) Implement a gather support info button

2015-08-03 Thread Alexandre Rafalovitch (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652014#comment-14652014
 ] 

Alexandre Rafalovitch commented on SOLR-7796:
-

Great idea.

Might be also useful to include number of records in each shard. This would 
give overall data size as well as showing off some dis-balances in routing.

 Implement a gather support info button
 

 Key: SOLR-7796
 URL: https://issues.apache.org/jira/browse/SOLR-7796
 Project: Solr
  Issue Type: Improvement
  Components: web gui
Reporter: Shawn Heisey
Priority: Minor

 A gather support info button in the admin UI would be extremely helpful.  
 There are some basic pieces of info that we like to have for problem reports 
 on the user list, so there should be an easy way for a user to gather that 
 info.
 Some of the more basic bits of info would be easy to include in a single file 
 that's easy to cut/paste -- java version, heap info, core/collection names, 
 directories, and stats, etc.  If available, it should include server info 
 like memory, commandline args, ZK info, and possibly disk space.
 There could be two buttons -- one that gathers smaller info into an XML, 
 JSON, or .properties structure that can be easily cut/paste into an email 
 message, and another that gathers larger info like files for configuration 
 and schema along with the other info (grabbing from zookeeper if running in 
 cloud mode) and packages it into a .zip file.  Because the user list eats 
 almost all attachments, we would need to come up with some advice for sharing 
 the zipfile.  I hate to ask INFRA for a file sharing service, but that might 
 not be a bad idea.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7555) Display total space and available space in Admin

2015-08-03 Thread Eric Pugh (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652028#comment-14652028
 ] 

Eric Pugh commented on SOLR-7555:
-

Will submit update tonight!

 Display total space and available space in Admin
 

 Key: SOLR-7555
 URL: https://issues.apache.org/jira/browse/SOLR-7555
 Project: Solr
  Issue Type: Improvement
  Components: web gui
Affects Versions: 5.1
Reporter: Eric Pugh
Assignee: Erik Hatcher
Priority: Minor
 Fix For: 5.3

 Attachments: DiskSpaceAwareDirectory.java, 
 SOLR-7555-display_disk_space.patch, SOLR-7555-display_disk_space_v2.patch, 
 SOLR-7555-display_disk_space_v3.patch, SOLR-7555-display_disk_space_v4.patch, 
 SOLR-7555-display_disk_space_v5.patch, SOLR-7555.patch, SOLR-7555.patch, 
 SOLR-7555.patch


 Frequently I have access to the Solr Admin console, but not the underlying 
 server, and I'm curious how much space remains available.   This little patch 
 exposes total Volume size as well as the usable space remaining:
 !https://monosnap.com/file/VqlReekCFwpK6utI3lP18fbPqrGI4b.png!
 I'm not sure if this is the best place to put this, as every shard will share 
 the same data, so maybe it should be on the top level Dashboard?  Also not 
 sure what to call the fields! 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6714) Expose version and resource description in CorruptIndexException and friends

2015-08-03 Thread Simon Willnauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Simon Willnauer updated LUCENE-6714:

Attachment: LUCENE-6714.patch

new patch with some simple test additions to sanity check the things

 Expose version and resource description in CorruptIndexException and friends
 

 Key: LUCENE-6714
 URL: https://issues.apache.org/jira/browse/LUCENE-6714
 Project: Lucene - Core
  Issue Type: Improvement
Affects Versions: 5.2.1
Reporter: Simon Willnauer
Priority: Minor
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6714.patch, LUCENE-6714.patch


 It would be nice to access the minVersion, maxVersion in IndexTooNewException 
 and IndexTooOldException as well as the resoruce description in 
 CorruptIndexException programmatically. I'd love to use this to support 
 better serialization on top of those exception as well as structured 
 responses from the individual values. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6417) Upgrade ANTLR to version 4.5

2015-08-03 Thread Jack Conradson (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652029#comment-14652029
 ] 

Jack Conradson commented on LUCENE-6417:


Sorry, Mike and Uwe, for the delayed response.  I was actually on vacation the 
previous week.  I'll fix the pre-commit and make the suggested changes.  The 
ASM did not change at all (other than by mistake :) ), I was just forced to 
re-organize the ASM generation code into smaller chunks for the Antler 4.5 
visitor.  Thanks for reviewing the patch!

 Upgrade ANTLR to version 4.5
 

 Key: LUCENE-6417
 URL: https://issues.apache.org/jira/browse/LUCENE-6417
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Jack Conradson
 Attachments: LUCENE-6471.patch


 I would like to upgrade ANTLR from 3.5 to 4.5.  This version adds several 
 features that will improve the existing grammars.  The main improvement would 
 be the allowance of left-hand recursion in grammar rules which will reduce 
 the number of rules significantly for expressions.
 This change will require some code refactoring to the existing expressions 
 work.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6714) Expose version and resource description in CorruptIndexException and friends

2015-08-03 Thread Simon Willnauer (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652027#comment-14652027
 ] 

Simon Willnauer commented on LUCENE-6714:
-

 Looks good. Can we change resourceDescription/resourceDesc to just be one way 
 for all 3 exceptions? Then they will have a consistent API. I prefer the 
 longer one personally.

sure thing!

 Expose version and resource description in CorruptIndexException and friends
 

 Key: LUCENE-6714
 URL: https://issues.apache.org/jira/browse/LUCENE-6714
 Project: Lucene - Core
  Issue Type: Improvement
Affects Versions: 5.2.1
Reporter: Simon Willnauer
Priority: Minor
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6714.patch, LUCENE-6714.patch


 It would be nice to access the minVersion, maxVersion in IndexTooNewException 
 and IndexTooOldException as well as the resoruce description in 
 CorruptIndexException programmatically. I'd love to use this to support 
 better serialization on top of those exception as well as structured 
 responses from the individual values. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6706) Support Payload scoring for SpanOrQuery

2015-08-03 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652011#comment-14652011
 ] 

ASF subversion and git services commented on LUCENE-6706:
-

Commit 1693921 from [~romseygeek] in branch 'dev/trunk'
[ https://svn.apache.org/r1693921 ]

LUCENE-6706: Add PayloadScoreQuery

 Support Payload scoring for SpanOrQuery
 ---

 Key: LUCENE-6706
 URL: https://issues.apache.org/jira/browse/LUCENE-6706
 Project: Lucene - Core
  Issue Type: New Feature
  Components: core/query/scoring
Affects Versions: 5.2.1
Reporter: Jamie Johnson
Assignee: Alan Woodward
Priority: Minor
 Attachments: LUCENE-6706.patch, PayloadSpanOrQuery.java


 I need a way to have payloads influence the score of SpanOrQuery's.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-Tests-trunk-Java8 - Build # 256 - Failure

2015-08-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java8/256/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test

Error Message:
expected:0 but was:1

Stack Trace:
java.lang.AssertionError: expected:0 but was:1
at 
__randomizedtesting.SeedInfo.seed([29C350392312E065:A1976FE38DEE8D9D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at 
org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:156)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 

[jira] [Commented] (LUCENE-6714) Expose version and resource description in CorruptIndexException and friends

2015-08-03 Thread Robert Muir (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652022#comment-14652022
 ] 

Robert Muir commented on LUCENE-6714:
-

Looks good. Can we change resourceDescription/resourceDesc to just be one way 
for all 3 exceptions? Then they will have a consistent API. I prefer the longer 
one personally.

 Expose version and resource description in CorruptIndexException and friends
 

 Key: LUCENE-6714
 URL: https://issues.apache.org/jira/browse/LUCENE-6714
 Project: Lucene - Core
  Issue Type: Improvement
Affects Versions: 5.2.1
Reporter: Simon Willnauer
Priority: Minor
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6714.patch


 It would be nice to access the minVersion, maxVersion in IndexTooNewException 
 and IndexTooOldException as well as the resoruce description in 
 CorruptIndexException programmatically. I'd love to use this to support 
 better serialization on top of those exception as well as structured 
 responses from the individual values. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6706) Support Payload scoring for SpanOrQuery

2015-08-03 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652023#comment-14652023
 ] 

ASF subversion and git services commented on LUCENE-6706:
-

Commit 1693924 from [~romseygeek] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1693924 ]

LUCENE-6706: Add PayloadScoreQuery

 Support Payload scoring for SpanOrQuery
 ---

 Key: LUCENE-6706
 URL: https://issues.apache.org/jira/browse/LUCENE-6706
 Project: Lucene - Core
  Issue Type: New Feature
  Components: core/query/scoring
Affects Versions: 5.2.1
Reporter: Jamie Johnson
Assignee: Alan Woodward
Priority: Minor
 Attachments: LUCENE-6706.patch, PayloadSpanOrQuery.java


 I need a way to have payloads influence the score of SpanOrQuery's.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b60) - Build # 13717 - Failure!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13717/
Java: 32bit/jdk1.9.0-ea-b60 -server -XX:+UseSerialGC 
-Djava.locale.providers=JRE,SPI

1 tests failed.
FAILED:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:
Timeout while trying to assert update logs @ collection=source_collection

Stack Trace:
java.lang.AssertionError: Timeout while trying to assert update logs @ 
collection=source_collection
at 
__randomizedtesting.SeedInfo.seed([9B17B83096A8FC9A:9377CD1C99A6D491]:0)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.assertNumberOfTlogFiles(CdcrReplicationDistributedZkTest.java:644)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestUpdateLogSynchronisation(CdcrReplicationDistributedZkTest.java:384)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:502)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 

[jira] [Updated] (LUCENE-6711) Instead of docCount(), maxDoc() is used for numberOfDocuments in SimilarityBase

2015-08-03 Thread Ahmet Arslan (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ahmet Arslan updated LUCENE-6711:
-
Attachment: LUCENE-6711.patch

Includes changes to TFIDF and BM25, {{ant clean test}} passes.

 Instead of docCount(), maxDoc() is used for numberOfDocuments in 
 SimilarityBase
 ---

 Key: LUCENE-6711
 URL: https://issues.apache.org/jira/browse/LUCENE-6711
 Project: Lucene - Core
  Issue Type: Bug
  Components: core/search
Affects Versions: 5.2.1
Reporter: Ahmet Arslan
Priority: Minor
 Fix For: 5.3

 Attachments: LUCENE-6711.patch, LUCENE-6711.patch, LUCENE-6711.patch


 {{SimilarityBase.java}} has the following line :
 {code}
  long numberOfDocuments = collectionStats.maxDoc();
 {code}
 It seems like {{collectionStats.docCount()}}, which returns the total number 
 of documents that have at least one term for this field, is more appropriate 
 statistics here. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7766) support creation of a coreless collection

2015-08-03 Thread Christine Poerschke (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Christine Poerschke updated SOLR-7766:
--
Attachment: SOLR-7766.txt

 support creation of a coreless collection
 -

 Key: SOLR-7766
 URL: https://issues.apache.org/jira/browse/SOLR-7766
 Project: Solr
  Issue Type: New Feature
Reporter: Christine Poerschke
Assignee: Christine Poerschke
Priority: Minor
 Attachments: SOLR-7766.patch, SOLR-7766.txt


 By supplying a deliberately empty create node set (via 
 {{.../solr/admin/collections?action=CREATEcreateNodeSet=name=myCollection...}})
  the collection can be created in the usual manner but it will just not yet 
 contain any cores for any of its shards. Later on 
 {{.../solr/admin/collections?wt=jsonaction=ADDREPLICAcollection=myCollection...}}
  calls can create cores as and when and where required.
 github pull request with proposed changes to follow.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7766) support creation of a coreless collection

2015-08-03 Thread Christine Poerschke (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651929#comment-14651929
 ] 

Christine Poerschke commented on SOLR-7766:
---

{{createNodeSet=EMPTY}} it is then. github pull request updated (also rebased 
against latest trunk) and also attached patch to this JIRA.

 support creation of a coreless collection
 -

 Key: SOLR-7766
 URL: https://issues.apache.org/jira/browse/SOLR-7766
 Project: Solr
  Issue Type: New Feature
Reporter: Christine Poerschke
Assignee: Christine Poerschke
Priority: Minor
 Attachments: SOLR-7766.patch, SOLR-7766.txt


 By supplying a deliberately empty create node set (via 
 {{.../solr/admin/collections?action=CREATEcreateNodeSet=name=myCollection...}})
  the collection can be created in the usual manner but it will just not yet 
 contain any cores for any of its shards. Later on 
 {{.../solr/admin/collections?wt=jsonaction=ADDREPLICAcollection=myCollection...}}
  calls can create cores as and when and where required.
 github pull request with proposed changes to follow.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7796) Implement a gather support info button

2015-08-03 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651942#comment-14651942
 ] 

Shawn Heisey commented on SOLR-7796:


I saw an update on SOLR-7555, and the issue description got me thinking.

If the basic info had a list of cores with the index size, volume size, and 
free space for each one, that would be really nice.  Having a data point on the 
dashboard (and in the basic support info) for the total disk space consumed by 
all indexes would be really nice.  If we can separately calculate the size of 
inactive transient cores, that would be very nice.

You might be wondering why I would be interested in space information for every 
core.  There have been questions on the mailing list about how to have 
different cores put their index data on different filesystems, so I know that a 
few users out there will have that setup.  We could put information on the 
dashboard for volume size and free space for the solr home directory, which 
would be enough for the vast majority of users.


 Implement a gather support info button
 

 Key: SOLR-7796
 URL: https://issues.apache.org/jira/browse/SOLR-7796
 Project: Solr
  Issue Type: Improvement
  Components: web gui
Reporter: Shawn Heisey
Priority: Minor

 A gather support info button in the admin UI would be extremely helpful.  
 There are some basic pieces of info that we like to have for problem reports 
 on the user list, so there should be an easy way for a user to gather that 
 info.
 Some of the more basic bits of info would be easy to include in a single file 
 that's easy to cut/paste -- java version, heap info, core/collection names, 
 directories, and stats, etc.  If available, it should include server info 
 like memory, commandline args, ZK info, and possibly disk space.
 There could be two buttons -- one that gathers smaller info into an XML, 
 JSON, or .properties structure that can be easily cut/paste into an email 
 message, and another that gathers larger info like files for configuration 
 and schema along with the other info (grabbing from zookeeper if running in 
 cloud mode) and packages it into a .zip file.  Because the user list eats 
 almost all attachments, we would need to come up with some advice for sharing 
 the zipfile.  I hate to ask INFRA for a file sharing service, but that might 
 not be a bad idea.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-7864) timeAllowed causing ClassCastException

2015-08-03 Thread Markus Jelsma (JIRA)
Markus Jelsma created SOLR-7864:
---

 Summary: timeAllowed causing ClassCastException
 Key: SOLR-7864
 URL: https://issues.apache.org/jira/browse/SOLR-7864
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.2
Reporter: Markus Jelsma
 Fix For: 5.3, Trunk


If timeAllowed kicks in, following exception is thrown and user gets HTTP 500.

{code}
65219 [qtp2096057945-19] ERROR org.apache.solr.servlet.SolrDispatchFilter  [   
search] – null:java.lang.ClassCastException: 
org.apache.solr.response.ResultContext cannot be cast to 
org.apache.solr.common.SolrDocumentList
at 
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:275)
at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2064)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:450)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:227)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:196)
at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:497)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at 
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-6625) Add interceptor API for outgoing calls through HttpSolrClient

2015-08-03 Thread Noble Paul (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Noble Paul updated SOLR-6625:
-
Summary: Add interceptor API for outgoing calls through HttpSolrClient  
(was: HttpClient callback in HttpSolrServer)

 Add interceptor API for outgoing calls through HttpSolrClient
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625_SolrReqPropogate.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_r1654079.patch, SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: 5.3 release

2015-08-03 Thread Noble Paul
I may have to push the branch by a day or two. There are some more
loose ends to be tied up from my side. Sorry for the trouble

--Noble

On Thu, Jul 30, 2015 at 12:48 PM, Adrien Grand jpou...@gmail.com wrote:
 +1 to releasing 5.3, and thanks for volunteering!

 On Mon, Jul 27, 2015 at 10:56 AM, Noble Paul noble.p...@gmail.com wrote:
 Hi,
 I would like to volunteer myself as the RM for 5.3 release. I plan to
 cut the 5.3 release branch by next Monday (03/Aug).

 --
 -
 Noble Paul

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




-- 
-
Noble Paul

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6714) Expose version and resource description in CorruptIndexException and friends

2015-08-03 Thread Simon Willnauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Simon Willnauer updated LUCENE-6714:

Attachment: LUCENE-6714.patch

new patch with consistent naming for resourceDescription

 Expose version and resource description in CorruptIndexException and friends
 

 Key: LUCENE-6714
 URL: https://issues.apache.org/jira/browse/LUCENE-6714
 Project: Lucene - Core
  Issue Type: Improvement
Affects Versions: 5.2.1
Reporter: Simon Willnauer
Priority: Minor
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6714.patch, LUCENE-6714.patch, LUCENE-6714.patch


 It would be nice to access the minVersion, maxVersion in IndexTooNewException 
 and IndexTooOldException as well as the resoruce description in 
 CorruptIndexException programmatically. I'd love to use this to support 
 better serialization on top of those exception as well as structured 
 responses from the individual values. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6714) Expose version and resource description in CorruptIndexException and friends

2015-08-03 Thread Robert Muir (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652043#comment-14652043
 ] 

Robert Muir commented on LUCENE-6714:
-

+1, thanks!

 Expose version and resource description in CorruptIndexException and friends
 

 Key: LUCENE-6714
 URL: https://issues.apache.org/jira/browse/LUCENE-6714
 Project: Lucene - Core
  Issue Type: Improvement
Affects Versions: 5.2.1
Reporter: Simon Willnauer
Priority: Minor
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6714.patch, LUCENE-6714.patch, LUCENE-6714.patch


 It would be nice to access the minVersion, maxVersion in IndexTooNewException 
 and IndexTooOldException as well as the resoruce description in 
 CorruptIndexException programmatically. I'd love to use this to support 
 better serialization on top of those exception as well as structured 
 responses from the individual values. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5882) Introduce score local parameter for {!parent} query parser

2015-08-03 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652046#comment-14652046
 ] 

ASF subversion and git services commented on SOLR-5882:
---

Commit 1693926 from m...@apache.org in branch 'dev/trunk'
[ https://svn.apache.org/r1693926 ]

SOLR-5882: introducing local param {!parent score=..}..
fixing ScoreMode.Min for ToParentBlockJoinQuery
fixing ScoreMode parsing exception in ScoreJoinQParserPlugin

 Introduce score local parameter for {!parent} query parser
 --

 Key: SOLR-5882
 URL: https://issues.apache.org/jira/browse/SOLR-5882
 Project: Solr
  Issue Type: New Feature
Affects Versions: 4.8
Reporter: Andrey Kudryavtsev
Assignee: Mikhail Khludnev
 Fix For: 5.3

 Attachments: SOLR-5882.patch, SOLR-5882.patch


 I propose to have ability to configure scoring mode by local parameter
 Syntax for parent queries can be like:
 {code:borderStyle=solid}
 {!parent which=type:parent score=None|Avg|Max|Total|Min}...
 loweracase is also accepted
 {code} 
 Child query enables scoring by default.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (LUCENE-6417) Upgrade ANTLR to version 4.5

2015-08-03 Thread Jack Conradson (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652029#comment-14652029
 ] 

Jack Conradson edited comment on LUCENE-6417 at 8/3/15 4:13 PM:


Sorry, Mike and Uwe, for the delayed response.  I was actually on vacation the 
previous week.  I'll fix the pre-commit and make the suggested changes.  The 
ASM did not change at all (other than by mistake :) ), I was just forced to 
re-organize the ASM generation code into smaller chunks for the Antlr 4.5 
visitor.  Thanks for reviewing the patch!


was (Author: jdconradson):
Sorry, Mike and Uwe, for the delayed response.  I was actually on vacation the 
previous week.  I'll fix the pre-commit and make the suggested changes.  The 
ASM did not change at all (other than by mistake :) ), I was just forced to 
re-organize the ASM generation code into smaller chunks for the Antler 4.5 
visitor.  Thanks for reviewing the patch!

 Upgrade ANTLR to version 4.5
 

 Key: LUCENE-6417
 URL: https://issues.apache.org/jira/browse/LUCENE-6417
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Jack Conradson
 Attachments: LUCENE-6471.patch


 I would like to upgrade ANTLR from 3.5 to 4.5.  This version adds several 
 features that will improve the existing grammars.  The main improvement would 
 be the allowance of left-hand recursion in grammar rules which will reduce 
 the number of rules significantly for expressions.
 This change will require some code refactoring to the existing expressions 
 work.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6706) Support Payload scoring for SpanOrQuery

2015-08-03 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652047#comment-14652047
 ] 

ASF subversion and git services commented on LUCENE-6706:
-

Commit 1693927 from [~romseygeek] in branch 'dev/trunk'
[ https://svn.apache.org/r1693927 ]

LUCENE-6706: Remove deprecated PayloadTermQuery and PayloadNearQuery

 Support Payload scoring for SpanOrQuery
 ---

 Key: LUCENE-6706
 URL: https://issues.apache.org/jira/browse/LUCENE-6706
 Project: Lucene - Core
  Issue Type: New Feature
  Components: core/query/scoring
Affects Versions: 5.2.1
Reporter: Jamie Johnson
Assignee: Alan Woodward
Priority: Minor
 Attachments: LUCENE-6706.patch, PayloadSpanOrQuery.java


 I need a way to have payloads influence the score of SpanOrQuery's.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6706) Support Payload scoring for all SpanQueries

2015-08-03 Thread Alan Woodward (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alan Woodward updated LUCENE-6706:
--
Summary: Support Payload scoring for all SpanQueries  (was: Support Payload 
scoring for SpanOrQuery)

 Support Payload scoring for all SpanQueries
 ---

 Key: LUCENE-6706
 URL: https://issues.apache.org/jira/browse/LUCENE-6706
 Project: Lucene - Core
  Issue Type: New Feature
  Components: core/query/scoring
Affects Versions: 5.2.1
Reporter: Jamie Johnson
Assignee: Alan Woodward
Priority: Minor
 Fix For: 5.3

 Attachments: LUCENE-6706.patch, PayloadSpanOrQuery.java


 I need a way to have payloads influence the score of SpanOrQuery's.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (LUCENE-6706) Support Payload scoring for all SpanQueries

2015-08-03 Thread Alan Woodward (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alan Woodward resolved LUCENE-6706.
---
   Resolution: Fixed
Fix Version/s: 5.3

Thanks Jamie!

 Support Payload scoring for all SpanQueries
 ---

 Key: LUCENE-6706
 URL: https://issues.apache.org/jira/browse/LUCENE-6706
 Project: Lucene - Core
  Issue Type: New Feature
  Components: core/query/scoring
Affects Versions: 5.2.1
Reporter: Jamie Johnson
Assignee: Alan Woodward
Priority: Minor
 Fix For: 5.3

 Attachments: LUCENE-6706.patch, PayloadSpanOrQuery.java


 I need a way to have payloads influence the score of SpanOrQuery's.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6706) Support Payload scoring for all SpanQueries

2015-08-03 Thread Jamie Johnson (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652052#comment-14652052
 ] 

Jamie Johnson commented on LUCENE-6706:
---

Thanks Alan, I really appreciate the quick turn around on this.

 Support Payload scoring for all SpanQueries
 ---

 Key: LUCENE-6706
 URL: https://issues.apache.org/jira/browse/LUCENE-6706
 Project: Lucene - Core
  Issue Type: New Feature
  Components: core/query/scoring
Affects Versions: 5.2.1
Reporter: Jamie Johnson
Assignee: Alan Woodward
Priority: Minor
 Fix For: 5.3

 Attachments: LUCENE-6706.patch, PayloadSpanOrQuery.java


 I need a way to have payloads influence the score of SpanOrQuery's.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6714) Expose version and resource description in CorruptIndexException and friends

2015-08-03 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652055#comment-14652055
 ] 

ASF subversion and git services commented on LUCENE-6714:
-

Commit 1693929 from [~simonw] in branch 'dev/trunk'
[ https://svn.apache.org/r1693929 ]

LUCENE-6714: Expose exception details via getters on CorruptedIndex-, 
IndexTooOld-, IndexTooOldException

 Expose version and resource description in CorruptIndexException and friends
 

 Key: LUCENE-6714
 URL: https://issues.apache.org/jira/browse/LUCENE-6714
 Project: Lucene - Core
  Issue Type: Improvement
Affects Versions: 5.2.1
Reporter: Simon Willnauer
Priority: Minor
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6714.patch, LUCENE-6714.patch, LUCENE-6714.patch


 It would be nice to access the minVersion, maxVersion in IndexTooNewException 
 and IndexTooOldException as well as the resoruce description in 
 CorruptIndexException programmatically. I'd love to use this to support 
 better serialization on top of those exception as well as structured 
 responses from the individual values. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) Add interceptor API for outgoing calls through HttpSolrClient

2015-08-03 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652057#comment-14652057
 ] 

ASF subversion and git services commented on SOLR-6625:
---

Commit 1693931 from [~noble.paul] in branch 'dev/trunk'
[ https://svn.apache.org/r1693931 ]

SOLR-6625: Remove the HttpContext which provides our request

 Add interceptor API for outgoing calls through HttpSolrClient
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-revert.patch, SOLR-6625-testfailure.log, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6714) Expose version and resource description in CorruptIndexException and friends

2015-08-03 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652059#comment-14652059
 ] 

ASF subversion and git services commented on LUCENE-6714:
-

Commit 1693932 from [~simonw] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1693932 ]

LUCENE-6714: Expose exception details via getters on CorruptedIndex-, 
IndexTooOld-, IndexTooOldException

 Expose version and resource description in CorruptIndexException and friends
 

 Key: LUCENE-6714
 URL: https://issues.apache.org/jira/browse/LUCENE-6714
 Project: Lucene - Core
  Issue Type: Improvement
Affects Versions: 5.2.1
Reporter: Simon Willnauer
Priority: Minor
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6714.patch, LUCENE-6714.patch, LUCENE-6714.patch


 It would be nice to access the minVersion, maxVersion in IndexTooNewException 
 and IndexTooOldException as well as the resoruce description in 
 CorruptIndexException programmatically. I'd love to use this to support 
 better serialization on top of those exception as well as structured 
 responses from the individual values. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (LUCENE-6714) Expose version and resource description in CorruptIndexException and friends

2015-08-03 Thread Simon Willnauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Simon Willnauer resolved LUCENE-6714.
-
Resolution: Fixed
  Assignee: Simon Willnauer

 Expose version and resource description in CorruptIndexException and friends
 

 Key: LUCENE-6714
 URL: https://issues.apache.org/jira/browse/LUCENE-6714
 Project: Lucene - Core
  Issue Type: Improvement
Affects Versions: 5.2.1
Reporter: Simon Willnauer
Assignee: Simon Willnauer
Priority: Minor
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6714.patch, LUCENE-6714.patch, LUCENE-6714.patch


 It would be nice to access the minVersion, maxVersion in IndexTooNewException 
 and IndexTooOldException as well as the resoruce description in 
 CorruptIndexException programmatically. I'd love to use this to support 
 better serialization on top of those exception as well as structured 
 responses from the individual values. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Closed] (SOLR-7771) Classloader problem with solr.XXX class names and jars in SOLR_HOME/lib

2015-08-03 Thread Shawn Heisey (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shawn Heisey closed SOLR-7771.
--
Resolution: Duplicate

[~iorixxx] got this filed before I did, just found that issue.

 Classloader problem with solr.XXX class names and jars in SOLR_HOME/lib
 -

 Key: SOLR-7771
 URL: https://issues.apache.org/jira/browse/SOLR-7771
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.2.1
 Environment: C:\Users\elyograg\Downloads\solr-5.2.1java -version
 java version 1.8.0_45
 Java(TM) SE Runtime Environment (build 1.8.0_45-b14)
 Java HotSpot(TM) 64-Bit Server VM (build 25.45-b02, mixed mode)
Reporter: Shawn Heisey

 Jars placed in SOLR_HOME/lib seem to be loaded twice, which causes problems 
 trying to use solr.XX class names in schema.xml.
 If the full class name is used, it works.
 Steps to recreate on an extracted Solr 5.2.1 download.  This was done on 
 Windows, so I used backslashes as path separators:
 {noformat}
 bin\solr start
 bin\solr create -c foo -d sample_techproducts_configs
 bin\solr stop -all
 {noformat}
 Add the following to server\foo\conf\schema.xml, just before the /schema 
 end tag:
 {noformat}
 fieldType name=icu_test class=solr.TextField
   analyzer 
 tokenizer class=solr.ICUTokenizerFactory/
   /analyzer
 /fieldType
 {noformat}
 Create a new directory -- server\solr\lib.
 Copy icu4j-54.1.jar and lucene-analyzers-icu-5.2.1.jar from 
 contrib\analysis-extras to server\solr\lib.
 {noformat}
 bin\solr start
 {noformat}
 Note an exception in the logging tab:
 java.lang.NoClassDefFoundError: 
 org/apache/lucene/analysis/icu/segmentation/ICUTokenizer
 At this point, if the class name is changed from solr.ICUTokenizerFactory to 
 org.apache.lucene.analysis.icu.segmentation.ICUTokenizerFactory and solr is 
 stopped and started, then everything is OK.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Understanding performance degradation in range queries between Solr 5.2.1 and 4.10.4

2015-08-03 Thread Anshum Gupta
Guess bypassing that check and always returning true instead would help
confirm that. If that's the case, we should just initialize the timeout to
Long.MAX_VALUE and check for that to short-circuit?

On Mon, Aug 3, 2015 at 3:50 PM, Tomás Fernández Löbbe tomasflo...@gmail.com
 wrote:

 Yes, I saw that, but thought it could be the underlying implementation,
 not the ExitableTermsEnum wrapper. Maybe it's related to the calls to
 System.nanoTime then...

 On Mon, Aug 3, 2015 at 3:11 PM, Adrien Grand jpou...@gmail.com wrote:

 Thanks for sharing the traces, it looks like my intuition was wrong.
 :) They seem to point to
 ExitableDirectoryReader$ExitableTermsEnum.next, which checks whether
 the time is out before delegating.

 On Mon, Aug 3, 2015 at 7:21 PM, Tomás Fernández Löbbe
 tomasflo...@gmail.com wrote:
  Thanks Adrien,
  I'll run the tests with 5.3 snapshot and post the results here. In case
 this
  helps, this is the hprof samples output
  (-Xrunhprof:cpu=samples,depth=3,file=/home/ec2-user/hprof_output.txt)
 for
  4.10.4 and 5.2.1 in my test:
 
  Solr 4.10.4:
  CPU SAMPLES BEGIN (total = 243525) Fri Jul 31 22:29:06 2015
  rank   self  accum   count trace method
 1 75.07% 75.07%  182812 300523 java.net.PlainSocketImpl.socketAccept
 2  4.27% 79.34%   10408 301576
  org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.decodeMetaData
 3  4.15% 83.49%   10108 301585
  org.apache.lucene.index.FilteredTermsEnum.docs
 4  3.46% 86.95%8419 301582
  org.apache.lucene.index.FilteredTermsEnum.next
 5  2.49% 89.44%6070 301573 java.net.SocketInputStream.socketRead0
 6  1.99% 91.43%4848 301599
  org.apache.lucene.search.MultiTermQueryWrapperFilter.getDocIdSet
 7  1.98% 93.42%4824 301583
  org.apache.lucene.search.MultiTermQueryWrapperFilter.getDocIdSet
 8  1.57% 94.99%3824 301589
  org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll
 9  1.44% 96.42%3504 301594
 
 org.apache.lucene.codecs.lucene41.Lucene41PostingsReader$BlockDocsEnum.refillDocs
10  1.09% 97.51%2655 301581 java.nio.Bits.copyToArray
11  0.98% 98.50%2388 301598
 
 org.apache.lucene.codecs.lucene41.Lucene41PostingsReader$BlockDocsEnum.nextDoc
12  0.62% 99.12%1522 301600
 org.apache.lucene.store.DataInput.readVInt
13  0.21% 99.33% 500 301612
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.docs
14  0.07% 99.39% 167 301601
  org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.next
15  0.06% 99.45% 139 301619 java.lang.System.identityHashCode
16  0.05% 99.50% 114 301632
  org.apache.lucene.codecs.lucene41.ForUtil.readBlock
17  0.04% 99.54%  92 300708 java.util.zip.Inflater.inflateBytes
18  0.03% 99.57%  76 301624
 
 org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.loadNextFloorBlock
19  0.03% 99.59%  68 300613 java.lang.ClassLoader.defineClass1
20  0.03% 99.62%  68 301615
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
21  0.03% 99.65%  62 301635
  org.apache.solr.search.SolrIndexSearcher.getDocSetNC
22  0.02% 99.66%  41 301664
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
23  0.01% 99.68%  31 301629
 org.apache.lucene.util.FixedBitSet.init
  CPU SAMPLES END
 
  Solr 5.2.1:
  CPU SAMPLES BEGIN (total = 235415) Fri Jul 31 22:42:06 2015
  rank   self  accum   count trace method
 1 51.38% 51.38%  120954 301291 sun.nio.ch.EPollArrayWrapper.epollWait
 2 25.69% 77.07%   60477 301292
 sun.nio.ch.ServerSocketChannelImpl.accept0
 3 10.59% 87.66%   24923 301369
  org.apache.lucene.index.ExitableDirectoryReader$ExitableTermsEnum.next
 4  2.20% 89.86%5182 301414
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.postings
 5  2.01% 91.87%4742 301384
  org.apache.lucene.index.FilterLeafReader$FilterTermsEnum.postings
 6  1.25% 93.12%2944 301434
  java.lang.ThreadLocal$ThreadLocalMap.getEntryAfterMiss
 7  1.11% 94.23%2612 301367
  org.apache.lucene.search.MultiTermQueryConstantScoreWrapper$1.rewrite
 8  0.94% 95.17%2204 301390 org.apache.lucene.util.BitSet.or
 9  0.93% 96.10%2190 301383 java.nio.Bits.copyToArray
10  0.78% 96.87%1825 301449
 
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.refillDocs
11  0.73% 97.60%1717 301378
  org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll
12  0.73% 98.33%1715 301374 org.apache.lucene.util.BitSet.or
13  0.33% 98.66% 787 301387
 
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
14  0.16% 98.82% 374 301426
 
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
15  0.10% 98.93% 245 301382 org.apache.lucene.util.BitSet.or
16  0.09% 99.02% 219 301381
  org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.next
17  0.09% 99.11% 207 301370 org.apache.lucene.util.BitSet.or
18  0.06% 99.17% 153 

[jira] [Comment Edited] (SOLR-7859) Clamp down on use of System.currentTimeMillis

2015-08-03 Thread Ramkumar Aiyengar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652972#comment-14652972
 ] 

Ramkumar Aiyengar edited comment on SOLR-7859 at 8/4/15 2:38 AM:
-

Attached is a patch to remove most occurrences in solr code (boy there are a 
few!) and SuppressForbidden where the usage is legitimate.

There are also a couple of cases where the usage is suspect, but I haven't got 
to it as yet. One is around stats, but the more worrying thing is that we use 
the wall time recorded as commit data on a commit to check if replication needs 
to be done. In IndexFetcher, there is this code:

{code}
  if (!forceReplication  
IndexDeletionPolicyWrapper.getCommitTimestamp(commit) == latestVersion) {
//master and slave are already in sync just return
LOG.info(Slave in sync with master.);
successfulInstall = true;
return true;
  }
{code}

We are checking wall times across machines to check if we are in sync? That 
sounds wrong.. Or I am mistaken here? Why can't we just check generations? 
Another place below checks both generations and timestamps to see if a full 
copy is needed..

{code}
  // if the generation of master is older than that of the slave , it means 
they are not compatible to be copied
  // then a new index directory to be created and all the files need to be 
copied
  boolean isFullCopyNeeded = IndexDeletionPolicyWrapper
  .getCommitTimestamp(commit) = latestVersion
  || commit.getGeneration() = latestGeneration || forceReplication;
{code}


was (Author: andyetitmoves):
Attached is a patch to remove most occurrences in solr code (boy there are a 
few!) and SuppressForbidden where the usage is legitimate.

There are also a couple of cases where the usage is suspect, but I haven't got 
to it as yet. One is around stats, but the more worrying thing is that we use 
the wall time recorded as commit data on a commit to check if replication needs 
to be done. In IndexFetcher, there is this code:

{code}
  if (!forceReplication  
IndexDeletionPolicyWrapper.getCommitTimestamp(commit) == latestVersion) {
//master and slave are already in sync just return
LOG.info(Slave in sync with master.);
successfulInstall = true;
return true;
  }
{code}

We are checking wall times across machines to check if we are in sync, that 
sounds wrong. Or I am mistaken here?

 Clamp down on use of System.currentTimeMillis
 -

 Key: SOLR-7859
 URL: https://issues.apache.org/jira/browse/SOLR-7859
 Project: Solr
  Issue Type: Improvement
Reporter: Ramkumar Aiyengar
 Attachments: SOLR-7859.patch


 We did one round of this in SOLR-5734, but more places seem to keep cropping 
 up. We should do one more round, and start whitelisting places which really 
 need it using forbidden-apis.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6609) FieldCacheSource (or it's subclasses) should override getSortField

2015-08-03 Thread Hoss Man (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652759#comment-14652759
 ] 

Hoss Man commented on LUCENE-6609:
--

thanks for the review adrian.

(running full tests and precommit on 5x now)

 FieldCacheSource (or it's subclasses) should override getSortField
 --

 Key: LUCENE-6609
 URL: https://issues.apache.org/jira/browse/LUCENE-6609
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Hoss Man
Assignee: Hoss Man
 Attachments: LUCENE-6609.patch


 {{ValueSource}} defines the following method...
 {code}
   public SortField getSortField(boolean reverse) {
 return new ValueSourceSortField(reverse);
   }
 {code}
 ...where {{ValueSourceSortField}} builds up a {{ValueSourceComparator}} 
 containing a {{double[]}} based on the {{FunctionValues}} of the original 
 {{ValueSource}}.
 meanwhile, the abstract {{FieldCacheSource}} exists as a base implementation 
 for classes like {{IntFieldSource}} and {{DoubleFieldSource}} which wrap a 
 {{ValueSource}} around {{DocValues}} for the specified field.
 But neither {{FieldCacheSource}} nor any of it's subclasses override the 
 {{getSortField(boolean)}} method -- so attempting to sort on something like 
 an {{IntFieldSource}} winds up using a bunch of ram to build that 
 {{double[]}} to give users a less accurate sort (because of casting) then if 
 they just sorted directly on the field.
 is there any good reason why {{FieldCacheSource}} subclases like 
 {{IntFieldSource}} shouldn't all override {{getSortField}} with something 
 like...
 {code}
   public SortField getSortField(boolean reverse) {
 return new SortField(field, Type.INT, reverse);
   }
 {code}
 ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-5.x-Windows (32bit/jdk1.8.0_51) - Build # 4974 - Failure!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4974/
Java: 32bit/jdk1.8.0_51 -server -XX:+UseG1GC

5 tests failed.
FAILED:  
org.apache.lucene.search.payloads.TestPayloadScoreQuery.testSpanContainingQuery

Error Message:
Unexpected hit in document 296

Stack Trace:
java.lang.AssertionError: Unexpected hit in document 296
at 
__randomizedtesting.SeedInfo.seed([5A58A589322E17:8964B028249CFB65]:0)
at org.junit.Assert.fail(Assert.java:93)
at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.checkQuery(TestPayloadScoreQuery.java:66)
at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.testSpanContainingQuery(TestPayloadScoreQuery.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.lucene.search.payloads.TestPayloadScoreQuery.testNearQuery

Error Message:
Unexpected hit in document 296

Stack Trace:
java.lang.AssertionError: Unexpected hit in document 296
at 
__randomizedtesting.SeedInfo.seed([5A58A589322E17:40BA355A8FFBB4DB]:0)
at org.junit.Assert.fail(Assert.java:93)
at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.checkQuery(TestPayloadScoreQuery.java:66)
at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.testNearQuery(TestPayloadScoreQuery.java:112)
at 

[jira] [Commented] (LUCENE-6609) FieldCacheSource (or it's subclasses) should override getSortField

2015-08-03 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652757#comment-14652757
 ] 

ASF subversion and git services commented on LUCENE-6609:
-

Commit 1693979 from hoss...@apache.org in branch 'dev/trunk'
[ https://svn.apache.org/r1693979 ]

LUCENE-6609: Add getSortField impls to many subclasses of FieldCacheSource 
which return the most direct SortField implementation

 FieldCacheSource (or it's subclasses) should override getSortField
 --

 Key: LUCENE-6609
 URL: https://issues.apache.org/jira/browse/LUCENE-6609
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Hoss Man
Assignee: Hoss Man
 Attachments: LUCENE-6609.patch


 {{ValueSource}} defines the following method...
 {code}
   public SortField getSortField(boolean reverse) {
 return new ValueSourceSortField(reverse);
   }
 {code}
 ...where {{ValueSourceSortField}} builds up a {{ValueSourceComparator}} 
 containing a {{double[]}} based on the {{FunctionValues}} of the original 
 {{ValueSource}}.
 meanwhile, the abstract {{FieldCacheSource}} exists as a base implementation 
 for classes like {{IntFieldSource}} and {{DoubleFieldSource}} which wrap a 
 {{ValueSource}} around {{DocValues}} for the specified field.
 But neither {{FieldCacheSource}} nor any of it's subclasses override the 
 {{getSortField(boolean)}} method -- so attempting to sort on something like 
 an {{IntFieldSource}} winds up using a bunch of ram to build that 
 {{double[]}} to give users a less accurate sort (because of casting) then if 
 they just sorted directly on the field.
 is there any good reason why {{FieldCacheSource}} subclases like 
 {{IntFieldSource}} shouldn't all override {{getSortField}} with something 
 like...
 {code}
   public SortField getSortField(boolean reverse) {
 return new SortField(field, Type.INT, reverse);
   }
 {code}
 ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (LUCENE-6609) FieldCacheSource (or it's subclasses) should override getSortField

2015-08-03 Thread Hoss Man (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hoss Man resolved LUCENE-6609.
--
   Resolution: Fixed
Fix Version/s: Trunk
   5.3

 FieldCacheSource (or it's subclasses) should override getSortField
 --

 Key: LUCENE-6609
 URL: https://issues.apache.org/jira/browse/LUCENE-6609
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Hoss Man
Assignee: Hoss Man
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6609.patch


 {{ValueSource}} defines the following method...
 {code}
   public SortField getSortField(boolean reverse) {
 return new ValueSourceSortField(reverse);
   }
 {code}
 ...where {{ValueSourceSortField}} builds up a {{ValueSourceComparator}} 
 containing a {{double[]}} based on the {{FunctionValues}} of the original 
 {{ValueSource}}.
 meanwhile, the abstract {{FieldCacheSource}} exists as a base implementation 
 for classes like {{IntFieldSource}} and {{DoubleFieldSource}} which wrap a 
 {{ValueSource}} around {{DocValues}} for the specified field.
 But neither {{FieldCacheSource}} nor any of it's subclasses override the 
 {{getSortField(boolean)}} method -- so attempting to sort on something like 
 an {{IntFieldSource}} winds up using a bunch of ram to build that 
 {{double[]}} to give users a less accurate sort (because of casting) then if 
 they just sorted directly on the field.
 is there any good reason why {{FieldCacheSource}} subclases like 
 {{IntFieldSource}} shouldn't all override {{getSortField}} with something 
 like...
 {code}
   public SortField getSortField(boolean reverse) {
 return new SortField(field, Type.INT, reverse);
   }
 {code}
 ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6609) FieldCacheSource (or it's subclasses) should override getSortField

2015-08-03 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652844#comment-14652844
 ] 

ASF subversion and git services commented on LUCENE-6609:
-

Commit 1693987 from hoss...@apache.org in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1693987 ]

LUCENE-6609: Add getSortField impls to many subclasses of FieldCacheSource 
which return the most direct SortField implementation (merge r1693979)

 FieldCacheSource (or it's subclasses) should override getSortField
 --

 Key: LUCENE-6609
 URL: https://issues.apache.org/jira/browse/LUCENE-6609
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Hoss Man
Assignee: Hoss Man
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6609.patch


 {{ValueSource}} defines the following method...
 {code}
   public SortField getSortField(boolean reverse) {
 return new ValueSourceSortField(reverse);
   }
 {code}
 ...where {{ValueSourceSortField}} builds up a {{ValueSourceComparator}} 
 containing a {{double[]}} based on the {{FunctionValues}} of the original 
 {{ValueSource}}.
 meanwhile, the abstract {{FieldCacheSource}} exists as a base implementation 
 for classes like {{IntFieldSource}} and {{DoubleFieldSource}} which wrap a 
 {{ValueSource}} around {{DocValues}} for the specified field.
 But neither {{FieldCacheSource}} nor any of it's subclasses override the 
 {{getSortField(boolean)}} method -- so attempting to sort on something like 
 an {{IntFieldSource}} winds up using a bunch of ram to build that 
 {{double[]}} to give users a less accurate sort (because of casting) then if 
 they just sorted directly on the field.
 is there any good reason why {{FieldCacheSource}} subclases like 
 {{IntFieldSource}} shouldn't all override {{getSortField}} with something 
 like...
 {code}
   public SortField getSortField(boolean reverse) {
 return new SortField(field, Type.INT, reverse);
   }
 {code}
 ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0_51) - Build # 5103 - Failure!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/5103/
Java: 32bit/jdk1.8.0_51 -client -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  
org.apache.solr.search.function.SortByFunctionTest.testFieldSortSpecifiedAsFunction

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
at 
__randomizedtesting.SeedInfo.seed([44EFE5C0854BAE53:7EBD258F7D3938EF]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:765)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:732)
at 
org.apache.solr.search.function.SortByFunctionTest.testFieldSortSpecifiedAsFunction(SortByFunctionTest.java:175)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.UnsupportedOperationException: codec does not support 
random access ordinals, cannot use selector: MAX docValsImpl: 
org.apache.lucene.codecs.memory.MemoryDocValuesProducer$9@1a3e743
at 

[JENKINS-EA] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_60-ea-b24) - Build # 13720 - Failure!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13720/
Java: 64bit/jdk1.8.0_60-ea-b24 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:
Timeout while trying to assert update logs @ collection=source_collection

Stack Trace:
java.lang.AssertionError: Timeout while trying to assert update logs @ 
collection=source_collection
at 
__randomizedtesting.SeedInfo.seed([6DBB89F8922A4694:65DBFCD49D246E9F]:0)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.assertNumberOfTlogFiles(CdcrReplicationDistributedZkTest.java:644)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestUpdateLogSynchronisation(CdcrReplicationDistributedZkTest.java:374)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 

[jira] [Updated] (SOLR-7855) OverseerCollectionProcessor: separate general task management from collection message handling

2015-08-03 Thread Gregory Chanan (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gregory Chanan updated SOLR-7855:
-
Attachment: SOLR-7855.patch

v2 of the patch, only minor changes mainly around renaming imports for tests.

 OverseerCollectionProcessor: separate general task management from collection 
 message handling
 --

 Key: SOLR-7855
 URL: https://issues.apache.org/jira/browse/SOLR-7855
 Project: Solr
  Issue Type: Bug
  Components: SolrCloud
Reporter: Gregory Chanan
Assignee: Gregory Chanan
 Attachments: SOLR-7855.patch, SOLR-7855.patch


 While working on SOLR-7789, I realized it would be easier if I split up the 
 OverseerCollectionProcessor into two parts:
 1) General handling of tasks (work queues, etc)
 2) Processing a collection handler request
 I haven't decided whether the ConfigSet should have its own processor, i.e. 
 OverseerConfigSetProcessor or reuse at least the thread for the 
 OverseerCollectionProcessor, but in either case this refactoring will be 
 helpful.  That is, if the ConfigSet processing has its own processing, I can 
 reuse the general handling of tasks part.  If the ConfigSet processing reuses 
 the OverseerCollectionProcessing thread, I won't complicate the 
 implementation with ConfigSet operations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Reopened] (LUCENE-6706) Support Payload scoring for all SpanQueries

2015-08-03 Thread Hoss Man (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hoss Man reopened LUCENE-6706:
--

re-opened due to test failures

 Support Payload scoring for all SpanQueries
 ---

 Key: LUCENE-6706
 URL: https://issues.apache.org/jira/browse/LUCENE-6706
 Project: Lucene - Core
  Issue Type: New Feature
  Components: core/query/scoring
Affects Versions: 5.2.1
Reporter: Jamie Johnson
Assignee: Alan Woodward
Priority: Minor
 Fix For: 5.3

 Attachments: LUCENE-6706.patch, PayloadSpanOrQuery.java


 I need a way to have payloads influence the score of SpanOrQuery's.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS-EA] Lucene-Solr-5.x-Linux (64bit/jdk1.8.0_60-ea-b24) - Build # 13541 - Failure!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/13541/
Java: 64bit/jdk1.8.0_60-ea-b24 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  
org.apache.solr.search.function.SortByFunctionTest.testFieldSortSpecifiedAsFunction

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
at 
__randomizedtesting.SeedInfo.seed([3D6425F20488D812:736E5BDFCFA4EAE]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:765)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:732)
at 
org.apache.solr.search.function.SortByFunctionTest.testFieldSortSpecifiedAsFunction(SortByFunctionTest.java:175)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.UnsupportedOperationException: codec does not support 
random access ordinals, cannot use selector: MAX docValsImpl: 
org.apache.lucene.codecs.memory.MemoryDocValuesProducer$9@4c18199e
   

[jira] [Commented] (SOLR-6188) solr.ICUFoldingFilterFactory causes NoClassDefFoundError: o/a/l/a/icu/ICUFoldingFilter

2015-08-03 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652607#comment-14652607
 ] 

Shawn Heisey commented on SOLR-6188:


I closed SOLR-7771 as a duplicate of this issue.

I'm attempting to get Solr 5.2.1 installed into my dev environment with the 
config from my Solr 4.9 install.  I have all the extra jars in 
${solr.solr.home}/lib.

By updating schema.xml to replace the solr.ICU* class names with the fully 
qualified versions, I was able to get Solr to start properly.

I'm using another custom analysis component recompiled with 5.2.1 jars:

https://github.com/solrmarc/CJKFoldingFilter/releases

This component works just fine with solr.CJKFoldingFilter in the class 
parameter.


 solr.ICUFoldingFilterFactory causes NoClassDefFoundError: 
 o/a/l/a/icu/ICUFoldingFilter
 --

 Key: SOLR-6188
 URL: https://issues.apache.org/jira/browse/SOLR-6188
 Project: Solr
  Issue Type: Bug
  Components: Schema and Analysis
Affects Versions: 4.8.1
Reporter: Ahmet Arslan
  Labels: ICUFoldingFilterFactory
 Fix For: 4.10


 When fully qualified class name is used in schema.xml 
 {{org.apache.lucene.analysis.icu.ICUFoldingFilterFactory}}
 it works. However as documented in confluence and wiki, when 
 {{solr.ICUFoldingFilterFactory}} is used it throws following exception.
 This is true for both released 4.8.1 version and trunk r1604168
 following type works :
 {code:xml}
  fieldType name=folded2 class=solr.TextField
   analyzer
 tokenizer class=solr.StandardTokenizerFactory/
 filter 
 class=org.apache.lucene.analysis.icu.ICUFoldingFilterFactory/
   /analyzer
 /fieldType
 {code}
 this does not : 
 {code:xml}
  fieldType name=folded class=solr.TextField
   analyzer
 tokenizer class=solr.StandardTokenizerFactory/
 filter class=solr.ICUFoldingFilterFactory/
   /analyzer
 /fieldType
 {code}
 {noformat}
 257 [main] ERROR org.apache.solr.core.SolrCore  – Error loading 
 core:java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: 
 org/apache/lucene/analysis/icu/ICUFoldingFilter
   at java.util.concurrent.FutureTask.report(FutureTask.java:122)
   at java.util.concurrent.FutureTask.get(FutureTask.java:188)
   at org.apache.solr.core.CoreContainer.load(CoreContainer.java:301)
   at 
 org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:190)
   at 
 org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:137)
   at org.eclipse.jetty.servlet.FilterHolder.doStart(FilterHolder.java:119)
   at 
 org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
   at 
 org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:719)
   at 
 org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:265)
   at 
 org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1252)
   at 
 org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:710)
   at 
 org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:494)
   at 
 org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
   at 
 org.eclipse.jetty.deploy.bindings.StandardStarter.processBinding(StandardStarter.java:39)
   at 
 org.eclipse.jetty.deploy.AppLifeCycle.runBindings(AppLifeCycle.java:186)
   at 
 org.eclipse.jetty.deploy.DeploymentManager.requestAppGoal(DeploymentManager.java:494)
   at 
 org.eclipse.jetty.deploy.DeploymentManager.addApp(DeploymentManager.java:141)
   at 
 org.eclipse.jetty.deploy.providers.ScanningAppProvider.fileAdded(ScanningAppProvider.java:145)
   at 
 org.eclipse.jetty.deploy.providers.ScanningAppProvider$1.fileAdded(ScanningAppProvider.java:56)
   at org.eclipse.jetty.util.Scanner.reportAddition(Scanner.java:609)
   at org.eclipse.jetty.util.Scanner.reportDifferences(Scanner.java:540)
   at org.eclipse.jetty.util.Scanner.scan(Scanner.java:403)
   at org.eclipse.jetty.util.Scanner.doStart(Scanner.java:337)
   at 
 org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
   at 
 org.eclipse.jetty.deploy.providers.ScanningAppProvider.doStart(ScanningAppProvider.java:121)
   at 
 org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
   at 
 org.eclipse.jetty.deploy.DeploymentManager.startAppProvider(DeploymentManager.java:555)
   at 
 org.eclipse.jetty.deploy.DeploymentManager.doStart(DeploymentManager.java:230)
   at 
 org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
   at 
 

[jira] [Assigned] (LUCENE-6609) FieldCacheSource (or it's subclasses) should override getSortField

2015-08-03 Thread Hoss Man (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hoss Man reassigned LUCENE-6609:


Assignee: Hoss Man

 FieldCacheSource (or it's subclasses) should override getSortField
 --

 Key: LUCENE-6609
 URL: https://issues.apache.org/jira/browse/LUCENE-6609
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Hoss Man
Assignee: Hoss Man
 Attachments: LUCENE-6609.patch


 {{ValueSource}} defines the following method...
 {code}
   public SortField getSortField(boolean reverse) {
 return new ValueSourceSortField(reverse);
   }
 {code}
 ...where {{ValueSourceSortField}} builds up a {{ValueSourceComparator}} 
 containing a {{double[]}} based on the {{FunctionValues}} of the original 
 {{ValueSource}}.
 meanwhile, the abstract {{FieldCacheSource}} exists as a base implementation 
 for classes like {{IntFieldSource}} and {{DoubleFieldSource}} which wrap a 
 {{ValueSource}} around {{DocValues}} for the specified field.
 But neither {{FieldCacheSource}} nor any of it's subclasses override the 
 {{getSortField(boolean)}} method -- so attempting to sort on something like 
 an {{IntFieldSource}} winds up using a bunch of ram to build that 
 {{double[]}} to give users a less accurate sort (because of casting) then if 
 they just sorted directly on the field.
 is there any good reason why {{FieldCacheSource}} subclases like 
 {{IntFieldSource}} shouldn't all override {{getSortField}} with something 
 like...
 {code}
   public SortField getSortField(boolean reverse) {
 return new SortField(field, Type.INT, reverse);
   }
 {code}
 ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Understanding performance degradation in range queries between Solr 5.2.1 and 4.10.4

2015-08-03 Thread Tomás Fernández Löbbe
Yes, I saw that, but thought it could be the underlying implementation, not
the ExitableTermsEnum wrapper. Maybe it's related to the calls to
System.nanoTime then...

On Mon, Aug 3, 2015 at 3:11 PM, Adrien Grand jpou...@gmail.com wrote:

 Thanks for sharing the traces, it looks like my intuition was wrong.
 :) They seem to point to
 ExitableDirectoryReader$ExitableTermsEnum.next, which checks whether
 the time is out before delegating.

 On Mon, Aug 3, 2015 at 7:21 PM, Tomás Fernández Löbbe
 tomasflo...@gmail.com wrote:
  Thanks Adrien,
  I'll run the tests with 5.3 snapshot and post the results here. In case
 this
  helps, this is the hprof samples output
  (-Xrunhprof:cpu=samples,depth=3,file=/home/ec2-user/hprof_output.txt) for
  4.10.4 and 5.2.1 in my test:
 
  Solr 4.10.4:
  CPU SAMPLES BEGIN (total = 243525) Fri Jul 31 22:29:06 2015
  rank   self  accum   count trace method
 1 75.07% 75.07%  182812 300523 java.net.PlainSocketImpl.socketAccept
 2  4.27% 79.34%   10408 301576
  org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.decodeMetaData
 3  4.15% 83.49%   10108 301585
  org.apache.lucene.index.FilteredTermsEnum.docs
 4  3.46% 86.95%8419 301582
  org.apache.lucene.index.FilteredTermsEnum.next
 5  2.49% 89.44%6070 301573 java.net.SocketInputStream.socketRead0
 6  1.99% 91.43%4848 301599
  org.apache.lucene.search.MultiTermQueryWrapperFilter.getDocIdSet
 7  1.98% 93.42%4824 301583
  org.apache.lucene.search.MultiTermQueryWrapperFilter.getDocIdSet
 8  1.57% 94.99%3824 301589
  org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll
 9  1.44% 96.42%3504 301594
 
 org.apache.lucene.codecs.lucene41.Lucene41PostingsReader$BlockDocsEnum.refillDocs
10  1.09% 97.51%2655 301581 java.nio.Bits.copyToArray
11  0.98% 98.50%2388 301598
 
 org.apache.lucene.codecs.lucene41.Lucene41PostingsReader$BlockDocsEnum.nextDoc
12  0.62% 99.12%1522 301600
 org.apache.lucene.store.DataInput.readVInt
13  0.21% 99.33% 500 301612
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.docs
14  0.07% 99.39% 167 301601
  org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.next
15  0.06% 99.45% 139 301619 java.lang.System.identityHashCode
16  0.05% 99.50% 114 301632
  org.apache.lucene.codecs.lucene41.ForUtil.readBlock
17  0.04% 99.54%  92 300708 java.util.zip.Inflater.inflateBytes
18  0.03% 99.57%  76 301624
 
 org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.loadNextFloorBlock
19  0.03% 99.59%  68 300613 java.lang.ClassLoader.defineClass1
20  0.03% 99.62%  68 301615
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
21  0.03% 99.65%  62 301635
  org.apache.solr.search.SolrIndexSearcher.getDocSetNC
22  0.02% 99.66%  41 301664
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
23  0.01% 99.68%  31 301629
 org.apache.lucene.util.FixedBitSet.init
  CPU SAMPLES END
 
  Solr 5.2.1:
  CPU SAMPLES BEGIN (total = 235415) Fri Jul 31 22:42:06 2015
  rank   self  accum   count trace method
 1 51.38% 51.38%  120954 301291 sun.nio.ch.EPollArrayWrapper.epollWait
 2 25.69% 77.07%   60477 301292
 sun.nio.ch.ServerSocketChannelImpl.accept0
 3 10.59% 87.66%   24923 301369
  org.apache.lucene.index.ExitableDirectoryReader$ExitableTermsEnum.next
 4  2.20% 89.86%5182 301414
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.postings
 5  2.01% 91.87%4742 301384
  org.apache.lucene.index.FilterLeafReader$FilterTermsEnum.postings
 6  1.25% 93.12%2944 301434
  java.lang.ThreadLocal$ThreadLocalMap.getEntryAfterMiss
 7  1.11% 94.23%2612 301367
  org.apache.lucene.search.MultiTermQueryConstantScoreWrapper$1.rewrite
 8  0.94% 95.17%2204 301390 org.apache.lucene.util.BitSet.or
 9  0.93% 96.10%2190 301383 java.nio.Bits.copyToArray
10  0.78% 96.87%1825 301449
 
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.refillDocs
11  0.73% 97.60%1717 301378
  org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll
12  0.73% 98.33%1715 301374 org.apache.lucene.util.BitSet.or
13  0.33% 98.66% 787 301387
 
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
14  0.16% 98.82% 374 301426
 
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
15  0.10% 98.93% 245 301382 org.apache.lucene.util.BitSet.or
16  0.09% 99.02% 219 301381
  org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.next
17  0.09% 99.11% 207 301370 org.apache.lucene.util.BitSet.or
18  0.06% 99.17% 153 301416 org.apache.lucene.util.BitSet.or
19  0.06% 99.24% 151 301427 org.apache.lucene.util.BitSet.or
20  0.06% 99.30% 151 301441
 org.apache.lucene.store.DataInput.readVInt
21  0.06% 99.36% 147 301389 java.lang.System.identityHashCode
22  0.06% 99.42% 140 301375

Re: Understanding performance degradation in range queries between Solr 5.2.1 and 4.10.4

2015-08-03 Thread Adrien Grand
Thanks for sharing the traces, it looks like my intuition was wrong.
:) They seem to point to
ExitableDirectoryReader$ExitableTermsEnum.next, which checks whether
the time is out before delegating.

On Mon, Aug 3, 2015 at 7:21 PM, Tomás Fernández Löbbe
tomasflo...@gmail.com wrote:
 Thanks Adrien,
 I'll run the tests with 5.3 snapshot and post the results here. In case this
 helps, this is the hprof samples output
 (-Xrunhprof:cpu=samples,depth=3,file=/home/ec2-user/hprof_output.txt) for
 4.10.4 and 5.2.1 in my test:

 Solr 4.10.4:
 CPU SAMPLES BEGIN (total = 243525) Fri Jul 31 22:29:06 2015
 rank   self  accum   count trace method
1 75.07% 75.07%  182812 300523 java.net.PlainSocketImpl.socketAccept
2  4.27% 79.34%   10408 301576
 org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.decodeMetaData
3  4.15% 83.49%   10108 301585
 org.apache.lucene.index.FilteredTermsEnum.docs
4  3.46% 86.95%8419 301582
 org.apache.lucene.index.FilteredTermsEnum.next
5  2.49% 89.44%6070 301573 java.net.SocketInputStream.socketRead0
6  1.99% 91.43%4848 301599
 org.apache.lucene.search.MultiTermQueryWrapperFilter.getDocIdSet
7  1.98% 93.42%4824 301583
 org.apache.lucene.search.MultiTermQueryWrapperFilter.getDocIdSet
8  1.57% 94.99%3824 301589
 org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll
9  1.44% 96.42%3504 301594
 org.apache.lucene.codecs.lucene41.Lucene41PostingsReader$BlockDocsEnum.refillDocs
   10  1.09% 97.51%2655 301581 java.nio.Bits.copyToArray
   11  0.98% 98.50%2388 301598
 org.apache.lucene.codecs.lucene41.Lucene41PostingsReader$BlockDocsEnum.nextDoc
   12  0.62% 99.12%1522 301600 org.apache.lucene.store.DataInput.readVInt
   13  0.21% 99.33% 500 301612
 org.apache.lucene.codecs.blocktree.SegmentTermsEnum.docs
   14  0.07% 99.39% 167 301601
 org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.next
   15  0.06% 99.45% 139 301619 java.lang.System.identityHashCode
   16  0.05% 99.50% 114 301632
 org.apache.lucene.codecs.lucene41.ForUtil.readBlock
   17  0.04% 99.54%  92 300708 java.util.zip.Inflater.inflateBytes
   18  0.03% 99.57%  76 301624
 org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.loadNextFloorBlock
   19  0.03% 99.59%  68 300613 java.lang.ClassLoader.defineClass1
   20  0.03% 99.62%  68 301615
 org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
   21  0.03% 99.65%  62 301635
 org.apache.solr.search.SolrIndexSearcher.getDocSetNC
   22  0.02% 99.66%  41 301664
 org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
   23  0.01% 99.68%  31 301629 org.apache.lucene.util.FixedBitSet.init
 CPU SAMPLES END

 Solr 5.2.1:
 CPU SAMPLES BEGIN (total = 235415) Fri Jul 31 22:42:06 2015
 rank   self  accum   count trace method
1 51.38% 51.38%  120954 301291 sun.nio.ch.EPollArrayWrapper.epollWait
2 25.69% 77.07%   60477 301292 sun.nio.ch.ServerSocketChannelImpl.accept0
3 10.59% 87.66%   24923 301369
 org.apache.lucene.index.ExitableDirectoryReader$ExitableTermsEnum.next
4  2.20% 89.86%5182 301414
 org.apache.lucene.codecs.blocktree.SegmentTermsEnum.postings
5  2.01% 91.87%4742 301384
 org.apache.lucene.index.FilterLeafReader$FilterTermsEnum.postings
6  1.25% 93.12%2944 301434
 java.lang.ThreadLocal$ThreadLocalMap.getEntryAfterMiss
7  1.11% 94.23%2612 301367
 org.apache.lucene.search.MultiTermQueryConstantScoreWrapper$1.rewrite
8  0.94% 95.17%2204 301390 org.apache.lucene.util.BitSet.or
9  0.93% 96.10%2190 301383 java.nio.Bits.copyToArray
   10  0.78% 96.87%1825 301449
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.refillDocs
   11  0.73% 97.60%1717 301378
 org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll
   12  0.73% 98.33%1715 301374 org.apache.lucene.util.BitSet.or
   13  0.33% 98.66% 787 301387
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
   14  0.16% 98.82% 374 301426
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
   15  0.10% 98.93% 245 301382 org.apache.lucene.util.BitSet.or
   16  0.09% 99.02% 219 301381
 org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.next
   17  0.09% 99.11% 207 301370 org.apache.lucene.util.BitSet.or
   18  0.06% 99.17% 153 301416 org.apache.lucene.util.BitSet.or
   19  0.06% 99.24% 151 301427 org.apache.lucene.util.BitSet.or
   20  0.06% 99.30% 151 301441 org.apache.lucene.store.DataInput.readVInt
   21  0.06% 99.36% 147 301389 java.lang.System.identityHashCode
   22  0.06% 99.42% 140 301375
 org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
   23  0.04% 99.47% 104 301425 org.apache.lucene.util.BitSet.or
   24  0.03% 99.50%  76 301423
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
   25  0.03% 99.53%  74 301454
 

[jira] [Commented] (SOLR-7495) Unexpected docvalues type NUMERIC when grouping by a int facet

2015-08-03 Thread Nick Coult (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652674#comment-14652674
 ] 

Nick Coult commented on SOLR-7495:
--

We are having the same problem in Solr 5.2.

 Unexpected docvalues type NUMERIC when grouping by a int facet
 --

 Key: SOLR-7495
 URL: https://issues.apache.org/jira/browse/SOLR-7495
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.1
Reporter: Fabio Batista da Silva

 Hey All,
 After upgrading from solr 4.10 to 5.1 with solr could
 I'm getting a IllegalStateException when i try to facet a int field.
 IllegalStateException: unexpected docvalues type NUMERIC for field 'year' 
 (expected=SORTED). Use UninvertingReader or index with docvalues.
 schema.xml
 {code}
 ?xml version=1.0 ?
 schema name=schema version=1.2
 fields
 !-- solar cloud version field --
 field name=_version_ type=long indexed=true stored=true/
 !-- Common fields --
 field name=id type=string indexed=true stored=true  
 multiValued=false required=true/
 field name=index_type type=string indexed=true  stored=true  
 multiValued=false required=true/
 field name=year type=int indexed=true stored=true/
 field name=model type=string indexed=true stored=true/
 field name=year_make_model type=string indexed=true 
 stored=true/
 /fields
 !-- Field Types --
 types
 fieldType name=string class=solr.StrField sortMissingLast=true 
 /
 fieldType name=boolean class=solr.BoolField 
 sortMissingLast=true/
 fieldType name=int class=solr.TrieIntField precisionStep=0 
 positionIncrementGap=0/
 fieldType name=float class=solr.TrieFloatField precisionStep=0 
 positionIncrementGap=0/
 fieldType name=long class=solr.TrieLongField precisionStep=0 
 positionIncrementGap=0/
 fieldType name=double class=solr.TrieDoubleField 
 precisionStep=0 positionIncrementGap=0/
 fieldType name=date class=solr.TrieDateField precisionStep=0 
 positionIncrementGap=0/
 fieldType name=text_ngram class=solr.TextField 
 positionIncrementGap=100
 analyzer type=index
 tokenizer class=solr.StandardTokenizerFactory/
 filter class=solr.StopFilterFactory ignoreCase=true 
 words=stopwords.txt /
 filter class=solr.LowerCaseFilterFactory/
 filter class=solr.EdgeNGramFilterFactory minGramSize=2 
 maxGramSize=15/
 /analyzer
 analyzer type=query
 tokenizer class=solr.StandardTokenizerFactory/
 filter class=solr.StopFilterFactory ignoreCase=true 
 words=stopwords.txt /
 filter class=solr.SynonymFilterFactory 
 synonyms=synonyms.txt ignoreCase=true expand=true/
 filter class=solr.LowerCaseFilterFactory/
 /analyzer
 /fieldType
 fieldType name=text_general class=solr.TextField 
 positionIncrementGap=100
 analyzer type=index
 tokenizer class=solr.StandardTokenizerFactory/
 filter class=solr.StopFilterFactory ignoreCase=true 
 words=stopwords.txt /
 filter class=solr.LowerCaseFilterFactory/
 filter class=solr.EdgeNGramFilterFactory minGramSize=2 
 maxGramSize=15/
 /analyzer
 analyzer type=query
 tokenizer class=solr.StandardTokenizerFactory/
 filter class=solr.StopFilterFactory ignoreCase=true 
 words=stopwords.txt /
 filter class=solr.SynonymFilterFactory 
 synonyms=synonyms.txt ignoreCase=true expand=true/
 filter class=solr.LowerCaseFilterFactory/
 /analyzer
 /fieldType
 fieldType name=location_rpt 
 class=solr.SpatialRecursivePrefixTreeFieldType geo=true 
 distErrPct=0.025 maxDistErr=0.09 units=degrees /
 /types
 uniqueKeyid/uniqueKey
 defaultSearchFieldname/defaultSearchField
 solrQueryParser defaultOperator=OR/
 /schema
 {code}
 query :
 {code}
 http://solr.dev:8983/solr/my_collection/select?wt=jsonfl=idfq=index_type:foobargroup=truegroup.field=year_make_modelgroup.facet=truefacet=truefacet.field=year
 {code}
 Exception :
 {code}
 ull:org.apache.solr.common.SolrException: Exception during facet.field: year
 at org.apache.solr.request.SimpleFacets$3.call(SimpleFacets.java:627)
 at org.apache.solr.request.SimpleFacets$3.call(SimpleFacets.java:612)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at org.apache.solr.request.SimpleFacets$2.execute(SimpleFacets.java:566)
 at 
 org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:637)
 at 
 org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:280)
 at 
 

[jira] [Updated] (SOLR-7855) OverseerCollectionProcessor: separate general task management from collection message handling

2015-08-03 Thread Gregory Chanan (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gregory Chanan updated SOLR-7855:
-
Attachment: SOLR-7855.patch

Here's a patch.  Review request: https://reviews.apache.org/r/37057/.

Splits up the OverseerCollectionProcessor as follows:

- Defines an interface OverseerMessageHandler for handling messages sent to the 
overseer queues
- OverseerCollectionMessageHandler handles collection related messages (i.e. 
this is just the message handling code from the old OverseerCollectionProcessor 
code)
- OverseerProcessor is the task management related code from the old 
OverseerCollectionProcessor
- OverseerProcessor.OverseerMessageHandlerSelector is an interface for 
selecting an OverseerMessageHandler for an incoming message.  This would allows 
us to handle multiple types of message (e.g. Collection / ConfigSet) with the 
same OverseerProcessor
- OverseerCollectionProcessor is now just an OverseerProcessor with an 
OverseerMessageHandlerSelector that always selects an 
OverseerCollectionMessageHandler for processing.

One complication is with prioritizeOverseerNodes, which doesn't really fit into 
this new model or the existing model (it doesn't really have anything to do 
directly with collections AFAICT, though the CollectionProcessor handles 
messages about it).  This should probably be moved somewhere else and is a pain 
because both the OverseerProcessor (before running the task loop) and the 
CollectionMessageHandler (to respond to ADDROLE ops) call it.  For now I moved 
the code to an OverseerNodePrioritizer that is passed into both those objects, 
though I'm open for suggestions there.

Otherwise, just some renaming of imports from OverseerCollectionProcessor to 
OverseerCollectionMessageHandler.

I was originally going to put all the new classes in the cloud.overseer package 
but there are some package-level info that is needed and for some reason, all 
the overseer related code isn't there.  I'm okay with moving everything there 
if that's what we want to do.

This patch should have no effect on end users.

 OverseerCollectionProcessor: separate general task management from collection 
 message handling
 --

 Key: SOLR-7855
 URL: https://issues.apache.org/jira/browse/SOLR-7855
 Project: Solr
  Issue Type: Bug
  Components: SolrCloud
Reporter: Gregory Chanan
Assignee: Gregory Chanan
 Attachments: SOLR-7855.patch


 While working on SOLR-7789, I realized it would be easier if I split up the 
 OverseerCollectionProcessor into two parts:
 1) General handling of tasks (work queues, etc)
 2) Processing a collection handler request
 I haven't decided whether the ConfigSet should have its own processor, i.e. 
 OverseerConfigSetProcessor or reuse at least the thread for the 
 OverseerCollectionProcessor, but in either case this refactoring will be 
 helpful.  That is, if the ConfigSet processing has its own processing, I can 
 reuse the general handling of tasks part.  If the ConfigSet processing reuses 
 the OverseerCollectionProcessing thread, I won't complicate the 
 implementation with ConfigSet operations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6609) FieldCacheSource (or it's subclasses) should override getSortField

2015-08-03 Thread Hoss Man (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hoss Man updated LUCENE-6609:
-
Attachment: LUCENE-6609.patch

here's a patch with the changes and some basic tests (both whitebox at the 
lucene level and more pragmatic at the solr level)

Only one existing test needed changed in this patch: 
TestFunctionQuerySort.testSearchAfterWhenSortingByFunctionValues was assumed 
the sort values in the FieldDoc would be Doubles when using an IntFieldSource 
as the basis of the Sort -- to keep the spirit of the original test, I wrapped 
that IntFieldSource in a SumFloatFunction.

 FieldCacheSource (or it's subclasses) should override getSortField
 --

 Key: LUCENE-6609
 URL: https://issues.apache.org/jira/browse/LUCENE-6609
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Hoss Man
 Attachments: LUCENE-6609.patch


 {{ValueSource}} defines the following method...
 {code}
   public SortField getSortField(boolean reverse) {
 return new ValueSourceSortField(reverse);
   }
 {code}
 ...where {{ValueSourceSortField}} builds up a {{ValueSourceComparator}} 
 containing a {{double[]}} based on the {{FunctionValues}} of the original 
 {{ValueSource}}.
 meanwhile, the abstract {{FieldCacheSource}} exists as a base implementation 
 for classes like {{IntFieldSource}} and {{DoubleFieldSource}} which wrap a 
 {{ValueSource}} around {{DocValues}} for the specified field.
 But neither {{FieldCacheSource}} nor any of it's subclasses override the 
 {{getSortField(boolean)}} method -- so attempting to sort on something like 
 an {{IntFieldSource}} winds up using a bunch of ram to build that 
 {{double[]}} to give users a less accurate sort (because of casting) then if 
 they just sorted directly on the field.
 is there any good reason why {{FieldCacheSource}} subclases like 
 {{IntFieldSource}} shouldn't all override {{getSortField}} with something 
 like...
 {code}
   public SortField getSortField(boolean reverse) {
 return new SortField(field, Type.INT, reverse);
   }
 {code}
 ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Understanding performance degradation in range queries between Solr 5.2.1 and 4.10.4

2015-08-03 Thread Tomás Fernández Löbbe
I'll run the test removing the ExitableDirectoryReader wrap to check if
this is the issue. I'll post my results here.

On Mon, Aug 3, 2015 at 6:07 PM, Anshum Gupta ans...@anshumgupta.net wrote:

 Guess bypassing that check and always returning true instead would help
 confirm that. If that's the case, we should just initialize the timeout to
 Long.MAX_VALUE and check for that to short-circuit?

 On Mon, Aug 3, 2015 at 3:50 PM, Tomás Fernández Löbbe 
 tomasflo...@gmail.com wrote:

 Yes, I saw that, but thought it could be the underlying implementation,
 not the ExitableTermsEnum wrapper. Maybe it's related to the calls to
 System.nanoTime then...

 On Mon, Aug 3, 2015 at 3:11 PM, Adrien Grand jpou...@gmail.com wrote:

 Thanks for sharing the traces, it looks like my intuition was wrong.
 :) They seem to point to
 ExitableDirectoryReader$ExitableTermsEnum.next, which checks whether
 the time is out before delegating.

 On Mon, Aug 3, 2015 at 7:21 PM, Tomás Fernández Löbbe
 tomasflo...@gmail.com wrote:
  Thanks Adrien,
  I'll run the tests with 5.3 snapshot and post the results here. In
 case this
  helps, this is the hprof samples output
  (-Xrunhprof:cpu=samples,depth=3,file=/home/ec2-user/hprof_output.txt)
 for
  4.10.4 and 5.2.1 in my test:
 
  Solr 4.10.4:
  CPU SAMPLES BEGIN (total = 243525) Fri Jul 31 22:29:06 2015
  rank   self  accum   count trace method
 1 75.07% 75.07%  182812 300523 java.net.PlainSocketImpl.socketAccept
 2  4.27% 79.34%   10408 301576
  org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.decodeMetaData
 3  4.15% 83.49%   10108 301585
  org.apache.lucene.index.FilteredTermsEnum.docs
 4  3.46% 86.95%8419 301582
  org.apache.lucene.index.FilteredTermsEnum.next
 5  2.49% 89.44%6070 301573
 java.net.SocketInputStream.socketRead0
 6  1.99% 91.43%4848 301599
  org.apache.lucene.search.MultiTermQueryWrapperFilter.getDocIdSet
 7  1.98% 93.42%4824 301583
  org.apache.lucene.search.MultiTermQueryWrapperFilter.getDocIdSet
 8  1.57% 94.99%3824 301589
  org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll
 9  1.44% 96.42%3504 301594
 
 org.apache.lucene.codecs.lucene41.Lucene41PostingsReader$BlockDocsEnum.refillDocs
10  1.09% 97.51%2655 301581 java.nio.Bits.copyToArray
11  0.98% 98.50%2388 301598
 
 org.apache.lucene.codecs.lucene41.Lucene41PostingsReader$BlockDocsEnum.nextDoc
12  0.62% 99.12%1522 301600
 org.apache.lucene.store.DataInput.readVInt
13  0.21% 99.33% 500 301612
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.docs
14  0.07% 99.39% 167 301601
  org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.next
15  0.06% 99.45% 139 301619 java.lang.System.identityHashCode
16  0.05% 99.50% 114 301632
  org.apache.lucene.codecs.lucene41.ForUtil.readBlock
17  0.04% 99.54%  92 300708 java.util.zip.Inflater.inflateBytes
18  0.03% 99.57%  76 301624
 
 org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.loadNextFloorBlock
19  0.03% 99.59%  68 300613 java.lang.ClassLoader.defineClass1
20  0.03% 99.62%  68 301615
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
21  0.03% 99.65%  62 301635
  org.apache.solr.search.SolrIndexSearcher.getDocSetNC
22  0.02% 99.66%  41 301664
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
23  0.01% 99.68%  31 301629
 org.apache.lucene.util.FixedBitSet.init
  CPU SAMPLES END
 
  Solr 5.2.1:
  CPU SAMPLES BEGIN (total = 235415) Fri Jul 31 22:42:06 2015
  rank   self  accum   count trace method
 1 51.38% 51.38%  120954 301291
 sun.nio.ch.EPollArrayWrapper.epollWait
 2 25.69% 77.07%   60477 301292
 sun.nio.ch.ServerSocketChannelImpl.accept0
 3 10.59% 87.66%   24923 301369
  org.apache.lucene.index.ExitableDirectoryReader$ExitableTermsEnum.next
 4  2.20% 89.86%5182 301414
  org.apache.lucene.codecs.blocktree.SegmentTermsEnum.postings
 5  2.01% 91.87%4742 301384
  org.apache.lucene.index.FilterLeafReader$FilterTermsEnum.postings
 6  1.25% 93.12%2944 301434
  java.lang.ThreadLocal$ThreadLocalMap.getEntryAfterMiss
 7  1.11% 94.23%2612 301367
  org.apache.lucene.search.MultiTermQueryConstantScoreWrapper$1.rewrite
 8  0.94% 95.17%2204 301390 org.apache.lucene.util.BitSet.or
 9  0.93% 96.10%2190 301383 java.nio.Bits.copyToArray
10  0.78% 96.87%1825 301449
 
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.refillDocs
11  0.73% 97.60%1717 301378
  org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll
12  0.73% 98.33%1715 301374 org.apache.lucene.util.BitSet.or
13  0.33% 98.66% 787 301387
 
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
14  0.16% 98.82% 374 301426
 
 org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
15  0.10% 98.93% 245 301382 org.apache.lucene.util.BitSet.or
 

[jira] [Comment Edited] (SOLR-6188) solr.ICUFoldingFilterFactory causes NoClassDefFoundError: o/a/l/a/icu/ICUFoldingFilter

2015-08-03 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652607#comment-14652607
 ] 

Shawn Heisey edited comment on SOLR-6188 at 8/3/15 9:48 PM:


I closed SOLR-7771 as a duplicate of this issue.

I'm attempting to get Solr 5.2.1 installed into my dev environment with the 
config from my Solr 4.9 install.  I have all the extra jars in the lib 
directory under my solr home.

By updating schema.xml to replace the solr.ICU* class names with the fully 
qualified versions, I was able to get Solr to start properly.

I'm using another custom analysis component recompiled with 5.2.1 jars:

https://github.com/solrmarc/CJKFoldingFilter/releases

This component works just fine with solr.CJKFoldingFilter in the class 
parameter.



was (Author: elyograg):
I closed SOLR-7771 as a duplicate of this issue.

I'm attempting to get Solr 5.2.1 installed into my dev environment with the 
config from my Solr 4.9 install.  I have all the extra jars in 
${solr.solr.home}/lib.

By updating schema.xml to replace the solr.ICU* class names with the fully 
qualified versions, I was able to get Solr to start properly.

I'm using another custom analysis component recompiled with 5.2.1 jars:

https://github.com/solrmarc/CJKFoldingFilter/releases

This component works just fine with solr.CJKFoldingFilter in the class 
parameter.


 solr.ICUFoldingFilterFactory causes NoClassDefFoundError: 
 o/a/l/a/icu/ICUFoldingFilter
 --

 Key: SOLR-6188
 URL: https://issues.apache.org/jira/browse/SOLR-6188
 Project: Solr
  Issue Type: Bug
  Components: Schema and Analysis
Affects Versions: 4.8.1
Reporter: Ahmet Arslan
  Labels: ICUFoldingFilterFactory
 Fix For: 4.10


 When fully qualified class name is used in schema.xml 
 {{org.apache.lucene.analysis.icu.ICUFoldingFilterFactory}}
 it works. However as documented in confluence and wiki, when 
 {{solr.ICUFoldingFilterFactory}} is used it throws following exception.
 This is true for both released 4.8.1 version and trunk r1604168
 following type works :
 {code:xml}
  fieldType name=folded2 class=solr.TextField
   analyzer
 tokenizer class=solr.StandardTokenizerFactory/
 filter 
 class=org.apache.lucene.analysis.icu.ICUFoldingFilterFactory/
   /analyzer
 /fieldType
 {code}
 this does not : 
 {code:xml}
  fieldType name=folded class=solr.TextField
   analyzer
 tokenizer class=solr.StandardTokenizerFactory/
 filter class=solr.ICUFoldingFilterFactory/
   /analyzer
 /fieldType
 {code}
 {noformat}
 257 [main] ERROR org.apache.solr.core.SolrCore  – Error loading 
 core:java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: 
 org/apache/lucene/analysis/icu/ICUFoldingFilter
   at java.util.concurrent.FutureTask.report(FutureTask.java:122)
   at java.util.concurrent.FutureTask.get(FutureTask.java:188)
   at org.apache.solr.core.CoreContainer.load(CoreContainer.java:301)
   at 
 org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:190)
   at 
 org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:137)
   at org.eclipse.jetty.servlet.FilterHolder.doStart(FilterHolder.java:119)
   at 
 org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
   at 
 org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:719)
   at 
 org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:265)
   at 
 org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1252)
   at 
 org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:710)
   at 
 org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:494)
   at 
 org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
   at 
 org.eclipse.jetty.deploy.bindings.StandardStarter.processBinding(StandardStarter.java:39)
   at 
 org.eclipse.jetty.deploy.AppLifeCycle.runBindings(AppLifeCycle.java:186)
   at 
 org.eclipse.jetty.deploy.DeploymentManager.requestAppGoal(DeploymentManager.java:494)
   at 
 org.eclipse.jetty.deploy.DeploymentManager.addApp(DeploymentManager.java:141)
   at 
 org.eclipse.jetty.deploy.providers.ScanningAppProvider.fileAdded(ScanningAppProvider.java:145)
   at 
 org.eclipse.jetty.deploy.providers.ScanningAppProvider$1.fileAdded(ScanningAppProvider.java:56)
   at org.eclipse.jetty.util.Scanner.reportAddition(Scanner.java:609)
   at org.eclipse.jetty.util.Scanner.reportDifferences(Scanner.java:540)
   at org.eclipse.jetty.util.Scanner.scan(Scanner.java:403)
   at 

[JENKINS] Lucene-Solr-5.x-MacOSX (64bit/jdk1.8.0) - Build # 2530 - Failure!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-MacOSX/2530/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  
org.apache.lucene.search.TestEarlyTerminatingSortingCollector.testTerminatedEarly

Error Message:
should have terminated early 
(searcher.reader=StandardDirectoryReader(segments_q:104 _u(5.3.0):C7))

Stack Trace:
java.lang.AssertionError: should have terminated early 
(searcher.reader=StandardDirectoryReader(segments_q:104 _u(5.3.0):C7))
at 
__randomizedtesting.SeedInfo.seed([B7A31D1CF6052036:9638A7AE573F6EB1]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at 
org.apache.lucene.search.TestEarlyTerminatingSortingCollector.testTerminatedEarly(TestEarlyTerminatingSortingCollector.java:294)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 7718 lines...]
   [junit4] Suite: org.apache.lucene.search.TestEarlyTerminatingSortingCollector
   [junit4]   2 NOTE: reproduce with: ant test  
-Dtestcase=TestEarlyTerminatingSortingCollector 
-Dtests.method=testTerminatedEarly -Dtests.seed=B7A31D1CF6052036 
-Dtests.slow=true -Dtests.locale=th_TH_TH_#u-nu-thai 
-Dtests.timezone=Pacific/Fiji -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.59s J0 | 

[jira] [Updated] (SOLR-5756) A utility API to move collections from internal to external

2015-08-03 Thread Scott Blum (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Scott Blum updated SOLR-5756:
-
Attachment: SOLR-5756-trunk.patch

Try this.  I haven't run tests all the way through, but most of the way.

 A utility API to move collections from internal to external
 ---

 Key: SOLR-5756
 URL: https://issues.apache.org/jira/browse/SOLR-5756
 Project: Solr
  Issue Type: Bug
Reporter: Noble Paul
Assignee: Shalin Shekhar Mangar
 Attachments: SOLR-5756-trunk.patch, SOLR-5756-trunk.patch, 
 SOLR-5756-vs-5.2.1.patch


 SOLR-5473 allows creation of collection with state stored outside of 
 clusterstate.json. We would need an API to  move existing 'internal' 
 collections outside



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7859) Clamp down on use of System.currentTimeMillis

2015-08-03 Thread Ramkumar Aiyengar (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ramkumar Aiyengar updated SOLR-7859:

Attachment: SOLR-7859.patch

Attached is a patch to remove most occurrences in solr code (boy there are a 
few!) and SuppressForbidden where the usage is legitimate.

There are also a couple of cases where the usage is suspect, but I haven't got 
to it as yet. One is around stats, but the more worrying thing is that we use 
the wall time recorded as commit data on a commit to check if replication needs 
to be done. In IndexFetcher, there is this code:

{code}
  if (!forceReplication  
IndexDeletionPolicyWrapper.getCommitTimestamp(commit) == latestVersion) {
//master and slave are already in sync just return
LOG.info(Slave in sync with master.);
successfulInstall = true;
return true;
  }
{code}

We are checking wall times across machines to check if we are in sync, that 
sounds wrong. Or I am mistaken here?

 Clamp down on use of System.currentTimeMillis
 -

 Key: SOLR-7859
 URL: https://issues.apache.org/jira/browse/SOLR-7859
 Project: Solr
  Issue Type: Improvement
Reporter: Ramkumar Aiyengar
 Attachments: SOLR-7859.patch


 We did one round of this in SOLR-5734, but more places seem to keep cropping 
 up. We should do one more round, and start whitelisting places which really 
 need it using forbidden-apis.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6609) FieldCacheSource (or it's subclasses) should override getSortField

2015-08-03 Thread Adrien Grand (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652653#comment-14652653
 ] 

Adrien Grand commented on LUCENE-6609:
--

+1

 FieldCacheSource (or it's subclasses) should override getSortField
 --

 Key: LUCENE-6609
 URL: https://issues.apache.org/jira/browse/LUCENE-6609
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Hoss Man
Assignee: Hoss Man
 Attachments: LUCENE-6609.patch


 {{ValueSource}} defines the following method...
 {code}
   public SortField getSortField(boolean reverse) {
 return new ValueSourceSortField(reverse);
   }
 {code}
 ...where {{ValueSourceSortField}} builds up a {{ValueSourceComparator}} 
 containing a {{double[]}} based on the {{FunctionValues}} of the original 
 {{ValueSource}}.
 meanwhile, the abstract {{FieldCacheSource}} exists as a base implementation 
 for classes like {{IntFieldSource}} and {{DoubleFieldSource}} which wrap a 
 {{ValueSource}} around {{DocValues}} for the specified field.
 But neither {{FieldCacheSource}} nor any of it's subclasses override the 
 {{getSortField(boolean)}} method -- so attempting to sort on something like 
 an {{IntFieldSource}} winds up using a bunch of ram to build that 
 {{double[]}} to give users a less accurate sort (because of casting) then if 
 they just sorted directly on the field.
 is there any good reason why {{FieldCacheSource}} subclases like 
 {{IntFieldSource}} shouldn't all override {{getSortField}} with something 
 like...
 {code}
   public SortField getSortField(boolean reverse) {
 return new SortField(field, Type.INT, reverse);
   }
 {code}
 ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6706) Support Payload scoring for all SpanQueries

2015-08-03 Thread Steve Rowe (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652893#comment-14652893
 ] 

Steve Rowe commented on LUCENE-6706:


Reproduces for me on branch_5x/win7/java8: 
[http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4974/]:

{noformat}
   [junit4] Suite: org.apache.lucene.search.payloads.TestPayloadScoreQuery
   [junit4]   2 NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2 NOTE: reproduce with: ant test  
-Dtestcase=TestPayloadScoreQuery -Dtests.method=testSpanContainingQuery 
-Dtests.seed=5A58A589322E17 -Dtests.slow=true -Dtests.linedocsfile=e
:/Lucene_data/enwiki.random.lines.txt -Dtests.locale=nl_BE 
-Dtests.timezone=US/Samoa -Dtests.asserts=true -Dtests.file.encoding=Cp1252
   [junit4] FAILURE 0.12s | TestPayloadScoreQuery.testSpanContainingQuery 
   [junit4] Throwable #1: java.lang.AssertionError: Unexpected hit in 
document 296
   [junit4]at 
__randomizedtesting.SeedInfo.seed([5A58A589322E17:8964B028249CFB65]:0)
   [junit4]at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.checkQuery(TestPayloadScoreQuery.java:66)
   [junit4]at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.testSpanContainingQuery(TestPayloadScoreQuery.java:152)
   [junit4]at java.lang.Thread.run(Thread.java:745)
   [junit4]   2 NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2 NOTE: reproduce with: ant test  
-Dtestcase=TestPayloadScoreQuery -Dtests.method=testNearQuery 
-Dtests.seed=5A58A589322E17 -Dtests.slow=true -Dtests.linedocsfile=e:/Lucene_d
ata/enwiki.random.lines.txt -Dtests.locale=nl_BE -Dtests.timezone=US/Samoa 
-Dtests.asserts=true -Dtests.file.encoding=Cp1252
   [junit4] FAILURE 0.01s | TestPayloadScoreQuery.testNearQuery 
   [junit4] Throwable #1: java.lang.AssertionError: Unexpected hit in 
document 296
   [junit4]at 
__randomizedtesting.SeedInfo.seed([5A58A589322E17:40BA355A8FFBB4DB]:0)
   [junit4]at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.checkQuery(TestPayloadScoreQuery.java:66)
   [junit4]at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.testNearQuery(TestPayloadScoreQuery.java:112)
   [junit4]at java.lang.Thread.run(Thread.java:745)
   [junit4]   2 NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2 NOTE: reproduce with: ant test  
-Dtestcase=TestPayloadScoreQuery -Dtests.method=testOrQuery 
-Dtests.seed=5A58A589322E17 -Dtests.slow=true 
-Dtests.linedocsfile=e:/Lucene_data/enwiki.random.lines.txt 
-Dtests.locale=nl_BE -Dtests.timezone=US/Samoa -Dtests.asserts=true 
-Dtests.file.encoding=Cp1252
   [junit4] FAILURE 0.01s | TestPayloadScoreQuery.testOrQuery 
   [junit4] Throwable #1: java.lang.AssertionError: Unexpected hit in 
document 292
   [junit4]at 
__randomizedtesting.SeedInfo.seed([5A58A589322E17:603E139078605B5F]:0)
   [junit4]at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.checkQuery(TestPayloadScoreQuery.java:66)
   [junit4]at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.testOrQuery(TestPayloadScoreQuery.java:93)
   [junit4]at java.lang.Thread.run(Thread.java:745)
   [junit4]   2 NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2 NOTE: reproduce with: ant test  
-Dtestcase=TestPayloadScoreQuery -Dtests.method=testTermQuery 
-Dtests.seed=5A58A589322E17 -Dtests.slow=true 
-Dtests.linedocsfile=e:/Lucene_data/enwiki.random.lines.txt 
-Dtests.locale=nl_BE -Dtests.timezone=US/Samoa -Dtests.asserts=true 
-Dtests.file.encoding=Cp1252
   [junit4] FAILURE 0.01s | TestPayloadScoreQuery.testTermQuery 
   [junit4] Throwable #1: java.lang.AssertionError: Unexpected hit in 
document 292
   [junit4]at 
__randomizedtesting.SeedInfo.seed([5A58A589322E17:BF4CC9B6B5DEAF7]:0)
   [junit4]at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.checkQuery(TestPayloadScoreQuery.java:66)
   [junit4]at 
org.apache.lucene.search.payloads.TestPayloadScoreQuery.testTermQuery(TestPayloadScoreQuery.java:80)
   [junit4]at java.lang.Thread.run(Thread.java:745)
   [junit4]   2 NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2 NOTE: reproduce with: ant test  
-Dtestcase=TestPayloadScoreQuery -Dtests.method=testNestedNearQuery 
-Dtests.seed=5A58A589322E17 -Dtests.slow=true 
-Dtests.linedocsfile=e:/Lucene_data/enwiki.random.lines.txt 
-Dtests.locale=nl_BE -Dtests.timezone=US/Samoa -Dtests.asserts=true 
-Dtests.file.encoding=Cp1252
   [junit4] 

[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_51) - Build # 13723 - Failure!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13723/
Java: 64bit/jdk1.8.0_51 -XX:-UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest

Error Message:
ObjectTracker found 1 object(s) that were not released!!! [TransactionLog]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not 
released!!! [TransactionLog]
at __randomizedtesting.SeedInfo.seed([35924587113964F9]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:236)
at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:
Timeout while trying to assert update logs @ collection=source_collection

Stack Trace:
java.lang.AssertionError: Timeout while trying to assert update logs @ 
collection=source_collection
at 
__randomizedtesting.SeedInfo.seed([35924587113964F9:3DF230AB1E374CF2]:0)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.assertNumberOfTlogFiles(CdcrReplicationDistributedZkTest.java:644)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestUpdateLogSynchronisation(CdcrReplicationDistributedZkTest.java:384)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 

Re: Understanding performance degradation in range queries between Solr 5.2.1 and 4.10.4

2015-08-03 Thread Yonik Seeley
On Mon, Aug 3, 2015 at 6:07 PM, Anshum Gupta ans...@anshumgupta.net wrote:
 Guess bypassing that check and always returning true instead would help
 confirm that. If that's the case, we should just initialize the timeout to
 Long.MAX_VALUE and check for that to short-circuit?

Another possibility is to run queries without a time limit on a reader
that isn't wrapped.
That could possibly be friendlier to branch prediction with mixed
queries (some without timeouts and some with).

-Yonik

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6654) KNearestNeighborClassifier not taking in consideration Class ranking

2015-08-03 Thread Alessandro Benedetti (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651678#comment-14651678
 ] 

Alessandro Benedetti commented on LUCENE-6654:
--

To make it simple, using this patch before should not cause any conflict,  if 
we keep not protected here( which is better for patch isolation) later a small 
merge will happen, 
Which of.course is not a problem!  :)

 KNearestNeighborClassifier not taking in consideration Class ranking
 

 Key: LUCENE-6654
 URL: https://issues.apache.org/jira/browse/LUCENE-6654
 Project: Lucene - Core
  Issue Type: Improvement
  Components: modules/classification
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
Priority: Minor
  Labels: classification, knn
 Attachments: LUCENE-6654.patch


 Currently the KNN Classifier assign the score for a ClassificationResult, 
 based only on the frequency of the class in the top K results.
 This is conceptually a simplification.
 Actually the ranking must take a part.
 If not this can happen :
 Top 4
 1) Class1
 2) Class1
 3) Class2
 4) Class2
 As a result of this Top 4 , both the classes will have the same score.
 But the expected result is that Class1 has a better score, as the MLT score 
 the documents accordingly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b60) - Build # 13713 - Failure!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13713/
Java: 32bit/jdk1.9.0-ea-b60 -server -XX:+UseG1GC -Djava.locale.providers=JRE,SPI

1 tests failed.
FAILED:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard1

Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete 
@source_collection:shard1
at 
__randomizedtesting.SeedInfo.seed([21435AB8DC35042:A74408782CD7849]:0)
at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:732)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestUpdateLogSynchronisation(CdcrReplicationDistributedZkTest.java:361)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:502)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 

[JENKINS] Lucene-Solr-5.x-Linux (64bit/jdk1.7.0_80) - Build # 13531 - Failure!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/13531/
Java: 64bit/jdk1.7.0_80 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test

Error Message:
expected:0 but was:1

Stack Trace:
java.lang.AssertionError: expected:0 but was:1
at 
__randomizedtesting.SeedInfo.seed([1C6D70B651683E42:94394F6CFF9453BA]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at 
org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:156)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 

[jira] [Updated] (SOLR-5882) Introduce score local parameter for {!parent} query parser

2015-08-03 Thread Mikhail Khludnev (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Khludnev updated SOLR-5882:
---
Description: 
I propose to have ability to configure scoring mode by local parameter

Syntax for parent queries can be like:

{code:borderStyle=solid}
{!parent which=type:parent score=None|Avg|Max|Total|Min}...
loweracase is also accepted
{code} 

Child query enables scoring by default.



  was:
*TODO* it needs to be updated.

Today BlockJoinParentQParser creates queries with hardcoded _scoring mode_ 
None: 
{code:borderStyle=solid}
  protected Query createQuery(Query parentList, Query query) {
return new ToParentBlockJoinQuery(query, getFilter(parentList), 
ScoreMode.None);
  }
{code} 

Analogically BlockJoinChildQParser creates queries with hardcoded _doScores_ 
false:

{code:borderStyle=solid}
  protected Query createQuery(Query parentListQuery, Query query) {
return new ToChildBlockJoinQuery(query, getFilter(parentListQuery), false);
  }
{code}
I propose to have ability to configure this scoring options via query syntax.

Syntax for parent queries can be like:

{code:borderStyle=solid}
{!parent which=type:parent scoreMode=None|Avg|Max|Total}
{code} 

For child query:

{code:borderStyle=solid}
{!child of=type:parent doScores=true|false}
{code} 




 Introduce score local parameter for {!parent} query parser
 --

 Key: SOLR-5882
 URL: https://issues.apache.org/jira/browse/SOLR-5882
 Project: Solr
  Issue Type: New Feature
Affects Versions: 4.8
Reporter: Andrey Kudryavtsev
Assignee: Mikhail Khludnev
 Fix For: 5.3

 Attachments: SOLR-5882.patch, SOLR-5882.patch


 I propose to have ability to configure scoring mode by local parameter
 Syntax for parent queries can be like:
 {code:borderStyle=solid}
 {!parent which=type:parent score=None|Avg|Max|Total|Min}...
 loweracase is also accepted
 {code} 
 Child query enables scoring by default.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (SOLR-7719) Suggester Component results parsing

2015-08-03 Thread Tommaso Teofili (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tommaso Teofili resolved SOLR-7719.
---
   Resolution: Fixed
Fix Version/s: 5.3

backported to branch 5.x, resolving therefore as fixed.

 Suggester Component results parsing
 ---

 Key: SOLR-7719
 URL: https://issues.apache.org/jira/browse/SOLR-7719
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
Priority: Minor
  Labels: queryResponse, suggester, suggestions
 Fix For: 5.3, Trunk

 Attachments: SOLR-7719.patch, SOLR-7719.patch

   Original Estimate: 24h
  Remaining Estimate: 24h

 Currently SolrJ org.apache.solr.client.solrj.response.QueryResponse is not 
 managing suggestions coming from the Suggest Component .
 It would be nice to have the suggestions properly managed and returned with 
 simply getter methods.
 Current Json :
 lst name=suggest
 lst name=dictionary1
 lst name=queryTerm
 int name=numFound2/int
 arr name=suggestions
lst
str name=termsuggestion1/str..
str name=termsuggestion2/str…
/lst
/arr
/lst
/lst..
 This will be parsed accordingly .
 Producing an easy to use Java Map.
 Dictionary2suggestions



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6691) tweak SortingMergePolicy.getSortDescription

2015-08-03 Thread Christine Poerschke (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651689#comment-14651689
 ] 

Christine Poerschke commented on LUCENE-6691:
-

Err, relatively basic commit question. In {{CHANGES.txt}} where would this 
issue best be placed? I'm thinking 'Changes in Runtime Behavior' or perhaps 
'Bug fixes' section?

 tweak SortingMergePolicy.getSortDescription
 ---

 Key: LUCENE-6691
 URL: https://issues.apache.org/jira/browse/LUCENE-6691
 Project: Lucene - Core
  Issue Type: Test
Reporter: Christine Poerschke
Assignee: Christine Poerschke
Priority: Minor

 Building tests for SOLR-5730 identified that early termination can be omitted 
 for sorted segments because the {{LeafReader}} concerned is not a 
 {{SegmentReader}} - github pull request to illustrate to follow:
 * the {{TestEarlyTerminatingSortingCollector.testTerminatedEarly}} test uses 
 a wrapped reader in the same way as {{SolrIndexSearcher}}
 * the {{SortingMergePolicy.getSortDescription}} change (assuming it is a 
 valid change to make) fixes that particular test only
 * {{ExitableDirectoryReader}} and {{UninvertingReader}} wrap could perhaps 
 also be added in {{LuceneTestCase.wrapReader}} ?
 LUCENE-6065 remove foreign readers from merge, fix LeafReader instead. 
 also concerns SortingMergePolicy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5882) Introduce score local parameter for {!parent} query parser

2015-08-03 Thread Mikhail Khludnev (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651683#comment-14651683
 ] 

Mikhail Khludnev commented on SOLR-5882:


[~shalinmangar] it fails on upper case, it accepts only Capital and lowercase. 
Here it mimics SOLR-6234 behavior.  I just didn't find a guide how to do that. 
Is there any examples of case insensitive behavior of qparsers?
If you prefer I can rework ScoreModeParser which can make both qparsers case 
insensitive for scoremode, it's not a big deal. 

 Introduce score local parameter for {!parent} query parser
 --

 Key: SOLR-5882
 URL: https://issues.apache.org/jira/browse/SOLR-5882
 Project: Solr
  Issue Type: New Feature
Affects Versions: 4.8
Reporter: Andrey Kudryavtsev
Assignee: Mikhail Khludnev
 Fix For: 5.3

 Attachments: SOLR-5882.patch, SOLR-5882.patch


 I propose to have ability to configure scoring mode by local parameter
 Syntax for parent queries can be like:
 {code:borderStyle=solid}
 {!parent which=type:parent score=None|Avg|Max|Total|Min}...
 loweracase is also accepted
 {code} 
 Child query enables scoring by default.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7863) Lowercase the CLUSTERPROP command in ZkCLI for consistency

2015-08-03 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/SOLR-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Høydahl updated SOLR-7863:
--
Fix Version/s: Trunk

 Lowercase the CLUSTERPROP command in ZkCLI for consistency
 --

 Key: SOLR-7863
 URL: https://issues.apache.org/jira/browse/SOLR-7863
 Project: Solr
  Issue Type: Bug
  Components: scripts and tools
Affects Versions: 5.2.1
Reporter: Jan Høydahl
Assignee: Jan Høydahl
Priority: Minor
  Labels: zkcli
 Fix For: 5.3, Trunk

 Attachments: SOLR-7863.patch


 The examples for the zkcli.sh command looks like this
 {noformat}
 Examples:
 zkcli.sh -zkhost localhost:9983 -cmd bootstrap -solrhome /opt/solr
 zkcli.sh -zkhost localhost:9983 -cmd upconfig -confdir 
 /opt/solr/collection1/conf -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd downconfig -confdir 
 /opt/solr/collection1/conf -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd linkconfig -collection collection1 
 -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd makepath /apache/solr
 zkcli.sh -zkhost localhost:9983 -cmd put /solr.conf 'conf data'
 zkcli.sh -zkhost localhost:9983 -cmd putfile /solr.xml 
 /User/myuser/solr/solr.xml
 zkcli.sh -zkhost localhost:9983 -cmd get /solr.xml
 zkcli.sh -zkhost localhost:9983 -cmd getfile /solr.xml solr.xml.file
 zkcli.sh -zkhost localhost:9983 -cmd clear /solr
 zkcli.sh -zkhost localhost:9983 -cmd list
 zkcli.sh -zkhost localhost:9983 -cmd CLUSTERPROP -name urlScheme -val https
 {noformat}
 It is inconsistent that CLUSTERPROP is uppercase.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7863) Lowercase the CLUSTERPROP command in ZkCLI for consistency

2015-08-03 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/SOLR-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Høydahl updated SOLR-7863:
--
Labels: zkcli  (was: )

 Lowercase the CLUSTERPROP command in ZkCLI for consistency
 --

 Key: SOLR-7863
 URL: https://issues.apache.org/jira/browse/SOLR-7863
 Project: Solr
  Issue Type: Bug
  Components: scripts and tools
Affects Versions: 5.2.1
Reporter: Jan Høydahl
Assignee: Jan Høydahl
Priority: Minor
  Labels: zkcli
 Fix For: 5.3, Trunk

 Attachments: SOLR-7863.patch


 The examples for the zkcli.sh command looks like this
 {noformat}
 Examples:
 zkcli.sh -zkhost localhost:9983 -cmd bootstrap -solrhome /opt/solr
 zkcli.sh -zkhost localhost:9983 -cmd upconfig -confdir 
 /opt/solr/collection1/conf -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd downconfig -confdir 
 /opt/solr/collection1/conf -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd linkconfig -collection collection1 
 -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd makepath /apache/solr
 zkcli.sh -zkhost localhost:9983 -cmd put /solr.conf 'conf data'
 zkcli.sh -zkhost localhost:9983 -cmd putfile /solr.xml 
 /User/myuser/solr/solr.xml
 zkcli.sh -zkhost localhost:9983 -cmd get /solr.xml
 zkcli.sh -zkhost localhost:9983 -cmd getfile /solr.xml solr.xml.file
 zkcli.sh -zkhost localhost:9983 -cmd clear /solr
 zkcli.sh -zkhost localhost:9983 -cmd list
 zkcli.sh -zkhost localhost:9983 -cmd CLUSTERPROP -name urlScheme -val https
 {noformat}
 It is inconsistent that CLUSTERPROP is uppercase.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7863) Lowercase the CLUSTERPROP command in ZkCLI for consistency

2015-08-03 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/SOLR-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Høydahl updated SOLR-7863:
--
Attachment: SOLR-7863.patch

I'm attaching a patch that lowercases the clusterprop cmd but accepts both 
upper and lowercase variants for back compat. Also adds error msg for unknown 
cmd.

 Lowercase the CLUSTERPROP command in ZkCLI for consistency
 --

 Key: SOLR-7863
 URL: https://issues.apache.org/jira/browse/SOLR-7863
 Project: Solr
  Issue Type: Bug
  Components: scripts and tools
Affects Versions: 5.2.1
Reporter: Jan Høydahl
Assignee: Jan Høydahl
Priority: Minor
  Labels: zkcli
 Fix For: 5.3, Trunk

 Attachments: SOLR-7863.patch


 The examples for the zkcli.sh command looks like this
 {noformat}
 Examples:
 zkcli.sh -zkhost localhost:9983 -cmd bootstrap -solrhome /opt/solr
 zkcli.sh -zkhost localhost:9983 -cmd upconfig -confdir 
 /opt/solr/collection1/conf -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd downconfig -confdir 
 /opt/solr/collection1/conf -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd linkconfig -collection collection1 
 -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd makepath /apache/solr
 zkcli.sh -zkhost localhost:9983 -cmd put /solr.conf 'conf data'
 zkcli.sh -zkhost localhost:9983 -cmd putfile /solr.xml 
 /User/myuser/solr/solr.xml
 zkcli.sh -zkhost localhost:9983 -cmd get /solr.xml
 zkcli.sh -zkhost localhost:9983 -cmd getfile /solr.xml solr.xml.file
 zkcli.sh -zkhost localhost:9983 -cmd clear /solr
 zkcli.sh -zkhost localhost:9983 -cmd list
 zkcli.sh -zkhost localhost:9983 -cmd CLUSTERPROP -name urlScheme -val https
 {noformat}
 It is inconsistent that CLUSTERPROP is uppercase.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7863) Lowercase the CLUSTERPROP command in ZkCLI for consistency

2015-08-03 Thread JIRA

[ 
https://issues.apache.org/jira/browse/SOLR-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651704#comment-14651704
 ] 

Jan Høydahl commented on SOLR-7863:
---

Also, if an unknown -cmd is issued, the tool just exits without any 
message/error.

 Lowercase the CLUSTERPROP command in ZkCLI for consistency
 --

 Key: SOLR-7863
 URL: https://issues.apache.org/jira/browse/SOLR-7863
 Project: Solr
  Issue Type: Bug
  Components: scripts and tools
Affects Versions: 5.2.1
Reporter: Jan Høydahl
Assignee: Jan Høydahl
Priority: Minor
 Fix For: 5.3


 The examples for the zkcli.sh command looks like this
 {noformat}
 Examples:
 zkcli.sh -zkhost localhost:9983 -cmd bootstrap -solrhome /opt/solr
 zkcli.sh -zkhost localhost:9983 -cmd upconfig -confdir 
 /opt/solr/collection1/conf -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd downconfig -confdir 
 /opt/solr/collection1/conf -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd linkconfig -collection collection1 
 -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd makepath /apache/solr
 zkcli.sh -zkhost localhost:9983 -cmd put /solr.conf 'conf data'
 zkcli.sh -zkhost localhost:9983 -cmd putfile /solr.xml 
 /User/myuser/solr/solr.xml
 zkcli.sh -zkhost localhost:9983 -cmd get /solr.xml
 zkcli.sh -zkhost localhost:9983 -cmd getfile /solr.xml solr.xml.file
 zkcli.sh -zkhost localhost:9983 -cmd clear /solr
 zkcli.sh -zkhost localhost:9983 -cmd list
 zkcli.sh -zkhost localhost:9983 -cmd CLUSTERPROP -name urlScheme -val https
 {noformat}
 It is inconsistent that CLUSTERPROP is uppercase.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7863) Lowercase the CLUSTERPROP command in ZkCLI for consistency

2015-08-03 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/SOLR-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Høydahl updated SOLR-7863:
--
Attachment: SOLR-7863.patch

New patch, making all -cmd case insensitive, so you can write {{-cmd LIST}} if 
you wish. Will commit this to trunk and 5.x shortly.

 Lowercase the CLUSTERPROP command in ZkCLI for consistency
 --

 Key: SOLR-7863
 URL: https://issues.apache.org/jira/browse/SOLR-7863
 Project: Solr
  Issue Type: Bug
  Components: scripts and tools
Affects Versions: 5.2.1
Reporter: Jan Høydahl
Assignee: Jan Høydahl
Priority: Minor
  Labels: zkcli
 Fix For: 5.3, Trunk

 Attachments: SOLR-7863.patch, SOLR-7863.patch


 The examples for the zkcli.sh command looks like this
 {noformat}
 Examples:
 zkcli.sh -zkhost localhost:9983 -cmd bootstrap -solrhome /opt/solr
 zkcli.sh -zkhost localhost:9983 -cmd upconfig -confdir 
 /opt/solr/collection1/conf -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd downconfig -confdir 
 /opt/solr/collection1/conf -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd linkconfig -collection collection1 
 -confname myconf
 zkcli.sh -zkhost localhost:9983 -cmd makepath /apache/solr
 zkcli.sh -zkhost localhost:9983 -cmd put /solr.conf 'conf data'
 zkcli.sh -zkhost localhost:9983 -cmd putfile /solr.xml 
 /User/myuser/solr/solr.xml
 zkcli.sh -zkhost localhost:9983 -cmd get /solr.xml
 zkcli.sh -zkhost localhost:9983 -cmd getfile /solr.xml solr.xml.file
 zkcli.sh -zkhost localhost:9983 -cmd clear /solr
 zkcli.sh -zkhost localhost:9983 -cmd list
 zkcli.sh -zkhost localhost:9983 -cmd CLUSTERPROP -name urlScheme -val https
 {noformat}
 It is inconsistent that CLUSTERPROP is uppercase.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7719) Suggester Component results parsing

2015-08-03 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651629#comment-14651629
 ] 

ASF subversion and git services commented on SOLR-7719:
---

Commit 1693867 from [~teofili] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1693867 ]

SOLR-7719 - backported Suggester component parsing to branch 5.x

 Suggester Component results parsing
 ---

 Key: SOLR-7719
 URL: https://issues.apache.org/jira/browse/SOLR-7719
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
Priority: Minor
  Labels: queryResponse, suggester, suggestions
 Fix For: Trunk

 Attachments: SOLR-7719.patch, SOLR-7719.patch

   Original Estimate: 24h
  Remaining Estimate: 24h

 Currently SolrJ org.apache.solr.client.solrj.response.QueryResponse is not 
 managing suggestions coming from the Suggest Component .
 It would be nice to have the suggestions properly managed and returned with 
 simply getter methods.
 Current Json :
 lst name=suggest
 lst name=dictionary1
 lst name=queryTerm
 int name=numFound2/int
 arr name=suggestions
lst
str name=termsuggestion1/str..
str name=termsuggestion2/str…
/lst
/arr
/lst
/lst..
 This will be parsed accordingly .
 Producing an easy to use Java Map.
 Dictionary2suggestions



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6654) KNearestNeighborClassifier not taking in consideration Class ranking

2015-08-03 Thread Tommaso Teofili (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651666#comment-14651666
 ] 

Tommaso Teofili commented on LUCENE-6654:
-

I've reviewed the patch and it looks good, thanks Alessandro.
Just a minor thing about some fields / methods being marked as _protected_ 
while they could be _private_, this is usually much better for information 
hiding and keeping the API as compact as possible.

 KNearestNeighborClassifier not taking in consideration Class ranking
 

 Key: LUCENE-6654
 URL: https://issues.apache.org/jira/browse/LUCENE-6654
 Project: Lucene - Core
  Issue Type: Improvement
  Components: modules/classification
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
Priority: Minor
  Labels: classification, knn
 Attachments: LUCENE-6654.patch


 Currently the KNN Classifier assign the score for a ClassificationResult, 
 based only on the frequency of the class in the top K results.
 This is conceptually a simplification.
 Actually the ranking must take a part.
 If not this can happen :
 Top 4
 1) Class1
 2) Class1
 3) Class2
 4) Class2
 As a result of this Top 4 , both the classes will have the same score.
 But the expected result is that Class1 has a better score, as the MLT score 
 the documents accordingly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-7863) Lowercase the CLUSTERPROP command in ZkCLI for consistency

2015-08-03 Thread JIRA
Jan Høydahl created SOLR-7863:
-

 Summary: Lowercase the CLUSTERPROP command in ZkCLI for consistency
 Key: SOLR-7863
 URL: https://issues.apache.org/jira/browse/SOLR-7863
 Project: Solr
  Issue Type: Bug
  Components: scripts and tools
Affects Versions: 5.2.1
Reporter: Jan Høydahl
Assignee: Jan Høydahl
Priority: Minor
 Fix For: 5.3


The examples for the zkcli.sh command looks like this
{noformat}
Examples:
zkcli.sh -zkhost localhost:9983 -cmd bootstrap -solrhome /opt/solr
zkcli.sh -zkhost localhost:9983 -cmd upconfig -confdir 
/opt/solr/collection1/conf -confname myconf
zkcli.sh -zkhost localhost:9983 -cmd downconfig -confdir 
/opt/solr/collection1/conf -confname myconf
zkcli.sh -zkhost localhost:9983 -cmd linkconfig -collection collection1 
-confname myconf
zkcli.sh -zkhost localhost:9983 -cmd makepath /apache/solr
zkcli.sh -zkhost localhost:9983 -cmd put /solr.conf 'conf data'
zkcli.sh -zkhost localhost:9983 -cmd putfile /solr.xml 
/User/myuser/solr/solr.xml
zkcli.sh -zkhost localhost:9983 -cmd get /solr.xml
zkcli.sh -zkhost localhost:9983 -cmd getfile /solr.xml solr.xml.file
zkcli.sh -zkhost localhost:9983 -cmd clear /solr
zkcli.sh -zkhost localhost:9983 -cmd list
zkcli.sh -zkhost localhost:9983 -cmd CLUSTERPROP -name urlScheme -val https
{noformat}
It is inconsistent that CLUSTERPROP is uppercase.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6654) KNearestNeighborClassifier not taking in consideration Class ranking

2015-08-03 Thread Alessandro Benedetti (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651672#comment-14651672
 ] 

Alessandro Benedetti commented on LUCENE-6654:
--

Hi Tommaso! 
The reason for that is related the fact that that class is involved also with 
another issue  ( the document classifier one)   
But I agree with you, in isolation for this issue they should not be protected.
When you take a look to the Document Classifier one,  they overlap a little 
bit, this class should be merged ( basically i put this in the most 
straighforward way). 
When you take a look to the other you will see :)

 KNearestNeighborClassifier not taking in consideration Class ranking
 

 Key: LUCENE-6654
 URL: https://issues.apache.org/jira/browse/LUCENE-6654
 Project: Lucene - Core
  Issue Type: Improvement
  Components: modules/classification
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
Priority: Minor
  Labels: classification, knn
 Attachments: LUCENE-6654.patch


 Currently the KNN Classifier assign the score for a ClassificationResult, 
 based only on the frequency of the class in the top K results.
 This is conceptually a simplification.
 Actually the ranking must take a part.
 If not this can happen :
 Top 4
 1) Class1
 2) Class1
 3) Class2
 4) Class2
 As a result of this Top 4 , both the classes will have the same score.
 But the expected result is that Class1 has a better score, as the MLT score 
 the documents accordingly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6678) jdk1.9.0-ea-b72 JVM failures

2015-08-03 Thread Dawid Weiss (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dawid Weiss updated LUCENE-6678:

Attachment: hs_err_pid7608.log

{code}
   [junit4] # V  [libjvm.so+0x48651f]  ConcurrentMark::completeCleanup()+0x9f
{code}

 jdk1.9.0-ea-b72 JVM failures
 

 Key: LUCENE-6678
 URL: https://issues.apache.org/jira/browse/LUCENE-6678
 Project: Lucene - Core
  Issue Type: Task
Reporter: Dawid Weiss
Priority: Trivial
 Attachments: hs_err_pid7402.log, hs_err_pid7407.log, 
 hs_err_pid7408.log, hs_err_pid7608.log


 A placeholder for JDK1.9.0-ea-b72 failures.
 Linked issues:
 [8129961 : SIGSEGV when copying to survivor space]
 https://bugs.openjdk.java.net/browse/JDK-8129961



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_51) - Build # 13711 - Still Failing!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13711/
Java: 64bit/jdk1.8.0_51 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:
Error from server at 
https://127.0.0.1:49092/rq_jl/source_collection_shard1_replica1: ClusterState 
says we are the leader 
(https://127.0.0.1:49092/rq_jl/source_collection_shard1_replica1), but locally 
we don't think so. Request came from null

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at https://127.0.0.1:49092/rq_jl/source_collection_shard1_replica1: 
ClusterState says we are the leader 
(https://127.0.0.1:49092/rq_jl/source_collection_shard1_replica1), but locally 
we don't think so. Request came from null
at 
__randomizedtesting.SeedInfo.seed([EA39C87A9358B705:E259BD569C569F0E]:0)
at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at 
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:635)
at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:967)
at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:107)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:72)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:86)
at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.index(BaseCdcrDistributedZkTest.java:184)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestOps(CdcrReplicationDistributedZkTest.java:436)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:52)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 

Re: [JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0_51) - Build # 5098 - Failure!

2015-08-03 Thread Michael McCandless
I'll dig ...

Mike McCandless

http://blog.mikemccandless.com


On Sun, Aug 2, 2015 at 10:53 PM, Policeman Jenkins Server
jenk...@thetaphi.de wrote:
 Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/5098/
 Java: 64bit/jdk1.8.0_51 -XX:-UseCompressedOops -XX:+UseG1GC

 1 tests failed.
 FAILED:  org.apache.lucene.rangetree.TestRangeTree.testMultiValuedSortedSet

 Error Message:
 dir=.\temp\RangeTreeWriter2453214844782505478 still has 
 file=.\temp\RangeTreeWriter2453214844782505478\size20382.7946562357398785588

 Stack Trace:
 java.lang.AssertionError: dir=.\temp\RangeTreeWriter2453214844782505478 still 
 has 
 file=.\temp\RangeTreeWriter2453214844782505478\size20382.7946562357398785588
 at 
 __randomizedtesting.SeedInfo.seed([E796DC58347808A:75003E413103FD44]:0)
 at 
 org.apache.lucene.rangetree.RangeTreeWriter.directoryIsEmpty(RangeTreeWriter.java:402)
 at 
 org.apache.lucene.rangetree.RangeTreeWriter.finish(RangeTreeWriter.java:391)
 at 
 org.apache.lucene.rangetree.RangeTreeDocValuesConsumer.addSortedSetField(RangeTreeDocValuesConsumer.java:144)
 at 
 org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addSortedSetField(PerFieldDocValuesFormat.java:131)
 at 
 org.apache.lucene.codecs.DocValuesConsumer.mergeSortedSetField(DocValuesConsumer.java:736)
 at 
 org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:219)
 at 
 org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:150)
 at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:105)
 at 
 org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4075)
 at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3650)
 at 
 org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
 at 
 org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1915)
 at 
 org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1748)
 at 
 org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1705)
 at 
 org.apache.lucene.index.RandomIndexWriter.forceMerge(RandomIndexWriter.java:408)
 at 
 org.apache.lucene.rangetree.TestRangeTree.testMultiValuedSortedSet(TestRangeTree.java:229)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:497)
 at 
 com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
 at 
 com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
 at 
 com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
 at 
 com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
 at 
 org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
 at 
 org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
 at 
 org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
 at 
 org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
 at 
 org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
 at 
 com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
 at 
 com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
 at 
 com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
 at 
 com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
 at 
 com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
 at 
 com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
 at 
 com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
 at 
 com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
 at 
 org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
 at 
 com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
 at 
 org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
 at 
 com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
 at 
 

[jira] [Commented] (SOLR-5882) Introduce score local parameter for {!parent} query parser

2015-08-03 Thread Shalin Shekhar Mangar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651623#comment-14651623
 ] 

Shalin Shekhar Mangar commented on SOLR-5882:
-

[~mkhludnev] - does a score mode specified in uppercase throw an exception? 
Shouldn't that be case-insensitive?

 Introduce score local parameter for {!parent} query parser
 --

 Key: SOLR-5882
 URL: https://issues.apache.org/jira/browse/SOLR-5882
 Project: Solr
  Issue Type: New Feature
Affects Versions: 4.8
Reporter: Andrey Kudryavtsev
Assignee: Mikhail Khludnev
 Fix For: 5.3

 Attachments: SOLR-5882.patch, SOLR-5882.patch


 I propose to have ability to configure scoring mode by local parameter
 Syntax for parent queries can be like:
 {code:borderStyle=solid}
 {!parent which=type:parent score=None|Avg|Max|Total|Min}...
 loweracase is also accepted
 {code} 
 Child query enables scoring by default.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5882) Introduce score local parameter for {!parent} query parser

2015-08-03 Thread Mikhail Khludnev (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651533#comment-14651533
 ] 

Mikhail Khludnev commented on SOLR-5882:


[~thelabdude] I appreciate if you can have a look.

 Introduce score local parameter for {!parent} query parser
 --

 Key: SOLR-5882
 URL: https://issues.apache.org/jira/browse/SOLR-5882
 Project: Solr
  Issue Type: New Feature
Affects Versions: 4.8
Reporter: Andrey Kudryavtsev
Assignee: Mikhail Khludnev
 Fix For: 5.3

 Attachments: SOLR-5882.patch, SOLR-5882.patch


 I propose to have ability to configure scoring mode by local parameter
 Syntax for parent queries can be like:
 {code:borderStyle=solid}
 {!parent which=type:parent score=None|Avg|Max|Total|Min}...
 loweracase is also accepted
 {code} 
 Child query enables scoring by default.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6678) jdk1.9.0-ea-b72 JVM failures

2015-08-03 Thread Dawid Weiss (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651565#comment-14651565
 ] 

Dawid Weiss commented on LUCENE-6678:
-

http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/13527/consoleText

This seems to be a new one. 
{code}
   [junit4] #
   [junit4] # A fatal error has been detected by the Java Runtime Environment:
   [junit4] #
   [junit4] #  SIGSEGV (0xb) at pc=0x7f3547f9b51f, pid=7608, 
tid=139866754520832
   [junit4] #
   [junit4] # JRE version: Java(TM) SE Runtime Environment (9.0-b60) (build 
1.9.0-ea-b60)
   [junit4] # Java VM: Java HotSpot(TM) 64-Bit Server VM (1.9.0-ea-b60 mixed 
mode linux-amd64 )
   [junit4] # Problematic frame:
   [junit4] # V  [libjvm.so+0x48651f]  ConcurrentMark::completeCleanup()+0x9f
   [junit4] #
   [junit4] # Failed to write core dump. Core dumps have been disabled. To 
enable core dumping, try ulimit -c unlimited before starting Java again
   [junit4] #
   [junit4] # An error report file with more information is saved as:
   [junit4] # 
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build/core/test/J0/hs_err_pid7608.log
   [junit4] #
   [junit4] # If you would like to submit a bug report, please visit:
   [junit4] #   http://bugreport.java.com/bugreport/crash.jsp
   [junit4] #
{code}

 jdk1.9.0-ea-b72 JVM failures
 

 Key: LUCENE-6678
 URL: https://issues.apache.org/jira/browse/LUCENE-6678
 Project: Lucene - Core
  Issue Type: Task
Reporter: Dawid Weiss
Priority: Trivial
 Attachments: hs_err_pid7402.log, hs_err_pid7407.log, 
 hs_err_pid7408.log


 A placeholder for JDK1.9.0-ea-b72 failures.
 Linked issues:
 [8129961 : SIGSEGV when copying to survivor space]
 https://bugs.openjdk.java.net/browse/JDK-8129961



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-6625) Add interceptor API for outgoing calls through HttpSolrClient

2015-08-03 Thread Ishan Chattopadhyaya (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ishan Chattopadhyaya updated SOLR-6625:
---
Attachment: SOLR-6625-revert.patch

Close to 5.3, I am feeling unsure of what else is broken. Since SOLR-7692 can 
use the serverside request object (SolrRequestObject) directly from 
SolrRequestInfo, I want to revert the SolrHttpContext and the SolrHttpClient 
parts from this issue. We'll still continue to have the HttpRequestInterceptor 
support and the tests.

Here's a patch to do the same. The tests are passing for me.

If, at a later point, we need client side request object (SolrRequest), we can 
bring back these changes with more tests. Right now, that seems not necessary.

 Add interceptor API for outgoing calls through HttpSolrClient
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-revert.patch, SOLR-6625-testfailure.log, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (SOLR-6625) Add interceptor API for outgoing calls through HttpSolrClient

2015-08-03 Thread Ishan Chattopadhyaya (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651961#comment-14651961
 ] 

Ishan Chattopadhyaya edited comment on SOLR-6625 at 8/3/15 3:09 PM:


Close to 5.3, I am feeling unsure of what else is broken. Since SOLR-7692 can 
use the serverside request object (SolrRequestObject) directly from 
SolrRequestInfo, I want to revert the SolrHttpContext and the SolrHttpClient 
parts from this issue. We'll still continue to have the HttpRequestInterceptor 
support and the tests.

Here's a patch to do the same (SOLR-6625-revert.patch). The tests are passing 
for me.

If, at a later point, we need client side request object (SolrRequest), we can 
bring back these changes with more tests. Right now, that seems not necessary.


was (Author: ichattopadhyaya):
Close to 5.3, I am feeling unsure of what else is broken. Since SOLR-7692 can 
use the serverside request object (SolrRequestObject) directly from 
SolrRequestInfo, I want to revert the SolrHttpContext and the SolrHttpClient 
parts from this issue. We'll still continue to have the HttpRequestInterceptor 
support and the tests.

Here's a patch to do the same. The tests are passing for me.

If, at a later point, we need client side request object (SolrRequest), we can 
bring back these changes with more tests. Right now, that seems not necessary.

 Add interceptor API for outgoing calls through HttpSolrClient
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-revert.patch, SOLR-6625-testfailure.log, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5882) Introduce score local parameter for {!parent} query parser

2015-08-03 Thread Mikhail Khludnev (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651964#comment-14651964
 ] 

Mikhail Khludnev commented on SOLR-5882:


lowercase works. and it's up to user to leave  the first letter Capital like in 
enum's javadoc

 Introduce score local parameter for {!parent} query parser
 --

 Key: SOLR-5882
 URL: https://issues.apache.org/jira/browse/SOLR-5882
 Project: Solr
  Issue Type: New Feature
Affects Versions: 4.8
Reporter: Andrey Kudryavtsev
Assignee: Mikhail Khludnev
 Fix For: 5.3

 Attachments: SOLR-5882.patch, SOLR-5882.patch


 I propose to have ability to configure scoring mode by local parameter
 Syntax for parent queries can be like:
 {code:borderStyle=solid}
 {!parent which=type:parent score=None|Avg|Max|Total|Min}...
 loweracase is also accepted
 {code} 
 Child query enables scoring by default.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5882) Introduce score local parameter for {!parent} query parser

2015-08-03 Thread Shalin Shekhar Mangar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651973#comment-14651973
 ] 

Shalin Shekhar Mangar commented on SOLR-5882:
-

Okay, cool. +1 to commit!

 Introduce score local parameter for {!parent} query parser
 --

 Key: SOLR-5882
 URL: https://issues.apache.org/jira/browse/SOLR-5882
 Project: Solr
  Issue Type: New Feature
Affects Versions: 4.8
Reporter: Andrey Kudryavtsev
Assignee: Mikhail Khludnev
 Fix For: 5.3

 Attachments: SOLR-5882.patch, SOLR-5882.patch


 I propose to have ability to configure scoring mode by local parameter
 Syntax for parent queries can be like:
 {code:borderStyle=solid}
 {!parent which=type:parent score=None|Avg|Max|Total|Min}...
 loweracase is also accepted
 {code} 
 Child query enables scoring by default.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6712) GeoPointField should cut over to DocValues for boundary filtering

2015-08-03 Thread Nicholas Knize (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nicholas Knize updated LUCENE-6712:
---
Attachment: LUCENE-6712.patch

Updated patch includes the following:

* added GeoPointTermQueryConstantScoreWrapper accidentally left out of last 
patch (forgot to add the file)
* reduces precision_step to 9 to further reduce range recursion and index size
* removed some duplicate diffs from LUCENE-6704

Due Diligence Benchmarks (on 60M point test data):

index time:  454.891 ms from 633.196 ms (*28% performance gain*)
index size: 3.9G from 4.7G (*17% reduction*)
search time: 0.018 ms/query from 0.028 ms/query (*28% performance gain*)


 GeoPointField should cut over to DocValues for boundary filtering
 -

 Key: LUCENE-6712
 URL: https://issues.apache.org/jira/browse/LUCENE-6712
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Nicholas Knize
 Attachments: LUCENE-6712.patch, LUCENE-6712.patch


 Currently GeoPointField queries only use the Terms Dictionary for ranges that 
 fall within and on the boundary of the query shape.  For boundary ranges the 
 full precision terms are iterated, for within ranges the postings list is 
 used.
 Instead of iterating full precision terms for boundary ranges, this 
 enhancement cuts over to DocValues for post-filtering boundary terms. This 
 allows us to increase precisionStep for GeoPointField thereby reducing the 
 number of terms and the size of the index. This enhancement should also 
 provide a boost in query performance since visiting more docs and fewer terms 
 should be more efficient than visiting fewer docs and more terms. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5882) Introduce score local parameter for {!parent} query parser

2015-08-03 Thread Yonik Seeley (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652070#comment-14652070
 ] 

Yonik Seeley commented on SOLR-5882:


bq.  Okay, I don't have a serious objection to this but I just find it weird 
to require case-sensitivity for such parameter names. Perhaps we can use 
lowercase only?   
bq. lowercase works. and it's up to user to leave the first letter Capital like 
in enum's javadoc

I agree with Shalin, and I don't think the enum value is really relevant 
(again, interface vs implementation... plus someone could always change the 
enum).
So when this is documented in the ref guide, let's use lowecase.

 Introduce score local parameter for {!parent} query parser
 --

 Key: SOLR-5882
 URL: https://issues.apache.org/jira/browse/SOLR-5882
 Project: Solr
  Issue Type: New Feature
Affects Versions: 4.8
Reporter: Andrey Kudryavtsev
Assignee: Mikhail Khludnev
 Fix For: 5.3

 Attachments: SOLR-5882.patch, SOLR-5882.patch


 I propose to have ability to configure scoring mode by local parameter
 Syntax for parent queries can be like:
 {code:borderStyle=solid}
 {!parent which=type:parent score=None|Avg|Max|Total|Min}...
 loweracase is also accepted
 {code} 
 Child query enables scoring by default.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6706) Support Payload scoring for all SpanQueries

2015-08-03 Thread Alan Woodward (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652084#comment-14652084
 ] 

Alan Woodward commented on LUCENE-6706:
---

Bah, sorry Steve, will fix.

 Support Payload scoring for all SpanQueries
 ---

 Key: LUCENE-6706
 URL: https://issues.apache.org/jira/browse/LUCENE-6706
 Project: Lucene - Core
  Issue Type: New Feature
  Components: core/query/scoring
Affects Versions: 5.2.1
Reporter: Jamie Johnson
Assignee: Alan Woodward
Priority: Minor
 Fix For: 5.3

 Attachments: LUCENE-6706.patch, PayloadSpanOrQuery.java


 I need a way to have payloads influence the score of SpanOrQuery's.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6417) Upgrade ANTLR to version 4.5

2015-08-03 Thread Jack Conradson (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jack Conradson updated LUCENE-6417:
---
Attachment: LUCENE-6471.patch

Attached an updated patch.

 Upgrade ANTLR to version 4.5
 

 Key: LUCENE-6417
 URL: https://issues.apache.org/jira/browse/LUCENE-6417
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Jack Conradson
 Attachments: LUCENE-6471.patch, LUCENE-6471.patch


 I would like to upgrade ANTLR from 3.5 to 4.5.  This version adds several 
 features that will improve the existing grammars.  The main improvement would 
 be the allowance of left-hand recursion in grammar rules which will reduce 
 the number of rules significantly for expressions.
 This change will require some code refactoring to the existing expressions 
 work.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0_51) - Build # 5101 - Failure!

2015-08-03 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/5101/
Java: 32bit/jdk1.8.0_51 -client -XX:+UseParallelGC

All tests passed

Build Log:
[...truncated 5148 lines...]
[javac] Compiling 224 source files to 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\queryparser\classes\java
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\xml\builders\BoostingTermBuilder.java:5:
 error: cannot find symbol
[javac] import org.apache.lucene.search.payloads.PayloadTermQuery;
[javac] ^
[javac]   symbol:   class PayloadTermQuery
[javac]   location: package org.apache.lucene.search.payloads
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\xml\builders\BoostingTermBuilder.java:29:
 error: reference not found
[javac]  * Builder for {@link PayloadTermQuery}
[javac]   ^
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\classic\QueryParserTokenManager.java:493:
 warning: [cast] redundant cast to int
[javac]  int hiByte = (int)(curChar  8);
[javac]   ^
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\classic\QueryParserTokenManager.java:687:
 warning: [cast] redundant cast to int
[javac]  int hiByte = (int)(curChar  8);
[javac]   ^
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\classic\QueryParserTokenManager.java:860:
 warning: [cast] redundant cast to int
[javac]  int hiByte = (int)(curChar  8);
[javac]   ^
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\flexible\standard\config\NumericConfig.java:32:
 warning: [overrides] Class NumericConfig overrides equals, but neither it nor 
any superclass overrides hashCode method
[javac] public class NumericConfig {
[javac]^
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\flexible\standard\parser\StandardSyntaxParserTokenManager.java:375:
 warning: [cast] redundant cast to int
[javac]  int hiByte = (int)(curChar  8);
[javac]   ^
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\flexible\standard\parser\StandardSyntaxParserTokenManager.java:495:
 warning: [cast] redundant cast to int
[javac]  int hiByte = (int)(curChar  8);
[javac]   ^
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\flexible\standard\parser\StandardSyntaxParserTokenManager.java:668:
 warning: [cast] redundant cast to int
[javac]  int hiByte = (int)(curChar  8);
[javac]   ^
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\surround\parser\QueryParserTokenManager.java:348:
 warning: [cast] redundant cast to int
[javac]  int hiByte = (int)(curChar  8);
[javac]   ^
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\surround\parser\QueryParserTokenManager.java:468:
 warning: [cast] redundant cast to int
[javac]  int hiByte = (int)(curChar  8);
[javac]   ^
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\surround\query\RewriteQuery.java:64:
 warning: [rawtypes] found raw type: RewriteQuery
[javac] RewriteQuery other = (RewriteQuery)obj;
[javac] ^
[javac]   missing type arguments for generic class RewriteQuerySQ
[javac]   where SQ is a type-variable:
[javac] SQ extends SrndQuery declared in class RewriteQuery
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\surround\query\OrQuery.java:43:
 warning: [rawtypes] found raw type: Iterator
[javac] Iterator sqi = getSubQueriesIterator();
[javac] ^
[javac]   missing type arguments for generic class IteratorE
[javac]   where E is a type-variable:
[javac] E extends Object declared in interface Iterator
[javac] 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\queryparser\src\java\org\apache\lucene\queryparser\surround\query\OrQuery.java:60:
 warning: [rawtypes] found 

[jira] [Commented] (LUCENE-6706) Support Payload scoring for all SpanQueries

2015-08-03 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652103#comment-14652103
 ] 

ASF subversion and git services commented on LUCENE-6706:
-

Commit 1693933 from [~romseygeek] in branch 'dev/trunk'
[ https://svn.apache.org/r1693933 ]

LUCENE-6706: Commit from the right directory this time

 Support Payload scoring for all SpanQueries
 ---

 Key: LUCENE-6706
 URL: https://issues.apache.org/jira/browse/LUCENE-6706
 Project: Lucene - Core
  Issue Type: New Feature
  Components: core/query/scoring
Affects Versions: 5.2.1
Reporter: Jamie Johnson
Assignee: Alan Woodward
Priority: Minor
 Fix For: 5.3

 Attachments: LUCENE-6706.patch, PayloadSpanOrQuery.java


 I need a way to have payloads influence the score of SpanOrQuery's.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7865) lookup method implemented in BlendedInfixLookupFactory does not respect suggest.count

2015-08-03 Thread Arcadius Ahouansou (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arcadius Ahouansou updated SOLR-7865:
-
Summary: lookup method implemented in BlendedInfixLookupFactory does not 
respect suggest.count  (was: loockup method implemented in 
BlendedInfixLookupFactory does not respect suggest.count)

 lookup method implemented in BlendedInfixLookupFactory does not respect 
 suggest.count
 -

 Key: SOLR-7865
 URL: https://issues.apache.org/jira/browse/SOLR-7865
 Project: Solr
  Issue Type: Bug
  Components: Suggester
Affects Versions: 5.2.1
Reporter: Arcadius Ahouansou

 The following test failes in the TestBlendedInfixSuggestions.java:
 This is mainly because {code}num * numFactor{code} get called multiple times.
 {code}
   public void testSuggestCount() {
 assertQ(req(qt, URI, q, the, SuggesterParams.SUGGEST_COUNT, 1, 
 SuggesterParams.SUGGEST_DICT, blended_infix_suggest_linear),
 
 //lst[@name='suggest']/lst[@name='blended_infix_suggest_linear']/lst[@name='the']/int[@name='numFound'][.='1'],
 
 //lst[@name='suggest']/lst[@name='blended_infix_suggest_linear']/lst[@name='the']/arr[@name='suggestions']/lst[1]/str[@name='term'][.='top
  of bthe/b lake'],
 
 //lst[@name='suggest']/lst[@name='blended_infix_suggest_linear']/lst[@name='the']/arr[@name='suggestions']/lst[1]/long[@name='weight'][.='14'],
 
 //lst[@name='suggest']/lst[@name='blended_infix_suggest_linear']/lst[@name='the']/arr[@name='suggestions']/lst[1]/str[@name='payload'][.='lake']
 );
   }
 {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-7866) getMaxVersionFromIndex is throwing an NPE if some segments are not current

2015-08-03 Thread Timothy Potter (JIRA)
Timothy Potter created SOLR-7866:


 Summary: getMaxVersionFromIndex is throwing an NPE if some 
segments are not current
 Key: SOLR-7866
 URL: https://issues.apache.org/jira/browse/SOLR-7866
 Project: Solr
  Issue Type: Bug
Reporter: Timothy Potter
Assignee: Timothy Potter
Priority: Blocker
 Fix For: 5.3


Reported by user on #solr irc (via Shalin)
{code}
java.lang.NullPointerException
at 
org.apache.lucene.util.NumericUtils.prefixCodedToLong(NumericUtils.java:226)
at org.apache.lucene.util.NumericUtils.getMaxLong(NumericUtils.java:582)
at 
org.apache.solr.update.VersionInfo.getMaxVersionFromIndex(VersionInfo.java:234)
at 
org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(UpdateLog.java:1580)
at 
org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(UpdateLog.java:1610)
at org.apache.solr.core.SolrCore.seedVersionBuckets(SolrCore.java:861)
at org.apache.solr.core.SolrCore.init(SolrCore.java:843)
at org.apache.solr.core.SolrCore.init(SolrCore.java:658)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:637)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:381)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:375)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Understanding performance degradation in range queries between Solr 5.2.1 and 4.10.4

2015-08-03 Thread Tomás Fernández Löbbe
Thanks Adrien,
I'll run the tests with 5.3 snapshot and post the results here. In case
this helps, this is the hprof samples output
(-Xrunhprof:cpu=samples,depth=3,file=/home/ec2-user/hprof_output.txt) for
4.10.4 and 5.2.1 in my test:

Solr 4.10.4:
CPU SAMPLES BEGIN (total = 243525) Fri Jul 31 22:29:06 2015
rank   self  accum   count trace method
   1 75.07% 75.07%  182812 300523 java.net.PlainSocketImpl.socketAccept
   2  4.27% 79.34%   10408 301576
org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.decodeMetaData
   3  4.15% 83.49%   10108 301585
org.apache.lucene.index.FilteredTermsEnum.docs
   4  3.46% 86.95%8419 301582
org.apache.lucene.index.FilteredTermsEnum.next
   5  2.49% 89.44%6070 301573 java.net.SocketInputStream.socketRead0
   6  1.99% 91.43%4848 301599
org.apache.lucene.search.MultiTermQueryWrapperFilter.getDocIdSet
   7  1.98% 93.42%4824 301583
org.apache.lucene.search.MultiTermQueryWrapperFilter.getDocIdSet
   8  1.57% 94.99%3824 301589
org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll
   9  1.44% 96.42%3504 301594
org.apache.lucene.codecs.lucene41.Lucene41PostingsReader$BlockDocsEnum.refillDocs
  10  1.09% 97.51%2655 301581 java.nio.Bits.copyToArray
  11  0.98% 98.50%2388 301598
org.apache.lucene.codecs.lucene41.Lucene41PostingsReader$BlockDocsEnum.nextDoc
  12  0.62% 99.12%1522 301600 org.apache.lucene.store.DataInput.readVInt
  13  0.21% 99.33% 500 301612
org.apache.lucene.codecs.blocktree.SegmentTermsEnum.docs
  14  0.07% 99.39% 167 301601
org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.next
  15  0.06% 99.45% 139 301619 java.lang.System.identityHashCode
  16  0.05% 99.50% 114 301632
org.apache.lucene.codecs.lucene41.ForUtil.readBlock
  17  0.04% 99.54%  92 300708 java.util.zip.Inflater.inflateBytes
  18  0.03% 99.57%  76 301624
org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.loadNextFloorBlock
  19  0.03% 99.59%  68 300613 java.lang.ClassLoader.defineClass1
  20  0.03% 99.62%  68 301615
org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
  21  0.03% 99.65%  62 301635
org.apache.solr.search.SolrIndexSearcher.getDocSetNC
  22  0.02% 99.66%  41 301664
org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
  23  0.01% 99.68%  31 301629 org.apache.lucene.util.FixedBitSet.init
CPU SAMPLES END

Solr 5.2.1:
CPU SAMPLES BEGIN (total = 235415) Fri Jul 31 22:42:06 2015
rank   self  accum   count trace method
   1 51.38% 51.38%  120954 301291 sun.nio.ch.EPollArrayWrapper.epollWait
   2 25.69% 77.07%   60477 301292 sun.nio.ch.ServerSocketChannelImpl.accept0
   3 10.59% 87.66%   24923 301369
org.apache.lucene.index.ExitableDirectoryReader$ExitableTermsEnum.next
   4  2.20% 89.86%5182 301414
org.apache.lucene.codecs.blocktree.SegmentTermsEnum.postings
   5  2.01% 91.87%4742 301384
org.apache.lucene.index.FilterLeafReader$FilterTermsEnum.postings
   6  1.25% 93.12%2944 301434
java.lang.ThreadLocal$ThreadLocalMap.getEntryAfterMiss
   7  1.11% 94.23%2612 301367
org.apache.lucene.search.MultiTermQueryConstantScoreWrapper$1.rewrite
   8  0.94% 95.17%2204 301390 org.apache.lucene.util.BitSet.or
   9  0.93% 96.10%2190 301383 java.nio.Bits.copyToArray
  10  0.78% 96.87%1825 301449
org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.refillDocs
  11  0.73% 97.60%1717 301378
org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll
  12  0.73% 98.33%1715 301374 org.apache.lucene.util.BitSet.or
  13  0.33% 98.66% 787 301387
org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
  14  0.16% 98.82% 374 301426
org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
  15  0.10% 98.93% 245 301382 org.apache.lucene.util.BitSet.or
  16  0.09% 99.02% 219 301381
org.apache.lucene.codecs.blocktree.SegmentTermsEnumFrame.next
  17  0.09% 99.11% 207 301370 org.apache.lucene.util.BitSet.or
  18  0.06% 99.17% 153 301416 org.apache.lucene.util.BitSet.or
  19  0.06% 99.24% 151 301427 org.apache.lucene.util.BitSet.or
  20  0.06% 99.30% 151 301441 org.apache.lucene.store.DataInput.readVInt
  21  0.06% 99.36% 147 301389 java.lang.System.identityHashCode
  22  0.06% 99.42% 140 301375
org.apache.lucene.codecs.blocktree.SegmentTermsEnum.next
  23  0.04% 99.47% 104 301425 org.apache.lucene.util.BitSet.or
  24  0.03% 99.50%  76 301423
org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockDocsEnum.nextDoc
  25  0.03% 99.53%  74 301454
org.apache.lucene.search.MultiTermQueryConstantScoreWrapper$1.rewrite
  26  0.03% 99.56%  65 301432
org.apache.lucene.util.BitDocIdSet$Builder.or
  27  0.02% 99.58%  53 301456 org.apache.lucene.util.FixedBitSet.or
  28  0.02% 99.60%  52 300077 java.lang.ClassLoader.defineClass1
  29  0.02% 99.63%  50 301464
org.apache.lucene.codecs.lucene50.ForUtil.readBlock
  30  0.02% 99.64%  39 301438

[jira] [Commented] (LUCENE-6711) Instead of docCount(), maxDoc() is used for numberOfDocuments in SimilarityBase

2015-08-03 Thread Hoss Man (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652160#comment-14652160
 ] 

Hoss Man commented on LUCENE-6711:
--

bq. I also think its best to just make the change for trunk and not do it in a 
minor version.

+1

This is the sort of behavior change that should be noted in MIGRATE.txt -- 
Ahmet: could you take a stab at adding the necessary text in your patch?

 Instead of docCount(), maxDoc() is used for numberOfDocuments in 
 SimilarityBase
 ---

 Key: LUCENE-6711
 URL: https://issues.apache.org/jira/browse/LUCENE-6711
 Project: Lucene - Core
  Issue Type: Bug
  Components: core/search
Reporter: Ahmet Arslan
Priority: Minor
 Fix For: Trunk

 Attachments: LUCENE-6711.patch, LUCENE-6711.patch, LUCENE-6711.patch


 {{SimilarityBase.java}} has the following line :
 {code}
  long numberOfDocuments = collectionStats.maxDoc();
 {code}
 It seems like {{collectionStats.docCount()}}, which returns the total number 
 of documents that have at least one term for this field, is more appropriate 
 statistics here. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 3390 - Failure

2015-08-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/3390/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test

Error Message:
expected:0 but was:1

Stack Trace:
java.lang.AssertionError: expected:0 but was:1
at 
__randomizedtesting.SeedInfo.seed([2B6CE069A5DB5A50:A338DFB30B2737A8]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at 
org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:156)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 

[jira] [Updated] (SOLR-7799) LukeRequestHandler too slow when there are many fields

2015-08-03 Thread Erik Hatcher (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Erik Hatcher updated SOLR-7799:
---
Fix Version/s: Trunk

 LukeRequestHandler too slow when there are many fields
 --

 Key: SOLR-7799
 URL: https://issues.apache.org/jira/browse/SOLR-7799
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.2
Reporter: Erik Hatcher
Assignee: Erik Hatcher
 Fix For: 5.3, Trunk

 Attachments: SOLR-7799.patch


 /admin/luke responds very slowly when there are many fields in the index.  
 The issue is with getFirstLiveDoc() spinning its wheels a lot to get the 
 index flags.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7860) Standardize use of HttpSolrClients in Solr

2015-08-03 Thread Ishan Chattopadhyaya (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ishan Chattopadhyaya updated SOLR-7860:
---
Attachment: SOLR-7860.patch

First cut at removing so many httpclients lying around. Removing the SDF's 
httpclient and using the update shard handler's httpclient.

 Standardize use of HttpSolrClients in Solr
 --

 Key: SOLR-7860
 URL: https://issues.apache.org/jira/browse/SOLR-7860
 Project: Solr
  Issue Type: Improvement
Reporter: Ramkumar Aiyengar
Priority: Minor
 Attachments: SOLR-7860.patch


 {{HttpShardHandlerFactory}} and {{UpdateShardHandler}} already provide two 
 places where one can get {{HttpSolrClient}}s with timeouts set up properly 
 etc., but there are lots of miscellaneous places which instantiate their own, 
 with hardcoded timeouts. These are just waiting for some environment to 
 realize the timeouts are not suitable, and not configurable as well. We 
 should standardize this (anyone knows why there two to begin with?), ideally 
 this hardcoding shouldn't exist at all..



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



  1   2   >