Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1623 - Still Failing

2013-05-16 Thread Shai Erera
I think this exception should be thrown only when the bytes land in the
Directory. I think that in general we buffer bytes before sending them to
the actual IndexOutput? I don't know if this is done with RAMDir too i.e.
that there isn't code out there that buffers its writes to any IndexOutput,
not caring if it's RAMFile or not.

And technically, if you have a buffer of 16K, but can only write 2K to the
underlying Directory, you shouldn't hit the exception until you actually
flush the bytes?

Adrien, not in front of the code now, but if writeBytes applies the limit,
why do we need any special logic in MDW.flush?

Shai


On Thu, May 16, 2013 at 3:45 PM, Adrien Grand jpou...@gmail.com wrote:

 On Thu, May 16, 2013 at 1:58 PM, Robert Muir rcm...@gmail.com wrote:
  I dont get it. MDW wraps its IndexOutput so it knows... sounds like
  the counting is off.

 The problem is that RAMDirectory delays the counting.
 MockDirectoryWrapper.getRecomputedActualSizeInBytes sums all the
 lengths of the existing RAMFiles to get the actual size, but
 RAMFile.length is only updated after a RAMOutputStream seek or flush.
 This means that if you write 5 bytes, then 3 bytes, RAMFile.length
 will still be 0 and then suddenly upon flush it will become 5+3=8.

 Using the Mock IndexOutput to track bytes is an option, but I was
 thinking it could be interesting too to see what happens with
 directories that buffer content so that the disk full exception
 happens in flush instead of writeBytes?

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1623 - Still Failing

2013-05-16 Thread Robert Muir
On Thu, May 16, 2013 at 8:45 AM, Adrien Grand jpou...@gmail.com wrote:

 Using the Mock IndexOutput to track bytes is an option, but I was
 thinking it could be interesting too to see what happens with
 directories that buffer content so that the disk full exception
 happens in flush instead of writeBytes?


But it can easily happen in both places...

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4773) New discovery mode needs to ensure that instanceDir is correct

2013-05-16 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659676#comment-13659676
 ] 

Shawn Heisey commented on SOLR-4773:


[~andyfowler] - I finally found some time and looked into this more deeply in 
relation to 4.3.0.  The patch for this issue does not fix the problem with 
relative dataDirs in the released version.  The patch as-is won't apply to 
4.3.0 because the code in branch_4x was significantly refactored, but I found 
the right place to apply the change from getPath to getCanonicalPath, and it 
didn't help.  It did fix an exception during startup (solrconfig.xml couldn't 
be found) when I followed your simple instructions for running the multicore 
example with discovery, but only core0 started, core1 didn't, because it had 
the same dataDir as core0.

[~markrmil...@gmail.com] - Do you happen to know how we can fix the problem 
with relative or missing dataDir properties in the 4.3 branch?  Would the 
change be trivial enough to make it to 4.3.1?  Discovery mode is essentially 
broken at the moment in the 4.3.0 release unless you have full absolute paths 
that are explicitly declared in the properties file.  This is not how I want 
things to work in my own setup.


 New discovery mode needs to ensure that instanceDir is correct
 --

 Key: SOLR-4773
 URL: https://issues.apache.org/jira/browse/SOLR-4773
 Project: Solr
  Issue Type: Bug
  Components: Schema and Analysis
Affects Versions: 5.0, 4.4
Reporter: Erick Erickson
Assignee: Mark Miller
 Fix For: 5.0, 4.4

 Attachments: SOLR-4773.patch, SOLR-4773.patch


 Doing a fresh checkout of 4.x (trunk to to I think) and firing up the example 
 fails because we can't find solrconfig. The construction of the instanceDir 
 in SolrCoreDiscoverer constructs a path with an extra solr (e.g. 
 solr/solr/core).
 I'll attach a patch shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4829) transaction log reference leak

2013-05-16 Thread Yonik Seeley (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yonik Seeley updated SOLR-4829:
---

Attachment: SOLR-4829.patch

Here's another version that cleans up tlog references during tlog recovery in 
the event an unexpected exception (like a commit throwing something other than 
IOException).

Aside: we should keep in mind that when index corruption happens, lucene can 
throw exceptions other than IOException.

 transaction log reference leak
 --

 Key: SOLR-4829
 URL: https://issues.apache.org/jira/browse/SOLR-4829
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.1
Reporter: Yonik Seeley
Assignee: Yonik Seeley
 Fix For: 5.0, 4.3.1

 Attachments: SOLR-4829.patch, SOLR-4829.patch, SOLR-4829.patch


 Failure to dereference tlogs or RecentUpdates can cause old transaction logs 
 to never be closed  deleted.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.6.0) - Build # 458 - Still Failing!

2013-05-16 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/458/
Java: 64bit/jdk1.6.0 -XX:-UseCompressedOops -XX:+UseParallelGC

All tests passed

Build Log:
[...truncated 1523 lines...]
[javac] Compiling 392 source files to 
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/build/analysis/common/classes/java
[javac] 
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/analysis/common/src/java/org/apache/lucene/analysis/position/PositionFilter.java:25:
 package org.apache.lucene.queryparser.classic does not exist
[javac] import org.apache.lucene.queryparser.classic.QueryParser;
[javac] ^
[javac] 
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/analysis/common/src/java/org/apache/lucene/analysis/synonym/SynonymFilterFactory.java:86:
 warning: [dep-ann] deprecated item is not annotated with @Deprecated
[javac]   TokenFilterFactory getDelegator() {
[javac]  ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] 1 error

[...truncated 1 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:383: 
The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:363: 
The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The 
following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/build.xml:549:
 The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1827:
 The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/analysis/build.xml:99:
 The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/analysis/build.xml:38:
 The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/module-build.xml:58:
 The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:489:
 The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1626:
 Compile failed; see the compiler error output for details.

Total time: 19 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1621 - Still Failing

2013-05-16 Thread Chris Hostetter


: (b) is unlikely. Dump the allocation tree and see what's the major
: contributor to the size.

Right, see rmuir's response and the subsequent collection of aggregation 
of info in my comment on SOLR-4825...

https://issues.apache.org/jira/browse/SOLR-4825#comment-13659117


-Hoss

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS-MAVEN] Lucene-Solr-Maven-4.x #328: POMs out of sync

2013-05-16 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-Maven-4.x/328/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.ShardSplitTest.testDistribSearch

Error Message:
Wrong doc count on shard1_0 expected:125 but was:124

Stack Trace:
java.lang.AssertionError: Wrong doc count on shard1_0 expected:125 but 
was:124
at 
__randomizedtesting.SeedInfo.seed([7C6CF0CF6C540501:FD8A7ED71B0B653D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at 
org.apache.solr.cloud.ShardSplitTest.checkDocCountsAndShardStates(ShardSplitTest.java:166)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:142)




Build Log:
[...truncated 23900 lines...]



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1621 - Still Failing

2013-05-16 Thread Robert Muir
My suspicion is that its that map key'ed on solrcore.

in this case it would be holding references to SolrCores from previous
tests. Because test order and other things are randomized, it would
explain the huge size fluctuations.

On Thu, May 16, 2013 at 12:35 PM, Chris Hostetter
hossman_luc...@fucit.org wrote:


 : (b) is unlikely. Dump the allocation tree and see what's the major
 : contributor to the size.

 Right, see rmuir's response and the subsequent collection of aggregation
 of info in my comment on SOLR-4825...

 https://issues.apache.org/jira/browse/SOLR-4825#comment-13659117


 -Hoss

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.6.0_45) - Build # 5623 - Failure!

2013-05-16 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/5623/
Java: 32bit/jdk1.6.0_45 -client -XX:+UseSerialGC

All tests passed

Build Log:
[...truncated 1574 lines...]
[javac] Compiling 392 source files to 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/classes/java
[javac] 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/common/src/java/org/apache/lucene/analysis/position/PositionFilter.java:25:
 package org.apache.lucene.queryparser.classic does not exist
[javac] import org.apache.lucene.queryparser.classic.QueryParser;
[javac] ^
[javac] 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/common/src/java/org/apache/lucene/analysis/synonym/SynonymFilterFactory.java:86:
 warning: [dep-ann] deprecated item is not annotated with @Deprecated
[javac]   TokenFilterFactory getDelegator() {
[javac]  ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] 1 error

[...truncated 1 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:383: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:363: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:549: The 
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1827: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/build.xml:99: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/build.xml:38: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/module-build.xml:58: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:489: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1626: 
Compile failed; see the compiler error output for details.

Total time: 8 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.6.0_45 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

[jira] [Commented] (SOLR-4773) New discovery mode needs to ensure that instanceDir is correct

2013-05-16 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659699#comment-13659699
 ] 

Mark Miller commented on SOLR-4773:
---

I don't know that it would be that easy - I honestly think it could involve 
multiple bugs - I fixed many little things in this area in 4x and I think erick 
has as well. With all the refactoring and all the bugs (there is still a 
critical outstanding one around persistence if I remember right), as I've said 
elsewhere, I don't consider the new solr.xml format to be usable for 4.3 and I 
don't think I can confidently make it solid for 4.3.1 - I've dedicated what 
time I can to make it solid for 4.4 (and I know there is still work to do and 
work I've done but not put up yet), which shouldn't be too far out.

I reccomended keeping this stuff in 5x and changing the tests and example to 
use it before pushing it out in a release - as I said, it didn't actually bake 
in 5x by sitting there, essentially hidden from dev use and wide testing for a 
couple weeks - I pushed back a bit multiple times - because I was worried this 
would be the result, but at this point, we are where we are, and I can only 
offer to help make things usable for 4.4 at best.

 New discovery mode needs to ensure that instanceDir is correct
 --

 Key: SOLR-4773
 URL: https://issues.apache.org/jira/browse/SOLR-4773
 Project: Solr
  Issue Type: Bug
  Components: Schema and Analysis
Affects Versions: 5.0, 4.4
Reporter: Erick Erickson
Assignee: Mark Miller
 Fix For: 5.0, 4.4

 Attachments: SOLR-4773.patch, SOLR-4773.patch


 Doing a fresh checkout of 4.x (trunk to to I think) and firing up the example 
 fails because we can't find solrconfig. The construction of the instanceDir 
 in SolrCoreDiscoverer constructs a path with an extra solr (e.g. 
 solr/solr/core).
 I'll attach a patch shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4773) New discovery mode needs to ensure that instanceDir is correct

2013-05-16 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659703#comment-13659703
 ] 

Shawn Heisey commented on SOLR-4773:


bq. at this point, we are where we are, and I can only offer to help make 
things usable for 4.4 at best.

Thanks, Mark.  I thought that might be the case, just wanted to nail it down.  
Now I know what to tell users!


 New discovery mode needs to ensure that instanceDir is correct
 --

 Key: SOLR-4773
 URL: https://issues.apache.org/jira/browse/SOLR-4773
 Project: Solr
  Issue Type: Bug
  Components: Schema and Analysis
Affects Versions: 5.0, 4.4
Reporter: Erick Erickson
Assignee: Mark Miller
 Fix For: 5.0, 4.4

 Attachments: SOLR-4773.patch, SOLR-4773.patch


 Doing a fresh checkout of 4.x (trunk to to I think) and firing up the example 
 fails because we can't find solrconfig. The construction of the instanceDir 
 in SolrCoreDiscoverer constructs a path with an extra solr (e.g. 
 solr/solr/core).
 I'll attach a patch shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1621 - Still Failing

2013-05-16 Thread Mark Miller
What's a little odd is that this should work exactly as it did before we used 
log4j - I just pure copied the code from a Formatter to a Layout. I originally 
suspected that the Layout is holding onto stuff, but thought perhaps that had 
something to do with java util logging vs log4j, since this didn't seem to 
previously show up as an issue. Perhaps we have added enough tests to cross a 
threshold while this was not in use.

In any case, it seems likely we can improve the Layout - I can take a look.

- Mark

On May 16, 2013, at 12:44 PM, Robert Muir rcm...@gmail.com wrote:

 My suspicion is that its that map key'ed on solrcore.
 
 in this case it would be holding references to SolrCores from previous
 tests. Because test order and other things are randomized, it would
 explain the huge size fluctuations.
 
 On Thu, May 16, 2013 at 12:35 PM, Chris Hostetter
 hossman_luc...@fucit.org wrote:
 
 
 : (b) is unlikely. Dump the allocation tree and see what's the major
 : contributor to the size.
 
 Right, see rmuir's response and the subsequent collection of aggregation
 of info in my comment on SOLR-4825...
 
 https://issues.apache.org/jira/browse/SOLR-4825#comment-13659117
 
 
 -Hoss
 
 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org
 
 
 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org
 


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1623 - Still Failing

2013-05-16 Thread Shai Erera
Looking at the code, I think that today flush() cannot throw diskFullEx?
MockIO checks for diskFull in writeBytes and copyBytes, using
dir.sizeInBytes.

So I think if you limit maxSize=5 and write 4 + 4 bytes, to a Directory
with a buffer of 20 bytes, then both writeBytes will succeed (as
dir.sizeInBytes = 0).
flush() will also succeed since it only calls delegate.flush().

So I think either MDW should track its size, or MockIO track the num
written bytes?

Shai


On Thu, May 16, 2013 at 7:08 PM, Robert Muir rcm...@gmail.com wrote:

 On Thu, May 16, 2013 at 8:45 AM, Adrien Grand jpou...@gmail.com wrote:

  Using the Mock IndexOutput to track bytes is an option, but I was
  thinking it could be interesting too to see what happens with
  directories that buffer content so that the disk full exception
  happens in flush instead of writeBytes?
 

 But it can easily happen in both places...

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1621 - Still Failing

2013-05-16 Thread Mark Miller

On May 16, 2013, at 12:59 PM, Mark Miller markrmil...@gmail.com wrote:

 In any case, it seems likely we can improve the Layout - I can take a look.

Seems like we could get away with just using SolrCore#hashCode rather than 
keying by the SolrCore.

- Mark


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-4833) All(most all) Logger instances should be made static

2013-05-16 Thread Hoss Man (JIRA)
Hoss Man created SOLR-4833:
--

 Summary: All(most all) Logger instances should be made static
 Key: SOLR-4833
 URL: https://issues.apache.org/jira/browse/SOLR-4833
 Project: Solr
  Issue Type: Improvement
Reporter: Hoss Man


The majority of Logger usage in Solr is via static variables, but there are a 
few places where this pattern does not hold true - i think we should fix that 
and be completley consistent.  if there is any specific cases where a 
non-static variable really makes a lot of sense, then it should be heavily 
commented as to why.



The SLF4J FAQ has a list of pros and cons for why Logger variables 
should/shouldn't be static...

http://slf4j.org/faq.html#declared_static

...the majority of the pros for non-static usage don't really apply to Solr, 
while the pros for static usage due.

Another lucene/solr specific pro in favor of static variables for loggers is 
the way our test framework looks for memory leaks in tests.  Having a simple 
test that does not null out a static reference to what seems like a small 
object is typically fine -- but if that small object has an explicit 
(non-static) reference to a Logger, all of the state in that Logger is counted 
as part of the size of that small object leading to confusion.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 259 - Failure

2013-05-16 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/259/

All tests passed

Build Log:
[...truncated 1578 lines...]
[javac] Compiling 392 source files to 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build/analysis/common/classes/java
[javac] 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/common/src/java/org/apache/lucene/analysis/position/PositionFilter.java:25:
 package org.apache.lucene.queryparser.classic does not exist
[javac] import org.apache.lucene.queryparser.classic.QueryParser;
[javac] ^
[javac] 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/common/src/java/org/apache/lucene/analysis/synonym/SynonymFilterFactory.java:86:
 warning: [dep-ann] deprecated item is not annotated with @Deprecated
[javac]   TokenFilterFactory getDelegator() {
[javac]  ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] 1 error

[...truncated 1 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:390:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:363:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:39:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build.xml:549:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1827:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/build.xml:99:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/build.xml:38:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/module-build.xml:58:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:489:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1626:
 Compile failed; see the compiler error output for details.

Total time: 36 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1621 - Still Failing

2013-05-16 Thread Chris Hostetter

: What's a little odd is that this should work exactly as it did before we 

It just occured to me that one thing rmuir and i noticed in IRC never made 
it into email or my jira comments: the Logger used by SolrRequestParsers 
is not static, so the mem estimator would count that as ram used by the 
object itself.

I opened SOLR-4833 to audit all non-static Logger usage to try and 
mitigate this type of failure in the future -- but that's still just 
addressing the visible symptom that alerted us to (what i consider) the 
more alarming problem: how big the Logger can get.



-Hoss

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b89) - Build # 5624 - Still Failing!

2013-05-16 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/5624/
Java: 32bit/jdk1.8.0-ea-b89 -client -XX:+UseG1GC

All tests passed

Build Log:
[...truncated 1435 lines...]
[javac] Compiling 392 source files to 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/classes/java
[javac] 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/common/src/java/org/apache/lucene/analysis/position/PositionFilter.java:25:
 error: package org.apache.lucene.queryparser.classic does not exist
[javac] import org.apache.lucene.queryparser.classic.QueryParser;
[javac] ^
[javac] 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/common/src/java/org/apache/lucene/analysis/nl/DutchStemmer.java:42:
 warning: [rawtypes] found raw type: Map
[javac]   private Map _stemDict;
[javac]   ^
[javac]   missing type arguments for generic class MapK,V
[javac]   where K,V are type-variables:
[javac] K extends Object declared in interface Map
[javac] V extends Object declared in interface Map
[javac] 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/common/src/java/org/apache/lucene/analysis/nl/DutchStemmer.java:408:
 warning: [rawtypes] found raw type: Map
[javac]   void setStemDictionary(Map dict) {
[javac]  ^
[javac]   missing type arguments for generic class MapK,V
[javac]   where K,V are type-variables:
[javac] K extends Object declared in interface Map
[javac] V extends Object declared in interface Map
[javac] 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/common/src/java/org/tartarus/snowball/Among.java:46:
 warning: [rawtypes] found raw type: Class
[javac]   private static final Class?[] EMPTY_PARAMS = new Class[0];
[javac]  ^
[javac]   missing type arguments for generic class ClassT
[javac]   where T is a type-variable:
[javac] T extends Object declared in class Class
[javac] 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/common/src/java/org/apache/lucene/analysis/synonym/SynonymFilterFactory.java:86:
 warning: [dep-ann] deprecated item is not annotated with @Deprecated
[javac]   TokenFilterFactory getDelegator() {
[javac]  ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] 1 error

[...truncated 1 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:383: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:363: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:549: The 
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1827: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/build.xml:99: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/build.xml:38: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/module-build.xml:58: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:489: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1626: 
Compile failed; see the compiler error output for details.

Total time: 9 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b89 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Re: [JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 259 - Failure

2013-05-16 Thread Robert Muir
These look like serious problems? Looks like the build is broken such
that analyzers is trying to pull in queryparser

On Thu, May 16, 2013 at 1:27 PM, Apache Jenkins Server
jenk...@builds.apache.org wrote:
 Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/259/

 All tests passed

 Build Log:
 [...truncated 1578 lines...]
 [javac] Compiling 392 source files to 
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build/analysis/common/classes/java
 [javac] 
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/common/src/java/org/apache/lucene/analysis/position/PositionFilter.java:25:
  package org.apache.lucene.queryparser.classic does not exist
 [javac] import org.apache.lucene.queryparser.classic.QueryParser;
 [javac] ^
 [javac] 
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/common/src/java/org/apache/lucene/analysis/synonym/SynonymFilterFactory.java:86:
  warning: [dep-ann] deprecated item is not annotated with @Deprecated
 [javac]   TokenFilterFactory getDelegator() {
 [javac]  ^
 [javac] Note: Some input files use or override a deprecated API.
 [javac] Note: Recompile with -Xlint:deprecation for details.
 [javac] 1 error

 [...truncated 1 lines...]
 BUILD FAILED
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:390:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:363:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:39:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build.xml:549:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1827:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/build.xml:99:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/build.xml:38:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/module-build.xml:58:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:489:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1626:
  Compile failed; see the compiler error output for details.

 Total time: 36 minutes 7 seconds
 Build step 'Invoke Ant' marked build as failure
 Archiving artifacts
 Recording test results
 Email was triggered for: Failure
 Sending email for trigger: Failure




 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 259 - Failure

2013-05-16 Thread Robert Muir
I'm testing a patch right now and then i'll commit. the trick here is
to instead use a link like this:

a href={@docRoot}/../queryparser/overview-summary.htmlQueryParser/a

(since it really applies to all queryparsers anyway).

and its ok because if something is wrong our python linkchecker will
detect it.

On Thu, May 16, 2013 at 1:43 PM, Robert Muir rcm...@gmail.com wrote:
 These look like serious problems? Looks like the build is broken such
 that analyzers is trying to pull in queryparser

 On Thu, May 16, 2013 at 1:27 PM, Apache Jenkins Server
 jenk...@builds.apache.org wrote:
 Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/259/

 All tests passed

 Build Log:
 [...truncated 1578 lines...]
 [javac] Compiling 392 source files to 
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build/analysis/common/classes/java
 [javac] 
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/common/src/java/org/apache/lucene/analysis/position/PositionFilter.java:25:
  package org.apache.lucene.queryparser.classic does not exist
 [javac] import org.apache.lucene.queryparser.classic.QueryParser;
 [javac] ^
 [javac] 
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/common/src/java/org/apache/lucene/analysis/synonym/SynonymFilterFactory.java:86:
  warning: [dep-ann] deprecated item is not annotated with @Deprecated
 [javac]   TokenFilterFactory getDelegator() {
 [javac]  ^
 [javac] Note: Some input files use or override a deprecated API.
 [javac] Note: Recompile with -Xlint:deprecation for details.
 [javac] 1 error

 [...truncated 1 lines...]
 BUILD FAILED
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:390:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:363:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:39:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build.xml:549:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1827:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/build.xml:99:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/build.xml:38:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/module-build.xml:58:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:489:
  The following error occurred while executing this line:
 /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1626:
  Compile failed; see the compiler error output for details.

 Total time: 36 minutes 7 seconds
 Build step 'Invoke Ant' marked build as failure
 Archiving artifacts
 Recording test results
 Email was triggered for: Failure
 Sending email for trigger: Failure




 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 259 - Failure

2013-05-16 Thread Chris Hostetter

: I'm testing a patch right now and then i'll commit. the trick here is
: to instead use a link like this:

i just commited a change to not use a jdoc link at all actually

that's consistent with how FilteringTokenFilter refers to the same method

: 
: a href={@docRoot}/../queryparser/overview-summary.htmlQueryParser/a
: 
: (since it really applies to all queryparsers anyway).
: 
: and its ok because if something is wrong our python linkchecker will
: detect it.
: 
: On Thu, May 16, 2013 at 1:43 PM, Robert Muir rcm...@gmail.com wrote:
:  These look like serious problems? Looks like the build is broken such
:  that analyzers is trying to pull in queryparser
: 
:  On Thu, May 16, 2013 at 1:27 PM, Apache Jenkins Server
:  jenk...@builds.apache.org wrote:
:  Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/259/
: 
:  All tests passed
: 
:  Build Log:
:  [...truncated 1578 lines...]
:  [javac] Compiling 392 source files to 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build/analysis/common/classes/java
:  [javac] 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/common/src/java/org/apache/lucene/analysis/position/PositionFilter.java:25:
 package org.apache.lucene.queryparser.classic does not exist
:  [javac] import org.apache.lucene.queryparser.classic.QueryParser;
:  [javac] ^
:  [javac] 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/common/src/java/org/apache/lucene/analysis/synonym/SynonymFilterFactory.java:86:
 warning: [dep-ann] deprecated item is not annotated with @Deprecated
:  [javac]   TokenFilterFactory getDelegator() {
:  [javac]  ^
:  [javac] Note: Some input files use or override a deprecated API.
:  [javac] Note: Recompile with -Xlint:deprecation for details.
:  [javac] 1 error
: 
:  [...truncated 1 lines...]
:  BUILD FAILED
:  
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:390:
 The following error occurred while executing this line:
:  
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:363:
 The following error occurred while executing this line:
:  
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:39:
 The following error occurred while executing this line:
:  
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build.xml:549:
 The following error occurred while executing this line:
:  
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1827:
 The following error occurred while executing this line:
:  
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/build.xml:99:
 The following error occurred while executing this line:
:  
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/analysis/build.xml:38:
 The following error occurred while executing this line:
:  
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/module-build.xml:58:
 The following error occurred while executing this line:
:  
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:489:
 The following error occurred while executing this line:
:  
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1626:
 Compile failed; see the compiler error output for details.
: 
:  Total time: 36 minutes 7 seconds
:  Build step 'Invoke Ant' marked build as failure
:  Archiving artifacts
:  Recording test results
:  Email was triggered for: Failure
:  Sending email for trigger: Failure
: 
: 
: 
: 
:  -
:  To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
:  For additional commands, e-mail: dev-h...@lucene.apache.org
: 
: -
: To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
: For additional commands, e-mail: dev-h...@lucene.apache.org
: 
: 

-Hoss

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



documentation-lint warning

2013-05-16 Thread Robert Muir
FYI we currently have:

 [exec] Crawl/parse...
 [exec]
 [exec]   
file:///build/docs/analyzers-common/org/apache/lucene/analysis/util/FilteringTokenFilter.html
 [exec] WARNING: anchor version appears more than once


I forget why this is a warning and not a hard fail, but we should
probably investigate: it seems wrong.

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 259 - Failure

2013-05-16 Thread Robert Muir
On Thu, May 16, 2013 at 1:53 PM, Chris Hostetter
hossman_luc...@fucit.org wrote:

 : I'm testing a patch right now and then i'll commit. the trick here is
 : to instead use a link like this:

 i just commited a change to not use a jdoc link at all actually

 that's consistent with how FilteringTokenFilter refers to the same method

ok, you can remove my link if you want.

at least i fixed the method name to be the right one :)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: svn commit: r1483459 - /lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py

2013-05-16 Thread Steve Rowe
Thanks Mike!

I had arrived at the same fix, but didnt' commit because the smoke tester was 
also complaining (after running for 30 minutes) about Solr's NOTICE.txt not 
having a verbatim copy of Lucene's NOTICE.txt - this is as a result of my 
changing the text in Lucene's NOTICE.txt about servlet-api.jar to include 
javax.servlet-*.jar.

Tracking down why this was still true after copy/pasting Lucene's into Solr's 
took a while - after I had the smoke tester print out the things it was 
comparing, I realized that it wasn't comparing my local changes, but rather the 
committed changes…

Anyway, I've committed a change to Solr's NOTICE.txt to make it a verbatim copy 
of Lucene's NOTICE.txt, and I'm running the smoke tester again after committing.

Steve

On May 16, 2013, at 1:19 PM, mikemcc...@apache.org wrote:

 Author: mikemccand
 Date: Thu May 16 17:18:59 2013
 New Revision: 1483459
 
 URL: http://svn.apache.org/r1483459
 Log:
 allow javax.servlet exception in lucene/replicator
 
 Modified:
lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py
 
 Modified: lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py
 URL: 
 http://svn.apache.org/viewvc/lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py?rev=1483459r1=1483458r2=1483459view=diff
 ==
 --- lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py (original)
 +++ lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py Thu May 16 
 17:18:59 2013
 @@ -265,6 +265,9 @@ def checkAllJARs(topDir, project, svnRev
   if normRoot.endswith('/contrib/dataimporthandler/lib') and 
 (file.startswith('mail-') or file.startswith('activation-')):
 print('  **WARNING**: skipping check of %s/%s: it has javax.* 
 classes' % (root, file))
 continue
 +else:
 +  if normRoot.endswith('/replicator/lib') and 
 file.startswith('javax.servlet'):
 +continue
 fullPath = '%s/%s' % (root, file)
 noJavaPackageClasses('JAR file %s' % fullPath, fullPath)
 if file.lower().find('lucene') != -1 or file.lower().find('solr') != 
 -1:
 
 


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4989) Hanging on DocumentsWriterStallControl.waitIfStalled forever

2013-05-16 Thread Jessica Cheng (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659825#comment-13659825
 ] 

Jessica Cheng commented on LUCENE-4989:
---

Thanks for the quick replies guys. Simon, no, there wasn't any blocked threads 
(it would have made tracking the problem down easier :)).

 Hanging on DocumentsWriterStallControl.waitIfStalled forever
 

 Key: LUCENE-4989
 URL: https://issues.apache.org/jira/browse/LUCENE-4989
 Project: Lucene - Core
  Issue Type: Bug
  Components: core/index
Affects Versions: 4.1
 Environment: Linux 2.6.32
Reporter: Jessica Cheng
  Labels: hang
 Fix For: 5.0, 4.3.1


 In an environment where our underlying storage was timing out on various 
 operations, we find all of our indexing threads eventually stuck in the 
 following state (so far for 4 days):
 Thread-0 daemon prio=5 Thread id=556  WAITING
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:503)
   at 
 org.apache.lucene.index.DocumentsWriterStallControl.waitIfStalled(DocumentsWriterStallControl.java:74)
   at 
 org.apache.lucene.index.DocumentsWriterFlushControl.waitIfStalled(DocumentsWriterFlushControl.java:676)
   at 
 org.apache.lucene.index.DocumentsWriter.preUpdate(DocumentsWriter.java:301)
   at 
 org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:361)
   at 
 org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1484)
   at ...
 I have not yet enabled detail logging and tried to reproduce yet, but looking 
 at the code, I see that DWFC.abortPendingFlushes does
 try {
   dwpt.abort();
   doAfterFlush(dwpt);
 } catch (Throwable ex) {
   // ignore - keep on aborting the flush queue
 }
 (and the same for the blocked ones). Since the throwable is ignored, I can't 
 say for sure, but I've seen DWPT.abort thrown in other cases, so if it does 
 throw, we'd fail to call doAfterFlush and properly decrement flushBytes. This 
 can be a problem, right? Is it possible to do this instead:
 try {
   dwpt.abort();
 } catch (Throwable ex) {
   // ignore - keep on aborting the flush queue
 } finally {
   try {
 doAfterFlush(dwpt);
   } catch (Throwable ex2) {
 // ignore - keep on aborting the flush queue
   }
 }
 It's ugly but safer. Otherwise, maybe at least add logging for the throwable 
 just to make sure this is/isn't happening.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: svn commit: r1483459 - /lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py

2013-05-16 Thread Steve Rowe
BUILD SUCCESSFUL on branch_4x for me - hopefully these javax.servlet issues are 
all cleared up now. - Steve

On May 16, 2013, at 2:34 PM, Steve Rowe sar...@gmail.com wrote:

 Thanks Mike!
 
 I had arrived at the same fix, but didnt' commit because the smoke tester was 
 also complaining (after running for 30 minutes) about Solr's NOTICE.txt not 
 having a verbatim copy of Lucene's NOTICE.txt - this is as a result of my 
 changing the text in Lucene's NOTICE.txt about servlet-api.jar to include 
 javax.servlet-*.jar.
 
 Tracking down why this was still true after copy/pasting Lucene's into Solr's 
 took a while - after I had the smoke tester print out the things it was 
 comparing, I realized that it wasn't comparing my local changes, but rather 
 the committed changes…
 
 Anyway, I've committed a change to Solr's NOTICE.txt to make it a verbatim 
 copy of Lucene's NOTICE.txt, and I'm running the smoke tester again after 
 committing.
 
 Steve
 
 On May 16, 2013, at 1:19 PM, mikemcc...@apache.org wrote:
 
 Author: mikemccand
 Date: Thu May 16 17:18:59 2013
 New Revision: 1483459
 
 URL: http://svn.apache.org/r1483459
 Log:
 allow javax.servlet exception in lucene/replicator
 
 Modified:
   lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py
 
 Modified: lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py
 URL: 
 http://svn.apache.org/viewvc/lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py?rev=1483459r1=1483458r2=1483459view=diff
 ==
 --- lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py (original)
 +++ lucene/dev/trunk/dev-tools/scripts/smokeTestRelease.py Thu May 16 
 17:18:59 2013
 @@ -265,6 +265,9 @@ def checkAllJARs(topDir, project, svnRev
  if normRoot.endswith('/contrib/dataimporthandler/lib') and 
 (file.startswith('mail-') or file.startswith('activation-')):
print('  **WARNING**: skipping check of %s/%s: it has javax.* 
 classes' % (root, file))
continue
 +else:
 +  if normRoot.endswith('/replicator/lib') and 
 file.startswith('javax.servlet'):
 +continue
fullPath = '%s/%s' % (root, file)
noJavaPackageClasses('JAR file %s' % fullPath, fullPath)
if file.lower().find('lucene') != -1 or file.lower().find('solr') != 
 -1:
 
 
 


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 472 - Still Failing!

2013-05-16 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/472/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC

All tests passed

Build Log:
[...truncated 9133 lines...]
[junit4:junit4] ERROR: JVM J0 ended with an exception, command line: 
/Library/Java/JavaVirtualMachines/jdk1.7.0_21.jdk/Contents/Home/jre/bin/java 
-XX:-UseCompressedOops -XX:+UseParallelGC -XX:+HeapDumpOnOutOfMemoryError 
-XX:HeapDumpPath=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/heapdumps
 -Dtests.prefix=tests -Dtests.seed=CEB10A8207D7EFB0 -Xmx512M -Dtests.iters= 
-Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random 
-Dtests.postingsformat=random -Dtests.docvaluesformat=random 
-Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random 
-Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=5.0 
-Dtests.cleanthreads=perClass 
-Djava.util.logging.config.file=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/tools/junit4/logging.properties
 -Dtests.nightly=false -Dtests.weekly=false -Dtests.slow=true 
-Dtests.asserts.gracious=false -Dtests.multiplier=1 -DtempDir=. 
-Djava.io.tmpdir=. 
-Djunit4.tempDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/temp
 
-Dclover.db.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/clover/db
 -Djava.security.manager=org.apache.lucene.util.TestSecurityManager 
-Djava.security.policy=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/tools/junit4/tests.policy
 -Dlucene.version=5.0-SNAPSHOT -Djetty.testMode=1 -Djetty.insecurerandom=1 
-Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory 
-Djava.awt.headless=true -Dfile.encoding=UTF-8 -classpath 

Implementing a reader over Accumulo and FieldNorms type?

2013-05-16 Thread Ed Kohlwey
I'm experimenting with an IndexReader design over Accumulo and am wondering
what valid DocValues types are for norms in the FieldInfo constructor.

The actual fieldNorms method returns a numericDocValues, and norms have
historically always been numeric values. Is numeric the only valid type
here or are there other valid types? What is the point of this option?


[jira] [Commented] (SOLR-1093) A RequestHandler to run multiple queries in a batch

2013-05-16 Thread yuanyun.cn (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659915#comment-13659915
 ] 

yuanyun.cn commented on SOLR-1093:
--

Just found one small issue in the code.
If we put several fq for one query, only one will be used, for example: 
1.fq=datatype:41.fq=filetype:pdf.

To fix this, just need change code below:
org.apache.solr.handler.component.MultiSearchHandler.initRequestParams(SolrQueryRequest,
 VectorSimpleOrderedMapObject, SimpleOrderedMapObject)
+int startPos = paramName.indexOf('.') + 1;
+localRequestParams.elementAt(queryId - 1).add(
+paramName.substring(startPos), reqParams.get(paramName));


Should be changed to:
int startPos = paramName.indexOf('.') + 1;

String[] paramsValues = reqParams.getParams(paramName);
if(paramsValues!=null)
{
  for(String value: paramsValues)
  {
localRequestParams.elementAt(queryId - 1).add(
paramName.substring(startPos),value);
  }


 A RequestHandler to run multiple queries in a batch
 ---

 Key: SOLR-1093
 URL: https://issues.apache.org/jira/browse/SOLR-1093
 Project: Solr
  Issue Type: New Feature
  Components: search
Reporter: Noble Paul
Assignee: Simon Willnauer
 Attachments: SOLR-1093.patch


 It is a common requirement that a single page requires to fire multiple 
 queries .In cases where these queries are independent of each other. If there 
 is a handler which can take in multiple queries , run them in paralll and 
 send the response as one big chunk it would be useful
 Let us say the handler is  MultiRequestHandler
 {code}
 requestHandler name=/multi class=solr.MultiRequestHandler/
 {code}
 h2.Query Syntax
 The request must specify the no:of queries as count=n
 Each request parameter must be prefixed with a number which denotes the query 
 index.optionally ,it may can also specify the handler name.
 example
 {code}
 /multi?count=21.handler=/select1.q=a:b2.handler=/select2.q=a:c
 {code}
 default handler can be '/select' so the equivalent can be
 {code} 
 /multi?count=21.q=a:b2.q=a:c
 {code}
 h2.The response
 The response will be a ListNamedList where each NamedList will be a 
 response to a query. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4816) Change CloudSolrServer to send updates to the correct shard

2013-05-16 Thread Joel Bernstein (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joel Bernstein updated SOLR-4816:
-

Attachment: SOLR-4816.patch

To get the existing tests to run I needed to limit the directUpdates to only 
UpdateRequests that have document lists. 

All other requests bypass the directUpdates method and follow the main flow.

Currently UpdateRequestExt also bypasses the directUpdates method and follows 
the main flow. There is a TODO in the UpdateRequestExt class to bake it into 
the UpdateRequest class. This would be a cleaner approach to getting 
UpdateRequestExt to work with directUpdates.





 Change CloudSolrServer to send updates to the correct shard
 ---

 Key: SOLR-4816
 URL: https://issues.apache.org/jira/browse/SOLR-4816
 Project: Solr
  Issue Type: Improvement
  Components: SolrCloud
Affects Versions: 4.3
Reporter: Joel Bernstein
Priority: Minor
 Attachments: SOLR-4816.patch, SOLR-4816.patch, SOLR-4816.patch, 
 SOLR-4816.patch, SOLR-4816.patch, SOLR-4816-sriesenberg.patch


 This issue changes CloudSolrServer so it routes update requests to the 
 correct shard. This would be a nice feature to have to eliminate the document 
 routing overhead on the Solr servers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (SOLR-4831) Transaction logs are leaking

2013-05-16 Thread Steven Bower (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steven Bower resolved SOLR-4831.


Resolution: Duplicate

 Transaction logs are leaking
 

 Key: SOLR-4831
 URL: https://issues.apache.org/jira/browse/SOLR-4831
 Project: Solr
  Issue Type: Bug
Reporter: Steven Bower

 We have a system in which a client is sending 1 record at a time (via REST) 
 followed by a commit. This has produced ~65k tlog files and the JVM has run 
 out of file descriptors... I grabbed a heap dump from the JVM and I can see 
 ~52k unreachable FileDescriptors... This leads me to believe that the 
 TransactionLog is not properly closing all of it's files before getting rid 
 of the object... 
 I've verified with lsof that indeed there are ~60k tlog files that are open 
 currently..
 This is Solr 4.3.0

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4829) transaction log reference leak

2013-05-16 Thread Steven Bower (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659947#comment-13659947
 ] 

Steven Bower commented on SOLR-4829:


I patched my 4.3.0 install with the attached patch on a solr instance with my 
broken index that was causing this issue to begin with and i see that the tlog 
files are limited to 10 files properly and I am not building up orphaned 
FileDescriptors any more. Additionally I've verified with lsof that the tlog 
isn't leaking open file...

 transaction log reference leak
 --

 Key: SOLR-4829
 URL: https://issues.apache.org/jira/browse/SOLR-4829
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.1
Reporter: Yonik Seeley
Assignee: Yonik Seeley
 Fix For: 5.0, 4.3.1

 Attachments: SOLR-4829.patch, SOLR-4829.patch, SOLR-4829.patch


 Failure to dereference tlogs or RecentUpdates can cause old transaction logs 
 to never be closed  deleted.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4816) Change CloudSolrServer to send updates to the correct shard

2013-05-16 Thread Joel Bernstein (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659950#comment-13659950
 ] 

Joel Bernstein commented on SOLR-4816:
--

Existing tests now run with latest patch. Still need to add tests for the new 
directUpdate functionality.

 Change CloudSolrServer to send updates to the correct shard
 ---

 Key: SOLR-4816
 URL: https://issues.apache.org/jira/browse/SOLR-4816
 Project: Solr
  Issue Type: Improvement
  Components: SolrCloud
Affects Versions: 4.3
Reporter: Joel Bernstein
Priority: Minor
 Attachments: SOLR-4816.patch, SOLR-4816.patch, SOLR-4816.patch, 
 SOLR-4816.patch, SOLR-4816.patch, SOLR-4816-sriesenberg.patch


 This issue changes CloudSolrServer so it routes update requests to the 
 correct shard. This would be a nice feature to have to eliminate the document 
 routing overhead on the Solr servers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (SOLR-4823) Split LBHttpSolrServer into two classes one for the solrj use case and one for the solr cloud use case

2013-05-16 Thread philip hoy (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659604#comment-13659604
 ] 

philip hoy edited comment on SOLR-4823 at 5/16/13 8:40 PM:
---

Here is a first stab at a refactoring, it is without any additional test 
coverage at present and may well be a bit too much to swallow. However I am 
happy to revisit it. 

Interestingly moving the cloud load balancing code out of LBHttpSolrServer did 
not affect any tests so perhaps that use case could do with some extra test 
coverage regardless of this patch.


  was (Author: phloy):
Here is a first stab at a refactoring, it is without any additional test 
coverage at present and may well be a bit too much to swallow. However I am 
happy to revisit it. 

Interestingly moving the cloud load balancing code out of LBHttpSolrServer did 
not affect any tests so perhaps that use case could do with some extra test 
coverage.

  
 Split LBHttpSolrServer into two classes one for the solrj use case and one 
 for the solr cloud use case
 --

 Key: SOLR-4823
 URL: https://issues.apache.org/jira/browse/SOLR-4823
 Project: Solr
  Issue Type: Improvement
  Components: SolrCloud
Reporter: philip hoy
Priority: Minor
 Attachments: SOLR-4823.patch


 The LBHttpSolrServer has too many responsibilities. It could perhaps be 
 broken into two classes, one in solrj to be used in the place of an external 
 load balancer that balances across a known set of solr servers defined at 
 construction time and one in solr core to be used by the solr cloud 
 components that balances across servers dependant on the request.
 To save code duplication, if much arises an abstract bass class could be 
 introduced in to solrj.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.6.0) - Build # 459 - Still Failing!

2013-05-16 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/459/
Java: 64bit/jdk1.6.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.lucene.replicator.http.HttpReplicatorTest.testBasic

Error Message:
Connection to http://localhost:49252 refused

Stack Trace:
org.apache.http.conn.HttpHostConnectException: Connection to 
http://localhost:49252 refused
at 
__randomizedtesting.SeedInfo.seed([1FE42A255BC02A46:B41E3730841CAC68]:0)
at 
org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:190)
at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
at 
org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
at 
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
at 
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
at 
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
at 
org.apache.lucene.replicator.http.HttpClientBase.executeGET(HttpClientBase.java:178)
at 
org.apache.lucene.replicator.http.HttpReplicator.checkForUpdate(HttpReplicator.java:51)
at 
org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:196)
at 
org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:402)
at 
org.apache.lucene.replicator.http.HttpReplicatorTest.testBasic(HttpReplicatorTest.java:110)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)

Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1621 - Still Failing

2013-05-16 Thread Dawid Weiss
 is not static, so the mem estimator would count that as ram used by the
 object itself.

The estimation actually includes static fields -- if it didn't you
could easily overflow memory simply by allocating static byte[]
buffers or something else. Object-level fields are garbage collected
because the reference is released after the test (unless something
else keeps it; there is no way to tell). Take a look at the LTC:

.around(new StaticFieldsInvariantRule(STATIC_LEAK_THRESHOLD, true) {
  @Override
  protected boolean accept(java.lang.reflect.Field field) {
// Don't count known classes that consume memory once.
if (STATIC_LEAK_IGNORED_TYPES.contains(field.getType().getName())) {
  return false;
}
// Don't count references from ourselves, we're top-level.
if (field.getDeclaringClass() == LuceneTestCase.class) {
  return false;
}
return super.accept(field);
  }
})

Dawid

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1621 - Still Failing

2013-05-16 Thread Chris Hostetter
:  is not static, so the mem estimator would count that as ram used by the
:  object itself.
: 
: The estimation actually includes static fields -- if it didn't you
: could easily overflow memory simply by allocating static byte[]

But clearly there is a diff between statics in the tests, and statics in 
classes of objects held onto by the test -- otherwise we should have 
started seeing way more clean up your statics failures then this when 
the Logger changes got committed.

this test seemed to be the touchstone because...

 * the test maintained a static, un-nulled out, SolrRequestParser
 * SolrRequestParser instance have non-static refrences to a Logger

...surely if the SolrRequestParser *class* had a static var the Logger 
(instead of an instance var) that wouldn't have counted against the amount 
of memory being used by the SolrRequestParser ?

i mean ... if the static vars in every class were counted against the 
objects of that class, the RAM estimater would be virtually useless.


-Hoss

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4829) transaction log reference leak

2013-05-16 Thread Yonik Seeley (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659996#comment-13659996
 ] 

Yonik Seeley commented on SOLR-4829:


Thanks for verifying Steven!
Committed to trunk, 4x, 4.3.1

 transaction log reference leak
 --

 Key: SOLR-4829
 URL: https://issues.apache.org/jira/browse/SOLR-4829
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.1
Reporter: Yonik Seeley
Assignee: Yonik Seeley
 Fix For: 5.0, 4.3.1

 Attachments: SOLR-4829.patch, SOLR-4829.patch, SOLR-4829.patch


 Failure to dereference tlogs or RecentUpdates can cause old transaction logs 
 to never be closed  deleted.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (SOLR-4829) transaction log reference leak

2013-05-16 Thread Yonik Seeley (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yonik Seeley resolved SOLR-4829.


   Resolution: Fixed
Fix Version/s: 4.4

 transaction log reference leak
 --

 Key: SOLR-4829
 URL: https://issues.apache.org/jira/browse/SOLR-4829
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.1
Reporter: Yonik Seeley
Assignee: Yonik Seeley
 Fix For: 5.0, 4.4, 4.3.1

 Attachments: SOLR-4829.patch, SOLR-4829.patch, SOLR-4829.patch


 Failure to dereference tlogs or RecentUpdates can cause old transaction logs 
 to never be closed  deleted.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1621 - Still Failing

2013-05-16 Thread Dawid Weiss
 ...surely if the SolrRequestParser *class* had a static var the Logger
 (instead of an instance var) that wouldn't have counted against the amount
 of memory being used by the SolrRequestParser ?

No, it wouldn't. We collect static fields from the suite class and
then traverse the object graph from these (but don't count static
fields again).

https://github.com/carrotsearch/randomizedtesting/blob/master/randomized-runner/src/main/java/com/carrotsearch/randomizedtesting/rules/StaticFieldsInvariantRule.java#L91

Perhaps I should add an option to dump the heaviest objects (not just
fields) from that total graph estimator.

D.

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1621 - Still Failing

2013-05-16 Thread Chris Hostetter

:  ...surely if the SolrRequestParser *class* had a static var the Logger
:  (instead of an instance var) that wouldn't have counted against the amount
:  of memory being used by the SolrRequestParser ?
: 
: No, it wouldn't. We collect static fields from the suite class and
: then traverse the object graph from these (but don't count static
: fields again).

Now i'm completley confused.  i said...

the Logger used by SolrRequestParsers is not static, so the mem estimator 
would count that as ram used by the object itself. 

(the object in question being the SolrRequestParsers instance)

Then you said...

The estimation actually includes static fields

...it appeared that you were refering to static fields in the classes of 
hte objects ithe estimation was asked to look at (ie: the 
SolrRequestParsers class), but now i get the sense that you were refering 
to static fields in the test -- which was never in question, all of the 
fields listed in teh failure message are obviously static fields in the 
test class.


So i think my initial understanding was correct, and we are just 
confusing eachother and talking in circles?


-Hoss

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1621 - Still Failing

2013-05-16 Thread Dawid Weiss
 The estimation actually includes static fields

Yeah, I probably misunderstood something along the way, apologies.
When you look at the code I linked to things are pretty simple:

1) collect values of static fields from the test suite class (and its
superclasses),
2) for non-null values, estimate the RAM used by those objects and
their referenced graph of objects.

I think your understanding was correct (? :)

Dawid

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Edit permission for Lucene and Solr wikis' ContributorsGroup pages

2013-05-16 Thread Steve Rowe
FYI: After consultation with the PMC, I've moved all committers from 
ContributorsGroup to AdminGroup, the idea being that all committers should be 
able to add people to ContributorsGroup.

This change affected just three people: Christian Moen, Shalin Mangar (who's 
now on the PMC anyway), and Shawn Heisey.

Please let me know if I've missed anybody.

Thanks,
Steve


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_21) - Build # 2827 - Still Failing!

2013-05-16 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/2827/
Java: 64bit/jdk1.7.0_21 -XX:+UseCompressedOops -XX:+UseParallelGC

5 tests failed.
FAILED:  
org.apache.solr.client.solrj.embedded.TestEmbeddedSolrServer.testShutdown

Error Message:


Stack Trace:
org.apache.solr.common.SolrException: 
at 
__randomizedtesting.SeedInfo.seed([BC53272C0441EB7A:5F252EB9E33B7E08]:0)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:262)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:219)
at org.apache.solr.core.CoreContainer.init(CoreContainer.java:149)
at 
org.apache.solr.client.solrj.embedded.AbstractEmbeddedSolrServerTestCase.setUp(AbstractEmbeddedSolrServerTestCase.java:64)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:771)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.io.IOException: The filename, directory name, or volume label 
syntax is incorrect
at java.io.WinNTFileSystem.canonicalize0(Native Method)
at java.io.Win32FileSystem.canonicalize(Win32FileSystem.java:414)
at java.io.File.getCanonicalPath(File.java:589)
at 

[jira] [Commented] (SOLR-3076) Solr should support block joins

2013-05-16 Thread Tom Burton-West (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660124#comment-13660124
 ] 

Tom Burton-West commented on SOLR-3076:
---


I'd like to test this out with some real data and would like to use the 
XmlUpdateRequestHandler.  Since  SOLR-3535 was folded in here, I looked here to 
try to find the XML syntax to use. I couldn't tell from a quick read of the 
code what the XML syntax would be to actually use to add a parent and children. 
  Would it be possible to add a test similar to 
solr/core/src/test/org.apache.solr.handler/XmlUpdateRequestHandlerTest?

I would assume all that the xml in XmlUpdateRequestHandlerTest could be 
replaced with the proper xml to index a block consisting of a parent and its 
children

i.e in the test replace:
String xml = 
  doc boost=\5.5\ +
field name=\id\ boost=\2.2\12345/field +
field name=\name\kitten/field +
field name=\cat\ boost=\3\aaa/field +
field name=\cat\ boost=\4\bbb/field +
field name=\cat\ boost=\5\bbb/field +
field name=\ab\aamp;b/field +
  /doc;

with whatever xml is needed to index a block (parent and children).



 Solr should support block joins
 ---

 Key: SOLR-3076
 URL: https://issues.apache.org/jira/browse/SOLR-3076
 Project: Solr
  Issue Type: New Feature
Reporter: Grant Ingersoll
 Fix For: 5.0, 4.4

 Attachments: 27M-singlesegment-histogram.png, 27M-singlesegment.png, 
 bjq-vs-filters-backward-disi.patch, bjq-vs-filters-illegal-state.patch, 
 child-bjqparser.patch, dih-3076.patch, dih-config.xml, 
 parent-bjq-qparser.patch, parent-bjq-qparser.patch, Screen Shot 2012-07-17 at 
 1.12.11 AM.png, SOLR-3076-childDocs.patch, SOLR-3076.patch, SOLR-3076.patch, 
 SOLR-3076.patch, SOLR-3076.patch, SOLR-3076.patch, SOLR-3076.patch, 
 solrconf-bjq-erschema-snippet.xml, solrconfig.xml.patch, 
 tochild-bjq-filtered-search-fix.patch


 Lucene has the ability to do block joins, we should add it to Solr.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4751) The replication problem of the file in a subdirectory.

2013-05-16 Thread Koji Sekiguchi (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660197#comment-13660197
 ] 

Koji Sekiguchi commented on SOLR-4751:
--

Looks good! I'll commit shortly.

 The replication problem of the file in a subdirectory.
 --

 Key: SOLR-4751
 URL: https://issues.apache.org/jira/browse/SOLR-4751
 Project: Solr
  Issue Type: Bug
  Components: replication (java)
Affects Versions: 4.2.1
Reporter: Minoru Osuka
Assignee: Koji Sekiguchi
Priority: Minor
 Attachments: SOLR-4751.patch, SOLR-4751.patch


 When set lang/stopwords_ja.txt to confFiles in replication settings,
 {code:xml}
   requestHandler name=/replication class=solr.ReplicationHandler 
lst name=master
  str name=replicateAftercommit/str
  str name=replicateAfterstartup/str
  str 
 name=confFilesschema.xml,stopwords.txt,lang/stopwords_ja.txt/str
/lst
   /requestHandler
 {code}
 Only stopwords_ja.txt exists in solr/collection1/conf/lang directory on slave 
 node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4751) The replication problem of the file in a subdirectory.

2013-05-16 Thread Koji Sekiguchi (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Koji Sekiguchi updated SOLR-4751:
-

Fix Version/s: 4.3.1
   4.4
   5.0

 The replication problem of the file in a subdirectory.
 --

 Key: SOLR-4751
 URL: https://issues.apache.org/jira/browse/SOLR-4751
 Project: Solr
  Issue Type: Bug
  Components: replication (java)
Affects Versions: 4.2.1
Reporter: Minoru Osuka
Assignee: Koji Sekiguchi
Priority: Minor
 Fix For: 5.0, 4.4, 4.3.1

 Attachments: SOLR-4751.patch, SOLR-4751.patch


 When set lang/stopwords_ja.txt to confFiles in replication settings,
 {code:xml}
   requestHandler name=/replication class=solr.ReplicationHandler 
lst name=master
  str name=replicateAftercommit/str
  str name=replicateAfterstartup/str
  str 
 name=confFilesschema.xml,stopwords.txt,lang/stopwords_ja.txt/str
/lst
   /requestHandler
 {code}
 Only stopwords_ja.txt exists in solr/collection1/conf/lang directory on slave 
 node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (SOLR-4751) The replication problem of the file in a subdirectory.

2013-05-16 Thread Koji Sekiguchi (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Koji Sekiguchi resolved SOLR-4751.
--

Resolution: Fixed

Committed on trunk, branch_4x and lucene_solr_4_3. Thanks!

 The replication problem of the file in a subdirectory.
 --

 Key: SOLR-4751
 URL: https://issues.apache.org/jira/browse/SOLR-4751
 Project: Solr
  Issue Type: Bug
  Components: replication (java)
Affects Versions: 4.2.1
Reporter: Minoru Osuka
Assignee: Koji Sekiguchi
Priority: Minor
 Fix For: 5.0, 4.4, 4.3.1

 Attachments: SOLR-4751.patch, SOLR-4751.patch


 When set lang/stopwords_ja.txt to confFiles in replication settings,
 {code:xml}
   requestHandler name=/replication class=solr.ReplicationHandler 
lst name=master
  str name=replicateAftercommit/str
  str name=replicateAfterstartup/str
  str 
 name=confFilesschema.xml,stopwords.txt,lang/stopwords_ja.txt/str
/lst
   /requestHandler
 {code}
 Only stopwords_ja.txt exists in solr/collection1/conf/lang directory on slave 
 node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4751) The replication problem of the file in a subdirectory.

2013-05-16 Thread Minoru Osuka (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660264#comment-13660264
 ] 

Minoru Osuka commented on SOLR-4751:


Sekiguchi-san,

Thank you so much for your help!

 The replication problem of the file in a subdirectory.
 --

 Key: SOLR-4751
 URL: https://issues.apache.org/jira/browse/SOLR-4751
 Project: Solr
  Issue Type: Bug
  Components: replication (java)
Affects Versions: 4.2.1
Reporter: Minoru Osuka
Assignee: Koji Sekiguchi
Priority: Minor
 Fix For: 5.0, 4.4, 4.3.1

 Attachments: SOLR-4751.patch, SOLR-4751.patch


 When set lang/stopwords_ja.txt to confFiles in replication settings,
 {code:xml}
   requestHandler name=/replication class=solr.ReplicationHandler 
lst name=master
  str name=replicateAftercommit/str
  str name=replicateAfterstartup/str
  str 
 name=confFilesschema.xml,stopwords.txt,lang/stopwords_ja.txt/str
/lst
   /requestHandler
 {code}
 Only stopwords_ja.txt exists in solr/collection1/conf/lang directory on slave 
 node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-4834) Surround QParser should enable query text analysis

2013-05-16 Thread Isaac Hebsh (JIRA)
Isaac Hebsh created SOLR-4834:
-

 Summary: Surround QParser should enable query text analysis
 Key: SOLR-4834
 URL: https://issues.apache.org/jira/browse/SOLR-4834
 Project: Solr
  Issue Type: Improvement
  Components: query parsers
Affects Versions: 4.3
Reporter: Isaac Hebsh
 Fix For: 5.0, 4.4


When using surround query parser, the query terms are not being analyzed. The 
basic example is lower case, of course. This is probably an intended behaviour, 
not a bug.

I suggest one more query parameter, which determines whether to do analysis or 
not. something like this:
{code}
_query_:{!surround df=myfield analyze=true}SpinPoint 7n GB18030
{code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: documentation-lint warning

2013-05-16 Thread Adrien Grand
On Thu, May 16, 2013 at 7:55 PM, Robert Muir rcm...@gmail.com wrote:
 FYI we currently have:

  [exec] Crawl/parse...
  [exec]
  [exec]   
 file:///build/docs/analyzers-common/org/apache/lucene/analysis/util/FilteringTokenFilter.html
  [exec] WARNING: anchor version appears more than once


 I forget why this is a warning and not a hard fail, but we should
 probably investigate: it seems wrong.

The reason why there were 2 anchors named version is that javadoc
added such an anchor for the protected field called version and the
class javadocs contained another anchor named version to describe
the way FilteringTokenFilter handles the lucene match version. I
renamed the 2nd one to fix this warning.

+1 to fail hard on duplicate anchor names.

-- 
Adrien

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-1375) BloomFilter on a field

2013-05-16 Thread Isaac Hebsh (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660354#comment-13660354
 ] 

Isaac Hebsh commented on SOLR-1375:
---

Hi, I know that this issue is not active for a long while, But I could not 
understand why. What work should be done in order to make the issue resolved?

 BloomFilter on a field
 --

 Key: SOLR-1375
 URL: https://issues.apache.org/jira/browse/SOLR-1375
 Project: Solr
  Issue Type: New Feature
  Components: update
Affects Versions: 1.4
Reporter: Jason Rutherglen
Priority: Minor
 Fix For: 4.4

 Attachments: SOLR-1375.patch, SOLR-1375.patch, SOLR-1375.patch, 
 SOLR-1375.patch, SOLR-1375.patch

   Original Estimate: 120h
  Remaining Estimate: 120h

 * A bloom filter is a read only probabilistic set. Its useful
 for verifying a key exists in a set, though it returns false
 positives. http://en.wikipedia.org/wiki/Bloom_filter 
 * The use case is indexing in Hadoop and checking for duplicates
 against a Solr cluster (which when using term dictionary or a
 query) is too slow and exceeds the time consumed for indexing.
 When a match is found, the host, segment, and term are returned.
 If the same term is found on multiple servers, multiple results
 are returned by the distributed process. (We'll need to add in
 the core name I just realized). 
 * When new segments are created, and commit is called, a new
 bloom filter is generated from a given field (default:id) by
 iterating over the term dictionary values. There's a bloom
 filter file per segment, which is managed on each Solr shard.
 When segments are merged away, their corresponding .blm files is
 also removed. In a future version we'll have a central server
 for the bloom filters so we're not abusing the thread pool of
 the Solr proxy and the networking of the Solr cluster (this will
 be done sooner than later after testing this version). I held
 off because the central server requires syncing the Solr
 servers' files (which is like reverse replication). 
 * The patch uses the BloomFilter from Hadoop 0.20. I want to jar
 up only the necessary classes so we don't have a giant Hadoop
 jar in lib.
 http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/util/bloom/BloomFilter.html
 * Distributed code is added and seems to work, I extended
 TestDistributedSearch to test over multiple HTTP servers. I
 chose this approach rather than the manual method used by (for
 example) TermVectorComponent.testDistributed because I'm new to
 Solr's distributed search and wanted to learn how it works (the
 stages are confusing). Using this method, I didn't need to setup
 multiple tomcat servers and manually execute tests.
 * We need more of the bloom filter options passable via
 solrconfig
 * I'll add more test cases

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4834) Surround QParser should enable query text analysis

2013-05-16 Thread Isaac Hebsh (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Isaac Hebsh updated SOLR-4834:
--

Labels: analysis qparserplugin surround  (was: )

 Surround QParser should enable query text analysis
 --

 Key: SOLR-4834
 URL: https://issues.apache.org/jira/browse/SOLR-4834
 Project: Solr
  Issue Type: Improvement
  Components: query parsers
Affects Versions: 4.3
Reporter: Isaac Hebsh
  Labels: analysis, qparserplugin, surround
 Fix For: 5.0, 4.4


 When using surround query parser, the query terms are not being analyzed. The 
 basic example is lower case, of course. This is probably an intended 
 behaviour, not a bug.
 I suggest one more query parameter, which determines whether to do analysis 
 or not. something like this:
 {code}
 _query_:{!surround df=myfield analyze=true}SpinPoint 7n GB18030
 {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-4835) highlighting in combination with join does not work in solr 4.0 - 4.2

2013-05-16 Thread Matthias Herrmann (JIRA)
Matthias Herrmann created SOLR-4835:
---

 Summary: highlighting in combination with join does not work in 
solr 4.0 - 4.2
 Key: SOLR-4835
 URL: https://issues.apache.org/jira/browse/SOLR-4835
 Project: Solr
  Issue Type: Bug
  Components: highlighter
Affects Versions: 4.0-ALPHA
Reporter: Matthias Herrmann


q= {!join from=manu_id_s to=id}ipod
by highlighting this query it does not highlights the required field ,hence 
highlighting not works in join queries.




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4835) highlighting in combination with join does not work in solr 4.0 - 4.2

2013-05-16 Thread Matthias Herrmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matthias Herrmann updated SOLR-4835:


Description: 
I need to highlight results based on a query that contains a join operation.
I made a simple example by indexing example/exampledocs/*.xml which ships with 
standard Solr distribution. Having these documents indexed to the example 
server I run the following query:
[http://localhost:8983/solr/collection1/select?q=belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*
 ]
In the query result the section highlighting looks like:
{code}
highlighting:{
F8V7067-APL-KIT:{
  name:[emBelkin/em Mobile Power Cord for iPod w/ Dock],
  manu_id_s:[embelkin/em],
  manu:[emBelkin/em]},
IW-02:{
  manu_id_s:[embelkin/em],
  manu:[emBelkin/em]}}
{code}
So highlighting works fine. BUT when running this query: 
[http://localhost:8983/solr/collection1/select?q=\{!join+from=id+to=id\}belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*]
In the query result the section highlighting looks like:
{code}
highlighting:{
F8V7067-APL-KIT:{},
IW-02:{}}
{code}
As you can see highlighting does not work in combination with join. Is this a 
bug or am I missing something?




  was:
q= {!join from=manu_id_s to=id}ipod
by highlighting this query it does not highlights the required field ,hence 
highlighting not works in join queries.





 highlighting in combination with join does not work in solr 4.0 - 4.2
 -

 Key: SOLR-4835
 URL: https://issues.apache.org/jira/browse/SOLR-4835
 Project: Solr
  Issue Type: Bug
  Components: highlighter
Affects Versions: 4.0-ALPHA
Reporter: Matthias Herrmann
  Labels: documentation

 I need to highlight results based on a query that contains a join operation.
 I made a simple example by indexing example/exampledocs/*.xml which ships 
 with standard Solr distribution. Having these documents indexed to the 
 example server I run the following query:
 [http://localhost:8983/solr/collection1/select?q=belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*
  ]
 In the query result the section highlighting looks like:
 {code}
 highlighting:{
 F8V7067-APL-KIT:{
   name:[emBelkin/em Mobile Power Cord for iPod w/ Dock],
   manu_id_s:[embelkin/em],
   manu:[emBelkin/em]},
 IW-02:{
   manu_id_s:[embelkin/em],
   manu:[emBelkin/em]}}
 {code}
 So highlighting works fine. BUT when running this query: 
 [http://localhost:8983/solr/collection1/select?q=\{!join+from=id+to=id\}belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*]
 In the query result the section highlighting looks like:
 {code}
 highlighting:{
 F8V7067-APL-KIT:{},
 IW-02:{}}
 {code}
 As you can see highlighting does not work in combination with join. Is this a 
 bug or am I missing something?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4835) highlighting in combination with join does not work in solr 4.0 - 4.2

2013-05-16 Thread Matthias Herrmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matthias Herrmann updated SOLR-4835:


Component/s: query parsers

 highlighting in combination with join does not work in solr 4.0 - 4.2
 -

 Key: SOLR-4835
 URL: https://issues.apache.org/jira/browse/SOLR-4835
 Project: Solr
  Issue Type: Bug
  Components: highlighter, query parsers
Affects Versions: 4.0-ALPHA
Reporter: Matthias Herrmann
  Labels: documentation

 I need to highlight results based on a query that contains a join operation.
 I made a simple example by indexing example/exampledocs/*.xml which ships 
 with standard Solr distribution. Having these documents indexed to the 
 example server I run the following query:
 [http://localhost:8983/solr/collection1/select?q=belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*
  ]
 In the query result the section highlighting looks like:
 {code}
 highlighting:{
 F8V7067-APL-KIT:{
   name:[emBelkin/em Mobile Power Cord for iPod w/ Dock],
   manu_id_s:[embelkin/em],
   manu:[emBelkin/em]},
 IW-02:{
   manu_id_s:[embelkin/em],
   manu:[emBelkin/em]}}
 {code}
 So highlighting works fine. BUT when running this query: 
 [http://localhost:8983/solr/collection1/select?q=\{!join+from=id+to=id\}belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*]
 In the query result the section highlighting looks like:
 {code}
 highlighting:{
 F8V7067-APL-KIT:{},
 IW-02:{}}
 {code}
 As you can see highlighting does not work in combination with join. Is this a 
 bug or am I missing something?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4835) highlighting in combination with join does not work in solr 4.0 - 4.2

2013-05-16 Thread Matthias Herrmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matthias Herrmann updated SOLR-4835:


Description: 
I need to highlight results based on a query that contains a join operation. I 
want to highlight docs that occur in the to set which is in my 
I made a simple example by indexing example/exampledocs/*.xml which ships with 
standard Solr distribution. Having these documents indexed to the example 
server I run the following query:
[http://localhost:8983/solr/collection1/select?q=belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*
 ]
In the query result the section highlighting looks like:
{code}
highlighting:{
F8V7067-APL-KIT:{
  name:[emBelkin/em Mobile Power Cord for iPod w/ Dock],
  manu_id_s:[embelkin/em],
  manu:[emBelkin/em]},
IW-02:{
  manu_id_s:[embelkin/em],
  manu:[emBelkin/em]}}
{code}
So highlighting works fine. BUT when running this query: 
[http://localhost:8983/solr/collection1/select?q=\{!join+from=id+to=id\}belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*]
In the query result the section highlighting looks like:
{code}
highlighting:{
F8V7067-APL-KIT:{},
IW-02:{}}
{code}
As you can see highlighting does not work in combination with join. Is this a 
bug or am I missing something?




  was:
I need to highlight results based on a query that contains a join operation.
I made a simple example by indexing example/exampledocs/*.xml which ships with 
standard Solr distribution. Having these documents indexed to the example 
server I run the following query:
[http://localhost:8983/solr/collection1/select?q=belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*
 ]
In the query result the section highlighting looks like:
{code}
highlighting:{
F8V7067-APL-KIT:{
  name:[emBelkin/em Mobile Power Cord for iPod w/ Dock],
  manu_id_s:[embelkin/em],
  manu:[emBelkin/em]},
IW-02:{
  manu_id_s:[embelkin/em],
  manu:[emBelkin/em]}}
{code}
So highlighting works fine. BUT when running this query: 
[http://localhost:8983/solr/collection1/select?q=\{!join+from=id+to=id\}belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*]
In the query result the section highlighting looks like:
{code}
highlighting:{
F8V7067-APL-KIT:{},
IW-02:{}}
{code}
As you can see highlighting does not work in combination with join. Is this a 
bug or am I missing something?





 highlighting in combination with join does not work in solr 4.0 - 4.2
 -

 Key: SOLR-4835
 URL: https://issues.apache.org/jira/browse/SOLR-4835
 Project: Solr
  Issue Type: Bug
  Components: highlighter, query parsers
Affects Versions: 4.0-ALPHA
Reporter: Matthias Herrmann
  Labels: documentation

 I need to highlight results based on a query that contains a join operation. 
 I want to highlight docs that occur in the to set which is in my 
 I made a simple example by indexing example/exampledocs/*.xml which ships 
 with standard Solr distribution. Having these documents indexed to the 
 example server I run the following query:
 [http://localhost:8983/solr/collection1/select?q=belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*
  ]
 In the query result the section highlighting looks like:
 {code}
 highlighting:{
 F8V7067-APL-KIT:{
   name:[emBelkin/em Mobile Power Cord for iPod w/ Dock],
   manu_id_s:[embelkin/em],
   manu:[emBelkin/em]},
 IW-02:{
   manu_id_s:[embelkin/em],
   manu:[emBelkin/em]}}
 {code}
 So highlighting works fine. BUT when running this query: 
 [http://localhost:8983/solr/collection1/select?q=\{!join+from=id+to=id\}belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*]
 In the query result the section highlighting looks like:
 {code}
 highlighting:{
 F8V7067-APL-KIT:{},
 IW-02:{}}
 {code}
 As you can see highlighting does not work in combination with join. Is this a 
 bug or am I missing something?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4835) highlighting in combination with join does not work in solr 4.0 - 4.2

2013-05-16 Thread Matthias Herrmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matthias Herrmann updated SOLR-4835:


Description: 
I need to highlight results based on a query that contains a join operation. I 
want to highlight docs that occur in the to set which is in my understanding 
the final result set of the join operation.

I made a simple example by indexing example/exampledocs/*.xml which ships with 
standard Solr distribution. Having these documents indexed to the example 
server I run the following query:
[http://localhost:8983/solr/collection1/select?q=belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*
 ]
In the query result the section highlighting looks like:
{code}
highlighting:{
F8V7067-APL-KIT:{
  name:[emBelkin/em Mobile Power Cord for iPod w/ Dock],
  manu_id_s:[embelkin/em],
  manu:[emBelkin/em]},
IW-02:{
  manu_id_s:[embelkin/em],
  manu:[emBelkin/em]}}
{code}
So highlighting works fine. BUT when running this query: 
[http://localhost:8983/solr/collection1/select?q=\{!join+from=id+to=id\}belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*]
In the query result the section highlighting looks like:
{code}
highlighting:{
F8V7067-APL-KIT:{},
IW-02:{}}
{code}
As you can see highlighting does not work in combination with join. Is this a 
bug or am I missing something?




  was:
I need to highlight results based on a query that contains a join operation. I 
want to highlight docs that occur in the to set which is in my 
I made a simple example by indexing example/exampledocs/*.xml which ships with 
standard Solr distribution. Having these documents indexed to the example 
server I run the following query:
[http://localhost:8983/solr/collection1/select?q=belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*
 ]
In the query result the section highlighting looks like:
{code}
highlighting:{
F8V7067-APL-KIT:{
  name:[emBelkin/em Mobile Power Cord for iPod w/ Dock],
  manu_id_s:[embelkin/em],
  manu:[emBelkin/em]},
IW-02:{
  manu_id_s:[embelkin/em],
  manu:[emBelkin/em]}}
{code}
So highlighting works fine. BUT when running this query: 
[http://localhost:8983/solr/collection1/select?q=\{!join+from=id+to=id\}belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*]
In the query result the section highlighting looks like:
{code}
highlighting:{
F8V7067-APL-KIT:{},
IW-02:{}}
{code}
As you can see highlighting does not work in combination with join. Is this a 
bug or am I missing something?





 highlighting in combination with join does not work in solr 4.0 - 4.2
 -

 Key: SOLR-4835
 URL: https://issues.apache.org/jira/browse/SOLR-4835
 Project: Solr
  Issue Type: Bug
  Components: highlighter, query parsers
Affects Versions: 4.0-ALPHA
Reporter: Matthias Herrmann
  Labels: documentation

 I need to highlight results based on a query that contains a join operation. 
 I want to highlight docs that occur in the to set which is in my 
 understanding the final result set of the join operation.
 I made a simple example by indexing example/exampledocs/*.xml which ships 
 with standard Solr distribution. Having these documents indexed to the 
 example server I run the following query:
 [http://localhost:8983/solr/collection1/select?q=belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*
  ]
 In the query result the section highlighting looks like:
 {code}
 highlighting:{
 F8V7067-APL-KIT:{
   name:[emBelkin/em Mobile Power Cord for iPod w/ Dock],
   manu_id_s:[embelkin/em],
   manu:[emBelkin/em]},
 IW-02:{
   manu_id_s:[embelkin/em],
   manu:[emBelkin/em]}}
 {code}
 So highlighting works fine. BUT when running this query: 
 [http://localhost:8983/solr/collection1/select?q=\{!join+from=id+to=id\}belkindefType=lucenewt=jsonindent=truehl=truehl.fl=*]
 In the query result the section highlighting looks like:
 {code}
 highlighting:{
 F8V7067-APL-KIT:{},
 IW-02:{}}
 {code}
 As you can see highlighting does not work in combination with join. Is this a 
 bug or am I missing something?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



<    1   2