[ https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882122#comment-13882122 ]
Steve Rowe commented on SOLR-5652: ---------------------------------- Uwe's Jenkins found a "walk already seen" *Linux* failure on branch_4x using Oracle 1.8.0-ea-b124 JVM: [http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9136/] - a missing value str_dv doc (id=2) appears at both the first *and* last positions and pages: {noformat} [junit4] 2> 414765 T2177 oasc.DistribCursorPagingTest.assertFullWalkNoDups SOLR-5652: ({params(q=*%3A*&fl=id%2Cstr_dv_last&rows=41&sort=str_dv_last+asc%2C+id+asc),defaults(cursorMark=*)}) gave us these docs: {id=2}; {id=3, str_dv_last=}; {id=9, str_dv_last=}; {id=18, str_dv_last=}; {id=35, str_dv_last=}; {id=41}; {id=43, str_dv_last=}; {id=46, str_dv_last=}; {id=48, str_dv_last=}; {id=51, str_dv_last=}; {id=55}; {id=80, str_dv_last=}; {id=125, str_dv_last=}; {id=117, str_dv_last=u}xPe}; {id=11, str_dv_last=CVLjZ-k U}; {id=104, str_dv_last=g}; {id=66, str_dv_last=h}; {id=27, str_dv_last=j}; {id=120, str_dv_last=l}; {id=128, str_dv_last=o}; {id=19, str_dv_last=q}; {id=76, str_dv_last=t}; {id=42, str_dv_last=x}; {id=92, str_dv_last=y}; {id=40, str_dv_last=z}; {id=6, str_dv_last=???????????}; {id=82, str_dv_last=????}; {id=1, str_dv_last=??}; {id=103, str_dv_last=???????}; {id=15, str_dv_last=???????????????????}; {id=81, str_dv_last=??????????}; {id=29, str_dv_last=?}; {id=98, str_dv_last=????????????????}; {id=78, str_dv_last=????????????}; {id=72, str_dv_last=??????????????}; {id=73, str_dv_last=???????????????????}; {id=33, str_dv_last=???????????}; {id=121, str_dv_last=????????????????}; {id=97, str_dv_last=??}; {id=47, str_dv_last=??????????????}; {id=32, str_dv_last=????????????}; [junit4] 2> 414781 T2177 oasc.DistribCursorPagingTest.assertFullWalkNoDups SOLR-5652: ({params(q=*%3A*&fl=id%2Cstr_dv_last&rows=41&sort=str_dv_last+asc%2C+id+asc),defaults(cursorMark=AoI%2FBeC%2FpeC8neC9teC%2Bu%2BC9nOC%2FhuC%2BgeC8geC9ruC%2BgeC9s%2BC%2Bl1AC)}) gave us these docs: {id=106, str_dv_last=??????}; {id=54, str_dv_last=??????}; {id=94, str_dv_last=????}; {id=63, str_dv_last=????????????????????}; {id=88, str_dv_last=??}; {id=24, str_dv_last=??}; {id=17, str_dv_last=????????}; {id=99, str_dv_last=??????????}; {id=7, str_dv_last=?????????????????}; {id=50, str_dv_last=?????????????}; {id=85, str_dv_last=????????????}; {id=77, str_dv_last=??}; {id=102, str_dv_last=?}; {id=89, str_dv_last=??????????????}; {id=8, str_dv_last=????????}; {id=74, str_dv_last=?????????????????}; {id=60, str_dv_last=????????????????}; {id=67, str_dv_last=?????}; {id=109, str_dv_last=????????????????}; {id=118, str_dv_last=???????????}; {id=112, str_dv_last=?}; {id=56, str_dv_last=???}; {id=5, str_dv_last=????????}; {id=95, str_dv_last=???????????????????}; {id=22, str_dv_last=??????????}; {id=31, str_dv_last=???????????????}; {id=16, str_dv_last=?}; {id=52, str_dv_last=???????????}; {id=57, str_dv_last=????????????????????}; {id=113, str_dv_last=???????????}; {id=91, str_dv_last=??}; {id=34, str_dv_last=??????}; {id=39, str_dv_last=?????????}; {id=59, str_dv_last=?????}; {id=61, str_dv_last=???????}; {id=44, str_dv_last=?????????????????}; {id=69, str_dv_last=????????????}; {id=119, str_dv_last=???????}; {id=12, str_dv_last=??????}; {id=90, str_dv_last=????}; {id=123, str_dv_last=???????????????????}; [junit4] 2> 414795 T2177 oasc.DistribCursorPagingTest.assertFullWalkNoDups SOLR-5652: ({params(q=*%3A*&fl=id%2Cstr_dv_last&rows=41&sort=str_dv_last+asc%2C+id+asc),defaults(cursorMark=AoI%2FGuOEm%2BOEpOOEjuOEoeOEmeOEpuOEo%2BOEmeOEh%2BOEneOEjeOEheOErOOEguOEoeOElOOEluOEpeOEgVsH)}) gave us these docs: {id=68, str_dv_last=??????????????}; {id=96, str_dv_last=?????????????}; {id=45, str_dv_last=????????}; {id=38, str_dv_last=??????????}; {id=110, str_dv_last=???????????????}; {id=20, str_dv_last=??????}; {id=129, str_dv_last=??????????????????}; {id=75, str_dv_last=???????}; {id=79, str_dv_last=????}; {id=62, str_dv_last=?????????}; {id=30, str_dv_last=??????????????????}; {id=111, str_dv_last=???????????}; {id=28, str_dv_last=????????}; {id=105, str_dv_last=??????????????}; {id=100, str_dv_last=?}; {id=37, str_dv_last=??????}; {id=115, str_dv_last=???????????????}; {id=107, str_dv_last=?????????????}; {id=49, str_dv_last=??}; {id=93, str_dv_last=???????????????}; {id=65, str_dv_last=??????}; {id=25, str_dv_last=????????}; {id=14, str_dv_last=????????}; {id=83, str_dv_last=???????????????????}; {id=124, str_dv_last=????????????????}; {id=114, str_dv_last=???????????????????}; {id=71, str_dv_last=??????????????????}; {id=108, str_dv_last=???????????????}; {id=36, str_dv_last=?????????????????}; {id=86, str_dv_last=??????????}; {id=122, str_dv_last=?????????}; {id=84, str_dv_last=?????????}; {id=127, str_dv_last=???????????}; {id=70, str_dv_last=?????????????}; {id=13, str_dv_last=????}; {id=10, str_dv_last=?????}; {id=64, str_dv_last=????}; {id=26, str_dv_last=???????????}; {id=58, str_dv_last=??????????????????}; {id=4, str_dv_last=?????????????????}; {id=101, str_dv_last=??????????}; [junit4] 2> 414805 T2177 oasc.DistribCursorPagingTest.assertFullWalkNoDups SOLR-5652: ({params(q=*%3A*&fl=id%2Cstr_dv_last&rows=41&sort=str_dv_last+asc%2C+id+asc),defaults(cursorMark=AoI%2FCfCdhojwnYSm8J2Es%2FCdhKvwnYWo8J2FqfCdhYfwnYaE8J2HpPCdhqJVBg%3D%3D)}) gave us these docs: {id=87, str_dv_last=??}; {id=116, str_dv_last=?????}; {id=23, str_dv_last=???????????}; {id=53, str_dv_last=??????}; {id=126, str_dv_last=???????????????}; {id=21, str_dv_last=???????????}; [junit4] 2> 414813 T2177 oasc.DistribCursorPagingTest.assertFullWalkNoDups SOLR-5652: ({params(q=*%3A*&fl=id%2Cstr_dv_last&rows=41&sort=str_dv_last+asc%2C+id+asc),defaults(cursorMark=AoI%2FDfSEm7v0jba69IqEqvSFmYX0hram9IeujPSLqIX0ibic9IeajfSAlKX0hZqwVQE%3D)}) gave us these docs: {id=2}; [junit4] > Throwable #1: java.lang.AssertionError: ({params(q=*%3A*&fl=id%2Cstr_dv_last&rows=41&sort=str_dv_last+asc%2C+id+asc),defaults(cursorMark=AoI%2FDfSEm7v0jba69IqEqvSFmYX0hram9IeujPSLqIX0ibic9IeajfSAlKX0hZqwVQE%3D)}) walk already seen: 2, don't know why; q=id:2 gives: {responseHeader={status=0,QTime=5},response={numFound=1,start=0,maxScore=4.3672957,docs=[SolrDocument{id=2, int=-1269312747, int_last=-1269312747, int_first=-1269312747, int_dv_last=-1269312747, int_dv_first=-1269312747, long=-7073619055149191639, long_last=-7073619055149191639, long_first=-7073619055149191639, long_dv_last=-7073619055149191639, long_dv_first=-7073619055149191639, float=-5.1121048E7, float_last=-5.1121048E7, float_first=-5.1121048E7, float_dv_last=-5.1121048E7, float_dv_first=-5.1121048E7, double=1.209537768077775E9, double_last=1.209537768077775E9, double_first=1.209537768077775E9, double_dv_last=1.209537768077775E9, double_dv_first=1.209537768077775E9, _version_=1458244495980101632}]}} {noformat} Also, I found a *trunk* failure on OS X using Oracle 1.7.0_25 JVM - one failure out of 875 trials: {noformat} 797.log: [junit4] 2> 33038 T10 oasc.DistribCursorPagingTest.doRandomSortsOnLargeIndex SOLR-5652: Begining Loop over smallish num of docs 797.log: [junit4] > Throwable #1: java.lang.AssertionError: ({params(q=*%3A*&fl=id%2Clong_dv_last&rows=41&sort=long_dv_last+asc%2C+id+asc),defaults(cursorMark=AoIHQPUmIuYgRStcBA%3D%3D)}) walk already seen: 94, don't know why; q=id:94 gives: {responseHeader={status=0,QTime=8},response={numFound=1,start=0,maxScore=4.650658,docs=[SolrDocument{id=94, int=-1526187839, int_last=-1526187839, int_first=-1526187839, int_dv_last=-1526187839, int_dv_first=-1526187839, float=-4.343064E8, float_last=-4.343064E8, float_first=-4.343064E8, float_dv_last=-4.343064E8, float_dv_first=-4.343064E8, double=2.4889970242543688E8, double_last=2.4889970242543688E8, double_first=2.4889970242543688E8, double_dv_last=2.4889970242543688E8, double_dv_first=2.4889970242543688E8, str=႗ၨတဟက႖ဘပၩရၢ၇ႃ, str_last=႗ၨတဟက႖ဘပၩရၢ၇ႃ, str_first=႗ၨတဟက႖ဘပၩရၢ၇ႃ, str_dv_last=႗ၨတဟက႖ဘပၩရၢ၇ႃ, str_dv_first=႗ၨတဟက႖ဘပၩရၢ၇ႃ, bin=1OWONkZ+pQ9N1WTd+bro5Ubqx8FFEGtqPDSD, bin_last=1OWONkZ+pQ9N1WTd+bro5Ubqx8FFEGtqPDSD, bin_first=1OWONkZ+pQ9N1WTd+bro5Ubqx8FFEGtqPDSD, bin_dv_last=1OWONkZ+pQ9N1WTd+bro5Ubqx8FFEGtqPDSD, bin_dv_first=1OWONkZ+pQ9N1WTd+bro5Ubqx8FFEGtqPDSD, _version_=1458175223436148736}]}} {noformat} Also, I ran 1000 trials on Win7 on branch_4x using Oracle 1.6.0_45 JVM, and saw 0 failures. > Heisenbug in DistribCursorPagingTest: "walk already seen ..." > ------------------------------------------------------------- > > Key: SOLR-5652 > URL: https://issues.apache.org/jira/browse/SOLR-5652 > Project: Solr > Issue Type: Bug > Reporter: Hoss Man > Assignee: Hoss Man > Attachments: 129.log, 372.log, > jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1200.log.txt, > jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1217.log.txt > > > Twice now, Uwe's jenkins has encountered a "walk already seen ..." assertion > failure from DistribCursorPagingTest that I've been unable to fathom, let > alone reproduce (although sarowe was able to trigger a similar, > non-reproducible seed, failure on his machine) > Using this as a tracking issue to try and make sense of it. > Summary of things noticed so far (in 3 failures): > * So far only seen on http://jenkins.thetaphi.de & sarowe's mac > * So far only seen on MacOSX > * So far only seen on branch 4x > * So far seen on both Java6 and Java7 > * fails occured in first block of randomized testing: > ** we've indexed a small number of randomized docs > ** we're explicitly looping over every field and sorting in both directions > * fails were both when doing a "desc" sorting on one of the "\*_dv_last" or > "\*_dv_first" fields (docValues=true, either sortMissingLast=true OR > sortMissingFirst=true) > ** sort on same field asc has always worked fine just before this (fields are > in arbitrary order, but "asc" always tried before "desc") > ** sorting on some other random fields has sometimes been tried before this > and worked > (specifics of each failure seen in the wild recorded in comments) -- This message was sent by Atlassian JIRA (v6.1.5#6160) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org