[ 
https://issues.apache.org/jira/browse/LUCENE-8106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16363479#comment-16363479
 ] 

Steve Rowe edited comment on LUCENE-8106 at 2/14/18 4:45 AM:
-------------------------------------------------------------

Reopening to add some more functionality to the script:

# Add cmdline option parsing
# Run {{git fetch}} by default prior to running tests, and allow opt-out (for 
Jenkins) via cmdline option {{--no-fetch}}
# Add cmdline option for test iterations, defaulting to 5
# Sort failure report by reverse failure count, so that highest counts are on 
the bottom, with secondary sort on test suite name
# When all iterations fail for a test, re-test at branch tip (with the seed)
# When a test also fails 100% at branch tip, re-attempt without the seed


was (Author: steve_rowe):
Reopening to add some more functionality to the script:

# Add cmdline option parsing
# Run {{git fetch}} by default prior to running tests, and allow opt-out (for 
Jenkins) via cmdline option {{--no-fetch}}
# Add cmdline option for test iterations, defaulting to 5
# Sort failure report by reverse failure count, so that highest counts are on 
the bottom, with secondary sort on test suite name
# When all iterations fail for a test, re-test at branch tip with the seed
# When a test also fails at branch tip, re-attempt without the seed

> Add script to attempt to reproduce failing tests from a Jenkins log
> -------------------------------------------------------------------
>
>                 Key: LUCENE-8106
>                 URL: https://issues.apache.org/jira/browse/LUCENE-8106
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Steve Rowe
>            Assignee: Steve Rowe
>            Priority: Major
>             Fix For: master (8.0), 7.3
>
>         Attachments: LUCENE-8106-part2.patch, LUCENE-8106.patch, 
> LUCENE-8106.patch
>
>
> This script will be runnable from a downstream job triggered by an upstream 
> failing Jenkins job, passing log location info between the two.
> The script will also be runnable manually from a developer's cmdline.
> From the script help:
> {noformat}
> Usage:
>      python3 -u reproduceJenkinsFailures.py URL
> Must be run from a Lucene/Solr git workspace. Downloads the Jenkins
> log pointed to by the given URL, parses it for Git revision and failed
> Lucene/Solr tests, checks out the Git revision in the local workspace,
> groups the failed tests by module, then runs
> 'ant test -Dtest.dups=5 -Dtests.class="*.test1[|*.test2[...]]" ...'
> in each module of interest, failing at the end if any of the runs fails.
> To control the maximum number of concurrent JVMs used for each module's
> test run, set 'tests.jvms', e.g. in ~/lucene.build.properties
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to