[jira] [Commented] (OOZIE-2817) Increase test case stability in pre-commit job

[Abhishek Bafna (JIRA)]

    [ 
https://issues.apache.org/jira/browse/OOZIE-2817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15938192#comment-15938192
 ] 

Abhishek Bafna commented on OOZIE-2817:
---------------------------------------

For the Build: 
https://builds.apache.org/job/oozie-trunk-precommit-build/3722/consoleFull. 

This build had an flask test which got passed in the rerun. But that 
information did not got printed in the Jira 
[comment|https://issues.apache.org/jira/browse/OOZIE-2701?focusedCommentId=15938155&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15938155].

{code}
....
....
    flakyTests=$(cat ${TEMPDIR}/${TASKNAME}.flakies.out)
....
....
        echo "{color:green}+1 ${TASKNAME}{color}" >> $SUMMARYFILE
        echo ".    Tests run: $testsRun" >> $SUMMARYFILE
        if [ -n "${flakyTests}" ]; then
          echo ".    Tests rerun: ${testsReRun}" >> $SUMMARYFILE
          echo ".    Tests failed at first run: ${flakyTests}" >> $SUMMARYFILE
{code}

I think issue was: 

{code}
    failures=$(find . -name '*\.txt' | grep target/surefire-reports | xargs 
grep  "<<<" | grep -v "Tests run:" | sed 's/.*\.txt\://' | sed 's/ .*//' | grep 
-o '(\(.*\))' | tr -d '()'  | uniq | awk '{ sub ("\\\\$", ""); printf "%s", 
$0"," } END { print "" }')
    if [ -n "${failures}" ]; then
       echo "Rerunning failed tests: ${failures}"
       echo $FAILURES > ${TEMPDIR}/${TASKNAME}.flakies.out
{code}

The case for the variable {{FAILURES}} vs {{failures}}.
----
Total tests run in Jenkins Test report: 1,909 (Link: 
https://builds.apache.org/job/oozie-trunk-precommit-build/3722/testReport)
Total tests run in Comment from Report: 1912.

Not sure, why there is difference, could not reach to a conclusion.

[~gezapeti] Can you please take look here?

Thanks.

> Increase test case stability in pre-commit job
> ----------------------------------------------
>
>                 Key: OOZIE-2817
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2817
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Peter Cseh
>            Assignee: Peter Cseh
>             Fix For: 5.0.0
>
>         Attachments: OOZIE-2817-001.patch, OOZIE-2817-002.patch, 
> OOZIE-2817-003.patch, OOZIE-2817-amend.patch
>
>
> We could collect the failed tests and rerun them in the pre-commit hook.
> They will still fail if they are broken, but they'll probably pass if they 
> are just flaky.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)