Mike Drob commented on HBASE-18540:

Last time I had to do this, I used basically this recipe:

mvn clean package -DskipTests
for i in {1..100}; do
  mvn test -q -Dtest=$TEST
  echo $? >> results
echo $TEST is $(grep -c 1 results) % flaky.

> Ad-hoc job for checking if a test is flaky
> ------------------------------------------
>                 Key: HBASE-18540
>                 URL: https://issues.apache.org/jira/browse/HBASE-18540
>             Project: HBase
>          Issue Type: New Feature
>          Components: test
>            Reporter: Sean Busbey
> It would be great if we had an ad-hoc job that could run a given test a bunch 
> of times and tell me if it is flaky.
> I'm trying to evaluate the state of our new nightly jobs, and I'm not sure if 
> hte failures I'm seeing are a) things I need to get fixed soon, b) things 
> that are flaky but previously unrecognized, c) things that are flaky but 
> missed because our current flaky list is only based on the behavior of the 
> master branch.

This message was sent by Atlassian JIRA

Reply via email to