Uploaded image for project: 'Red Hat Fuse'
  1. Red Hat Fuse
  2. ENTESB-4479

Update Jenkins jobs to use Flaky Test Plugin and Surefire rerun failing tests option

    XMLWordPrintable

    Details

    • Type: Enhancement
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: jboss-fuse-6.3
    • Fix Version/s: jboss-fuse-6.3
    • Component/s: None
    • Labels:
    • Environment:

      Jenkins

    • Sprint:
      6.3 Sprint 2 (1-Feb - 26-Feb)

      Description

      Hiram Chirino suggested using the Jenkins Flaky Test Handler Plugin (https://wiki.jenkins-ci.org/display/JENKINS/Flaky+Test+Handler+Plugin) along with the new surefire option to rerun failing tests (https://maven.apache.org/surefire/maven-surefire-plugin/examples/rerun-failing-tests.html) to try to help reduce the issues we have with intermittent test failures.

      My initial attempts at this have been mixed. This requires surefire version 2.18 or newer, and in a couple of cases that has resulted in test failures. In other cases, rerunning doesn't help, either because of the way the test is written (i.e. setup() and cleanup() don't properly reset the state) or whatever caused the failure, like not being able to get a port, is not resolved by rerunning.

        Gliffy Diagrams

          Attachments

            Activity

              People

              • Assignee:
                kearls Kevin Earls
                Reporter:
                kearls Kevin Earls
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: