Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-33116

During rolling back to 4.12.0 from 4.12.nightly build, network degraded by RolloutHung

XMLWordPrintable

    • Important
    • No
    • False
    • Hide

      None

      Show
      None

      During rolling back to 4.12.0 from 4.12.0 nightly build, network degraded by RolloutHung

      Version-Release number of selected component (if applicable):

      How reproducible:

      Always

      Steps to Reproduce:

      1. Run prow ci job: https://qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/view/gs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.12-amd64-rollback-nightly-azure-upi-f14/1784179379723571200

      2. Upgrade timeout during rolling back to 4.12.0 from 4.12.0-0.nightly-2024-04-26-114645

      $ omc get co network -o yaml

      ......

      -lastTransitionTime: "2024-04-27T15:57:34Z"
      message: DaemonSet "/openshift-ovn-kubernetes/ovnkube-node" rollout is not making
      progress - pod ovnkube-node-hxzmp is in CrashLoopBackOff State
      reason: RolloutHung
      status: "True"
      type: Degraded

      $ omc describe pods -n openshift-ovn-kubernetes ovnkube-node-hxzmp

      .......

      Last State: Terminated
      Reason: Error
      Exit Code: 1
      Started: Sat, 27 Apr 2024 23:57:15 +0800
      Finished: Sat, 27 Apr 2024 23:58:15 +0800

      Actual results:

      Upgrade timeout during rolling back to 4.12.0

      Expected results:

      Rolling back should be success.

      Additional info:

      must-gather: https://gcsweb-qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.12-amd64-rollback-nightly-azure-upi-f14/1784179379723571200/artifacts/azure-upi-f14/gather-must-gather/

      reproduced job: https://qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/view/gs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.12-amd64-rollback-nightly-azure-upi-f14/1778381041560457216

      Affected Platforms: Azure

            sdn-team-bot sdn-team bot
            minl@redhat.com Ming Li
            Anurag Saxena Anurag Saxena
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated: