2022-03-08T10:42:53.568197943Z I0308 10:42:53.568002       1 cmd.go:200] Using service-serving-cert provided certificates
2022-03-08T10:42:53.569491762Z I0308 10:42:53.569445       1 observer_polling.go:159] Starting file observer
2022-03-08T10:42:53.611742698Z I0308 10:42:53.611341       1 builder.go:238] kube-controller-manager-operator version v0.0.0-alpha.0-858-gb05961c9-b05961c979fff825cc17fbd66660f7409cc82f28
2022-03-08T10:42:53.819923987Z W0308 10:42:53.819819       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
2022-03-08T10:42:53.819923987Z W0308 10:42:53.819843       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
2022-03-08T10:42:53.820778964Z I0308 10:42:53.820693       1 leaderelection.go:243] attempting to acquire leader lease  openshift-kube-controller-manager-operator/kube-controller-manager-operator-lock...
2022-03-08T10:42:53.825463826Z I0308 10:42:53.825393       1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController
2022-03-08T10:42:53.825463826Z I0308 10:42:53.825437       1 shared_informer.go:240] Waiting for caches to sync for RequestHeaderAuthRequestController
2022-03-08T10:42:53.825522492Z I0308 10:42:53.825475       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
2022-03-08T10:42:53.825522492Z I0308 10:42:53.825480       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
2022-03-08T10:42:53.825522492Z I0308 10:42:53.825490       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
2022-03-08T10:42:53.825522492Z I0308 10:42:53.825494       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
2022-03-08T10:42:53.826080373Z I0308 10:42:53.826028       1 dynamic_serving_content.go:130] Starting serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key
2022-03-08T10:42:53.826141512Z I0308 10:42:53.826074       1 secure_serving.go:197] Serving securely on [::]:8443
2022-03-08T10:42:53.826248266Z I0308 10:42:53.826094       1 tlsconfig.go:240] Starting DynamicServingCertificateController
2022-03-08T10:42:53.925689644Z I0308 10:42:53.925585       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file 
2022-03-08T10:42:53.925689644Z I0308 10:42:53.925649       1 shared_informer.go:247] Caches are synced for RequestHeaderAuthRequestController 
2022-03-08T10:42:53.925755249Z I0308 10:42:53.925732       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
2022-03-08T10:43:58.270160320Z I0308 10:43:58.270004       1 leaderelection.go:253] successfully acquired lease openshift-kube-controller-manager-operator/kube-controller-manager-operator-lock
2022-03-08T10:43:58.270458487Z I0308 10:43:58.270416       1 event.go:282] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator-lock", UID:"144301bc-ecf9-42f5-ac6f-c69bde1213ff", APIVersion:"v1", ResourceVersion:"16068", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' kube-controller-manager-operator-7bb9b6d8b8-h8hjn_e776a105-4aea-4dfc-b77a-0dec7ceec2e5 became leader
2022-03-08T10:43:58.292865699Z I0308 10:43:58.292786       1 base_controller.go:66] Waiting for caches to sync for RemoveStaleConditionsController
2022-03-08T10:43:58.294116242Z I0308 10:43:58.293898       1 base_controller.go:66] Waiting for caches to sync for LoggingSyncer
2022-03-08T10:43:58.294116242Z I0308 10:43:58.293947       1 base_controller.go:66] Waiting for caches to sync for RevisionController
2022-03-08T10:43:58.294520626Z I0308 10:43:58.294471       1 targetconfigcontroller.go:724] Starting TargetConfigController
2022-03-08T10:43:58.294520626Z I0308 10:43:58.294509       1 base_controller.go:66] Waiting for caches to sync for ConfigObserver
2022-03-08T10:43:58.294539450Z I0308 10:43:58.294525       1 base_controller.go:66] Waiting for caches to sync for InstallerController
2022-03-08T10:43:58.294557669Z I0308 10:43:58.294546       1 base_controller.go:66] Waiting for caches to sync for InstallerStateController
2022-03-08T10:43:58.294568936Z I0308 10:43:58.294559       1 base_controller.go:66] Waiting for caches to sync for StaticPodStateController
2022-03-08T10:43:58.294578465Z I0308 10:43:58.294570       1 base_controller.go:66] Waiting for caches to sync for PruneController
2022-03-08T10:43:58.294586951Z I0308 10:43:58.294580       1 base_controller.go:66] Waiting for caches to sync for NodeController
2022-03-08T10:43:58.294596740Z I0308 10:43:58.294582       1 base_controller.go:66] Waiting for caches to sync for StaticResourceController
2022-03-08T10:43:58.294650575Z I0308 10:43:58.294633       1 base_controller.go:66] Waiting for caches to sync for StatusSyncer_kube-controller-manager
2022-03-08T10:43:58.294659769Z I0308 10:43:58.294653       1 base_controller.go:66] Waiting for caches to sync for ResourceSyncController
2022-03-08T10:43:58.294693467Z I0308 10:43:58.294673       1 base_controller.go:66] Waiting for caches to sync for CertRotationController
2022-03-08T10:43:58.294693467Z I0308 10:43:58.294686       1 satokensigner_controller.go:344] Starting SATokenSignerController
2022-03-08T10:43:58.294754262Z I0308 10:43:58.294737       1 base_controller.go:66] Waiting for caches to sync for UnsupportedConfigOverridesController
2022-03-08T10:43:58.294761766Z I0308 10:43:58.294752       1 base_controller.go:66] Waiting for caches to sync for StaticResourceController
2022-03-08T10:43:58.394756121Z I0308 10:43:58.394698       1 base_controller.go:72] Caches are synced for InstallerStateController 
2022-03-08T10:43:58.394756121Z I0308 10:43:58.394726       1 base_controller.go:109] Starting #1 worker of InstallerStateController controller ...
2022-03-08T10:43:58.394814247Z I0308 10:43:58.394792       1 base_controller.go:72] Caches are synced for CertRotationController 
2022-03-08T10:43:58.394814247Z I0308 10:43:58.394806       1 base_controller.go:109] Starting #1 worker of CertRotationController controller ...
2022-03-08T10:43:58.395362831Z E0308 10:43:58.395330       1 base_controller.go:250] "CertRotationController" controller failed to sync "key", err: kubecontrollermanagers.operator.openshift.io "cluster" not found
2022-03-08T10:43:58.395767947Z E0308 10:43:58.395722       1 base_controller.go:250] "CertRotationController" controller failed to sync "key", err: kubecontrollermanagers.operator.openshift.io "cluster" not found
2022-03-08T10:43:58.401114661Z E0308 10:43:58.401008       1 base_controller.go:250] "CertRotationController" controller failed to sync "key", err: kubecontrollermanagers.operator.openshift.io "cluster" not found
2022-03-08T10:43:58.421822289Z E0308 10:43:58.421774       1 base_controller.go:250] "CertRotationController" controller failed to sync "key", err: kubecontrollermanagers.operator.openshift.io "cluster" not found
2022-03-08T10:43:58.463093677Z E0308 10:43:58.462984       1 base_controller.go:250] "CertRotationController" controller failed to sync "key", err: kubecontrollermanagers.operator.openshift.io "cluster" not found
2022-03-08T10:43:58.493261949Z I0308 10:43:58.493198       1 base_controller.go:72] Caches are synced for RemoveStaleConditionsController 
2022-03-08T10:43:58.493370662Z I0308 10:43:58.493359       1 base_controller.go:109] Starting #1 worker of RemoveStaleConditionsController controller ...
2022-03-08T10:43:58.494256989Z I0308 10:43:58.494158       1 base_controller.go:72] Caches are synced for LoggingSyncer 
2022-03-08T10:43:58.494256989Z I0308 10:43:58.494226       1 base_controller.go:109] Starting #1 worker of LoggingSyncer controller ...
2022-03-08T10:43:58.494639930Z I0308 10:43:58.494615       1 base_controller.go:72] Caches are synced for InstallerController 
2022-03-08T10:43:58.494639930Z I0308 10:43:58.494623       1 base_controller.go:72] Caches are synced for StaticPodStateController 
2022-03-08T10:43:58.494655646Z I0308 10:43:58.494640       1 base_controller.go:109] Starting #1 worker of StaticPodStateController controller ...
2022-03-08T10:43:58.494655646Z I0308 10:43:58.494644       1 base_controller.go:72] Caches are synced for PruneController 
2022-03-08T10:43:58.494655646Z I0308 10:43:58.494651       1 base_controller.go:109] Starting #1 worker of PruneController controller ...
2022-03-08T10:43:58.494683923Z I0308 10:43:58.494629       1 base_controller.go:109] Starting #1 worker of InstallerController controller ...
2022-03-08T10:43:58.494683923Z I0308 10:43:58.494660       1 base_controller.go:72] Caches are synced for StatusSyncer_kube-controller-manager 
2022-03-08T10:43:58.494692808Z I0308 10:43:58.494680       1 base_controller.go:109] Starting #1 worker of StatusSyncer_kube-controller-manager controller ...
2022-03-08T10:43:58.495573827Z I0308 10:43:58.495456       1 base_controller.go:72] Caches are synced for StaticResourceController 
2022-03-08T10:43:58.495573827Z I0308 10:43:58.495483       1 base_controller.go:109] Starting #1 worker of StaticResourceController controller ...
2022-03-08T10:43:58.495573827Z I0308 10:43:58.494617       1 base_controller.go:72] Caches are synced for NodeController 
2022-03-08T10:43:58.495573827Z I0308 10:43:58.495503       1 base_controller.go:109] Starting #1 worker of NodeController controller ...
2022-03-08T10:43:58.495903839Z I0308 10:43:58.495880       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:43:58Z","message":"NodeInstallerDegraded: 1 nodes are failing on revision 4:\nNodeInstallerDegraded: ; 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending","reason":"NodeInstaller_InstallerPodFailed","status":"True","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:38:54Z","message":"NodeInstallerProgressing: 2 nodes are at revision 0; 1 nodes are at revision 6","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 1 nodes are active; 2 nodes are at revision 0; 1 nodes are at revision 6","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:43:58.496088893Z I0308 10:43:58.496046       1 base_controller.go:72] Caches are synced for UnsupportedConfigOverridesController 
2022-03-08T10:43:58.496340177Z I0308 10:43:58.496298       1 base_controller.go:109] Starting #1 worker of UnsupportedConfigOverridesController controller ...
2022-03-08T10:43:58.496621333Z I0308 10:43:58.496106       1 base_controller.go:72] Caches are synced for StaticResourceController 
2022-03-08T10:43:58.496621333Z I0308 10:43:58.496601       1 base_controller.go:109] Starting #1 worker of StaticResourceController controller ...
2022-03-08T10:43:58.496864554Z I0308 10:43:58.496832       1 base_controller.go:72] Caches are synced for RevisionController 
2022-03-08T10:43:58.496864554Z I0308 10:43:58.496845       1 base_controller.go:109] Starting #1 worker of RevisionController controller ...
2022-03-08T10:43:58.499885225Z I0308 10:43:58.499799       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RevisionTriggered' new revision 7 triggered by "secret/localhost-recovery-client-token has changed"
2022-03-08T10:43:58.539127911Z I0308 10:43:58.538966       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded changed from False to True ("NodeInstallerDegraded: 1 nodes are failing on revision 4:\nNodeInstallerDegraded: ; 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending")
2022-03-08T10:43:59.394874345Z I0308 10:43:59.394797       1 base_controller.go:72] Caches are synced for ResourceSyncController 
2022-03-08T10:43:59.394874345Z I0308 10:43:59.394816       1 base_controller.go:72] Caches are synced for ConfigObserver 
2022-03-08T10:43:59.394874345Z I0308 10:43:59.394836       1 base_controller.go:109] Starting #1 worker of ConfigObserver controller ...
2022-03-08T10:43:59.394874345Z I0308 10:43:59.394826       1 base_controller.go:109] Starting #1 worker of ResourceSyncController controller ...
2022-03-08T10:43:59.488695895Z I0308 10:43:59.488578       1 request.go:645] Throttling request took 1.093590721s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:44:00.688630570Z I0308 10:44:00.688523       1 request.go:645] Throttling request took 2.191671812s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager
2022-03-08T10:44:00.903505312Z I0308 10:44:00.903429       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/revision-status-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:01.690336294Z I0308 10:44:01.688551       1 request.go:645] Throttling request took 1.783736713s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-1.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:01.912163105Z I0308 10:44:01.912092       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/installer-6-master-0.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:02.498944179Z I0308 10:44:02.498835       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapUpdated' Updated ConfigMap/revision-status-6 -n openshift-kube-controller-manager:
2022-03-08T10:44:02.498944179Z cause by changes in data.status
2022-03-08T10:44:02.696148286Z I0308 10:44:02.696085       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'SATokenSignerControllerOK' found expected kube-apiserver endpoints
2022-03-08T10:44:02.888577219Z I0308 10:44:02.888508       1 request.go:645] Throttling request took 1.394392839s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/configmaps/recycler-config
2022-03-08T10:44:03.496005888Z I0308 10:44:03.495956       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 6, but has not made progress because 
2022-03-08T10:44:03.888589763Z I0308 10:44:03.888531       1 request.go:645] Throttling request took 1.591958458s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/kube-controller-manager-sa
2022-03-08T10:44:04.104800784Z I0308 10:44:04.104748       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/kube-controller-manager-pod-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:04.304570797Z I0308 10:44:04.304514       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'SecretCreated' Created Secret/next-service-account-private-key -n openshift-kube-controller-manager-operator because it was missing
2022-03-08T10:44:05.088526666Z I0308 10:44:05.088458       1 request.go:645] Throttling request took 1.59150979s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-6-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:05.498654578Z I0308 10:44:05.498577       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/config-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:05.699966353Z I0308 10:44:05.699904       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapUpdated' Updated ConfigMap/sa-token-signing-certs -n openshift-config-managed:
2022-03-08T10:44:05.699966353Z cause by changes in data.service-account-002.pub
2022-03-08T10:44:06.088580464Z I0308 10:44:06.088517       1 request.go:645] Throttling request took 1.39305759s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-1.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:06.299748850Z I0308 10:44:06.299694       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 6, but has not made progress because 
2022-03-08T10:44:06.708197344Z I0308 10:44:06.708113       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/cluster-policy-controller-config-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:06.895244491Z I0308 10:44:06.895124       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Warning' reason: 'ConfigMapUpdateFailed' Failed to update ConfigMap/sa-token-signing-certs -n openshift-config-managed: Operation cannot be fulfilled on configmaps "sa-token-signing-certs": the object has been modified; please apply your changes to the latest version and try again
2022-03-08T10:44:06.914692518Z E0308 10:44:06.914626       1 satokensigner_controller.go:392] key failed with : Operation cannot be fulfilled on configmaps "sa-token-signing-certs": the object has been modified; please apply your changes to the latest version and try again
2022-03-08T10:44:06.916139822Z I0308 10:44:06.916082       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:43:58Z","message":"NodeInstallerDegraded: 1 nodes are failing on revision 4:\nNodeInstallerDegraded: ; 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending\nSATokenSignerDegraded: Operation cannot be fulfilled on configmaps \"sa-token-signing-certs\": the object has been modified; please apply your changes to the latest version and try again","reason":"NodeInstaller_InstallerPodFailed::SATokenSigner_Error","status":"True","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:38:54Z","message":"NodeInstallerProgressing: 2 nodes are at revision 0; 1 nodes are at revision 6","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 1 nodes are active; 2 nodes are at revision 0; 1 nodes are at revision 6","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:44:06.952300860Z I0308 10:44:06.952210       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "NodeInstallerDegraded: 1 nodes are failing on revision 4:\nNodeInstallerDegraded: ; 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending" to "NodeInstallerDegraded: 1 nodes are failing on revision 4:\nNodeInstallerDegraded: ; 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending\nSATokenSignerDegraded: Operation cannot be fulfilled on configmaps \"sa-token-signing-certs\": the object has been modified; please apply your changes to the latest version and try again"
2022-03-08T10:44:06.958834466Z I0308 10:44:06.958757       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:43:58Z","message":"NodeInstallerDegraded: 1 nodes are failing on revision 4:\nNodeInstallerDegraded: ; 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending","reason":"NodeInstaller_InstallerPodFailed","status":"True","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:38:54Z","message":"NodeInstallerProgressing: 2 nodes are at revision 0; 1 nodes are at revision 6","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 1 nodes are active; 2 nodes are at revision 0; 1 nodes are at revision 6","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:44:06.979606696Z I0308 10:44:06.978445       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "NodeInstallerDegraded: 1 nodes are failing on revision 4:\nNodeInstallerDegraded: ; 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending\nSATokenSignerDegraded: Operation cannot be fulfilled on configmaps \"sa-token-signing-certs\": the object has been modified; please apply your changes to the latest version and try again" to "NodeInstallerDegraded: 1 nodes are failing on revision 4:\nNodeInstallerDegraded: ; 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending"
2022-03-08T10:44:07.088629043Z I0308 10:44:07.088543       1 request.go:645] Throttling request took 1.191847956s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager-operator/configmaps/csr-controller-ca
2022-03-08T10:44:07.837294279Z I0308 10:44:07.837122       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/controller-manager-kubeconfig-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:08.089828924Z I0308 10:44:08.089327       1 request.go:645] Throttling request took 1.173765485s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-6-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:09.288983842Z I0308 10:44:09.288483       1 request.go:645] Throttling request took 1.282484709s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T10:44:09.539908966Z I0308 10:44:09.539840       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 6, but has not made progress because 
2022-03-08T10:44:10.288730168Z I0308 10:44:10.288574       1 request.go:645] Throttling request took 1.391201717s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-1.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:10.702271793Z I0308 10:44:10.700970       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/kube-controller-cert-syncer-kubeconfig-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:11.488563760Z I0308 10:44:11.488499       1 request.go:645] Throttling request took 1.172016473s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-2.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:11.915332878Z I0308 10:44:11.915270       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/serviceaccount-ca-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:12.101973919Z I0308 10:44:12.101866       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 6, but has not made progress because 
2022-03-08T10:44:12.489366214Z I0308 10:44:12.488575       1 request.go:645] Throttling request took 1.386053754s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-4-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:13.316610777Z I0308 10:44:13.316542       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/service-ca-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:13.488913569Z I0308 10:44:13.488792       1 request.go:645] Throttling request took 1.385601452s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-6-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:14.489276570Z I0308 10:44:14.489159       1 request.go:645] Throttling request took 1.172869071s, request: POST:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/configmaps
2022-03-08T10:44:14.511132954Z I0308 10:44:14.508892       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/recycler-config-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:15.688605387Z I0308 10:44:15.688543       1 request.go:645] Throttling request took 1.350043495s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/localhost-recovery-client
2022-03-08T10:44:15.900015602Z I0308 10:44:15.899940       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'SecretCreated' Created Secret/service-account-private-key-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:16.095102744Z I0308 10:44:16.094768       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 6, but has not made progress because waiting for static pod of revision 6, found 4
2022-03-08T10:44:16.925594905Z I0308 10:44:16.925514       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'SecretCreated' Created Secret/serving-cert-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:17.910510272Z I0308 10:44:17.910426       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'SecretCreated' Created Secret/localhost-recovery-client-token-7 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:17.944876074Z I0308 10:44:17.944703       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RevisionCreate' Revision 6 created because secret/localhost-recovery-client-token has changed
2022-03-08T10:44:19.088762910Z I0308 10:44:19.088686       1 request.go:645] Throttling request took 1.146248472s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-4-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:19.293270460Z I0308 10:44:19.293225       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 6, but has not made progress because waiting for static pod of revision 6, found 4
2022-03-08T10:44:19.321839377Z I0308 10:44:19.321676       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:43:58Z","message":"NodeInstallerDegraded: 1 nodes are failing on revision 4:\nNodeInstallerDegraded: ; 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending","reason":"NodeInstaller_InstallerPodFailed","status":"True","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:38:54Z","message":"NodeInstallerProgressing: 2 nodes are at revision 0; 1 nodes are at revision 6; 0 nodes have achieved new revision 7","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 1 nodes are active; 2 nodes are at revision 0; 1 nodes are at revision 6; 0 nodes have achieved new revision 7","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:44:19.335452555Z I0308 10:44:19.335397       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Progressing message changed from "NodeInstallerProgressing: 2 nodes are at revision 0; 1 nodes are at revision 6" to "NodeInstallerProgressing: 2 nodes are at revision 0; 1 nodes are at revision 6; 0 nodes have achieved new revision 7",Available message changed from "StaticPodsAvailable: 1 nodes are active; 2 nodes are at revision 0; 1 nodes are at revision 6" to "StaticPodsAvailable: 1 nodes are active; 2 nodes are at revision 0; 1 nodes are at revision 6; 0 nodes have achieved new revision 7"
2022-03-08T10:44:20.488657967Z I0308 10:44:20.488583       1 request.go:645] Throttling request took 1.173370502s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-6-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:21.499143274Z I0308 10:44:21.499091       1 installer_controller.go:318] "master-0.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:44:21.499143274Z  NodeName: (string) (len=49) "master-0.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:44:21.499143274Z  CurrentRevision: (int32) 0,
2022-03-08T10:44:21.499143274Z  TargetRevision: (int32) 0,
2022-03-08T10:44:21.499143274Z  LastFailedRevision: (int32) 6,
2022-03-08T10:44:21.499143274Z  LastFailedRevisionErrors: ([]string) (len=1 cap=1) {
2022-03-08T10:44:21.499143274Z   (string) (len=93) "static pod of revision 6 has been installed, but is not ready while new revision 7 is pending"
2022-03-08T10:44:21.499143274Z  }
2022-03-08T10:44:21.499143274Z }
2022-03-08T10:44:21.499143274Z  because new revision pending
2022-03-08T10:44:21.530027735Z I0308 10:44:21.529360       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:43:58Z","message":"NodeInstallerDegraded: 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending; 1 nodes are failing on revision 6:\nNodeInstallerDegraded: static pod of revision 6 has been installed, but is not ready while new revision 7 is pending","reason":"NodeInstaller_InstallerPodFailed","status":"True","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:38:54Z","message":"NodeInstallerProgressing: 2 nodes are at revision 0; 1 nodes are at revision 6; 0 nodes have achieved new revision 7","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 1 nodes are active; 2 nodes are at revision 0; 1 nodes are at revision 6; 0 nodes have achieved new revision 7","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:44:21.551446801Z I0308 10:44:21.551323       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "NodeInstallerDegraded: 1 nodes are failing on revision 4:\nNodeInstallerDegraded: ; 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending" to "NodeInstallerDegraded: 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending; 1 nodes are failing on revision 6:\nNodeInstallerDegraded: static pod of revision 6 has been installed, but is not ready while new revision 7 is pending"
2022-03-08T10:44:22.505886671Z I0308 10:44:22.505798       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapUpdated' Updated ConfigMap/revision-status-6 -n openshift-kube-controller-manager:
2022-03-08T10:44:22.505886671Z cause by changes in data.status
2022-03-08T10:44:22.688556603Z I0308 10:44:22.688479       1 request.go:645] Throttling request took 1.163018103s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T10:44:23.689010692Z I0308 10:44:23.688932       1 request.go:645] Throttling request took 1.182344247s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:26.313393468Z I0308 10:44:26.313331       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/revision-pruner-6-master-0.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:27.488486750Z I0308 10:44:27.488416       1 request.go:645] Throttling request took 1.159249239s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:28.488956713Z I0308 10:44:28.488884       1 request.go:645] Throttling request took 1.192481458s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:44:28.892685558Z I0308 10:44:28.892646       1 installer_controller.go:350] node master-0.case03116926.lab.upshift.rdu2.redhat.com with revision 0 is the oldest not matching its expected revision 0 and needs new revision 7
2022-03-08T10:44:28.892760056Z I0308 10:44:28.892749       1 installer_controller.go:359] "master-0.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:44:28.892760056Z  NodeName: (string) (len=49) "master-0.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:44:28.892760056Z  CurrentRevision: (int32) 0,
2022-03-08T10:44:28.892760056Z  TargetRevision: (int32) 7,
2022-03-08T10:44:28.892760056Z  LastFailedRevision: (int32) 6,
2022-03-08T10:44:28.892760056Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:44:28.892760056Z }
2022-03-08T10:44:28.913773270Z I0308 10:44:28.913635       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:43:58Z","message":"NodeInstallerDegraded: 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending; 1 nodes are failing on revision 6:\nNodeInstallerDegraded: ","reason":"NodeInstaller_InstallerPodFailed","status":"True","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:38:54Z","message":"NodeInstallerProgressing: 2 nodes are at revision 0; 1 nodes are at revision 6; 0 nodes have achieved new revision 7","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 1 nodes are active; 2 nodes are at revision 0; 1 nodes are at revision 6; 0 nodes have achieved new revision 7","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:44:28.915776866Z I0308 10:44:28.915718       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeTargetRevisionChanged' Updating node "master-0.case03116926.lab.upshift.rdu2.redhat.com" from revision 0 to 7 because node master-0.case03116926.lab.upshift.rdu2.redhat.com with revision 0 is the oldest not matching its expected revision 0
2022-03-08T10:44:28.934970230Z I0308 10:44:28.933413       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "NodeInstallerDegraded: 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending; 1 nodes are failing on revision 6:\nNodeInstallerDegraded: static pod of revision 6 has been installed, but is not ready while new revision 7 is pending" to "NodeInstallerDegraded: 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending; 1 nodes are failing on revision 6:\nNodeInstallerDegraded: "
2022-03-08T10:44:30.089136099Z I0308 10:44:30.088487       1 request.go:645] Throttling request took 1.174471078s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-6-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:31.288539444Z I0308 10:44:31.288482       1 request.go:645] Throttling request took 1.18296267s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-5-master-1.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:31.526739098Z I0308 10:44:31.526673       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/installer-7-master-0.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:44:32.289168514Z I0308 10:44:32.288722       1 request.go:645] Throttling request took 1.10342836s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:44:32.698752051Z I0308 10:44:32.698701       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:44:33.289533143Z I0308 10:44:33.289410       1 request.go:645] Throttling request took 1.184832048s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-2.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:44:34.519320919Z I0308 10:44:34.510280       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:44:36.509500745Z I0308 10:44:36.509411       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:44:41.358197299Z I0308 10:44:41.357893       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:44:42.894574618Z I0308 10:44:42.894436       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:44:46.298284548Z I0308 10:44:46.298228       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because waiting for static pod of revision 7, found 6
2022-03-08T10:44:59.650702870Z I0308 10:44:59.645611       1 request.go:645] Throttling request took 1.039447851s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/configmaps/config
2022-03-08T10:45:00.252153697Z I0308 10:45:00.250141       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:45:02.849808877Z I0308 10:45:02.849714       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:45:04.921230363Z I0308 10:45:04.921041       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:45:07.480289777Z I0308 10:45:07.480192       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:45:15.250422204Z I0308 10:45:15.250344       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:45:18.253284381Z I0308 10:45:18.253218       1 installer_controller.go:318] "master-0.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:45:18.253284381Z  NodeName: (string) (len=49) "master-0.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:45:18.253284381Z  CurrentRevision: (int32) 7,
2022-03-08T10:45:18.253284381Z  TargetRevision: (int32) 0,
2022-03-08T10:45:18.253284381Z  LastFailedRevision: (int32) 0,
2022-03-08T10:45:18.253284381Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:45:18.253284381Z }
2022-03-08T10:45:18.253284381Z  because static pod is ready
2022-03-08T10:45:18.272297998Z I0308 10:45:18.272224       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeCurrentRevisionChanged' Updated node "master-0.case03116926.lab.upshift.rdu2.redhat.com" from revision 0 to 7 because static pod is ready
2022-03-08T10:45:18.279321980Z I0308 10:45:18.279210       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:43:58Z","message":"NodeInstallerDegraded: 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending","reason":"NodeInstaller_InstallerPodFailed","status":"True","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:38:54Z","message":"NodeInstallerProgressing: 1 nodes are at revision 0; 1 nodes are at revision 6; 1 nodes are at revision 7","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 2 nodes are active; 1 nodes are at revision 0; 1 nodes are at revision 6; 1 nodes are at revision 7","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:45:18.306649678Z I0308 10:45:18.306591       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "NodeInstallerDegraded: 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending; 1 nodes are failing on revision 6:\nNodeInstallerDegraded: " to "NodeInstallerDegraded: 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending",Progressing message changed from "NodeInstallerProgressing: 2 nodes are at revision 0; 1 nodes are at revision 6; 0 nodes have achieved new revision 7" to "NodeInstallerProgressing: 1 nodes are at revision 0; 1 nodes are at revision 6; 1 nodes are at revision 7",Available message changed from "StaticPodsAvailable: 1 nodes are active; 2 nodes are at revision 0; 1 nodes are at revision 6; 0 nodes have achieved new revision 7" to "StaticPodsAvailable: 2 nodes are active; 1 nodes are at revision 0; 1 nodes are at revision 6; 1 nodes are at revision 7"
2022-03-08T10:45:19.445750938Z I0308 10:45:19.445671       1 request.go:645] Throttling request took 1.166835671s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:45:20.270172452Z I0308 10:45:20.269954       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/revision-pruner-7-master-0.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:45:21.447382146Z I0308 10:45:21.447238       1 request.go:645] Throttling request took 1.177157949s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:45:22.645863646Z I0308 10:45:22.645778       1 request.go:645] Throttling request took 1.191120442s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:45:24.653179258Z I0308 10:45:24.653119       1 installer_controller.go:350] node master-1.case03116926.lab.upshift.rdu2.redhat.com with revision 1 is the oldest not matching its expected revision 0 and needs new revision 7
2022-03-08T10:45:24.653311062Z I0308 10:45:24.653291       1 installer_controller.go:359] "master-1.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:45:24.653311062Z  NodeName: (string) (len=49) "master-1.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:45:24.653311062Z  CurrentRevision: (int32) 0,
2022-03-08T10:45:24.653311062Z  TargetRevision: (int32) 7,
2022-03-08T10:45:24.653311062Z  LastFailedRevision: (int32) 5,
2022-03-08T10:45:24.653311062Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:45:24.653311062Z }
2022-03-08T10:45:24.676398920Z I0308 10:45:24.676334       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeTargetRevisionChanged' Updating node "master-1.case03116926.lab.upshift.rdu2.redhat.com" from revision 0 to 7 because node master-1.case03116926.lab.upshift.rdu2.redhat.com with revision 1 is the oldest not matching its expected revision 0
2022-03-08T10:45:24.689100648Z I0308 10:45:24.689034       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:43:58Z","message":"NodeInstallerDegraded: 1 nodes are failing on revision 5:\nNodeInstallerDegraded: ","reason":"NodeInstaller_InstallerPodFailed","status":"True","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:38:54Z","message":"NodeInstallerProgressing: 1 nodes are at revision 0; 1 nodes are at revision 6; 1 nodes are at revision 7","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 2 nodes are active; 1 nodes are at revision 0; 1 nodes are at revision 6; 1 nodes are at revision 7","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:45:24.703488308Z I0308 10:45:24.703426       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "NodeInstallerDegraded: 1 nodes are failing on revision 5:\nNodeInstallerDegraded: static pod of revision 5 has been installed, but is not ready while new revision 6 is pending" to "NodeInstallerDegraded: 1 nodes are failing on revision 5:\nNodeInstallerDegraded: "
2022-03-08T10:45:25.845732011Z I0308 10:45:25.845677       1 request.go:645] Throttling request took 1.169332754s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-7-master-1.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:45:26.846007321Z I0308 10:45:26.845957       1 request.go:645] Throttling request took 1.250370374s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:45:27.057947591Z I0308 10:45:27.057894       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/installer-7-master-1.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:45:28.045966906Z I0308 10:45:28.045904       1 request.go:645] Throttling request took 1.19070855s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:45:28.251621850Z I0308 10:45:28.251361       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:45:29.245715330Z I0308 10:45:29.245666       1 request.go:645] Throttling request took 1.191861113s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:45:30.451807752Z I0308 10:45:30.451757       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:45:32.050215971Z I0308 10:45:32.050160       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:45:33.850655097Z I0308 10:45:33.850600       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:45:37.051655372Z I0308 10:45:37.051386       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because waiting for static pod of revision 7, found 5
2022-03-08T10:45:49.649561797Z I0308 10:45:49.649480       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:45:51.850077031Z I0308 10:45:51.849992       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:45:55.451277262Z I0308 10:45:55.450133       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:45:59.846260011Z I0308 10:45:59.846191       1 request.go:645] Throttling request took 1.041353803s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:46:01.650551599Z I0308 10:46:01.650446       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:46:04.250944295Z I0308 10:46:04.250861       1 installer_controller.go:318] "master-1.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:46:04.250944295Z  NodeName: (string) (len=49) "master-1.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:46:04.250944295Z  CurrentRevision: (int32) 7,
2022-03-08T10:46:04.250944295Z  TargetRevision: (int32) 0,
2022-03-08T10:46:04.250944295Z  LastFailedRevision: (int32) 0,
2022-03-08T10:46:04.250944295Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:46:04.250944295Z }
2022-03-08T10:46:04.250944295Z  because static pod is ready
2022-03-08T10:46:04.281518327Z I0308 10:46:04.281414       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"NodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:38:54Z","message":"NodeInstallerProgressing: 1 nodes are at revision 6; 2 nodes are at revision 7","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 1 nodes are at revision 6; 2 nodes are at revision 7","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:46:04.282233644Z I0308 10:46:04.282175       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeCurrentRevisionChanged' Updated node "master-1.case03116926.lab.upshift.rdu2.redhat.com" from revision 0 to 7 because static pod is ready
2022-03-08T10:46:04.298840661Z I0308 10:46:04.298747       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded changed from True to False ("NodeControllerDegraded: All master nodes are ready"),Progressing message changed from "NodeInstallerProgressing: 1 nodes are at revision 0; 1 nodes are at revision 6; 1 nodes are at revision 7" to "NodeInstallerProgressing: 1 nodes are at revision 6; 2 nodes are at revision 7",Available message changed from "StaticPodsAvailable: 2 nodes are active; 1 nodes are at revision 0; 1 nodes are at revision 6; 1 nodes are at revision 7" to "StaticPodsAvailable: 3 nodes are active; 1 nodes are at revision 6; 2 nodes are at revision 7"
2022-03-08T10:46:05.445782461Z I0308 10:46:05.445709       1 request.go:645] Throttling request took 1.16341943s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:46:07.278796816Z I0308 10:46:07.278622       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/revision-pruner-7-master-1.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:46:08.445839935Z I0308 10:46:08.445748       1 request.go:645] Throttling request took 1.159378875s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:46:10.651451771Z I0308 10:46:10.651368       1 installer_controller.go:350] node master-2.case03116926.lab.upshift.rdu2.redhat.com with revision 6 is the oldest and needs new revision 7
2022-03-08T10:46:10.651451771Z I0308 10:46:10.651424       1 installer_controller.go:359] "master-2.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:46:10.651451771Z  NodeName: (string) (len=49) "master-2.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:46:10.651451771Z  CurrentRevision: (int32) 6,
2022-03-08T10:46:10.651451771Z  TargetRevision: (int32) 7,
2022-03-08T10:46:10.651451771Z  LastFailedRevision: (int32) 0,
2022-03-08T10:46:10.651451771Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:46:10.651451771Z }
2022-03-08T10:46:10.678782546Z I0308 10:46:10.678702       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeTargetRevisionChanged' Updating node "master-2.case03116926.lab.upshift.rdu2.redhat.com" from revision 6 to 7 because node master-2.case03116926.lab.upshift.rdu2.redhat.com with revision 6 is the oldest
2022-03-08T10:46:11.845774198Z I0308 10:46:11.845697       1 request.go:645] Throttling request took 1.165579585s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-7-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:46:12.676116664Z I0308 10:46:12.675738       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/installer-7-master-2.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:46:13.245755374Z I0308 10:46:13.245678       1 request.go:645] Throttling request took 1.117130822s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:46:13.851647948Z I0308 10:46:13.851553       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:46:14.246757296Z I0308 10:46:14.246655       1 request.go:645] Throttling request took 1.195657247s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/configmaps/cluster-policy-controller-config
2022-03-08T10:46:16.050772612Z I0308 10:46:16.050684       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:46:17.771487696Z I0308 10:46:17.771343       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:46:19.653867989Z I0308 10:46:19.653760       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because 
2022-03-08T10:46:23.052499444Z I0308 10:46:23.050974       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because waiting for static pod of revision 7, found 6
2022-03-08T10:46:35.657633156Z I0308 10:46:35.656493       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:46:38.254905457Z I0308 10:46:38.254512       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:46:40.251771927Z I0308 10:46:40.251711       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:46:42.250196061Z I0308 10:46:42.250048       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:46:44.251778700Z I0308 10:46:44.251650       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 7, but has not made progress because static pod is pending
2022-03-08T10:46:54.255353949Z I0308 10:46:54.255250       1 installer_controller.go:318] "master-2.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:46:54.255353949Z  NodeName: (string) (len=49) "master-2.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:46:54.255353949Z  CurrentRevision: (int32) 7,
2022-03-08T10:46:54.255353949Z  TargetRevision: (int32) 0,
2022-03-08T10:46:54.255353949Z  LastFailedRevision: (int32) 0,
2022-03-08T10:46:54.255353949Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:46:54.255353949Z }
2022-03-08T10:46:54.255353949Z  because static pod is ready
2022-03-08T10:46:54.290433352Z I0308 10:46:54.290381       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"NodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:46:54Z","message":"NodeInstallerProgressing: 3 nodes are at revision 7","reason":"AsExpected","status":"False","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 7","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:46:54.307309903Z I0308 10:46:54.307242       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeCurrentRevisionChanged' Updated node "master-2.case03116926.lab.upshift.rdu2.redhat.com" from revision 6 to 7 because static pod is ready
2022-03-08T10:46:54.314891311Z I0308 10:46:54.314655       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Progressing changed from True to False ("NodeInstallerProgressing: 3 nodes are at revision 7"),Available message changed from "StaticPodsAvailable: 3 nodes are active; 1 nodes are at revision 6; 2 nodes are at revision 7" to "StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 7"
2022-03-08T10:46:55.445809181Z I0308 10:46:55.445676       1 request.go:645] Throttling request took 1.155424814s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-7-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:46:55.654609373Z I0308 10:46:55.654533       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapUpdated' Updated ConfigMap/revision-status-7 -n openshift-kube-controller-manager:
2022-03-08T10:46:55.654609373Z cause by changes in data.status
2022-03-08T10:46:58.468480174Z I0308 10:46:58.468366       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/revision-pruner-7-master-2.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:46:59.445759682Z I0308 10:46:59.445677       1 request.go:645] Throttling request took 1.049881553s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:47:00.645748216Z I0308 10:47:00.645692       1 request.go:645] Throttling request took 1.193089721s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:47:19.274771061Z I0308 10:47:19.274688       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"StaticPodsDegraded: pod/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com container \"kube-controller-manager-recovery-controller\" is terminated: Completed: \nNodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:46:54Z","message":"NodeInstallerProgressing: 3 nodes are at revision 7","reason":"AsExpected","status":"False","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 7","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:47:19.288198611Z I0308 10:47:19.288141       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "NodeControllerDegraded: All master nodes are ready" to "StaticPodsDegraded: pod/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com container \"kube-controller-manager-recovery-controller\" is terminated: Completed: \nNodeControllerDegraded: All master nodes are ready"
2022-03-08T10:47:20.445787165Z I0308 10:47:20.445697       1 request.go:645] Throttling request took 1.171735682s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager
2022-03-08T10:47:22.069505854Z I0308 10:47:22.069436       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"NodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:46:54Z","message":"NodeInstallerProgressing: 3 nodes are at revision 7","reason":"AsExpected","status":"False","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 7","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:47:22.083537356Z I0308 10:47:22.083422       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "StaticPodsDegraded: pod/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com container \"kube-controller-manager-recovery-controller\" is terminated: Completed: \nNodeControllerDegraded: All master nodes are ready" to "NodeControllerDegraded: All master nodes are ready"
2022-03-08T10:47:23.248279502Z I0308 10:47:23.245753       1 request.go:645] Throttling request took 1.177894426s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:50:00.060349814Z I0308 10:50:00.060225       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'SecretUpdated' Updated Secret/service-account-private-key -n openshift-kube-controller-manager because it changed
2022-03-08T10:50:00.064601910Z I0308 10:50:00.064550       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RevisionTriggered' new revision 8 triggered by "secret/service-account-private-key has changed"
2022-03-08T10:50:00.876396048Z I0308 10:50:00.870657       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/revision-status-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:01.667893325Z I0308 10:50:01.667825       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/kube-controller-manager-pod-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:02.271083672Z I0308 10:50:02.270700       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/config-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:02.867675186Z I0308 10:50:02.867446       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/cluster-policy-controller-config-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:03.462770483Z I0308 10:50:03.462431       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/controller-manager-kubeconfig-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:04.668384155Z I0308 10:50:04.667925       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/kube-controller-cert-syncer-kubeconfig-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:05.275046419Z I0308 10:50:05.269440       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/serviceaccount-ca-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:05.860013737Z I0308 10:50:05.859937       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/service-ca-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:06.462958243Z I0308 10:50:06.462856       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/recycler-config-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:07.066586430Z I0308 10:50:07.066444       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'SecretCreated' Created Secret/service-account-private-key-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:07.663144093Z I0308 10:50:07.661699       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'SecretCreated' Created Secret/serving-cert-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:08.287970465Z I0308 10:50:08.287648       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'SecretCreated' Created Secret/localhost-recovery-client-token-8 -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:08.311779944Z I0308 10:50:08.310359       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RevisionCreate' Revision 7 created because secret/service-account-private-key has changed
2022-03-08T10:50:08.322000991Z I0308 10:50:08.321919       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RevisionTriggered' new revision 8 triggered by "secret/service-account-private-key has changed"
2022-03-08T10:50:09.446094167Z I0308 10:50:09.446009       1 request.go:645] Throttling request took 1.128966388s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:50:09.662766243Z W0308 10:50:09.662102       1 staticpod.go:37] revision 8 is unexpectedly already the latest available revision. This is a possible race!
2022-03-08T10:50:09.677571052Z I0308 10:50:09.676940       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"NodeControllerDegraded: All master nodes are ready\nRevisionControllerDegraded: conflicting latestAvailableRevision 8","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:46:54Z","message":"NodeInstallerProgressing: 3 nodes are at revision 7","reason":"AsExpected","status":"False","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 7","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:50:09.681551086Z E0308 10:50:09.681463       1 base_controller.go:250] "RevisionController" controller failed to sync "key", err: conflicting latestAvailableRevision 8
2022-03-08T10:50:09.690588241Z I0308 10:50:09.690475       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "NodeControllerDegraded: All master nodes are ready" to "NodeControllerDegraded: All master nodes are ready\nRevisionControllerDegraded: conflicting latestAvailableRevision 8"
2022-03-08T10:50:09.715652822Z I0308 10:50:09.714754       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"NodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:46:54Z","message":"NodeInstallerProgressing: 3 nodes are at revision 7","reason":"AsExpected","status":"False","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 7","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:50:09.730670143Z I0308 10:50:09.730569       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "NodeControllerDegraded: All master nodes are ready\nRevisionControllerDegraded: conflicting latestAvailableRevision 8" to "NodeControllerDegraded: All master nodes are ready"
2022-03-08T10:50:10.645756497Z I0308 10:50:10.645681       1 request.go:645] Throttling request took 1.191250866s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-1.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:50:11.646532179Z I0308 10:50:11.645705       1 request.go:645] Throttling request took 1.190888658s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-7-master-2.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:50:12.845705642Z I0308 10:50:12.845646       1 request.go:645] Throttling request took 1.178794856s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-7-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:50:15.051547640Z I0308 10:50:15.051487       1 installer_controller.go:350] node master-0.case03116926.lab.upshift.rdu2.redhat.com with revision 7 is the oldest and needs new revision 8
2022-03-08T10:50:15.051595522Z I0308 10:50:15.051557       1 installer_controller.go:359] "master-0.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:50:15.051595522Z  NodeName: (string) (len=49) "master-0.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:50:15.051595522Z  CurrentRevision: (int32) 7,
2022-03-08T10:50:15.051595522Z  TargetRevision: (int32) 8,
2022-03-08T10:50:15.051595522Z  LastFailedRevision: (int32) 0,
2022-03-08T10:50:15.051595522Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:50:15.051595522Z }
2022-03-08T10:50:15.076647715Z I0308 10:50:15.076586       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"NodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:50:15Z","message":"NodeInstallerProgressing: 3 nodes are at revision 7; 0 nodes have achieved new revision 8","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 7; 0 nodes have achieved new revision 8","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:50:15.079641457Z I0308 10:50:15.078960       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeTargetRevisionChanged' Updating node "master-0.case03116926.lab.upshift.rdu2.redhat.com" from revision 7 to 8 because node master-0.case03116926.lab.upshift.rdu2.redhat.com with revision 7 is the oldest
2022-03-08T10:50:15.108706912Z I0308 10:50:15.108633       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Progressing changed from False to True ("NodeInstallerProgressing: 3 nodes are at revision 7; 0 nodes have achieved new revision 8"),Available message changed from "StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 7" to "StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 7; 0 nodes have achieved new revision 8"
2022-03-08T10:50:16.245767422Z I0308 10:50:16.245681       1 request.go:645] Throttling request took 1.165440789s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-8-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:50:17.263752341Z I0308 10:50:17.263438       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/installer-8-master-0.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:50:18.251868839Z I0308 10:50:18.251800       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:50:18.445988987Z I0308 10:50:18.445910       1 request.go:645] Throttling request took 1.182419589s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:50:20.252979884Z I0308 10:50:20.252016       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:50:22.051347158Z I0308 10:50:22.051270       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:50:23.850830782Z I0308 10:50:23.850724       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:50:27.450159427Z I0308 10:50:27.450044       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because waiting for static pod of revision 8, found 7
2022-03-08T10:50:39.459423834Z I0308 10:50:39.459291       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:50:41.450130709Z I0308 10:50:41.450055       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:50:44.652036566Z I0308 10:50:44.651958       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:50:46.850663502Z I0308 10:50:46.850614       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:50:51.250215470Z I0308 10:50:51.250138       1 installer_controller.go:331] "master-0.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:50:58.458775142Z I0308 10:50:58.458720       1 installer_controller.go:318] "master-0.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:50:58.458775142Z  NodeName: (string) (len=49) "master-0.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:50:58.458775142Z  CurrentRevision: (int32) 8,
2022-03-08T10:50:58.458775142Z  TargetRevision: (int32) 0,
2022-03-08T10:50:58.458775142Z  LastFailedRevision: (int32) 0,
2022-03-08T10:50:58.458775142Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:50:58.458775142Z }
2022-03-08T10:50:58.458775142Z  because static pod is ready
2022-03-08T10:50:58.476381346Z I0308 10:50:58.476301       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeCurrentRevisionChanged' Updated node "master-0.case03116926.lab.upshift.rdu2.redhat.com" from revision 7 to 8 because static pod is ready
2022-03-08T10:50:58.482417922Z I0308 10:50:58.482367       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"NodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:50:15Z","message":"NodeInstallerProgressing: 2 nodes are at revision 7; 1 nodes are at revision 8","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 2 nodes are at revision 7; 1 nodes are at revision 8","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:50:58.498925953Z I0308 10:50:58.498843       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Progressing message changed from "NodeInstallerProgressing: 3 nodes are at revision 7; 0 nodes have achieved new revision 8" to "NodeInstallerProgressing: 2 nodes are at revision 7; 1 nodes are at revision 8",Available message changed from "StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 7; 0 nodes have achieved new revision 8" to "StaticPodsAvailable: 3 nodes are active; 2 nodes are at revision 7; 1 nodes are at revision 8"
2022-03-08T10:50:59.645825812Z I0308 10:50:59.645720       1 request.go:645] Throttling request took 1.165750708s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-8-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:51:00.645830683Z I0308 10:51:00.645755       1 request.go:645] Throttling request took 1.184412973s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T10:51:00.866032676Z I0308 10:51:00.865562       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/revision-pruner-8-master-0.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:51:02.045754345Z I0308 10:51:02.045681       1 request.go:645] Throttling request took 1.179973286s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:51:03.045770157Z I0308 10:51:03.045703       1 request.go:645] Throttling request took 1.193983082s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-7-master-2.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:51:04.045766846Z I0308 10:51:04.045705       1 request.go:645] Throttling request took 1.195741064s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/secrets/csr-signer
2022-03-08T10:51:05.453258990Z I0308 10:51:05.453206       1 installer_controller.go:350] node master-1.case03116926.lab.upshift.rdu2.redhat.com with revision 7 is the oldest and needs new revision 8
2022-03-08T10:51:05.453307551Z I0308 10:51:05.453252       1 installer_controller.go:359] "master-1.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:51:05.453307551Z  NodeName: (string) (len=49) "master-1.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:51:05.453307551Z  CurrentRevision: (int32) 7,
2022-03-08T10:51:05.453307551Z  TargetRevision: (int32) 8,
2022-03-08T10:51:05.453307551Z  LastFailedRevision: (int32) 0,
2022-03-08T10:51:05.453307551Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:51:05.453307551Z }
2022-03-08T10:51:05.482529095Z I0308 10:51:05.482433       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeTargetRevisionChanged' Updating node "master-1.case03116926.lab.upshift.rdu2.redhat.com" from revision 7 to 8 because node master-1.case03116926.lab.upshift.rdu2.redhat.com with revision 7 is the oldest
2022-03-08T10:51:06.646450753Z I0308 10:51:06.646101       1 request.go:645] Throttling request took 1.162894957s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-8-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:51:07.845810575Z I0308 10:51:07.845716       1 request.go:645] Throttling request took 1.39635537s, request: POST:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods
2022-03-08T10:51:07.867016430Z I0308 10:51:07.866901       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/installer-8-master-1.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:51:08.855226080Z I0308 10:51:08.854973       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:51:09.046279635Z I0308 10:51:09.046201       1 request.go:645] Throttling request took 1.179297245s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:51:10.245667125Z I0308 10:51:10.245602       1 request.go:645] Throttling request took 1.185926968s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:51:11.049047743Z I0308 10:51:11.048999       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:51:13.252916881Z I0308 10:51:13.252856       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:51:15.852896766Z I0308 10:51:15.852838       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:51:17.452961894Z I0308 10:51:17.452908       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:51:20.050195665Z I0308 10:51:20.050134       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because waiting for static pod of revision 8, found 7
2022-03-08T10:51:29.649785560Z I0308 10:51:29.649662       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:51:31.652042055Z I0308 10:51:31.651966       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:51:33.850228190Z I0308 10:51:33.850039       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:51:36.255406155Z I0308 10:51:36.255343       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:51:38.878254639Z I0308 10:51:38.878171       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:51:42.054892896Z I0308 10:51:42.054828       1 installer_controller.go:331] "master-1.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:51:45.250358561Z I0308 10:51:45.250303       1 installer_controller.go:318] "master-1.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:51:45.250358561Z  NodeName: (string) (len=49) "master-1.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:51:45.250358561Z  CurrentRevision: (int32) 8,
2022-03-08T10:51:45.250358561Z  TargetRevision: (int32) 0,
2022-03-08T10:51:45.250358561Z  LastFailedRevision: (int32) 0,
2022-03-08T10:51:45.250358561Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:51:45.250358561Z }
2022-03-08T10:51:45.250358561Z  because static pod is ready
2022-03-08T10:51:45.275721951Z I0308 10:51:45.275671       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"NodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:50:15Z","message":"NodeInstallerProgressing: 1 nodes are at revision 7; 2 nodes are at revision 8","reason":"NodeInstaller","status":"True","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 1 nodes are at revision 7; 2 nodes are at revision 8","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:51:45.277577164Z I0308 10:51:45.277497       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeCurrentRevisionChanged' Updated node "master-1.case03116926.lab.upshift.rdu2.redhat.com" from revision 7 to 8 because static pod is ready
2022-03-08T10:51:45.292693451Z I0308 10:51:45.292626       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Progressing message changed from "NodeInstallerProgressing: 2 nodes are at revision 7; 1 nodes are at revision 8" to "NodeInstallerProgressing: 1 nodes are at revision 7; 2 nodes are at revision 8",Available message changed from "StaticPodsAvailable: 3 nodes are active; 2 nodes are at revision 7; 1 nodes are at revision 8" to "StaticPodsAvailable: 3 nodes are active; 1 nodes are at revision 7; 2 nodes are at revision 8"
2022-03-08T10:51:46.445803746Z I0308 10:51:46.445728       1 request.go:645] Throttling request took 1.165812317s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-8-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:51:48.483083428Z I0308 10:51:48.482980       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/revision-pruner-8-master-1.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:51:49.645761641Z I0308 10:51:49.645688       1 request.go:645] Throttling request took 1.162322849s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-7-master-2.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:51:51.463299892Z I0308 10:51:51.463224       1 installer_controller.go:350] node master-2.case03116926.lab.upshift.rdu2.redhat.com with revision 7 is the oldest and needs new revision 8
2022-03-08T10:51:51.463365275Z I0308 10:51:51.463290       1 installer_controller.go:359] "master-2.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:51:51.463365275Z  NodeName: (string) (len=49) "master-2.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:51:51.463365275Z  CurrentRevision: (int32) 7,
2022-03-08T10:51:51.463365275Z  TargetRevision: (int32) 8,
2022-03-08T10:51:51.463365275Z  LastFailedRevision: (int32) 0,
2022-03-08T10:51:51.463365275Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:51:51.463365275Z }
2022-03-08T10:51:51.492774871Z I0308 10:51:51.492706       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeTargetRevisionChanged' Updating node "master-2.case03116926.lab.upshift.rdu2.redhat.com" from revision 7 to 8 because node master-2.case03116926.lab.upshift.rdu2.redhat.com with revision 7 is the oldest
2022-03-08T10:51:52.645881226Z I0308 10:51:52.645787       1 request.go:645] Throttling request took 1.153270943s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-8-master-2.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:51:53.671312566Z I0308 10:51:53.671216       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/installer-8-master-2.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:51:54.045760805Z I0308 10:51:54.045692       1 request.go:645] Throttling request took 1.045729368s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
2022-03-08T10:51:54.851114593Z I0308 10:51:54.850994       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:51:55.045762556Z I0308 10:51:55.045689       1 request.go:645] Throttling request took 1.193783209s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-7-master-2.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:51:56.046712017Z I0308 10:51:56.046643       1 request.go:645] Throttling request took 1.19481703s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-8-master-2.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:51:57.050087290Z I0308 10:51:57.049995       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:51:58.652229432Z I0308 10:51:58.652153       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:51:59.645886383Z I0308 10:51:59.645790       1 request.go:645] Throttling request took 1.146113931s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/services/kube-controller-manager
2022-03-08T10:52:01.049201264Z I0308 10:52:01.049132       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because 
2022-03-08T10:52:04.468926211Z I0308 10:52:04.468875       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because waiting for static pod of revision 8, found 7
2022-03-08T10:52:16.250826654Z I0308 10:52:16.250752       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:52:19.065727793Z I0308 10:52:19.065643       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:52:20.849593381Z I0308 10:52:20.849526       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:52:25.057891146Z I0308 10:52:25.057841       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:52:28.850853232Z I0308 10:52:28.850789       1 installer_controller.go:331] "master-2.case03116926.lab.upshift.rdu2.redhat.com" is in transition to 8, but has not made progress because static pod is pending
2022-03-08T10:52:33.453501014Z I0308 10:52:33.453415       1 installer_controller.go:318] "master-2.case03116926.lab.upshift.rdu2.redhat.com" moving to (v1.NodeStatus) {
2022-03-08T10:52:33.453501014Z  NodeName: (string) (len=49) "master-2.case03116926.lab.upshift.rdu2.redhat.com",
2022-03-08T10:52:33.453501014Z  CurrentRevision: (int32) 8,
2022-03-08T10:52:33.453501014Z  TargetRevision: (int32) 0,
2022-03-08T10:52:33.453501014Z  LastFailedRevision: (int32) 0,
2022-03-08T10:52:33.453501014Z  LastFailedRevisionErrors: ([]string) <nil>
2022-03-08T10:52:33.453501014Z }
2022-03-08T10:52:33.453501014Z  because static pod is ready
2022-03-08T10:52:33.474367980Z I0308 10:52:33.474279       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeCurrentRevisionChanged' Updated node "master-2.case03116926.lab.upshift.rdu2.redhat.com" from revision 7 to 8 because static pod is ready
2022-03-08T10:52:33.476792825Z I0308 10:52:33.476752       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"NodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:52:33Z","message":"NodeInstallerProgressing: 3 nodes are at revision 8","reason":"AsExpected","status":"False","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 8","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T10:52:33.491001749Z I0308 10:52:33.490935       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Progressing changed from True to False ("NodeInstallerProgressing: 3 nodes are at revision 8"),Available message changed from "StaticPodsAvailable: 3 nodes are active; 1 nodes are at revision 7; 2 nodes are at revision 8" to "StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 8"
2022-03-08T10:52:34.471231921Z I0308 10:52:34.471182       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapUpdated' Updated ConfigMap/revision-status-8 -n openshift-kube-controller-manager:
2022-03-08T10:52:34.471231921Z cause by changes in data.status
2022-03-08T10:52:34.645774535Z I0308 10:52:34.645691       1 request.go:645] Throttling request took 1.170599521s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/revision-pruner-8-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:52:37.665933731Z I0308 10:52:37.665857       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodCreated' Created Pod/revision-pruner-8-master-2.case03116926.lab.upshift.rdu2.redhat.com -n openshift-kube-controller-manager because it was missing
2022-03-08T10:53:59.491195809Z I0308 10:53:59.490999       1 request.go:645] Throttling request took 1.155666698s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:54:00.691130025Z I0308 10:54:00.690998       1 request.go:645] Throttling request took 1.195428095s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-1.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:58:36.691129329Z I0308 10:58:36.690954       1 request.go:645] Throttling request took 1.096892485s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/secrets?resourceVersion=24200
2022-03-08T10:58:37.692685923Z I0308 10:58:37.691461       1 request.go:645] Throttling request took 1.866638907s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T10:58:38.890994166Z I0308 10:58:38.890932       1 request.go:645] Throttling request took 1.589352729s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T10:58:39.891013186Z I0308 10:58:39.890942       1 request.go:645] Throttling request took 1.189484116s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/kube-controller-manager-sa
2022-03-08T11:03:59.643169800Z I0308 11:03:59.643014       1 request.go:645] Throttling request took 1.140254624s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T11:04:00.643153505Z I0308 11:04:00.643073       1 request.go:645] Throttling request took 1.193004284s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/secrets/serving-cert
2022-03-08T11:07:27.902368208Z I0308 11:07:27.902224       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"StaticPodsDegraded: pod/kube-controller-manager-master-2.case03116926.lab.upshift.rdu2.redhat.com container \"kube-controller-manager-recovery-controller\" is terminated: Completed: \nNodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:52:33Z","message":"NodeInstallerProgressing: 3 nodes are at revision 8","reason":"AsExpected","status":"False","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 8","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T11:07:27.922485126Z I0308 11:07:27.922382       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "NodeControllerDegraded: All master nodes are ready" to "StaticPodsDegraded: pod/kube-controller-manager-master-2.case03116926.lab.upshift.rdu2.redhat.com container \"kube-controller-manager-recovery-controller\" is terminated: Completed: \nNodeControllerDegraded: All master nodes are ready"
2022-03-08T11:07:29.075144683Z I0308 11:07:29.075041       1 request.go:645] Throttling request took 1.147383006s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/configmaps/config
2022-03-08T11:07:30.298792801Z I0308 11:07:30.298706       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"NodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:52:33Z","message":"NodeInstallerProgressing: 3 nodes are at revision 8","reason":"AsExpected","status":"False","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 8","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T11:07:30.318053071Z I0308 11:07:30.317974       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "StaticPodsDegraded: pod/kube-controller-manager-master-2.case03116926.lab.upshift.rdu2.redhat.com container \"kube-controller-manager-recovery-controller\" is terminated: Completed: \nNodeControllerDegraded: All master nodes are ready" to "NodeControllerDegraded: All master nodes are ready"
2022-03-08T11:07:30.475172226Z I0308 11:07:30.475048       1 request.go:645] Throttling request took 1.002785516s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/services/kube-controller-manager
2022-03-08T11:07:31.675408809Z I0308 11:07:31.675336       1 request.go:645] Throttling request took 1.195480007s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/kube-controller-manager-sa
2022-03-08T11:07:53.275721455Z I0308 11:07:53.275053       1 request.go:645] Throttling request took 1.028704561s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-config-managed/secrets?resourceVersion=27139
2022-03-08T11:10:55.504765687Z I0308 11:10:55.504602       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"StaticPodsDegraded: pod/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com container \"kube-controller-manager-recovery-controller\" is terminated: Completed: \nNodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:52:33Z","message":"NodeInstallerProgressing: 3 nodes are at revision 8","reason":"AsExpected","status":"False","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 8","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T11:10:55.523078212Z I0308 11:10:55.522975       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "NodeControllerDegraded: All master nodes are ready" to "StaticPodsDegraded: pod/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com container \"kube-controller-manager-recovery-controller\" is terminated: Completed: \nNodeControllerDegraded: All master nodes are ready"
2022-03-08T11:10:56.671562026Z I0308 11:10:56.671487       1 request.go:645] Throttling request took 1.155909974s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/configmaps/config
2022-03-08T11:10:58.497569238Z I0308 11:10:58.494508       1 status_controller.go:172] clusteroperator/kube-controller-manager diff {"status":{"conditions":[{"lastTransitionTime":"2022-03-08T10:46:04Z","message":"NodeControllerDegraded: All master nodes are ready","reason":"AsExpected","status":"False","type":"Degraded"},{"lastTransitionTime":"2022-03-08T10:52:33Z","message":"NodeInstallerProgressing: 3 nodes are at revision 8","reason":"AsExpected","status":"False","type":"Progressing"},{"lastTransitionTime":"2022-03-08T10:41:49Z","message":"StaticPodsAvailable: 3 nodes are active; 3 nodes are at revision 8","reason":"AsExpected","status":"True","type":"Available"},{"lastTransitionTime":"2022-03-08T10:38:45Z","reason":"AsExpected","status":"True","type":"Upgradeable"}]}}
2022-03-08T11:10:58.510270604Z I0308 11:10:58.510204       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-kube-controller-manager-operator", Name:"kube-controller-manager-operator", UID:"eab5c6dd-ee48-42b1-9a41-e97928d02331", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'OperatorStatusChanged' Status for clusteroperator/kube-controller-manager changed: Degraded message changed from "StaticPodsDegraded: pod/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com container \"kube-controller-manager-recovery-controller\" is terminated: Completed: \nNodeControllerDegraded: All master nodes are ready" to "NodeControllerDegraded: All master nodes are ready"
2022-03-08T11:10:59.671578943Z I0308 11:10:59.671473       1 request.go:645] Throttling request took 1.176401815s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T11:11:00.671630350Z I0308 11:11:00.671535       1 request.go:645] Throttling request took 1.190148966s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T11:11:01.671676369Z I0308 11:11:01.671567       1 request.go:645] Throttling request took 1.151194943s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/services/kube-controller-manager
2022-03-08T11:13:59.557987337Z I0308 11:13:59.557831       1 request.go:645] Throttling request took 1.048031563s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T11:14:00.558023959Z I0308 11:14:00.557903       1 request.go:645] Throttling request took 1.146239627s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/configmaps/config
2022-03-08T11:23:59.633353191Z I0308 11:23:59.633181       1 request.go:645] Throttling request took 1.12068513s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T11:33:59.711803617Z I0308 11:33:59.710890       1 request.go:645] Throttling request took 1.194546304s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T11:34:00.711032475Z I0308 11:34:00.710954       1 request.go:645] Throttling request took 1.19413776s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/secrets/serving-cert
2022-03-08T11:43:59.689675048Z I0308 11:43:59.689481       1 request.go:645] Throttling request took 1.171724642s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T11:44:00.689608332Z I0308 11:44:00.689522       1 request.go:645] Throttling request took 1.195698985s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/secrets/serving-cert
2022-03-08T11:53:59.624882184Z I0308 11:53:59.624727       1 request.go:645] Throttling request took 1.104709032s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T11:54:00.624879626Z I0308 11:54:00.624786       1 request.go:645] Throttling request took 1.195911828s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager-operator/configmaps/csr-signer-ca
2022-03-08T12:03:59.577516525Z I0308 12:03:59.577293       1 request.go:645] Throttling request took 1.054612011s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T12:13:59.577255024Z I0308 12:13:59.577032       1 request.go:645] Throttling request took 1.051992212s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T12:14:00.577246790Z I0308 12:14:00.577177       1 request.go:645] Throttling request took 1.191333061s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/localhost-recovery-client
2022-03-08T12:23:59.577307350Z I0308 12:23:59.577147       1 request.go:645] Throttling request took 1.049838857s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T12:24:00.577333842Z I0308 12:24:00.577237       1 request.go:645] Throttling request took 1.195068778s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/secrets/csr-signer
2022-03-08T12:33:59.705428588Z I0308 12:33:59.705278       1 request.go:645] Throttling request took 1.174197248s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T12:43:59.537648739Z I0308 12:43:59.537441       1 request.go:645] Throttling request took 1.006517371s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T12:53:59.694242919Z I0308 12:53:59.693719       1 request.go:645] Throttling request took 1.160347756s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T12:54:00.694179621Z I0308 12:54:00.694114       1 request.go:645] Throttling request took 1.195701431s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-2.case03116926.lab.upshift.rdu2.redhat.com
2022-03-08T13:03:59.649418280Z I0308 13:03:59.649277       1 request.go:645] Throttling request took 1.113707701s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T13:04:00.649493122Z I0308 13:04:00.649347       1 request.go:645] Throttling request took 1.168216721s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/configmaps/config
2022-03-08T13:13:59.622053274Z I0308 13:13:59.621910       1 request.go:645] Throttling request took 1.082711531s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T13:14:00.622012246Z I0308 13:14:00.621947       1 request.go:645] Throttling request took 1.194897425s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager-operator/configmaps/csr-signer-ca
2022-03-08T13:24:00.120026012Z I0308 13:24:00.119894       1 request.go:645] Throttling request took 1.187788084s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/services/kube-controller-manager
2022-03-08T13:33:59.714048498Z I0308 13:33:59.713250       1 request.go:645] Throttling request took 1.170644547s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T13:43:59.613995079Z I0308 13:43:59.613794       1 request.go:645] Throttling request took 1.069299619s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/serviceaccounts/installer-sa
2022-03-08T13:44:00.613878099Z I0308 13:44:00.613800       1 request.go:645] Throttling request took 1.191193076s, request: GET:https://172.30.0.1:443/api/v1/namespaces/openshift-kube-controller-manager/pods?labelSelector=app%3Dinstaller
