Uploaded image for project: 'Maistra'
  1. Maistra
  2. MAISTRA-1908

pilot crash at random

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • maistra-2.0.0
    • maistra-2.0.0
    • pilot
    • None
    • False
    • False
    • Undefined
    • MAISTRA 2.0.0

      The istiod-basic-install pod seems to be crashing a bit at random causing downstream issues like sidecar-injector endpoint not being available when deploying pods.

       

      Installed image: quay.io/maistra/pilot-rhel8@sha256:a507b33b80656b42596e601c44282991ef95ad7521443347c1d43a45079e3dbb

       

      {{2020-10-06T15:09:09.946104Z info Work item handle failed (namespaces "ike-tests-kcrmkdutplbiasrx" is forbidden: User "system:serviceaccount:istio-system:istiod-service-account-basic-install" cannot get resource "namespaces" in API group "" in the namespace "ike-tests-kcrmkdutplbiasrx"), retry after delay 1s
       2020-10-06T15:09:10.446734Z info AdmissionReview for Kind=/v1, Kind=Pod Namespace=ike-tests-ayxozledjumjpbdz Name= (istio-workspace-75b54ffc79-***** (actual name not yet known)) UID=1be1d588-796c-4a01-9299-718519e21133 Rfc6902PatchOperation=CREATE UserInfo={system:serviceaccount:kube-system:replicaset-controller 37b5c87f-0d55-48bc-89b8-730a57aad349 [system:serviceaccounts system:serviceaccounts:kube-system system:authenticated] map[]}
       2020-10-06T15:09:10.446766Z info Skipping ike-tests-ayxozledjumjpbdz/istio-workspace-75b54ffc79-***** (actual name not yet known) due to policy check
       2020-10-06T15:09:10.948021Z info Work item handle failed (namespaces "ike-tests-kcrmkdutplbiasrx" is forbidden: User "system:serviceaccount:istio-system:istiod-service-account-basic-install" cannot get resource "namespaces" in API group "" in the namespace "ike-tests-kcrmkdutplbiasrx"), retry after delay 1s
       panic: interface conversion: interface {} is cache.DeletedFinalStateUnknown, not *v1.Endpoints
       goroutine 751 [running]:
       istio.io/istio/pilot/pkg/serviceregistry/kube/controller.(*endpointsController).onEvent.func1(0x26c7e80, 0xc00218c380, 0x2)
       istio.io/istio/pilot/pkg/serviceregistry/kube/controller/endpoints.go:242 +0x76
       istio.io/istio/pilot/pkg/serviceregistry/kube/controller.(*kubeEndpoints).handleEvent(0xc001b44ea0, 0xc0018eebc0, 0xb, 0xc002642800, 0x1a, 0x2, 0x26c7e80, 0xc00218c380, 0xc000de9ea0, 0xc0008d06c0, ...)
       istio.io/istio/pilot/pkg/serviceregistry/kube/controller/endpointsdiscovery.go:82 +0x16f
       istio.io/istio/pilot/pkg/serviceregistry/kube/controller.(*endpointsController).onEvent(0xc001b44ea0, 0x26c7e80, 0xc00218c380, 0x2, 0xc001c3fb90, 0x0)
       istio.io/istio/pilot/pkg/serviceregistry/kube/controller/endpoints.go:241 +0xea
       istio.io/istio/pilot/pkg/serviceregistry/kube/controller.(*endpointsController).registerEndpointsHandler.func3.1(0xc001c5ee68, 0x0)
       istio.io/istio/pilot/pkg/serviceregistry/kube/controller/endpoints.go:106 +0x45
       istio.io/istio/pkg/queue.(*queueImpl).Run(0xc001b46930, 0xc0002e6420)
       istio.io/istio/pkg/queue/instance.go:85 +0xda
       istio.io/istio/pilot/pkg/serviceregistry/kube/controller.(*Controller).Run.func1(0xc0002e6420, 0xc001c4cf20)
       istio.io/istio/pilot/pkg/serviceregistry/kube/controller/controller.go:543 +0x9d
       created by istio.io/istio/pilot/pkg/serviceregistry/kube/controller.(*Controller).Run
       istio.io/istio/pilot/pkg/serviceregistry/kube/controller/controller.go:541 +0x6f}}
      

            rhn-coreos-brison Brad Ison (Inactive)
            aslak@redhat.com Aslak Knutsen
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: