Uploaded image for project: 'Red Hat OpenStack Services on OpenShift'
  1. Red Hat OpenStack Services on OpenShift
  2. OSPRH-3713

Aodh uses public keystone endpoint no matter the configuration

XMLWordPrintable

    • 2
    • False
    • Hide

      None

      Show
      None
    • False
    • Proposed
    • ?
    • ?
    • Proposed
    • No
    • CloudOps 2024 Sprint 5, CloudOps 2024 Sprint 6, CloudOps 2024 Sprint 7, CloudOps 2024 Sprint 8
    • Moderate
    • CloudOps

      In next-gen environments it's expected for services to use the internal endpoints for communication. All of the operators should configure them this way. Currently the public endpoints in next-gen are behind TLS, but the required certificates to securely access these endpoints aren't distributed into the service containers. When heat tries to create alarms, aodh tries to access keystone on a public endpoint no matter the configuration in aodh.conf. This fails because of an SSL error.

      aodh.conf

      [DEFAULT]
      debug=True
      transport_url = rabbit://default_user_kqyDY3A1qXuSkTPxK-j:yT6EBU6qSd1zEiih80FdPkJCFGh5Nhhm@rabbitmq.openstack.svc:5672/?ssl=0
      
      [database]
      alarm_history_time_to_live=86400
      connection = mysql+pymysql://aodh:12345678@openstack/aodh
      
      [evaluator]
      workers=4
      
      [listener]
      workers=4
      
      [notifier]
      workers=4
      
      [oslo_messaging_rabbit]
      heartbeat_in_pthread=False
      
      [oslo_middleware]
      enable_proxy_headers_parsing=True
      
      [oslo_policy]
      policy_file=/etc/aodh/policy.yaml
      
      [oslo_messaging_notifications]
      driver=noop
      transport_url = rabbit://default_user_kqyDY3A1qXuSkTPxK-j:yT6EBU6qSd1zEiih80FdPkJCFGh5Nhhm@rabbitmq.openstack.svc:5672/?ssl=0
      
      [keystone_authtoken]
      www_authenticate_uri = http://keystone-internal.openstack.svc:5000
      interface=internal
      memcached_servers=inet:[memcached-0.memcached]:11211
      memcache_use_advanced_pool=True
      auth_type = password
      auth_url = http://keystone-internal.openstack.svc:5000
      username = aodh
      password = 12345678
      user_domain_name = Default
      project_name = service
      project_domain_name = Default
      
      [service_credentials]
      auth_type=password
      auth_url=http://keystone-internal.openstack.svc:5000
      project_name=service
      project_domain_name=Default
      username=aodh
      user_domain_name=Default
      password=12345678
      interface=internal
      
      [healthcheck]
      [service_types]
      [oslo_messaging_amqp]
      [api]
      [coordination]
      [cors]
       

      error from `openstack stack show`

      Resource CREATE failed: ClientException: resources.cpu_alarm_high: SSL exception connecting to https://keystone-public-openstack.apps-crc.testing/OS-TRUST/trusts: HTTPSConnectionPool(host='keystone-public-openstack.apps-crc.testing', port=443): Max retries exceeded with url: /OS-TRUST/trusts (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)'))) (HTTP 500) (Request-ID: req-f9c5942a-a295-46f6-822b-2b5dbb637a8b)

      aodh-api container logs around the error

      [Wed Jan 17 09:52:18.957023 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 2024-01-17 09:52:18.955 15 WARNING keystoneauth.discover [-] Failed to contact the endpoint at https://keystone-public-openstack.apps-crc.testing for discovery. Fallback to using that endpoint as the base url.\x1b[00m
      [Wed Jan 17 09:52:18.959451 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 2024-01-17 09:52:18.957 16 WARNING keystoneauth.discover [-] Failed to contact the endpoint at https://keystone-public-openstack.apps-crc.testing for discovery. Fallback to using that endpoint as the base url.\x1b[00m
      [Wed Jan 17 09:52:19.056981 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 2024-01-17 09:52:19.056 15 ERROR wsme.api [-] Server-side error: "SSL exception connecting to https://keystone-public-openstack.apps-crc.testing/OS-TRUST/trusts: HTTPSConnectionPool(host='keystone-public-openstack.apps-crc.testing', port=443): Max retries exceeded with url: /OS-TRUST/trusts (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)')))". Detail: 
      [Wed Jan 17 09:52:19.057009 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] Traceback (most recent call last):
      [Wed Jan 17 09:52:19.057015 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057020 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen
      [Wed Jan 17 09:52:19.057026 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     httplib_response = self._make_request(
      [Wed Jan 17 09:52:19.057031 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057036 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request
      [Wed Jan 17 09:52:19.057041 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     self._validate_conn(conn)
      [Wed Jan 17 09:52:19.057046 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057051 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn
      [Wed Jan 17 09:52:19.057056 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     conn.connect()
      [Wed Jan 17 09:52:19.057061 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057066 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect
      [Wed Jan 17 09:52:19.057071 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     self.sock = ssl_wrap_socket(
      [Wed Jan 17 09:52:19.057076 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057081 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket
      [Wed Jan 17 09:52:19.057086 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     ssl_sock = _ssl_wrap_socket_impl(
      [Wed Jan 17 09:52:19.057091 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057096 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
      [Wed Jan 17 09:52:19.057101 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
      [Wed Jan 17 09:52:19.057106 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057111 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket
      [Wed Jan 17 09:52:19.057116 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     return self.sslsocket_class._create(
      [Wed Jan 17 09:52:19.057121 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057126 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib64/python3.9/ssl.py", line 1074, in _create
      [Wed Jan 17 09:52:19.057131 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     self.do_handshake()
      [Wed Jan 17 09:52:19.057136 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057141 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib64/python3.9/ssl.py", line 1343, in do_handshake
      [Wed Jan 17 09:52:19.057150 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     self._sslobj.do_handshake()
      [Wed Jan 17 09:52:19.057156 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057160 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)
      [Wed Jan 17 09:52:19.057166 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057171 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057176 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] During handling of the above exception, another exception occurred:
      [Wed Jan 17 09:52:19.057181 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057186 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057190 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] Traceback (most recent call last):
      [Wed Jan 17 09:52:19.057195 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057200 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/requests/adapters.py", line 439, in send
      [Wed Jan 17 09:52:19.057205 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     resp = conn.urlopen(
      [Wed Jan 17 09:52:19.057210 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057215 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen
      [Wed Jan 17 09:52:19.057220 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     retries = retries.increment(
      [Wed Jan 17 09:52:19.057225 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057230 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 574, in increment
      [Wed Jan 17 09:52:19.057235 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     raise MaxRetryError(_pool, url, error or ResponseError(cause))
      [Wed Jan 17 09:52:19.057240 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057246 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='keystone-public-openstack.apps-crc.testing', port=443): Max retries exceeded with url: /OS-TRUST/trusts (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)')))
      [Wed Jan 17 09:52:19.057252 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057257 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057261 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] During handling of the above exception, another exception occurred:
      [Wed Jan 17 09:52:19.057266 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057271 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057276 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] Traceback (most recent call last):
      [Wed Jan 17 09:52:19.057281 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057286 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/keystoneauth1/session.py", line 1021, in _send_request
      [Wed Jan 17 09:52:19.057291 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     resp = self.session.request(method, url, **kwargs)
      [Wed Jan 17 09:52:19.057296 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057302 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/requests/sessions.py", line 544, in request
      [Wed Jan 17 09:52:19.057308 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     resp = self.send(prep, **send_kwargs)
      [Wed Jan 17 09:52:19.057313 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057318 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/requests/sessions.py", line 657, in send
      [Wed Jan 17 09:52:19.057323 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     r = adapter.send(request, **kwargs)
      [Wed Jan 17 09:52:19.057328 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057333 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/requests/adapters.py", line 514, in send
      [Wed Jan 17 09:52:19.057338 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     raise SSLError(e, request=request)
      [Wed Jan 17 09:52:19.057343 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057348 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] requests.exceptions.SSLError: HTTPSConnectionPool(host='keystone-public-openstack.apps-crc.testing', port=443): Max retries exceeded with url: /OS-TRUST/trusts (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)')))
      [Wed Jan 17 09:52:19.057354 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057368 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057373 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] During handling of the above exception, another exception occurred:
      [Wed Jan 17 09:52:19.057378 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057385 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057391 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] Traceback (most recent call last):
      [Wed Jan 17 09:52:19.057398 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057405 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/wsmeext/pecan.py", line 82, in callfunction
      [Wed Jan 17 09:52:19.057413 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     result = f(self, *args, **kwargs)
      [Wed Jan 17 09:52:19.057420 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057426 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/aodh/api/controllers/v2/alarms.py", line 844, in post
      [Wed Jan 17 09:52:19.057434 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     data.update_actions()
      [Wed Jan 17 09:52:19.057440 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057445 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/aodh/api/controllers/v2/alarms.py", line 463, in update_actions
      [Wed Jan 17 09:52:19.057450 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     trust_id = keystone_client.create_trust_id(
      [Wed Jan 17 09:52:19.057455 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057460 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/aodh/keystone_client.py", line 77, in create_trust_id
      [Wed Jan 17 09:52:19.057465 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     trust = client.trusts.create(trustor_user=trustor_user_id,
      [Wed Jan 17 09:52:19.057470 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057477 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/keystoneclient/v3/contrib/trusts.py", line 74, in create
      [Wed Jan 17 09:52:19.057482 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     return super(TrustManager, self).create(
      [Wed Jan 17 09:52:19.057488 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057493 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/keystoneclient/base.py", line 86, in func
      [Wed Jan 17 09:52:19.057498 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     return f(*args, **new_kwargs)
      [Wed Jan 17 09:52:19.057503 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057508 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/keystoneclient/base.py", line 383, in create
      [Wed Jan 17 09:52:19.057513 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     return self._post(
      [Wed Jan 17 09:52:19.057518 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057523 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/keystoneclient/base.py", line 192, in _post
      [Wed Jan 17 09:52:19.057528 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     resp, body = self.client.post(url, body=body, **kwargs)
      [Wed Jan 17 09:52:19.057533 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057538 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/keystoneauth1/adapter.py", line 399, in post
      [Wed Jan 17 09:52:19.057543 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     return self.request(url, 'POST', **kwargs)
      [Wed Jan 17 09:52:19.057548 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057553 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/keystoneauth1/adapter.py", line 552, in request
      [Wed Jan 17 09:52:19.057558 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     resp = super(LegacyJsonAdapter, self).request(*args, **kwargs)
      [Wed Jan 17 09:52:19.057563 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057568 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/keystoneauth1/adapter.py", line 255, in request
      [Wed Jan 17 09:52:19.057573 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     return self.session.request(url, method, **kwargs)
      [Wed Jan 17 09:52:19.057578 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057583 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/keystoneauth1/session.py", line 930, in request
      [Wed Jan 17 09:52:19.057588 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     resp = send(**kwargs)
      [Wed Jan 17 09:52:19.057593 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057598 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]   File "/usr/lib/python3.9/site-packages/keystoneauth1/session.py", line 1025, in _send_request
      [Wed Jan 17 09:52:19.057603 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356]     raise exceptions.SSLError(msg)
      [Wed Jan 17 09:52:19.057608 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] 
      [Wed Jan 17 09:52:19.057613 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] keystoneauth1.exceptions.connection.SSLError: SSL exception connecting to https://keystone-public-openstack.apps-crc.testing/OS-TRUST/trusts: HTTPSConnectionPool(host='keystone-public-openstack.apps-crc.testing', port=443): Max retries exceeded with url: /OS-TRUST/trusts (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)')))
      [Wed Jan 17 09:52:19.057621 2024] [wsgi:error] [pid 15:tid 94] [remote 10.217.1.209:35356] : keystoneauth1.exceptions.connection.SSLError: SSL exception connecting to https://keystone-public-openstack.apps-crc.testing/OS-TRUST/trusts: HTTPSConnectionPool(host='keystone-public-openstack.apps-crc.testing', port=443): Max retries exceeded with url: /OS-TRUST/trusts (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)')))\x1b[00m
      - - - [17/Jan/2024:09:52:13 +0000] "POST /v2/alarms HTTP/1.1" 500 477 5736043 "-" "heat-engine keystoneauth1/5.4.0 python-requests/2.25.1 CPython/3.9.18"
      [Wed Jan 17 09:52:19.069770 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 2024-01-17 09:52:19.069 16 ERROR wsme.api [-] Server-side error: "SSL exception connecting to https://keystone-public-openstack.apps-crc.testing/OS-TRUST/trusts: HTTPSConnectionPool(host='keystone-public-openstack.apps-crc.testing', port=443): Max retries exceeded with url: /OS-TRUST/trusts (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)')))". Detail: 
      [Wed Jan 17 09:52:19.069793 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] Traceback (most recent call last):
      [Wed Jan 17 09:52:19.069799 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069804 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen
      [Wed Jan 17 09:52:19.069810 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     httplib_response = self._make_request(
      [Wed Jan 17 09:52:19.069815 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069820 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request
      [Wed Jan 17 09:52:19.069825 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     self._validate_conn(conn)
      [Wed Jan 17 09:52:19.069830 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069835 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn
      [Wed Jan 17 09:52:19.069840 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     conn.connect()
      [Wed Jan 17 09:52:19.069845 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069850 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect
      [Wed Jan 17 09:52:19.069856 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     self.sock = ssl_wrap_socket(
      [Wed Jan 17 09:52:19.069860 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069865 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket
      [Wed Jan 17 09:52:19.069871 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     ssl_sock = _ssl_wrap_socket_impl(
      [Wed Jan 17 09:52:19.069876 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069881 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
      [Wed Jan 17 09:52:19.069886 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
      [Wed Jan 17 09:52:19.069891 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069896 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket
      [Wed Jan 17 09:52:19.069901 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     return self.sslsocket_class._create(
      [Wed Jan 17 09:52:19.069906 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069911 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib64/python3.9/ssl.py", line 1074, in _create
      [Wed Jan 17 09:52:19.069917 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     self.do_handshake()
      [Wed Jan 17 09:52:19.069921 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069926 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib64/python3.9/ssl.py", line 1343, in do_handshake
      [Wed Jan 17 09:52:19.069932 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     self._sslobj.do_handshake()
      [Wed Jan 17 09:52:19.069937 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069942 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)
      [Wed Jan 17 09:52:19.069947 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069952 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069957 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] During handling of the above exception, another exception occurred:
      [Wed Jan 17 09:52:19.069962 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069967 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069972 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] Traceback (most recent call last):
      [Wed Jan 17 09:52:19.069977 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069982 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/requests/adapters.py", line 439, in send
      [Wed Jan 17 09:52:19.069987 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     resp = conn.urlopen(
      [Wed Jan 17 09:52:19.069992 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.069996 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen
      [Wed Jan 17 09:52:19.070002 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     retries = retries.increment(
      [Wed Jan 17 09:52:19.070007 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070012 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 574, in increment
      [Wed Jan 17 09:52:19.070017 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     raise MaxRetryError(_pool, url, error or ResponseError(cause))
      [Wed Jan 17 09:52:19.070022 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070027 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='keystone-public-openstack.apps-crc.testing', port=443): Max retries exceeded with url: /OS-TRUST/trusts (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)')))
      [Wed Jan 17 09:52:19.070034 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070038 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070043 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] During handling of the above exception, another exception occurred:
      [Wed Jan 17 09:52:19.070048 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070053 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070058 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] Traceback (most recent call last):
      [Wed Jan 17 09:52:19.070063 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070068 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/keystoneauth1/session.py", line 1021, in _send_request
      [Wed Jan 17 09:52:19.070073 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     resp = self.session.request(method, url, **kwargs)
      [Wed Jan 17 09:52:19.070078 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070083 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/requests/sessions.py", line 544, in request
      [Wed Jan 17 09:52:19.070088 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     resp = self.send(prep, **send_kwargs)
      [Wed Jan 17 09:52:19.070093 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070098 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/requests/sessions.py", line 657, in send
      [Wed Jan 17 09:52:19.070104 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     r = adapter.send(request, **kwargs)
      [Wed Jan 17 09:52:19.070109 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070113 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/requests/adapters.py", line 514, in send
      [Wed Jan 17 09:52:19.070119 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     raise SSLError(e, request=request)
      [Wed Jan 17 09:52:19.070124 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070129 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] requests.exceptions.SSLError: HTTPSConnectionPool(host='keystone-public-openstack.apps-crc.testing', port=443): Max retries exceeded with url: /OS-TRUST/trusts (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)')))
      [Wed Jan 17 09:52:19.070135 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070140 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070145 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] During handling of the above exception, another exception occurred:
      [Wed Jan 17 09:52:19.070150 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070154 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070159 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] Traceback (most recent call last):
      [Wed Jan 17 09:52:19.070164 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070169 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/wsmeext/pecan.py", line 82, in callfunction
      [Wed Jan 17 09:52:19.070174 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     result = f(self, *args, **kwargs)
      [Wed Jan 17 09:52:19.070179 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070184 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/aodh/api/controllers/v2/alarms.py", line 844, in post
      [Wed Jan 17 09:52:19.070190 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     data.update_actions()
      [Wed Jan 17 09:52:19.070194 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070199 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/aodh/api/controllers/v2/alarms.py", line 463, in update_actions
      [Wed Jan 17 09:52:19.070205 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     trust_id = keystone_client.create_trust_id(
      [Wed Jan 17 09:52:19.070211 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070216 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/aodh/keystone_client.py", line 77, in create_trust_id
      [Wed Jan 17 09:52:19.070221 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     trust = client.trusts.create(trustor_user=trustor_user_id,
      [Wed Jan 17 09:52:19.070226 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070231 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/keystoneclient/v3/contrib/trusts.py", line 74, in create
      [Wed Jan 17 09:52:19.070236 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     return super(TrustManager, self).create(
      [Wed Jan 17 09:52:19.070241 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070246 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/keystoneclient/base.py", line 86, in func
      [Wed Jan 17 09:52:19.070251 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     return f(*args, **new_kwargs)
      [Wed Jan 17 09:52:19.070256 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070261 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/keystoneclient/base.py", line 383, in create
      [Wed Jan 17 09:52:19.070266 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     return self._post(
      [Wed Jan 17 09:52:19.070271 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070276 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/keystoneclient/base.py", line 192, in _post
      [Wed Jan 17 09:52:19.070281 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     resp, body = self.client.post(url, body=body, **kwargs)
      [Wed Jan 17 09:52:19.070286 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070291 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/keystoneauth1/adapter.py", line 399, in post
      [Wed Jan 17 09:52:19.070297 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     return self.request(url, 'POST', **kwargs)
      [Wed Jan 17 09:52:19.070302 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070306 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/keystoneauth1/adapter.py", line 552, in request
      [Wed Jan 17 09:52:19.070312 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     resp = super(LegacyJsonAdapter, self).request(*args, **kwargs)
      [Wed Jan 17 09:52:19.070317 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070322 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/keystoneauth1/adapter.py", line 255, in request
      [Wed Jan 17 09:52:19.070327 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     return self.session.request(url, method, **kwargs)
      [Wed Jan 17 09:52:19.070332 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070337 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/keystoneauth1/session.py", line 930, in request
      [Wed Jan 17 09:52:19.070342 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     resp = send(**kwargs)
      [Wed Jan 17 09:52:19.070347 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070352 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]   File "/usr/lib/python3.9/site-packages/keystoneauth1/session.py", line 1025, in _send_request
      [Wed Jan 17 09:52:19.070366 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340]     raise exceptions.SSLError(msg)
      [Wed Jan 17 09:52:19.070371 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] 
      [Wed Jan 17 09:52:19.070376 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] keystoneauth1.exceptions.connection.SSLError: SSL exception connecting to https://keystone-public-openstack.apps-crc.testing/OS-TRUST/trusts: HTTPSConnectionPool(host='keystone-public-openstack.apps-crc.testing', port=443): Max retries exceeded with url: /OS-TRUST/trusts (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)')))
      [Wed Jan 17 09:52:19.070383 2024] [wsgi:error] [pid 16:tid 47] [remote 10.217.1.209:35340] : keystoneauth1.exceptions.connection.SSLError: SSL exception connecting to https://keystone-public-openstack.apps-crc.testing/OS-TRUST/trusts: HTTPSConnectionPool(host='keystone-public-openstack.apps-crc.testing', port=443): Max retries exceeded with url: /OS-TRUST/trusts (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1129)')))\x1b[00m
      - - - [17/Jan/2024:09:52:13 +0000] "POST /v2/alarms HTTP/1.1" 500 477 5761640 "-" "heat-engine keystoneauth1/5.4.0 python-requests/2.25.1 CPython/3.9.18"
       

      IMPORTANT NOTE: I was able to trigger the error only by trying to create a stack. Creating an alarm using `openstack alarm create` worked without issues.

            ykulkarn@redhat.com Yadnesh Kulkarni
            rh-ee-jwysogla Jaromir Wysoglad
            rhos-dfg-cloudops
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: