When trying to update Cluster Settings from the OpenShift AI UI. I want to update the idle time limit for notebooks but when I make a change and hit save, I get "Error - HTTP Request Fail" warning on the UI and unable to save the change.

When we look into the request, we see we get 404 for the PUT request to /api/cluster-settings endpoint. We thought we might have blocked the PUT requests in general, but we got the same behaviour with POST request as well and we know we can successfully send POST requests (adding a new Serving Runtime is a POST request for example).

The users who get this error are in rhods-admins group and they can do other configurations from the UI except updating Cluster settings. We couldn't see anything unusual in the logs yet.

(OpenShift AI version 2.7.0)

curl -X PUT -H "Content-Type: application/json" -H "Cookie: XXXX" https://rhods-dashboard-redhat-ods-applications.apps.xxx.com/api/cluster-settings
-d @payload.json -vvvvvvvvvv

• Trying xx.xx.xx.xx:443...
• Connected to rhods-dashboard-redhat-ods-applications.apps.xxx.com (xx.xx.xx.xx) port 443 (#0)
• schannel: disabled automatic use of client certificate
• ALPN: offers http/1.1
• ALPN: server did not agree on a protocol. Uses default.
  > PUT /api/cluster-settings HTTP/1.1
  > Host: rhods-dashboard-redhat-ods-applications.apps.xxx.com
  > User-Agent: curl/7.83.1
  > Accept: /
  > Content-Type: application/json
  > Cookie:XXXX
  > Content-Length: 182
  >
• Mark bundle as not supporting multiuse
  < HTTP/1.1 404 Not Found
  < content-length: 70
  < content-type: application/json; charset=utf-8
  < date: Wed, 01 May 2024 22:03:50 GMT
  < gap-auth: XXX@cluster.local
  < gap-upstream-address: localhost:8080
  < strict-transport-security: max-age=31536000;includeSubDomains;preload
  <
  {"statusCode":404,"error":"Not Found","message":"HTTP request failed"}* Connection #0 to host rhods-dashboard-redhat-ods-applications.apps.xxx.com left intact

..or response to POST request:
{"message":"Route POST:/api/cluster-settings not found","error":"Not Found","statusCode":404}* Connection #0 to host rhods-dashboard-redhat-ods-applications.apps.xxx.com left intact