Description of problem: cleanup is halted due to clusterManagementAddOn "submariner" on managed clusters are not deleted

Version-Release number of selected component (if applicable):

ACM2.9 2.9.0-DOWNSTREAM-2023-10-18-17-59-25

Additional info:

submariner addon not cleaned up when toggled to false but deployment is still up

submariner addon pod logs
2023-10-20T19:53:38.351Z INF ..roker/controller.go:267 ..erBrokerController ManagedClusterAddOn in cluster "clc-gcp-1697726036587" still exists - not cleaning up yet
 
2023-10-20T19:53:38.351Z INF ..roker/controller.go:133 ..erBrokerController ClusterManagementAddOn "submariner" is deleting
 
2023-10-20T19:53:38.351Z INF ..roker/controller.go:267 ..erBrokerController ManagedClusterAddOn in cluster "clc-gcp-1697726036587" still exists - not cleaning up yet
 
2023-10-20T19:53:38.351Z INF ..roker/controller.go:133 ..erBrokerController ClusterManagementAddOn "submariner" is deleting
 
2023-10-20T19:53:38.352Z INF ..roker/controller.go:267 ..erBrokerController ManagedClusterAddOn in cluster "clc-gcp-1697726036587" still exists - not cleaning up yet
 
2023-10-20T19:53:38.352Z INF ..roker/controller.go:133 ..erBrokerController ClusterManagementAddOn "submariner" is deleting
 

2023-10-20T19:53:38.352Z INF ..roker/controller.go:267 ..erBrokerController ManagedClusterAddOn in cluster "clc-auto-clustersetpool-11269-26nnl" still exists - not cleaning up yet