Details
-
Feature Request
-
Resolution: Done
-
Major
-
None
-
None
Description
A new policy is required to provide a mechanism to improve the gateway performance. Current behavior is one call to the 3scale backend for each request that it receives. The goal is to reduce latency and increase throughput by significantly reducing the number of requests made to the 3scale backend.
In order to achieve that, this policy will cache authorization statuses and will do batch reporting. This means that there will be some trade-offs regarding rate-limits accuracy so the policy will be more suitable in certain situations (high cache hit ratio).
More info: https://github.com/3scale/apicast/blob/master/gateway/src/apicast/policy/3scale_batcher/README.md