Hello all 🙂
I saw that in the last update you've added the Request limiter (max queries per XX unit of time), it is super cool, thanks!
I was wondering if you will also consider a concurrent limiter. When average latency is required, it is easier to give the limit of a system by the maximum concurrency (based on the little's law of the queuing theory)
It could be used very similarly to the request limiter
a
Aleksei Tirman [JB]
12/12/2022, 11:16 AM
What do you mean by limiting concurrency?
a
Alexandre Conte
12/12/2022, 12:21 PM
I mean serving only X requests at the same moment
f
FunkyMuse
12/12/2022, 1:57 PM
Doesn't it do this already?
Does it happen at all that two or more requests come at the exact same time in millis?
a
Alexandre Conte
12/13/2022, 2:30 PM
Sorry for the late notice
It is possible for bigger servers to have multiple requests at the same milliseconds
Usually, the concurrent limit is a good proxy to the maximum capacity of an application to answer under a certain load (given a maximum response time)