If i have a simple rest api on a server whats the best way t

Question

If i have a simple rest api on a server whats the best way to test how many requests per seconds it can do I am trying to load test it via bench vegeta jmeter etc but my client machine runs out of resources i think before i reach the peak

Xavier Hanin · Answer

I suggest to have a look at which is asynchronous and doesn t use threads for the virtuals users so it s very resource cheap

Xavier Hanin · Answer

For very simple tests I ve also found `ab` useful in the past <http httpd apache org docs 2 2 en programs ab html>

asad.awadia · Answer

Hmm i ve tried both

asad.awadia · Answer

I dont think its the tooling i think its the server client machine tuning that is not right

Shawn A · Answer

What does your environment look like Are you able to spin up additional compute resources in the cloud I ve used locust on top of docker swarm to generate 5k TPS no problem

asad.awadia · Answer

Right now everything is just on local laptops

asad.awadia · Answer

Do u have an example

Shawn A · Answer

thats not a very good way to test the throughput of your app unfortunately

asad.awadia · Answer

Yeah i know lol

asad.awadia · Answer

That s why Im posting here

Shawn A · Answer

You should deploy onto whatever hardware you plan to host your app on in production

asad.awadia · Answer

My loadtester runs out of resources before i reach maximum throughput on the server

Shawn A · Answer

Is your server running locally too Or is that deployed somewhere

Shawn A · Answer

You ll want to move the load testing tool off your local machine and onto a server or cluster of servers wherever you host your stuff

asad.awadia · Answer

I have tried running the server on a simple server on gcp

asad.awadia · Answer

And then used kubernetes to scale up a cluster to spam it

asad.awadia · Answer

But still ran out of resources on the cluster before the server starts failing

asad.awadia · Answer

The instance is a tiny micro instance

asad.awadia · Answer

And the server is just one endpoint that returns 200

Shawn A · Answer

It returns a static hard coded 200 It does no other processing

Shawn A · Answer

Why would you want to load test that

asad.awadia · Answer

Because i want to compare two frameworks

Shawn A · Answer

Just pick one based on the features you need You ll be fine

earroyoron · Answer

If run out of resources just looks like you need some non blocking client to attack service some node js tool maybe

dave · Answer

< asad awadia> are these frameworks already covered by tech empower might save you some effort slightly smiling face

asad.awadia · Answer

< dave> they are

asad.awadia · Answer

But I can t even come close to those results

asad.awadia · Answer

And also want to do my own verification

dave · Answer

well they do have a customised setup which has taken years to hone into the state that it is now Since all frameworks are all run on the same hardware under the same conditions the results are pretty much relative so maybe you ve already got an pretty good answer as to which one is fastest

dave · Answer

they also do a variety of tests which you d also have to replicate for real world usage much more comprehensive than simply returning a 200 slightly smiling face

asad.awadia · Answer

I honestly just want to have a number for reference A simple vertx or ktor or http4k server with one endpoint returning 200 on a normal aws gcp instances can handle X requests per seconds

asad.awadia · Answer

That s all I want regardless of whether that s useful or not