This project aims to be a load benchmarking suite, no more, no less
Measuring response times (routing times) for each framework (middleware).
Results are not production-ready yet
- Helping decide beetween languages, depending on use case
- Learning languages, best practices, devops culture ...
- Having fun ❤️
- Crystal as
built-intools are made in this language - Docker as frameworks are
isolatedinto containers
docker is used for development purpose, production results will be computed on DigitalOcean
- Install all dependencies
shards install- Build internal tools
shards build- Build containers
job is either a language (example : crystal) or a framework (example : router.cr)
bin/neph [job]- Start the benchmark ....
tools is a list of language / framework to challenge (example : ruby kemal amber go python)
bin/benchmarker [tools]Last update: 2018-09-12
OS: Linux (version: 4.16.11-100.fc26.x86_64, arch: x86_64)
CPU Cores: 8
1️⃣ rocket (rust)
2️⃣ nickel (rust)
3️⃣ iron (rust)
4️⃣ roda (ruby)
5️⃣ rack-routing (ruby)
| Language (Runtime) | Framework (Middleware) | Average | 50% percentile | 90% percentile | 99% percentile | 99.9% percentile | Standard deviation |
|---|---|---|---|---|---|---|---|
| rust | rocket | 0.13 ms | 0.11 ms | 0.17 ms | 0.60 ms | 8.43 ms | 156.00 |
| rust | nickel | 0.11 ms | 0.12 ms | 0.15 ms | 0.19 ms | 5.59 ms | 78.67 |
| rust | iron | 0.56 ms | 0.47 ms | 0.92 ms | 2.64 ms | 27.19 ms | 561.00 |
| ruby | roda | 2.90 ms | 2.05 ms | 6.06 ms | 15.21 ms | 75.65 ms | 3081.33 |
| ruby | rack-routing | 3.63 ms | 2.47 ms | 8.11 ms | 18.74 ms | 67.40 ms | 3859.67 |
| ruby | hanami | 5.83 ms | 3.39 ms | 14.05 ms | 36.59 ms | 108.67 ms | 7479.67 |
| ruby | sinatra | 7.56 ms | 4.30 ms | 18.49 ms | 43.87 ms | 128.27 ms | 9189.00 |
| ruby | flame | 6.43 ms | 4.35 ms | 14.81 ms | 30.40 ms | 103.07 ms | 6524.67 |
| rust | actix-web | 5.06 ms | 4.39 ms | 9.26 ms | 15.63 ms | 102.85 ms | 3637.00 |
| php | symfony | 246.26 ms | 4.61 ms | 675.55 ms | 3779.48 ms | 6656.05 ms | 738533.33 |
| php | laravel | 284.88 ms | 4.77 ms | 336.10 ms | 5574.66 ms | 7436.76 ms | 997258.00 |
| go | fasthttprouter | 5.59 ms | 5.00 ms | 8.51 ms | 15.79 ms | 97.09 ms | 2782.67 |
| cpp | evhtp | 7.23 ms | 6.19 ms | 12.96 ms | 22.46 ms | 80.28 ms | 4545.00 |
| crystal | spider-gazelle | 7.65 ms | 6.53 ms | 13.80 ms | 24.10 ms | 54.98 ms | 4808.67 |
| python | vibora | 7.91 ms | 6.73 ms | 15.09 ms | 26.07 ms | 72.76 ms | 5632.67 |
| ruby | rails | 29.92 ms | 6.86 ms | 96.53 ms | 184.94 ms | 373.31 ms | 44107.00 |
| java | act | 9.48 ms | 8.18 ms | 14.36 ms | 27.74 ms | 278.72 ms | 9850.00 |
| go | gorilla-mux | 10.59 ms | 9.33 ms | 16.55 ms | 32.39 ms | 207.40 ms | 6519.67 |
| go | echo | 11.04 ms | 9.71 ms | 17.09 ms | 32.45 ms | 231.18 ms | 6620.00 |
| go | iris | 11.15 ms | 9.76 ms | 17.02 ms | 32.12 ms | 240.37 ms | 8796.33 |
| scala | akkahttp | 203.64 ms | 10.15 ms | 31.72 ms | 4692.81 ms | 7932.67 ms | 815146.67 |
| nim | mofuw | 32.14 ms | 10.59 ms | 60.58 ms | 369.61 ms | 737.84 ms | 69376.00 |
| csharp | aspnetcore | 13.15 ms | 11.05 ms | 21.70 ms | 38.19 ms | 381.55 ms | 11433.00 |
| node | rayo | 21.41 ms | 13.54 ms | 31.99 ms | 177.80 ms | 869.77 ms | 43144.67 |
| node | fastify | 29.21 ms | 15.93 ms | 34.05 ms | 423.82 ms | 1194.79 ms | 74594.00 |
| swift | perfect | 18.20 ms | 17.81 ms | 21.83 ms | 27.04 ms | 116.83 ms | 3229.33 |
| node | polka | 33.06 ms | 18.57 ms | 47.62 ms | 432.52 ms | 1342.22 ms | 79283.67 |
| swift | vapor | 51.34 ms | 18.74 ms | 38.84 ms | 1146.76 ms | 3176.61 ms | 191806.00 |
| python | bottle | 22.86 ms | 18.84 ms | 37.52 ms | 80.38 ms | 269.89 ms | 15440.67 |
| node | koa | 32.86 ms | 20.42 ms | 43.85 ms | 351.85 ms | 1177.41 ms | 68220.33 |
| node | restify | 28.12 ms | 21.50 ms | 43.65 ms | 110.05 ms | 675.58 ms | 30650.67 |
| python | japronto | 22.11 ms | 21.62 ms | 23.88 ms | 28.90 ms | 474.03 ms | 9940.33 |
| scala | http4s | 36.19 ms | 23.47 ms | 47.25 ms | 356.82 ms | 2154.62 ms | 108500.33 |
| node | express | 46.61 ms | 26.97 ms | 59.77 ms | 650.93 ms | 1655.67 ms | 108274.00 |
| go | gin | 52.25 ms | 27.60 ms | 148.41 ms | 218.76 ms | 471.25 ms | 58524.33 |
| crystal | router.cr | 30.44 ms | 30.39 ms | 39.56 ms | 48.22 ms | 133.96 ms | 7575.67 |
| crystal | raze | 31.36 ms | 31.20 ms | 39.88 ms | 49.35 ms | 333.32 ms | 11685.33 |
| crystal | prism | 33.50 ms | 31.78 ms | 42.41 ms | 52.59 ms | 265.61 ms | 9857.33 |
| crystal | raze | 31.36 ms | 31.20 ms | 39.88 ms | 49.35 ms | 333.32 ms | 11685.33 |
| crystal | kemal | 35.24 ms | 32.03 ms | 46.84 ms | 55.92 ms | 126.00 ms | 7853.33 |
| node | hapi | 72.10 ms | 37.05 ms | 79.10 ms | 1132.31 ms | 2313.01 ms | 180855.00 |
| swift | kitura | 41.51 ms | 39.48 ms | 55.87 ms | 84.80 ms | 333.57 ms | 14253.67 |
| crystal | lucky | 39.62 ms | 40.05 ms | 48.46 ms | 55.19 ms | 174.04 ms | 8550.33 |
| crystal | amber | 38.81 ms | 40.24 ms | 50.11 ms | 57.06 ms | 127.58 ms | 9032.00 |
| python | aiohttp | 48.59 ms | 42.67 ms | 86.06 ms | 144.89 ms | 291.83 ms | 29504.33 |
| python | flask | 64.32 ms | 49.22 ms | 116.01 ms | 195.21 ms | 367.72 ms | 37851.00 |
| python | sanic | 69.02 ms | 61.77 ms | 123.49 ms | 203.17 ms | 429.70 ms | 41482.00 |
| python | django | 91.95 ms | 83.36 ms | 136.10 ms | 210.84 ms | 918.58 ms | 42665.00 |
| python | tornado | 152.13 ms | 123.11 ms | 208.29 ms | 1025.72 ms | 2440.67 ms | 175368.67 |
| python | quart | 202.98 ms | 175.52 ms | 341.33 ms | 514.32 ms | 696.58 ms | 99105.00 |
1️⃣ actix-web (rust)
2️⃣ fasthttprouter (go)
3️⃣ vibora (python)
4️⃣ evhtp (cpp)
5️⃣ spider-gazelle (crystal)
In any way you want ...
- Request a framework addition
- Report a bug (on any implementation)
- Suggest an idea
- ...
Any kind of idea is ❤️
- Taichiro Suzuki - Author, maintainer
- OvermindDL1 - Maintainer
- Marwan Rabbâa - Mainainer