This project aims to be a load benchmarking suite, no more, no less
Measuring response times (routing times) for each framework (middleware).
Results are not production-ready yet
- Helping decide between languages, depending on use case
- Learning languages, best practices, devops culture ...
- Having fun ❤️
- Crystal as
built-intools are made in this language - Docker as frameworks are
isolatedinto containers - wrk as benchmarking tool,
>= 4.1.0
ℹ️ you need wrk stable
git clone --branch 4.1.0 https://github.com/wg/wrkdocker is used for development purpose, production results will be computed on DigitalOcean
- Install all dependencies
shards install- Build internal tools
shards build- Make framework list
bin/make config- Build containers
jobs are either languages (example : crystal) or frameworks (example : router.cr)
bin/neph [job1] [job2] [job3] ...- Start the benchmark ....
tools is a list of language / framework to challenge (example : ruby kemal amber go python)
bin/benchmarker [tools]Last update: 2019-10-03
OS: Linux (version: 5.2.17-200.fc30.x86_64, arch: x86_64)
CPU Cores: 8
1️⃣ nickel (rust)
2️⃣ iron (rust)
3️⃣ syro (ruby)
4️⃣ roda (ruby)
5️⃣ cuba (ruby)
| Language (Runtime) | Framework (Middleware) | Average | 50th percentile | 90th percentile | 99th percentile | 99.9th percentile | Standard deviation |
|---|---|---|---|---|---|---|---|
rust (1.38) |
nickel (0.11) | 0.10 ms | 0.10 ms | 0.14 ms | 0.18 ms | 7.53 ms | 76.00 |
rust (1.38) |
iron (0.6) | 0.51 ms | 0.43 ms | 0.92 ms | 1.94 ms | 38.26 ms | 518.00 |
ruby (2.6) |
syro (3.1) | 2.61 ms | 0.71 ms | 7.34 ms | 16.31 ms | 62.26 ms | 3704.67 |
ruby (2.6) |
roda (3.24) | 2.76 ms | 0.71 ms | 7.88 ms | 19.86 ms | 102.17 ms | 4430.33 |
ruby (2.6) |
cuba (3.9) | 2.95 ms | 0.65 ms | 8.44 ms | 17.70 ms | 51.69 ms | 4077.33 |
ruby (2.6) |
rack-routing (0.0) | 3.77 ms | 0.78 ms | 11.11 ms | 25.06 ms | 81.74 ms | 5656.33 |
c (11) |
agoo-c (0.5) | 4.23 ms | 3.91 ms | 7.48 ms | 13.06 ms | 38.88 ms | 2716.00 |
node (12.1) |
sifrr (0.0) | 4.48 ms | 3.72 ms | 9.13 ms | 17.07 ms | 72.76 ms | 3856.67 |
python (3.7) |
japronto (0.1) | 4.51 ms | 4.09 ms | 8.94 ms | 14.80 ms | 30.36 ms | 3298.67 |
swift (5.1) |
swifter (1.4) | 4.70 ms | 0.87 ms | 14.49 ms | 14.97 ms | 2520.01 ms | 47946.67 |
nim (1.0) |
httpbeast (0.2) | 4.92 ms | 4.23 ms | 9.02 ms | 15.67 ms | 52.85 ms | 3326.67 |
cpp (14/17) |
drogon (1.0) | 5.10 ms | 4.51 ms | 9.35 ms | 15.83 ms | 64.32 ms | 3422.33 |
go (1.13) |
atreugo (8.2) | 5.11 ms | 4.66 ms | 7.95 ms | 13.85 ms | 48.64 ms | 2402.33 |
go (1.13) |
fasthttprouter (0.1) | 5.16 ms | 4.62 ms | 7.88 ms | 14.34 ms | 165.88 ms | 4373.33 |
go (1.13) |
gorouter-fasthttp (4.1) | 5.22 ms | 4.76 ms | 7.98 ms | 14.17 ms | 43.87 ms | 2375.67 |
cpp (11) |
evhtp (1.2) | 5.25 ms | 4.73 ms | 8.81 ms | 14.62 ms | 41.37 ms | 2755.33 |
ruby (2.6) |
flame (4.18) | 5.41 ms | 0.66 ms | 16.81 ms | 41.88 ms | 110.26 ms | 9105.00 |
crystal (0.31) |
toro (0.4) | 5.74 ms | 5.02 ms | 9.72 ms | 15.94 ms | 45.68 ms | 3140.33 |
crystal (0.31) |
router.cr (0.2) | 5.97 ms | 5.16 ms | 10.16 ms | 16.82 ms | 60.26 ms | 3366.33 |
crystal (0.31) |
raze (0.3) | 6.06 ms | 5.23 ms | 10.41 ms | 17.23 ms | 47.92 ms | 3441.67 |
ruby (2.6) |
hanami (1.3) | 6.18 ms | 0.57 ms | 20.84 ms | 44.99 ms | 99.61 ms | 10399.00 |
crystal (0.31) |
kemal (0.28) | 6.25 ms | 5.35 ms | 10.58 ms | 17.44 ms | 50.29 ms | 3427.67 |
crystal (0.31) |
spider-gazelle (1.6) | 6.30 ms | 5.38 ms | 11.00 ms | 18.17 ms | 49.65 ms | 3669.67 |
crystal (0.31) |
amber (0.3) | 6.81 ms | 5.85 ms | 11.60 ms | 18.89 ms | 48.69 ms | 3729.67 |
rust (1.38) |
gotham (0.4) | 6.89 ms | 5.70 ms | 11.94 ms | 19.98 ms | 221.74 ms | 5673.00 |
ruby (2.6) |
sinatra (2.0) | 7.26 ms | 0.63 ms | 24.07 ms | 52.76 ms | 114.11 ms | 12084.33 |
nim (1.0) |
jester (0.4) | 7.39 ms | 6.63 ms | 11.19 ms | 19.35 ms | 56.80 ms | 3443.67 |
crystal (0.31) |
orion (1.7) | 7.65 ms | 6.72 ms | 13.01 ms | 21.55 ms | 52.65 ms | 4177.33 |
java (8) |
act (1.8) | 7.75 ms | 6.93 ms | 11.59 ms | 18.33 ms | 213.46 ms | 5691.33 |
go (1.13) |
gramework (1.6) | 7.77 ms | 6.59 ms | 13.24 ms | 24.47 ms | 96.64 ms | 4582.00 |
go (1.13) |
rte (0.0) | 8.24 ms | 6.92 ms | 13.09 ms | 28.97 ms | 281.57 ms | 7345.67 |
java (8) |
rapidoid (5.5) | 8.70 ms | 4.30 ms | 11.51 ms | 85.66 ms | 225.46 ms | 16689.67 |
go (1.13) |
chi (4.0) | 8.76 ms | 7.40 ms | 14.35 ms | 30.97 ms | 226.86 ms | 6372.00 |
go (1.13) |
gorouter (4.1) | 8.81 ms | 7.40 ms | 14.53 ms | 32.20 ms | 182.94 ms | 6423.67 |
ruby (2.6) |
grape (1.2) | 9.04 ms | 0.83 ms | 28.84 ms | 59.80 ms | 133.48 ms | 14050.67 |
go (1.13) |
kami (2.2) | 9.16 ms | 7.80 ms | 14.63 ms | 33.23 ms | 239.45 ms | 7052.67 |
go (1.13) |
violetear (7.0) | 9.16 ms | 8.10 ms | 13.46 ms | 29.31 ms | 281.38 ms | 6655.67 |
go (1.13) |
goroute (0.0) | 9.25 ms | 7.77 ms | 15.67 ms | 32.62 ms | 122.70 ms | 6015.00 |
go (1.13) |
echo (4.1) | 9.28 ms | 7.71 ms | 15.68 ms | 34.05 ms | 215.82 ms | 6869.00 |
go (1.13) |
gin (1.4) | 9.31 ms | 7.72 ms | 15.72 ms | 34.78 ms | 214.66 ms | 6425.00 |
go (1.13) |
beego (1.12) | 9.53 ms | 8.01 ms | 15.80 ms | 35.23 ms | 127.95 ms | 6593.33 |
go (1.13) |
gorilla-mux (1.7) | 9.59 ms | 7.90 ms | 16.46 ms | 35.76 ms | 123.21 ms | 6642.33 |
ruby (2.6) |
agoo (2.11) | 9.61 ms | 6.60 ms | 15.46 ms | 84.80 ms | 122.01 ms | 12914.33 |
csharp (7.3) |
aspnetcore (2.2) | 10.39 ms | 8.99 ms | 14.08 ms | 24.05 ms | 505.01 ms | 14456.67 |
rust (1.38) |
actix-web (1.0) | 10.46 ms | 10.15 ms | 13.92 ms | 18.15 ms | 33.18 ms | 2635.33 |
go (1.13) |
air (0.13) | 11.05 ms | 8.84 ms | 18.98 ms | 43.60 ms | 248.31 ms | 10011.67 |
go (1.13) |
gf (1.9) | 11.76 ms | 10.08 ms | 18.90 ms | 41.29 ms | 132.98 ms | 7046.67 |
swift (5.1) |
perfect (3.1) | 11.84 ms | 11.92 ms | 14.18 ms | 16.19 ms | 108.43 ms | 2768.00 |
kotlin (1.3) |
ktor (1.2) | 12.05 ms | 10.42 ms | 22.31 ms | 40.48 ms | 245.44 ms | 9693.67 |
python (3.7) |
falcon (2.0) | 12.72 ms | 9.04 ms | 28.58 ms | 49.96 ms | 107.85 ms | 10718.00 |
node (12.1) |
0http (1.2) | 13.02 ms | 9.65 ms | 18.00 ms | 78.86 ms | 523.48 ms | 22742.00 |
php (7.3) |
one (1.8) | 13.49 ms | 13.07 ms | 21.71 ms | 30.74 ms | 63.58 ms | 6269.67 |
node (12.1) |
polkadot (1.0) | 13.93 ms | 9.60 ms | 17.84 ms | 104.68 ms | 686.35 ms | 31979.67 |
c (99) |
kore (3.1) | 14.11 ms | 5.30 ms | 11.96 ms | 301.57 ms | 1184.78 ms | 67608.33 |
node (12.1) |
polka (0.5) | 15.88 ms | 10.99 ms | 20.36 ms | 119.35 ms | 705.58 ms | 34880.00 |
python (3.7) |
asgineer (0.7) | 16.03 ms | 15.16 ms | 23.19 ms | 33.66 ms | 180.79 ms | 6452.33 |
python (3.7) |
bottle (0.12) | 16.31 ms | 11.69 ms | 33.56 ms | 56.52 ms | 178.84 ms | 12036.00 |
ruby (2.6) |
plezi (0.16) | 16.36 ms | 14.97 ms | 24.63 ms | 37.51 ms | 88.29 ms | 6521.33 |
java (8) |
spring-boot (2.1) | 16.43 ms | 13.05 ms | 20.74 ms | 73.38 ms | 577.03 ms | 22098.33 |
node (12.1) |
restana (3.3) | 16.53 ms | 10.08 ms | 20.49 ms | 216.03 ms | 737.96 ms | 40888.67 |
python (3.7) |
blacksheep (0.1) | 17.09 ms | 16.10 ms | 24.92 ms | 34.94 ms | 173.74 ms | 6401.67 |
php (7.3) |
hyperf (1.0) | 17.24 ms | 12.99 ms | 37.98 ms | 70.63 ms | 143.58 ms | 15246.67 |
node (12.1) |
rayo (1.3) | 17.81 ms | 11.61 ms | 22.14 ms | 202.34 ms | 759.53 ms | 40612.67 |
clojure (1.10) |
coast (1.0) | 18.19 ms | 17.97 ms | 18.54 ms | 23.59 ms | 492.96 ms | 8960.67 |
python (3.7) |
starlette (0.12) | 19.60 ms | 18.17 ms | 29.73 ms | 45.26 ms | 248.81 ms | 8924.67 |
python (3.7) |
hug (2.6) | 20.27 ms | 14.26 ms | 43.21 ms | 66.13 ms | 179.92 ms | 14291.67 |
node (12.1) |
foxify (0.1) | 20.40 ms | 13.90 ms | 25.89 ms | 195.76 ms | 891.83 ms | 44215.00 |
node (12.1) |
fastify (2.8) | 20.84 ms | 14.37 ms | 26.92 ms | 184.75 ms | 826.81 ms | 41225.33 |
node (12.1) |
muneem (2.4) | 21.71 ms | 12.78 ms | 24.47 ms | 315.20 ms | 991.07 ms | 58544.00 |
node (12.1) |
iotjs-express (0.0) | 22.00 ms | 15.16 ms | 27.04 ms | 217.21 ms | 948.41 ms | 48965.33 |
php (7.3) |
swoft (2.0) | 22.27 ms | 22.29 ms | 28.15 ms | 36.63 ms | 71.27 ms | 5117.33 |
node (12.1) |
koa (2.8) | 22.89 ms | 14.50 ms | 27.26 ms | 278.49 ms | 1032.75 ms | 56448.67 |
swift (5.1) |
vapor (3.3) | 24.00 ms | 17.34 ms | 29.41 ms | 213.71 ms | 1224.89 ms | 57936.67 |
php (7.3) |
imi (1.0) | 24.67 ms | 24.12 ms | 28.71 ms | 39.19 ms | 156.81 ms | 6043.33 |
node (12.1) |
restify (8.4) | 26.28 ms | 20.10 ms | 28.45 ms | 193.15 ms | 848.27 ms | 43128.33 |
swift (5.1) |
kitura (2.7) | 27.34 ms | 19.71 ms | 21.26 ms | 299.32 ms | 1738.30 ms | 81244.33 |
node (12.1) |
express (4.17) | 27.36 ms | 17.38 ms | 31.66 ms | 362.60 ms | 1172.59 ms | 67483.67 |
ruby (2.6) |
rails (6.0) | 32.28 ms | 2.65 ms | 106.03 ms | 284.59 ms | 735.76 ms | 60497.67 |
python (3.7) |
fastapi (0.39) | 32.94 ms | 31.37 ms | 46.72 ms | 62.44 ms | 424.25 ms | 15441.67 |
scala (2.12) |
http4s (0.18) | 35.85 ms | 15.96 ms | 31.64 ms | 741.88 ms | 2461.68 ms | 151270.67 |
crystal (0.31) |
lucky (0.16) | 38.08 ms | 36.40 ms | 45.27 ms | 54.95 ms | 62.35 ms | 5496.67 |
python (3.7) |
molten (0.27) | 38.88 ms | 26.89 ms | 85.62 ms | 100.58 ms | 236.19 ms | 23757.33 |
php (7.3) |
basicphp (0.9) | 39.21 ms | 13.36 ms | 75.18 ms | 388.63 ms | 764.96 ms | 76765.33 |
python (3.7) |
clastic (19.9) | 39.89 ms | 28.85 ms | 90.82 ms | 125.91 ms | 489.74 ms | 35807.67 |
fsharp (7.3) |
suave (2.5) | 40.26 ms | 10.97 ms | 86.31 ms | 200.19 ms | 1707.43 ms | 78695.67 |
python (3.7) |
flask (1.1) | 41.82 ms | 30.79 ms | 96.66 ms | 108.88 ms | 345.97 ms | 28588.00 |
python (3.7) |
aiohttp (3.6) | 42.24 ms | 40.12 ms | 65.20 ms | 73.60 ms | 158.50 ms | 15206.33 |
php (7.3) |
slim (4.2) | 42.34 ms | 13.76 ms | 85.78 ms | 430.89 ms | 748.73 ms | 84414.67 |
node (12.1) |
moleculer (0.13) | 42.86 ms | 27.00 ms | 45.44 ms | 571.92 ms | 1452.38 ms | 93877.00 |
node (12.1) |
turbo_polka (2.0) | 43.62 ms | 42.28 ms | 49.87 ms | 56.33 ms | 379.46 ms | 8128.67 |
php (7.3) |
symfony (4.3) | 43.74 ms | 14.73 ms | 83.49 ms | 453.54 ms | 739.02 ms | 89643.00 |
python (3.7) |
sanic (19.6) | 44.62 ms | 42.13 ms | 68.06 ms | 89.29 ms | 188.97 ms | 17635.00 |
php (7.3) |
zend-expressive (3.2) | 44.71 ms | 14.27 ms | 91.10 ms | 454.30 ms | 922.54 ms | 90115.67 |
python (3.7) |
bocadillo (0.18) | 48.32 ms | 44.51 ms | 70.64 ms | 103.24 ms | 280.11 ms | 17314.33 |
php (7.3) |
zend-framework (3.1) | 48.54 ms | 14.92 ms | 98.38 ms | 511.64 ms | 876.78 ms | 101269.00 |
php (7.3) |
lumen (6.1) | 48.62 ms | 16.30 ms | 105.00 ms | 492.84 ms | 861.42 ms | 97220.33 |
java (8) |
javalin (3.4) | 55.10 ms | 11.27 ms | 86.96 ms | 1198.95 ms | 2825.78 ms | 211038.67 |
php (7.3) |
spiral (2.1) | 56.06 ms | 55.80 ms | 61.70 ms | 63.85 ms | 269.24 ms | 8993.00 |
node (12.1) |
hapi (18.1) | 56.92 ms | 25.70 ms | 45.88 ms | 1058.48 ms | 2111.83 ms | 169401.33 |
swift (5.1) |
kitura-nio (2.7) | 61.82 ms | 24.55 ms | 38.77 ms | 1359.44 ms | 3238.27 ms | 238393.00 |
php (7.3) |
laravel (6.1) | 77.18 ms | 21.07 ms | 144.72 ms | 908.69 ms | 1438.77 ms | 178846.67 |
python (3.7) |
quart (0.10) | 80.64 ms | 78.58 ms | 124.98 ms | 162.26 ms | 255.71 ms | 29674.33 |
python (3.7) |
responder (1.3) | 94.29 ms | 93.24 ms | 134.04 ms | 164.35 ms | 335.44 ms | 26368.67 |
python (3.7) |
tornado (5.1) | 96.43 ms | 96.76 ms | 112.64 ms | 125.01 ms | 658.50 ms | 22802.33 |
python (3.7) |
django (2.2) | 106.13 ms | 90.25 ms | 203.84 ms | 260.53 ms | 775.39 ms | 57933.67 |
python (3.7) |
masonite (2.2) | 139.69 ms | 107.25 ms | 249.90 ms | 361.44 ms | 914.03 ms | 84356.67 |
scala (2.12) |
akkahttp (10.1) | 182.09 ms | 7.49 ms | 22.79 ms | 4640.77 ms | 7936.59 ms | 783950.00 |
crystal (0.31) |
onyx (0.5) | 188.58 ms | 190.88 ms | 227.41 ms | 260.81 ms | 305.44 ms | 33331.33 |
perl (5.3) |
dancer2 (2.0) | 314.26 ms | 85.68 ms | 466.80 ms | 4869.84 ms | 6812.34 ms | 845205.67 |
python (3.7) |
cyclone (1.3) | 333.95 ms | 245.14 ms | 306.21 ms | 4040.61 ms | 6910.34 ms | 638856.00 |
crystal (0.31) |
athena (0.7) | 335.39 ms | 218.22 ms | 239.77 ms | 4015.67 ms | 5939.34 ms | 647323.33 |
1️⃣ (agoo-c) (c)
2️⃣ (japronto) (python)
3️⃣ (sifrr) (node)
4️⃣ (httpbeast) (nim)
5️⃣ (rapidoid) (java)
In any way you want ...
- Request a framework addition
- Report a bug (on any implementation)
- Suggest an idea
- ...
Any kind of idea is ❤️
- Taichiro Suzuki - Author | Maintainer
- OvermindDL1 - Maintainer
- Marwan Rabbâa - Maintainer