tuxmain/rust-rpxy
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

bench: updated all bench

Browse source
This commit is contained in:
Jun Kurihara 2025-05-20 22:33:06 +09:00
commit 5f7772d957
No known key found for this signature in database
GPG key ID: D992B3E3DE1DED23
4 changed files with 61 additions and 74 deletions
Download patch file Download diff file Expand all files Collapse all files

123
bench/README.md
View file

@ -3,7 +3,7 @@
This test simply measures the performance of several reverse proxy through HTTP/1.1 by the following command using [`rewrk`](https://github.com/lnx-search/rewrk). This test simply measures the performance of several reverse proxy through HTTP/1.1 by the following command using [`rewrk`](https://github.com/lnx-search/rewrk).
```sh: ```sh:
$ rewrk -c 512 -t 4 -d 15s -h http://localhost:8080 --pct rewrk -c 512 -t 4 -d 15s -h http://localhost:8080 --pct
``` ```
## Tests on `linux/arm64/v8` ## Tests on `linux/arm64/v8`
@ -94,12 +94,12 @@ Benchmarking 512 connections @ http://localhost:8100 for 15 second(s)
## Results on `linux/amd64` ## Results on `linux/amd64`
Done at Jul. 24, 2023 Done at May 20, 2025
### Environment ### Environment
- `rpxy` commit id: `7c0945a5124418aa9a1024568c1989bb77cf312f` - `rpxy` commit id: `7c0945a5124418aa9a1024568c1989bb77cf312f`
- Docker Desktop 4.21.1 (114176) - Docker Desktop 4.41.2 (192736)
- ReWrk 0.3.2 and Wrk 0.4.2 - ReWrk 0.3.2 and Wrk 0.4.2
- iMac '27 (2020, 10-Core Intel Core i9, 128GB RAM) - iMac '27 (2020, 10-Core Intel Core i9, 128GB RAM)
@ -107,8 +107,8 @@ The docker images of `nginx` and `caddy` for `linux/amd64` were pulled from the
Also, when `Sozu` is configured as an HTTP reverse proxy, it cannot handle HTTP request messages emit from `ReWrk` due to hostname parsing errors though it can correctly handle messages dispatched from `curl` and browsers. So, we additionally test using [`Wrk`](https://github.com/wg/wrk) to examine `Sozu` with the following command. Also, when `Sozu` is configured as an HTTP reverse proxy, it cannot handle HTTP request messages emit from `ReWrk` due to hostname parsing errors though it can correctly handle messages dispatched from `curl` and browsers. So, we additionally test using [`Wrk`](https://github.com/wg/wrk) to examine `Sozu` with the following command.
```sh: ```bash
$ wrk -c 512 -t 4 -d 15s http://localhost:8110 wrk -c 512 -t 4 -d 15s http://localhost:8110
``` ```
<!-- ``` <!-- ```
@ -119,7 +119,7 @@ ERROR Error connecting to backend: Could not get cluster id from request: Host
#### With ReWrk for `rpxy`, `nginx` and `caddy` #### With ReWrk for `rpxy`, `nginx` and `caddy`
``` ```bash
---------------------------- ----------------------------
Benchmark [x86_64] with ReWrk Benchmark [x86_64] with ReWrk
---------------------------- ----------------------------
@ -128,24 +128,22 @@ Beginning round 1...
Benchmarking 512 connections @ http://localhost:8080 for 15 second(s) Benchmarking 512 connections @ http://localhost:8080 for 15 second(s)
Latencies: Latencies:
Avg Stdev Min Max Avg Stdev Min Max
20.37ms 8.95ms 1.63ms 160.27ms 15.75ms 6.75ms 1.75ms 124.25ms
Requests: Requests:
Total: 376345 Req/Sec: 25095.19 Total: 486635 Req/Sec: 32445.33
Transfer: Transfer:
Total: 295.61 MB Transfer Rate: 19.71 MB/Sec Total: 381.02 MB Transfer Rate: 25.40 MB/Sec
+ --------------- + --------------- + + --------------- + --------------- +
| Percentile | Avg Latency | | Percentile | Avg Latency |
+ --------------- + --------------- + + --------------- + --------------- +
| 99.9% | 112.50ms | | 99.9% | 91.91ms |
| 99% | 61.33ms | | 99% | 55.53ms |
| 95% | 44.26ms | | 95% | 34.87ms |
| 90% | 38.74ms | | 90% | 29.55ms |
| 75% | 32.00ms | | 75% | 23.99ms |
| 50% | 26.82ms | | 50% | 20.17ms |
+ --------------- + --------------- + + --------------- + --------------- +
626 Errors: error shutting down connection: Socket is not connected (os error 57)
sleep 3 secs sleep 3 secs
---------------------------- ----------------------------
Benchmark on nginx Benchmark on nginx
@ -153,24 +151,22 @@ Beginning round 1...
Benchmarking 512 connections @ http://localhost:8090 for 15 second(s) Benchmarking 512 connections @ http://localhost:8090 for 15 second(s)
Latencies: Latencies:
Avg Stdev Min Max Avg Stdev Min Max
23.45ms 12.42ms 1.18ms 154.44ms 24.02ms 15.84ms 1.31ms 207.97ms
Requests: Requests:
Total: 326685 Req/Sec: 21784.73 Total: 318516 Req/Sec: 21236.67
Transfer: Transfer:
Total: 265.22 MB Transfer Rate: 17.69 MB/Sec Total: 259.11 MB Transfer Rate: 17.28 MB/Sec
+ --------------- + --------------- + + --------------- + --------------- +
| Percentile | Avg Latency | | Percentile | Avg Latency |
+ --------------- + --------------- + + --------------- + --------------- +
| 99.9% | 96.85ms | | 99.9% | 135.56ms |
| 99% | 73.93ms | | 99% | 92.59ms |
| 95% | 57.57ms | | 95% | 68.54ms |
| 90% | 50.36ms | | 90% | 58.75ms |
| 75% | 40.57ms | | 75% | 45.88ms |
| 50% | 32.70ms | | 50% | 35.64ms |
+ --------------- + --------------- + + --------------- + --------------- +
657 Errors: error shutting down connection: Socket is not connected (os error 57)
sleep 3 secs sleep 3 secs
---------------------------- ----------------------------
Benchmark on caddy Benchmark on caddy
@ -178,30 +174,26 @@ Beginning round 1...
Benchmarking 512 connections @ http://localhost:8100 for 15 second(s) Benchmarking 512 connections @ http://localhost:8100 for 15 second(s)
Latencies: Latencies:
Avg Stdev Min Max Avg Stdev Min Max
45.71ms 50.47ms 0.88ms 908.49ms 74.60ms 181.26ms 0.94ms 2723.20ms
Requests: Requests:
Total: 166917 Req/Sec: 11129.80 Total: 101893 Req/Sec: 6792.16
Transfer: Transfer:
Total: 133.77 MB Transfer Rate: 8.92 MB/Sec Total: 82.03 MB Transfer Rate: 5.47 MB/Sec
+ --------------- + --------------- + + --------------- + --------------- +
| Percentile | Avg Latency | | Percentile | Avg Latency |
+ --------------- + --------------- + + --------------- + --------------- +
| 99.9% | 608.92ms | | 99.9% | 2232.12ms |
| 99% | 351.18ms | | 99% | 1517.73ms |
| 95% | 210.56ms | | 95% | 624.63ms |
| 90% | 162.68ms | | 90% | 406.69ms |
| 75% | 106.97ms | | 75% | 222.42ms |
| 50% | 73.90ms | | 50% | 133.46ms |
+ --------------- + --------------- + + --------------- + --------------- +
646 Errors: error shutting down connection: Socket is not connected (os error 57)
sleep 3 secs
``` ```
#### With Wrk for `rpxy`, `nginx`, `caddy` and `sozu` #### With Wrk for `rpxy`, `nginx`, `caddy` and `sozu`
``` ```bash
---------------------------- ----------------------------
Benchmark [x86_64] with Wrk Benchmark [x86_64] with Wrk
---------------------------- ----------------------------
@ -209,12 +201,11 @@ Benchmark on rpxy
Running 15s test @ http://localhost:8080 Running 15s test @ http://localhost:8080
4 threads and 512 connections 4 threads and 512 connections
Thread Stats Avg Stdev Max +/- Stdev Thread Stats Avg Stdev Max +/- Stdev
Latency 18.68ms 8.09ms 122.64ms 74.03% Latency 15.65ms 6.94ms 104.73ms 81.28%
Req/Sec 6.95k 815.23 8.45k 83.83% Req/Sec 8.36k 0.90k 9.90k 77.83%
414819 requests in 15.01s, 326.37MB read 499550 requests in 15.02s, 391.14MB read
Socket errors: connect 0, read 608, write 0, timeout 0 Requests/sec: 33267.61
Requests/sec: 27627.79 Transfer/sec: 26.05MB
Transfer/sec: 21.74MB
sleep 3 secs sleep 3 secs
---------------------------- ----------------------------
@ -222,12 +213,11 @@ Benchmark on nginx
Running 15s test @ http://localhost:8090 Running 15s test @ http://localhost:8090
4 threads and 512 connections 4 threads and 512 connections
Thread Stats Avg Stdev Max +/- Stdev Thread Stats Avg Stdev Max +/- Stdev
Latency 23.34ms 13.80ms 126.06ms 74.66% Latency 24.26ms 15.29ms 167.43ms 73.34%
Req/Sec 5.71k 607.41 7.07k 73.17% Req/Sec 5.53k 493.14 6.91k 69.67%
341127 requests in 15.03s, 277.50MB read 330569 requests in 15.02s, 268.91MB read
Socket errors: connect 0, read 641, write 0, timeout 0 Requests/sec: 22014.96
Requests/sec: 22701.54 Transfer/sec: 17.91MB
Transfer/sec: 18.47MB
sleep 3 secs sleep 3 secs
---------------------------- ----------------------------
@ -235,13 +225,13 @@ Benchmark on caddy
Running 15s test @ http://localhost:8100 Running 15s test @ http://localhost:8100
4 threads and 512 connections 4 threads and 512 connections
Thread Stats Avg Stdev Max +/- Stdev Thread Stats Avg Stdev Max +/- Stdev
Latency 54.19ms 55.63ms 674.53ms 88.55% Latency 212.89ms 300.23ms 1.99s 86.56%
Req/Sec 2.92k 1.40k 5.57k 56.17% Req/Sec 1.31k 1.64k 5.72k 78.79%
174748 requests in 15.03s, 140.61MB read 67749 requests in 15.04s, 51.97MB read
Socket errors: connect 0, read 660, write 0, timeout 0 Socket errors: connect 0, read 0, write 0, timeout 222
Non-2xx or 3xx responses: 70 Non-2xx or 3xx responses: 3686
Requests/sec: 11624.63 Requests/sec: 4505.12
Transfer/sec: 9.35MB Transfer/sec: 3.46MB
sleep 3 secs sleep 3 secs
---------------------------- ----------------------------
@ -249,10 +239,9 @@ Benchmark on sozu
Running 15s test @ http://localhost:8110 Running 15s test @ http://localhost:8110
4 threads and 512 connections 4 threads and 512 connections
Thread Stats Avg Stdev Max +/- Stdev Thread Stats Avg Stdev Max +/- Stdev
Latency 19.78ms 4.89ms 98.09ms 76.88% Latency 34.68ms 6.30ms 90.21ms 72.49%
Req/Sec 6.49k 824.75 8.11k 76.17% Req/Sec 3.69k 397.85 5.08k 73.00%
387744 requests in 15.02s, 329.11MB read 220655 requests in 15.01s, 187.29MB read
Socket errors: connect 0, read 647, write 0, timeout 0 Requests/sec: 14699.17
Requests/sec: 25821.93 Transfer/sec: 12.48MB
Transfer/sec: 21.92MB
``` ```

9
bench/docker-compose.amd64.yml
View file

@ -1,4 +1,3 @@
version: "3"
services: services:
nginx: nginx:
image: nginx:alpine image: nginx:alpine
@ -28,7 +27,7 @@ services:
dockerfile: docker/Dockerfile dockerfile: docker/Dockerfile
restart: unless-stopped restart: unless-stopped
environment: environment:
- LOG_LEVEL=info - LOG_LEVEL=error # almost nolog
- LOG_TO_FILE=false - LOG_TO_FILE=false
ports: ports:
- 127.0.0.1:8080:8080 - 127.0.0.1:8080:8080
@ -47,7 +46,7 @@ services:
tty: false tty: false
privileged: true privileged: true
volumes: volumes:
- ./nginx.conf:/etc/nginx/conf.d/default.conf:ro - ./nginx.conf:/etc/nginx/conf.d/default.conf:ro # set as almost nolog
- /var/run/docker.sock:/tmp/docker.sock:ro - /var/run/docker.sock:/tmp/docker.sock:ro
logging: logging:
options: options:
@ -64,7 +63,7 @@ services:
restart: unless-stopped restart: unless-stopped
tty: false tty: false
volumes: volumes:
- ./Caddyfile:/etc/caddy/Caddyfile:ro - ./Caddyfile:/etc/caddy/Caddyfile:ro # set as almost no log
networks: networks:
bench-nw: bench-nw:
@ -82,7 +81,7 @@ services:
max-size: "10m" max-size: "10m"
max-file: "3" max-file: "3"
volumes: volumes:
- ./sozu-config.toml:/etc/sozu/config.toml - ./sozu-config.toml:/etc/sozu/config.toml # set as almost nolog
networks: networks:
bench-nw: bench-nw:

1
bench/docker-compose.yml
View file

@ -1,4 +1,3 @@
version: "3"
services: services:
nginx: nginx:
image: nginx:alpine image: nginx:alpine

2
bench/sozu-config.toml
View file

@ -1,4 +1,4 @@
log_level = "info" log_level = "error"
log_target = "stdout" log_target = "stdout"
max_connections = 512 max_connections = 512
activate_listeners = true activate_listeners = true