Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Rust crate tokio to v1.44.2 [SECURITY] #649

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Apr 7, 2025

This PR contains the following updates:

Package Type Update Change
tokio (source) dependencies patch 1.44.1 -> 1.44.2

GitHub Vulnerability Alerts

GHSA-rr8g-9fpq-6wmg

The broadcast channel internally calls clone on the stored value when receiving it, and only requires T:Send. This means that using the broadcast channel with values that are Send but not Sync can trigger unsoundness if the clone implementation makes use of the value being !Sync.

Thank you to Austin Bonander for finding and reporting this issue.


Release Notes

tokio-rs/tokio (tokio)

v1.44.2: Tokio v1.44.2

Compare Source

This release fixes a soundness issue in the broadcast channel. The channel
accepts values that are Send but !Sync. Previously, the channel called
clone() on these values without synchronizing. This release fixes the channel
by synchronizing calls to .clone() (Thanks Austin Bonander for finding and
reporting the issue).

Fixed
  • sync: synchronize clone() call in broadcast channel (#​7232)

Configuration

📅 Schedule: Branch creation - "" (UTC), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Apr 7, 2025
Copy link

github-actions bot commented Apr 7, 2025

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 186 5766 total, 0 failed avg: 894ms, p95: 2340ms
grafbase 169 5215 total, 0 failed avg: 926ms, p95: 2327ms
apollo-router 164 5120 total, 0 failed avg: 983ms, p95: 2258ms
hive-gateway-bun 84 2816 total, 0 failed avg: 3337ms, p95: 5975ms
apollo-server 77 2604 total, 0 failed avg: 3630ms, p95: 31658ms
hive-gateway 72 2444 total, 0 failed avg: 3846ms, p95: 21325ms
mercurius 68 2190 total, 0 failed avg: 4206ms, p95: 5977ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17238      ✗ 0    
     data_received..................: 506 MB  16 MB/s
     data_sent......................: 6.8 MB  221 kB/s
     http_req_blocked...............: avg=1.48ms   min=1.64µs  med=3.47µs   max=1.61s p(90)=6.73µs   p(95)=478.11µs
     http_req_connecting............: avg=950.25µs min=0s      med=0s       max=1.61s p(90)=0s       p(95)=212.39µs
     http_req_duration..............: avg=894.08ms min=3.83ms  med=740.2ms  max=5.52s p(90)=1.78s    p(95)=2.34s   
       { expected_response:true }...: avg=894.08ms min=3.83ms  med=740.2ms  max=5.52s p(90)=1.78s    p(95)=2.34s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5766 
     http_req_receiving.............: avg=276.51ms min=31.42µs med=87.5µs   max=4.86s p(90)=1.2s     p(95)=1.76s   
     http_req_sending...............: avg=17.67ms  min=8.08µs  med=15.8µs   max=3.14s p(90)=131.55µs p(95)=1.64ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=599.89ms min=3.66ms  med=573.64ms max=2.77s p(90)=1.01s    p(95)=1.17s   
     http_reqs......................: 5766    186.196489/s
     iteration_duration.............: avg=1.58s    min=37.1ms  med=1.33s    max=7.64s p(90)=3.13s    p(95)=3.73s   
     iterations.....................: 5746    185.550646/s
     vus............................: 9       min=9        max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15585      ✗ 0    
     data_received..................: 458 MB  15 MB/s
     data_sent......................: 6.2 MB  202 kB/s
     http_req_blocked...............: avg=3.14ms   min=1.43µs  med=3.3µs    max=1.95s p(90)=5.73µs   p(95)=5.9ms  
     http_req_connecting............: avg=2.12ms   min=0s      med=0s       max=1.95s p(90)=0s       p(95)=5.77ms 
     http_req_duration..............: avg=925.97ms min=3.01ms  med=784.55ms max=5.58s p(90)=1.83s    p(95)=2.32s  
       { expected_response:true }...: avg=925.97ms min=3.01ms  med=784.55ms max=5.58s p(90)=1.83s    p(95)=2.32s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5215 
     http_req_receiving.............: avg=280.3ms  min=34.02µs med=84.31µs  max=4.5s  p(90)=1.11s    p(95)=1.56s  
     http_req_sending...............: avg=20.7ms   min=7.96µs  med=14.69µs  max=3.2s  p(90)=699.36µs p(95)=24.95ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=624.96ms min=2.96ms  med=594ms    max=3.3s  p(90)=1.1s     p(95)=1.42s  
     http_reqs......................: 5215    169.759975/s
     iteration_duration.............: avg=1.75s    min=20.61ms med=1.58s    max=7.82s p(90)=3.34s    p(95)=3.94s  
     iterations.....................: 5195    169.10893/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15300      ✗ 0    
     data_received..................: 449 MB  15 MB/s
     data_sent......................: 6.1 MB  196 kB/s
     http_req_blocked...............: avg=2.07ms   min=1.5µs   med=3.19µs   max=2.75s p(90)=5.59µs   p(95)=1.12ms  
     http_req_connecting............: avg=732.21µs min=0s      med=0s       max=1.17s p(90)=0s       p(95)=833.32µs
     http_req_duration..............: avg=982.71ms min=6.42ms  med=822.91ms max=4.66s p(90)=1.96s    p(95)=2.25s   
       { expected_response:true }...: avg=982.71ms min=6.42ms  med=822.91ms max=4.66s p(90)=1.96s    p(95)=2.25s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5120 
     http_req_receiving.............: avg=281.18ms min=35.34µs med=83.78µs  max=4.09s p(90)=1.12s    p(95)=1.7s    
     http_req_sending...............: avg=29.89ms  min=8.02µs  med=14.61µs  max=3.23s p(90)=342.84µs p(95)=14.11ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=671.63ms min=6.35ms  med=625.74ms max=2.89s p(90)=1.19s    p(95)=1.33s   
     http_reqs......................: 5120    164.835621/s
     iteration_duration.............: avg=1.79s    min=28.72ms med=1.59s    max=8.18s p(90)=3.41s    p(95)=4.12s   
     iterations.....................: 5100    164.191732/s
     vus............................: 28      min=28       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8388      ✗ 0    
     data_received..................: 247 MB  7.4 MB/s
     data_sent......................: 3.3 MB  100 kB/s
     http_req_blocked...............: avg=1.02ms   min=1.44µs  med=3.46µs  max=24.06ms  p(90)=856.12µs p(95)=10.27ms 
     http_req_connecting............: avg=1ms      min=0s      med=0s      max=22.02ms  p(90)=430.5µs  p(95)=10.19ms 
     http_req_duration..............: avg=3.33s    min=15.55ms med=3.04s   max=8.24s    p(90)=5.19s    p(95)=5.97s   
       { expected_response:true }...: avg=3.33s    min=15.55ms med=3.04s   max=8.24s    p(90)=5.19s    p(95)=5.97s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2816 
     http_req_receiving.............: avg=60.48ms  min=38.38µs med=168.6µs max=1.74s    p(90)=14.71ms  p(95)=534.69ms
     http_req_sending...............: avg=763.87µs min=8.24µs  med=18.14µs max=268.24ms p(90)=310.65µs p(95)=739.66µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.27s    min=15.34ms med=2.96s   max=8.08s    p(90)=5.15s    p(95)=5.97s   
     http_reqs......................: 2816    84.142787/s
     iteration_duration.............: avg=3.41s    min=345.3ms med=3.1s    max=8.28s    p(90)=5.25s    p(95)=6.07s   
     iterations.....................: 2796    83.545182/s
     vus............................: 77      min=77      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7752      ✗ 0    
     data_received..................: 229 MB  6.8 MB/s
     data_sent......................: 3.1 MB  92 kB/s
     http_req_blocked...............: avg=527.02µs min=1.48µs  med=3.19µs   max=10.63ms  p(90)=682.81µs p(95)=4.86ms  
     http_req_connecting............: avg=510.28µs min=0s      med=0s       max=10.47ms  p(90)=534.28µs p(95)=4.66ms  
     http_req_duration..............: avg=3.62s    min=12.2ms  med=1.46s    max=33.26s   p(90)=2.73s    p(95)=31.65s  
       { expected_response:true }...: avg=3.62s    min=12.2ms  med=1.46s    max=33.26s   p(90)=2.73s    p(95)=31.65s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2604 
     http_req_receiving.............: avg=363.06µs min=46.04µs med=109.62µs max=301.07ms p(90)=186.84µs p(95)=263.93µs
     http_req_sending...............: avg=122.27µs min=8.84µs  med=16.2µs   max=16.97ms  p(90)=150.98µs p(95)=665.51µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.62s    min=12.11ms med=1.46s    max=33.26s   p(90)=2.73s    p(95)=31.65s  
     http_reqs......................: 2604    77.15427/s
     iteration_duration.............: avg=3.67s    min=152.4ms med=1.47s    max=33.27s   p(90)=2.91s    p(95)=31.68s  
     iterations.....................: 2584    76.561687/s
     vus............................: 63      min=63      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7272      ✗ 0    
     data_received..................: 215 MB  6.3 MB/s
     data_sent......................: 2.9 MB  86 kB/s
     http_req_blocked...............: avg=4.32ms   min=1.6µs    med=3.72µs   max=114.13ms p(90)=14.96ms  p(95)=36.94ms
     http_req_connecting............: avg=4.19ms   min=0s       med=0s       max=99.77ms  p(90)=14.55ms  p(95)=36.4ms 
     http_req_duration..............: avg=3.84s    min=15.51ms  med=2.13s    max=33.16s   p(90)=3.94s    p(95)=21.32s 
       { expected_response:true }...: avg=3.84s    min=15.51ms  med=2.13s    max=33.16s   p(90)=3.94s    p(95)=21.32s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2444 
     http_req_receiving.............: avg=454.18µs min=43.16µs  med=105.53µs max=82.01ms  p(90)=395.12µs p(95)=1.2ms  
     http_req_sending...............: avg=1.39ms   min=8.59µs   med=20.85µs  max=57.98ms  p(90)=588.15µs p(95)=11.75ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.84s    min=15.42ms  med=2.13s    max=33.15s   p(90)=3.94s    p(95)=21.32s 
     http_reqs......................: 2444    72.026564/s
     iteration_duration.............: avg=3.89s    min=317.93ms med=2.15s    max=33.19s   p(90)=3.99s    p(95)=21.88s 
     iterations.....................: 2424    71.437148/s
     vus............................: 59      min=59      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6510      ✗ 0    
     data_received..................: 192 MB  6.0 MB/s
     data_sent......................: 2.6 MB  81 kB/s
     http_req_blocked...............: avg=3ms    min=1.66µs   med=3.6µs   max=51.76ms  p(90)=16.02ms  p(95)=29.17ms 
     http_req_connecting............: avg=2.96ms min=0s       med=0s      max=51.73ms  p(90)=15.94ms  p(95)=28.94ms 
     http_req_duration..............: avg=4.2s   min=13.28ms  med=4.21s   max=8.51s    p(90)=5.28s    p(95)=5.97s   
       { expected_response:true }...: avg=4.2s   min=13.28ms  med=4.21s   max=8.51s    p(90)=5.28s    p(95)=5.97s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2190 
     http_req_receiving.............: avg=7.1ms  min=36.47µs  med=99.78µs max=634.66ms p(90)=277.13µs p(95)=969.18µs
     http_req_sending...............: avg=1.06ms min=8.76µs   med=19.32µs max=25.61ms  p(90)=2.52ms   p(95)=8.63ms  
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.19s  min=13.18ms  med=4.21s   max=8.51s    p(90)=5.28s    p(95)=5.97s   
     http_reqs......................: 2190    68.094605/s
     iteration_duration.............: avg=4.26s  min=585.34ms med=4.23s   max=8.53s    p(90)=5.3s     p(95)=6.03s   
     iterations.....................: 2170    67.472737/s
     vus............................: 73      min=73      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Apr 7, 2025

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 180 5649 total, 0 failed avg: 1216ms, p95: 4347ms
grafbase 165 5204 total, 0 failed avg: 1457ms, p95: 3251ms
apollo-router 158 4981 total, 3 failed avg: 1706ms, p95: 3864ms ❌ 3 failed requests, 3 non-200 responses, 3 unexpected GraphQL errors
hive-gateway-bun 87 3010 total, 0 failed avg: 5257ms, p95: 9090ms
apollo-server 78 2808 total, 0 failed avg: 5803ms, p95: 33791ms
hive-gateway 78 2818 total, 0 failed avg: 5764ms, p95: 33638ms
mercurius 67 2250 total, 0 failed avg: 6948ms, p95: 12105ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16887      ✗ 0    
     data_received..................: 496 MB  16 MB/s
     data_sent......................: 6.7 MB  214 kB/s
     http_req_blocked...............: avg=2.92ms   min=1.54µs  med=3.57µs   max=1.72s   p(90)=22.02µs p(95)=18.23ms
     http_req_connecting............: avg=1.73ms   min=0s      med=0s       max=332.6ms p(90)=0s      p(95)=17.93ms
     http_req_duration..............: avg=1.21s    min=3.25ms  med=913.19ms max=10.25s  p(90)=2.46s   p(95)=4.34s  
       { expected_response:true }...: avg=1.21s    min=3.25ms  med=913.19ms max=10.25s  p(90)=2.46s   p(95)=4.34s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5649 
     http_req_receiving.............: avg=507.03ms min=32.38µs med=94.12µs  max=9.72s   p(90)=1.62s   p(95)=3.65s  
     http_req_sending...............: avg=23.11ms  min=8.03µs  med=16.69µs  max=5.14s   p(90)=1.05ms  p(95)=7.04ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=685.58ms min=3.15ms  med=639.37ms max=2.67s   p(90)=1.23s   p(95)=1.42s  
     http_reqs......................: 5649    180.559371/s
     iteration_duration.............: avg=2.66s    min=26.78ms med=2.17s    max=12.15s  p(90)=5.77s   p(95)=6.94s  
     iterations.....................: 5629    179.92011/s
     vus............................: 208     min=208      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15552      ✗ 0    
     data_received..................: 457 MB  15 MB/s
     data_sent......................: 6.2 MB  196 kB/s
     http_req_blocked...............: avg=4.71ms   min=1.43µs  med=3.41µs  max=3.43s p(90)=31.87µs  p(95)=25.57ms
     http_req_connecting............: avg=3.03ms   min=0s      med=0s      max=1.57s p(90)=0s       p(95)=24.8ms 
     http_req_duration..............: avg=1.45s    min=3.06ms  med=1.28s   max=5.79s p(90)=2.65s    p(95)=3.25s  
       { expected_response:true }...: avg=1.45s    min=3.06ms  med=1.28s   max=5.79s p(90)=2.65s    p(95)=3.25s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5204 
     http_req_receiving.............: avg=289.01ms min=32.12µs med=79.92µs max=4.94s p(90)=1.16s    p(95)=1.76s  
     http_req_sending...............: avg=26.47ms  min=7.9µs   med=15.72µs max=4.14s p(90)=698.67µs p(95)=3.86ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.14s    min=2.99ms  med=1.05s   max=4.42s p(90)=1.98s    p(95)=2.64s  
     http_reqs......................: 5204    165.355249/s
     iteration_duration.............: avg=2.92s    min=31.57ms med=2.59s   max=13.7s p(90)=5.34s    p(95)=6.44s  
     iterations.....................: 5184    164.719756/s
     vus............................: 250     min=250      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 4958 / ✗ 3
     ✗ no graphql errors
      ↳  99% — ✓ 4958 / ✗ 3
     ✓ valid response structure

     █ setup

     checks.........................: 99.95% ✓ 14874      ✗ 6    
     data_received..................: 437 MB 14 MB/s
     data_sent......................: 5.9 MB 188 kB/s
     http_req_blocked...............: avg=4.65ms   min=1.53µs  med=3.52µs  max=2.73s  p(90)=3.18ms p(95)=22.08ms
     http_req_connecting............: avg=4.27ms   min=0s      med=0s      max=2.73s  p(90)=1.63ms p(95)=21.79ms
     http_req_duration..............: avg=1.7s     min=6.69ms  med=1.37s   max=6.92s  p(90)=3.19s  p(95)=3.86s  
       { expected_response:true }...: avg=1.7s     min=6.69ms  med=1.37s   max=6.92s  p(90)=3.19s  p(95)=3.86s  
     http_req_failed................: 0.06%  ✓ 3          ✗ 4978 
     http_req_receiving.............: avg=324.42ms min=0s      med=80.16µs max=4.09s  p(90)=1.21s  p(95)=2.33s  
     http_req_sending...............: avg=20.16ms  min=7.42µs  med=17µs    max=2.89s  p(90)=1.05ms p(95)=10.87ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s     p(95)=0s     
     http_req_waiting...............: avg=1.36s    min=6.62ms  med=1.18s   max=4.3s   p(90)=2.44s  p(95)=2.91s  
     http_reqs......................: 4981   158.258329/s
     iteration_duration.............: avg=3s       min=71.84ms med=2.67s   max=11.01s p(90)=5.62s  p(95)=6.4s   
     iterations.....................: 4961   157.622881/s
     vus............................: 253    min=253      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8970      ✗ 0    
     data_received..................: 264 MB  7.7 MB/s
     data_sent......................: 3.6 MB  104 kB/s
     http_req_blocked...............: avg=9.21ms  min=1.88µs   med=3.99µs   max=101.14ms p(90)=46.9ms  p(95)=65.13ms 
     http_req_connecting............: avg=9.12ms  min=0s       med=0s       max=101.11ms p(90)=45.56ms p(95)=64.84ms 
     http_req_duration..............: avg=5.25s   min=17.59ms  med=4.95s    max=12.38s   p(90)=7.73s   p(95)=9.08s   
       { expected_response:true }...: avg=5.25s   min=17.59ms  med=4.95s    max=12.38s   p(90)=7.73s   p(95)=9.08s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3010 
     http_req_receiving.............: avg=66.22ms min=36.34µs  med=134.68µs max=3.26s    p(90)=5.55ms  p(95)=216.38ms
     http_req_sending...............: avg=2.64ms  min=9.53µs   med=22.53µs  max=503.77ms p(90)=8.29ms  p(95)=14.96ms 
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=5.18s   min=17.33ms  med=4.9s     max=12.13s   p(90)=7.64s   p(95)=9.07s   
     http_reqs......................: 3010    87.260971/s
     iteration_duration.............: avg=5.37s   min=202.96ms med=5.01s    max=12.55s   p(90)=7.86s   p(95)=9.13s   
     iterations.....................: 2990    86.681164/s
     vus............................: 132     min=132     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8364      ✗ 0    
     data_received..................: 247 MB  6.9 MB/s
     data_sent......................: 3.3 MB  93 kB/s
     http_req_blocked...............: avg=2.04ms   min=1.46µs   med=2.8µs    max=31.69ms p(90)=9.56ms   p(95)=18.13ms 
     http_req_connecting............: avg=1.99ms   min=0s       med=0s       max=24.19ms p(90)=9.36ms   p(95)=17.9ms  
     http_req_duration..............: avg=5.8s     min=12.65ms  med=1.58s    max=35.41s  p(90)=32.18s   p(95)=33.79s  
       { expected_response:true }...: avg=5.8s     min=12.65ms  med=1.58s    max=35.41s  p(90)=32.18s   p(95)=33.79s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2808 
     http_req_receiving.............: avg=169.66µs min=43.01µs  med=107.85µs max=12.99ms p(90)=197.85µs p(95)=288.91µs
     http_req_sending...............: avg=562.58µs min=8.94µs   med=14.65µs  max=15.08ms p(90)=1.06ms   p(95)=5.34ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.8s     min=12.58ms  med=1.58s    max=35.41s  p(90)=32.17s   p(95)=33.78s  
     http_reqs......................: 2808    78.134027/s
     iteration_duration.............: avg=5.85s    min=452.27ms med=1.62s    max=35.42s  p(90)=32.23s   p(95)=33.81s  
     iterations.....................: 2788    77.577517/s
     vus............................: 2       min=2       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8394      ✗ 0    
     data_received..................: 248 MB  6.9 MB/s
     data_sent......................: 3.3 MB  93 kB/s
     http_req_blocked...............: avg=4.84ms   min=1.85µs   med=3.97µs   max=94.95ms  p(90)=10.89ms p(95)=52.25ms
     http_req_connecting............: avg=4.7ms    min=0s       med=0s       max=85.46ms  p(90)=9.05ms  p(95)=51.86ms
     http_req_duration..............: avg=5.76s    min=15.07ms  med=2.35s    max=35.29s   p(90)=22.68s  p(95)=33.63s 
       { expected_response:true }...: avg=5.76s    min=15.07ms  med=2.35s    max=35.29s   p(90)=22.68s  p(95)=33.63s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2818 
     http_req_receiving.............: avg=772.31µs min=42.29µs  med=112.05µs max=191.04ms p(90)=895.3µs p(95)=2.56ms 
     http_req_sending...............: avg=1.53ms   min=8.27µs   med=23.03µs  max=64.51ms  p(90)=2.26ms  p(95)=15.01ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=5.76s    min=14.95ms  med=2.35s    max=35.29s   p(90)=22.67s  p(95)=33.63s 
     http_reqs......................: 2818    78.490497/s
     iteration_duration.............: avg=5.83s    min=272.86ms med=2.38s    max=35.29s   p(90)=23.13s  p(95)=33.65s 
     iterations.....................: 2798    77.933432/s
     vus............................: 86      min=86      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6690      ✗ 0    
     data_received..................: 198 MB  6.0 MB/s
     data_sent......................: 2.7 MB  81 kB/s
     http_req_blocked...............: avg=3.62ms   min=1.5µs    med=3.67µs  max=59.03ms p(90)=23.55ms  p(95)=27.79ms 
     http_req_connecting............: avg=3.49ms   min=0s       med=0s      max=31.75ms p(90)=23.2ms   p(95)=27.58ms 
     http_req_duration..............: avg=6.94s    min=13.14ms  med=7.17s   max=14.01s  p(90)=9.41s    p(95)=12.1s   
       { expected_response:true }...: avg=6.94s    min=13.14ms  med=7.17s   max=14.01s  p(90)=9.41s    p(95)=12.1s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2250 
     http_req_receiving.............: avg=4.5ms    min=38.39µs  med=97.95µs max=478ms   p(90)=251.77µs p(95)=697.08µs
     http_req_sending...............: avg=377.84µs min=8.98µs   med=21.11µs max=24.46ms p(90)=1.05ms   p(95)=1.48ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=6.94s    min=13.06ms  med=7.17s   max=14.01s  p(90)=9.41s    p(95)=12.1s   
     http_reqs......................: 2250    67.893875/s
     iteration_duration.............: avg=7.06s    min=554.39ms med=7.25s   max=14.02s  p(90)=9.5s     p(95)=12.14s  
     iterations.....................: 2230    67.290374/s
     vus............................: 56      min=56      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Apr 7, 2025

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 179 5540 total, 0 failed avg: 893ms, p95: 2370ms
apollo-router 166 5205 total, 0 failed avg: 942ms, p95: 2299ms
grafbase 166 5155 total, 0 failed avg: 959ms, p95: 2465ms
hive-gateway-bun 81 2700 total, 0 failed avg: 3444ms, p95: 5541ms
apollo-server 76 2566 total, 0 failed avg: 3685ms, p95: 31752ms
hive-gateway 76 2562 total, 0 failed avg: 3667ms, p95: 24243ms
mercurius 65 2113 total, 0 failed avg: 4365ms, p95: 6173ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16560      ✗ 0    
     data_received..................: 486 MB  16 MB/s
     data_sent......................: 6.6 MB  213 kB/s
     http_req_blocked...............: avg=682.78µs min=1.88µs  med=4.36µs   max=941.06ms p(90)=7.1µs    p(95)=314.56µs
     http_req_connecting............: avg=421.61µs min=0s      med=0s       max=746.24ms p(90)=0s       p(95)=166.56µs
     http_req_duration..............: avg=892.72ms min=3.66ms  med=745.85ms max=7.41s    p(90)=1.75s    p(95)=2.37s   
       { expected_response:true }...: avg=892.72ms min=3.66ms  med=745.85ms max=7.41s    p(90)=1.75s    p(95)=2.37s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5540 
     http_req_receiving.............: avg=307.19ms min=34.64µs med=109.3µs  max=6.83s    p(90)=1.07s    p(95)=1.9s    
     http_req_sending...............: avg=13.45ms  min=8.34µs  med=24.04µs  max=3.18s    p(90)=145.59µs p(95)=3.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=572.06ms min=3.53ms  med=562.28ms max=1.93s    p(90)=999.54ms p(95)=1.11s   
     http_reqs......................: 5540    179.811987/s
     iteration_duration.............: avg=1.64s    min=35.13ms med=1.4s     max=8.53s    p(90)=3.31s    p(95)=3.96s   
     iterations.....................: 5520    179.162847/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15555      ✗ 0    
     data_received..................: 457 MB  15 MB/s
     data_sent......................: 6.2 MB  198 kB/s
     http_req_blocked...............: avg=1.23ms   min=1.68µs  med=3.43µs   max=1.65s p(90)=6.12µs   p(95)=1.29ms  
     http_req_connecting............: avg=957.34µs min=0s      med=0s       max=1.65s p(90)=0s       p(95)=871.07µs
     http_req_duration..............: avg=942.07ms min=6.55ms  med=791.67ms max=4.59s p(90)=1.9s     p(95)=2.29s   
       { expected_response:true }...: avg=942.07ms min=6.55ms  med=791.67ms max=4.59s p(90)=1.9s     p(95)=2.29s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5205 
     http_req_receiving.............: avg=320.62ms min=36.61µs med=95.84µs  max=3.58s p(90)=1.16s    p(95)=1.75s   
     http_req_sending...............: avg=20.19ms  min=8.15µs  med=15.29µs  max=3.13s p(90)=275.89µs p(95)=12.05ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=601.26ms min=6.48ms  med=582.36ms max=2.8s  p(90)=1.11s    p(95)=1.24s   
     http_reqs......................: 5205    166.424667/s
     iteration_duration.............: avg=1.75s    min=37.14ms med=1.51s    max=8.87s p(90)=3.41s    p(95)=4.15s   
     iterations.....................: 5185    165.785187/s
     vus............................: 66      min=66       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15405      ✗ 0    
     data_received..................: 453 MB  15 MB/s
     data_sent......................: 6.1 MB  198 kB/s
     http_req_blocked...............: avg=1.98ms   min=1.43µs  med=3.63µs   max=1.04s p(90)=6µs    p(95)=2.27ms 
     http_req_connecting............: avg=1.84ms   min=0s      med=0s       max=1.03s p(90)=0s     p(95)=1.73ms 
     http_req_duration..............: avg=959.36ms min=3.11ms  med=788.25ms max=6.34s p(90)=1.91s  p(95)=2.46s  
       { expected_response:true }...: avg=959.36ms min=3.11ms  med=788.25ms max=6.34s p(90)=1.91s  p(95)=2.46s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5155 
     http_req_receiving.............: avg=316.49ms min=34.84µs med=88.33µs  max=4.96s p(90)=1.26s  p(95)=1.85s  
     http_req_sending...............: avg=23.62ms  min=8.37µs  med=17.27µs  max=3.1s  p(90)=1.13ms p(95)=22.79ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s     p(95)=0s     
     http_req_waiting...............: avg=619.25ms min=3.04ms  med=602.78ms max=2.37s p(90)=1.11s  p(95)=1.33s  
     http_reqs......................: 5155    166.805221/s
     iteration_duration.............: avg=1.77s    min=30.72ms med=1.54s    max=9.72s p(90)=3.52s  p(95)=4.19s  
     iterations.....................: 5135    166.158062/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8040      ✗ 0    
     data_received..................: 237 MB  7.1 MB/s
     data_sent......................: 3.2 MB  96 kB/s
     http_req_blocked...............: avg=593.68µs min=1.46µs   med=4.27µs   max=15.03ms  p(90)=346.5µs  p(95)=5.2ms   
     http_req_connecting............: avg=557.93µs min=0s       med=0s       max=15ms     p(90)=247.99µs p(95)=4.76ms  
     http_req_duration..............: avg=3.44s    min=15.84ms  med=3.18s    max=7.76s    p(90)=5.02s    p(95)=5.54s   
       { expected_response:true }...: avg=3.44s    min=15.84ms  med=3.18s    max=7.76s    p(90)=5.02s    p(95)=5.54s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2700 
     http_req_receiving.............: avg=62.85ms  min=39.5µs   med=279.82µs max=1.99s    p(90)=48.14ms  p(95)=476.48ms
     http_req_sending...............: avg=762.49µs min=8.35µs   med=23.42µs  max=330.58ms p(90)=303.63µs p(95)=888.75µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.38s    min=15.63ms  med=3.16s    max=7.55s    p(90)=4.89s    p(95)=5.53s   
     http_reqs......................: 2700    81.235193/s
     iteration_duration.............: avg=3.53s    min=135.24ms med=3.24s    max=7.79s    p(90)=5.06s    p(95)=5.57s   
     iterations.....................: 2680    80.633451/s
     vus............................: 42      min=42      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7638      ✗ 0    
     data_received..................: 226 MB  6.7 MB/s
     data_sent......................: 3.0 MB  90 kB/s
     http_req_blocked...............: avg=622.18µs min=1.57µs   med=3.38µs   max=16.61ms  p(90)=540.86µs p(95)=5.21ms  
     http_req_connecting............: avg=607.97µs min=0s       med=0s       max=16.58ms  p(90)=505.67µs p(95)=5.19ms  
     http_req_duration..............: avg=3.68s    min=13.4ms   med=1.47s    max=33.17s   p(90)=2.86s    p(95)=31.75s  
       { expected_response:true }...: avg=3.68s    min=13.4ms   med=1.47s    max=33.17s   p(90)=2.86s    p(95)=31.75s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2566 
     http_req_receiving.............: avg=404.03µs min=45.76µs  med=112.59µs max=319.73ms p(90)=186.17µs p(95)=259.99µs
     http_req_sending...............: avg=230.11µs min=8.83µs   med=18.29µs  max=23.32ms  p(90)=156.9µs  p(95)=1.43ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.68s    min=13.3ms   med=1.47s    max=33.17s   p(90)=2.86s    p(95)=31.75s  
     http_reqs......................: 2566    76.197262/s
     iteration_duration.............: avg=3.72s    min=290.19ms med=1.49s    max=33.18s   p(90)=3.03s    p(95)=31.77s  
     iterations.....................: 2546    75.603363/s
     vus............................: 64      min=64      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7626      ✗ 0    
     data_received..................: 225 MB  6.7 MB/s
     data_sent......................: 3.0 MB  91 kB/s
     http_req_blocked...............: avg=1.16ms   min=1.6µs    med=3.63µs   max=37.33ms p(90)=3.33ms   p(95)=10.92ms 
     http_req_connecting............: avg=1.13ms   min=0s       med=0s       max=31.12ms p(90)=3.13ms   p(95)=10.88ms 
     http_req_duration..............: avg=3.66s    min=14.79ms  med=1.84s    max=32.86s  p(90)=3.57s    p(95)=24.24s  
       { expected_response:true }...: avg=3.66s    min=14.79ms  med=1.84s    max=32.86s  p(90)=3.57s    p(95)=24.24s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2562 
     http_req_receiving.............: avg=399.4µs  min=44.35µs  med=106.05µs max=43.83ms p(90)=371.74µs p(95)=1.26ms  
     http_req_sending...............: avg=281.86µs min=8.63µs   med=20.72µs  max=33.75ms p(90)=153.97µs p(95)=514.03µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.66s    min=14.68ms  med=1.84s    max=32.86s  p(90)=3.57s    p(95)=24.24s  
     http_reqs......................: 2562    76.676288/s
     iteration_duration.............: avg=3.71s    min=140.76ms med=1.87s    max=32.89s  p(90)=3.62s    p(95)=24.31s  
     iterations.....................: 2542    76.077723/s
     vus............................: 42      min=42      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6279      ✗ 0    
     data_received..................: 186 MB  5.7 MB/s
     data_sent......................: 2.5 MB  78 kB/s
     http_req_blocked...............: avg=2.94ms min=1.78µs   med=3.66µs   max=65.47ms  p(90)=10.17ms  p(95)=20.63ms
     http_req_connecting............: avg=2.84ms min=0s       med=0s       max=54.92ms  p(90)=9.64ms   p(95)=20.32ms
     http_req_duration..............: avg=4.36s  min=15.13ms  med=4.5s     max=8.68s    p(90)=5.25s    p(95)=6.17s  
       { expected_response:true }...: avg=4.36s  min=15.13ms  med=4.5s     max=8.68s    p(90)=5.25s    p(95)=6.17s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2113 
     http_req_receiving.............: avg=6.36ms min=38.58µs  med=101.09µs max=376.92ms p(90)=251.45µs p(95)=1.13ms 
     http_req_sending...............: avg=1.58ms min=8.99µs   med=21.23µs  max=41.75ms  p(90)=3.72ms   p(95)=11.12ms
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=4.35s  min=15.04ms  med=4.5s     max=8.68s    p(90)=5.25s    p(95)=6.16s  
     http_reqs......................: 2113    65.464552/s
     iteration_duration.............: avg=4.43s  min=565.85ms med=4.53s    max=8.7s     p(90)=5.27s    p(95)=6.24s  
     iterations.....................: 2093    64.844916/s
     vus............................: 105     min=105     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Apr 7, 2025

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
apollo-router 5092ms 167 11768 total, 674 failed avg: 2572ms, p95: 5093ms, max: 14450ms, med: 2462ms ❌ 674 failed requests, 674 non-200 responses, 674 unexpected GraphQL errors
cosmo 5638ms 182 13040 total, 0 failed avg: 2671ms, p95: 5638ms, max: 16285ms, med: 2347ms
grafbase 5893ms 167 12189 total, 0 failed avg: 2775ms, p95: 5894ms, max: 11491ms, med: 2452ms
hive-gateway-bun 30196ms 88 7371 total, 0 failed avg: 12053ms, p95: 30197ms, max: 39703ms, med: 10416ms
mercurius 40865ms 51 4730 total, 0 failed avg: 22903ms, p95: 40865ms, max: 41960ms, med: 23868ms
hive-gateway 52827ms 81 7314 total, 0 failed avg: 13022ms, p95: 52827ms, max: 58776ms, med: 3511ms
apollo-server 60000ms 76 7115 total, 561 failed avg: 13091ms, p95: 60000ms, max: 60448ms, med: 2346ms ❌ 561 failed requests, 561 non-200 responses, 561 unexpected GraphQL errors
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  94% — ✓ 11074 / ✗ 674
     ✗ no graphql errors
      ↳  94% — ✓ 11074 / ✗ 674
     ✓ valid response structure

     █ setup

     checks.........................: 96.10% ✓ 33222      ✗ 1348  
     data_received..................: 973 MB 14 MB/s
     data_sent......................: 14 MB  199 kB/s
     http_req_blocked...............: avg=524.35ms min=1.53µs  med=4.01µs  max=9.84s  p(90)=2.41s    p(95)=3.77s  
     http_req_connecting............: avg=504.42ms min=0s      med=0s      max=8.82s  p(90)=2.37s    p(95)=3.65s  
     http_req_duration..............: avg=2.57s    min=0s      med=2.46s   max=14.44s p(90)=4.59s    p(95)=5.09s  
       { expected_response:true }...: avg=2.56s    min=6.97ms  med=2.46s   max=12s    p(90)=4.56s    p(95)=5.05s  
     http_req_failed................: 5.72%  ✓ 674        ✗ 11094 
     http_req_receiving.............: avg=220.85ms min=0s      med=80.65µs max=6.38s  p(90)=676.95ms p(95)=1.61s  
     http_req_sending...............: avg=155.54ms min=0s      med=21.77µs max=9.6s   p(90)=520.52ms p(95)=881.3ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=2.19s    min=0s      med=2.05s   max=9.47s  p(90)=4.23s    p(95)=4.6s   
     http_reqs......................: 11768  167.62969/s
     iteration_duration.............: avg=6.08s    min=13.23ms med=5.45s   max=23.64s p(90)=11.77s   p(95)=14.2s  
     iterations.....................: 11748  167.344799/s
     vus............................: 6      min=6        max=1956
     vus_max........................: 2000   min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 39060      ✗ 0     
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 16 MB   217 kB/s
     http_req_blocked...............: avg=375.73ms min=1.51µs  med=3.4µs   max=11.24s p(90)=1.17s    p(95)=3.56s   
     http_req_connecting............: avg=359.14ms min=0s      med=0s      max=11.24s p(90)=1.12s    p(95)=3.49s   
     http_req_duration..............: avg=2.67s    min=3.26ms  med=2.34s   max=16.28s p(90)=5.13s    p(95)=5.63s   
       { expected_response:true }...: avg=2.67s    min=3.26ms  med=2.34s   max=16.28s p(90)=5.13s    p(95)=5.63s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 13040 
     http_req_receiving.............: avg=135.52ms min=32.48µs med=72.15µs max=7.99s  p(90)=225.03ms p(95)=1.02s   
     http_req_sending...............: avg=120.88ms min=8.26µs  med=15.37µs max=9.59s  p(90)=267.95ms p(95)=673.57ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.41s    min=3.11ms  med=1.91s   max=10.47s p(90)=4.98s    p(95)=5.37s   
     http_reqs......................: 13040   182.929086/s
     iteration_duration.............: avg=5.8s     min=27.89ms med=5.02s   max=28.87s p(90)=11.35s   p(95)=14.12s  
     iterations.....................: 13020   182.64852/s
     vus............................: 457     min=68       max=2000
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 36507      ✗ 0     
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   199 kB/s
     http_req_blocked...............: avg=364.11ms min=1.5µs   med=3.59µs  max=11.1s  p(90)=1.17s    p(95)=2.86s  
     http_req_connecting............: avg=360.52ms min=0s      med=0s      max=11.1s  p(90)=1.14s    p(95)=2.83s  
     http_req_duration..............: avg=2.77s    min=3.18ms  med=2.45s   max=11.49s p(90)=5.42s    p(95)=5.89s  
       { expected_response:true }...: avg=2.77s    min=3.18ms  med=2.45s   max=11.49s p(90)=5.42s    p(95)=5.89s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 12189 
     http_req_receiving.............: avg=156.96ms min=30.8µs  med=70.75µs max=7.02s  p(90)=475.49ms p(95)=1.05s  
     http_req_sending...............: avg=129.65ms min=7.95µs  med=17.01µs max=7.03s  p(90)=357.55ms p(95)=862.9ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=2.48s    min=3.09ms  med=2.14s   max=11.12s p(90)=5.25s    p(95)=5.7s   
     http_reqs......................: 12189   167.552257/s
     iteration_duration.............: avg=6.35s    min=37.68ms med=5.53s   max=28.93s p(90)=12.44s   p(95)=14.31s 
     iterations.....................: 12169   167.277334/s
     vus............................: 10      min=10       max=2000
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 22053     ✗ 0     
     data_received..................: 647 MB  7.8 MB/s
     data_sent......................: 8.7 MB  105 kB/s
     http_req_blocked...............: avg=15.12ms  min=1.86µs   med=4.37µs   max=1.13s  p(90)=12.02ms p(95)=99.41ms 
     http_req_connecting............: avg=14.99ms  min=0s       med=0s       max=1.13s  p(90)=11.74ms p(95)=99.24ms 
     http_req_duration..............: avg=12.05s   min=16.93ms  med=10.41s   max=39.7s  p(90)=24.61s  p(95)=30.19s  
       { expected_response:true }...: avg=12.05s   min=16.93ms  med=10.41s   max=39.7s  p(90)=24.61s  p(95)=30.19s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7371  
     http_req_receiving.............: avg=117.32ms min=39.42µs  med=124.99µs max=11.03s p(90)=62.26ms p(95)=666.44ms
     http_req_sending...............: avg=13.81ms  min=9.71µs   med=26.27µs  max=1.69s  p(90)=8.76ms  p(95)=49.73ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s     p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=11.92s   min=16.74ms  med=10.25s   max=39.7s  p(90)=24.44s  p(95)=30.19s  
     http_reqs......................: 7371    88.4271/s
     iteration_duration.............: avg=12.34s   min=172.06ms med=10.63s   max=41.08s p(90)=24.97s  p(95)=31.01s  
     iterations.....................: 7351    88.187168/s
     vus............................: 99      min=56      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14113     ✗ 0     
     data_received..................: 415 MB  4.5 MB/s
     data_sent......................: 5.6 MB  61 kB/s
     http_req_blocked...............: avg=186.37µs min=1.53µs   med=4.82µs  max=14.06ms p(90)=450.43µs p(95)=639.12µs
     http_req_connecting............: avg=151.85µs min=0s       med=0s      max=13.99ms p(90)=378.48µs p(95)=536.35µs
     http_req_duration..............: avg=22.9s    min=14.21ms  med=23.86s  max=41.95s  p(90)=39.75s   p(95)=40.86s  
       { expected_response:true }...: avg=22.9s    min=14.21ms  med=23.86s  max=41.95s  p(90)=39.75s   p(95)=40.86s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 4730  
     http_req_receiving.............: avg=43.8ms   min=34.43µs  med=111.9µs max=3.1s    p(90)=469.65µs p(95)=2.99ms  
     http_req_sending...............: avg=46.6µs   min=9.57µs   med=30.27µs max=3.06ms  p(90)=68µs     p(95)=88.09µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=22.85s   min=14.11ms  med=23.86s  max=41.95s  p(90)=39.75s   p(95)=40.86s  
     http_reqs......................: 4730    51.633959/s
     iteration_duration.............: avg=23.09s   min=238.69ms med=23.87s  max=41.96s  p(90)=39.84s   p(95)=40.88s  
     iterations.....................: 4691    51.208225/s
     vus............................: 322     min=54      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 21882     ✗ 0     
     data_received..................: 642 MB  7.2 MB/s
     data_sent......................: 8.7 MB  97 kB/s
     http_req_blocked...............: avg=1.27ms   min=1.96µs   med=4.81µs   max=167.49ms p(90)=582.33µs p(95)=3.54ms  
     http_req_connecting............: avg=1.22ms   min=0s       med=0s       max=167.41ms p(90)=472.5µs  p(95)=3.42ms  
     http_req_duration..............: avg=13.02s   min=15.58ms  med=3.51s    max=58.77s   p(90)=47s      p(95)=52.82s  
       { expected_response:true }...: avg=13.02s   min=15.58ms  med=3.51s    max=58.77s   p(90)=47s      p(95)=52.82s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7314  
     http_req_receiving.............: avg=796.97µs min=41.74µs  med=112.65µs max=529.89ms p(90)=859µs    p(95)=2.57ms  
     http_req_sending...............: avg=491.02µs min=9.24µs   med=28.98µs  max=64.17ms  p(90)=86.12µs  p(95)=413.51µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=13.02s   min=15.51ms  med=3.51s    max=58.77s   p(90)=47s      p(95)=52.81s  
     http_reqs......................: 7314    81.758256/s
     iteration_duration.............: avg=13.09s   min=133.74ms med=3.54s    max=58.79s   p(90)=47.34s   p(95)=52.94s  
     iterations.....................: 7294    81.53469/s
     vus............................: 65      min=55      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  92% — ✓ 6534 / ✗ 561
     ✗ no graphql errors
      ↳  92% — ✓ 6534 / ✗ 561
     ✓ valid response structure

     █ setup

     checks.........................: 94.58% ✓ 19602     ✗ 1122  
     data_received..................: 576 MB 6.2 MB/s
     data_sent......................: 8.5 MB 92 kB/s
     http_req_blocked...............: avg=477.19µs min=1.45µs  med=3.34µs   max=85.92ms p(90)=321.69µs p(95)=510.88µs
     http_req_connecting............: avg=455.07µs min=0s      med=0s       max=85.79ms p(90)=258.21µs p(95)=426.44µs
     http_req_duration..............: avg=13.09s   min=13.58ms med=2.34s    max=1m0s    p(90)=57.46s   p(95)=1m0s    
       { expected_response:true }...: avg=9.07s    min=13.58ms med=2.28s    max=59.97s  p(90)=39.01s   p(95)=46.33s  
     http_req_failed................: 7.88%  ✓ 561       ✗ 6554  
     http_req_receiving.............: avg=233.33µs min=0s      med=108.57µs max=94.02ms p(90)=206.5µs  p(95)=318.72µs
     http_req_sending...............: avg=172.73µs min=8.28µs  med=16.98µs  max=45.03ms p(90)=59.09µs  p(95)=85.36µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=13.09s   min=13.46ms med=2.34s    max=1m0s    p(90)=57.46s   p(95)=1m0s    
     http_reqs......................: 7115   76.686881/s
     iteration_duration.............: avg=13.13s   min=74.07ms med=2.36s    max=1m0s    p(90)=57.51s   p(95)=1m0s    
     iterations.....................: 7095   76.471317/s
     vus............................: 6      min=6       max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants