Skip to content
bench

Update auth docstrings #1368

Sign in to view logs

Update auth docstrings

Update auth docstrings #1368

Triggered via pull request January 9, 2025 23:00
@hinthornwhinthornw
opened #2977
wfh/auth/docs
Status Success
Total duration 43m 43s
Artifacts –

bench.yml

on: pull_request
benchmark
43m 32s
benchmark
Fit to window
Zoom out
Zoom in

Annotations

1 warning and 2 notices
benchmark
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Benchmark results: docs/docs/how-tos/auth/custom_auth.md#L1
......................................... fanout_to_subgraph_10x: Mean +- std dev: 60.9 ms +- 0.9 ms ......................................... fanout_to_subgraph_10x_sync: Mean +- std dev: 53.0 ms +- 0.6 ms ......................................... fanout_to_subgraph_10x_checkpoint: Mean +- std dev: 74.2 ms +- 1.0 ms ......................................... fanout_to_subgraph_10x_checkpoint_sync: Mean +- std dev: 94.9 ms +- 1.0 ms ......................................... fanout_to_subgraph_100x: Mean +- std dev: 598 ms +- 22 ms ......................................... fanout_to_subgraph_100x_sync: Mean +- std dev: 515 ms +- 10 ms ......................................... fanout_to_subgraph_100x_checkpoint: Mean +- std dev: 742 ms +- 10 ms ......................................... fanout_to_subgraph_100x_checkpoint_sync: Mean +- std dev: 956 ms +- 17 ms ......................................... react_agent_10x: Mean +- std dev: 30.5 ms +- 0.7 ms ......................................... react_agent_10x_sync: Mean +- std dev: 22.7 ms +- 0.3 ms ......................................... react_agent_10x_checkpoint: Mean +- std dev: 37.8 ms +- 0.7 ms ......................................... react_agent_10x_checkpoint_sync: Mean +- std dev: 36.6 ms +- 0.3 ms ......................................... react_agent_100x: Mean +- std dev: 340 ms +- 6 ms ......................................... react_agent_100x_sync: Mean +- std dev: 269 ms +- 2 ms ......................................... react_agent_100x_checkpoint: Mean +- std dev: 631 ms +- 6 ms ......................................... react_agent_100x_checkpoint_sync: Mean +- std dev: 617 ms +- 6 ms ......................................... wide_state_25x300: Mean +- std dev: 23.0 ms +- 0.5 ms ......................................... wide_state_25x300_sync: Mean +- std dev: 15.2 ms +- 0.2 ms ......................................... wide_state_25x300_checkpoint: Mean +- std dev: 248 ms +- 13 ms ......................................... wide_state_25x300_checkpoint_sync: Mean +- std dev: 244 ms +- 13 ms ......................................... wide_state_15x600: Mean +- std dev: 27.0 ms +- 0.5 ms ......................................... wide_state_15x600_sync: Mean +- std dev: 17.6 ms +- 0.1 ms ......................................... wide_state_15x600_checkpoint: Mean +- std dev: 429 ms +- 14 ms ......................................... wide_state_15x600_checkpoint_sync: Mean +- std dev: 426 ms +- 14 ms ......................................... wide_state_9x1200: Mean +- std dev: 26.9 ms +- 0.5 ms ......................................... wide_state_9x1200_sync: Mean +- std dev: 17.7 ms +- 0.1 ms ......................................... wide_state_9x1200_checkpoint: Mean +- std dev: 280 ms +- 14 ms ......................................... wide_state_9x1200_checkpoint_sync: Mean +- std dev: 276 ms +- 13 ms
Comparison against main: docs/docs/how-tos/auth/custom_auth.md#L1
+-----------------------------------------+----------+-----------------------+ | Benchmark | main | changes | +=========================================+==========+=======================+ | fanout_to_subgraph_100x_checkpoint | 896 ms | 742 ms: 1.21x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_100x | 681 ms | 598 ms: 1.14x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_100x_checkpoint | 683 ms | 631 ms: 1.08x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_100x_checkpoint_sync | 666 ms | 617 ms: 1.08x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_100x_sync | 549 ms | 515 ms: 1.07x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_100x_checkpoint_sync | 1.01 sec | 956 ms: 1.05x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_25x300_checkpoint | 259 ms | 248 ms: 1.05x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_15x600_sync | 18.4 ms | 17.6 ms: 1.05x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_25x300 | 24.0 ms | 23.0 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_10x_checkpoint_sync | 38.1 ms | 36.6 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_10x_checkpoint | 39.2 ms | 37.8 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_25x300_sync | 15.7 ms | 15.2 ms: 1.03x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_10x_checkpoint_sync | 98.0 ms | 94.9 ms: 1.03x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_10x_sync | 54.6 ms | 53.0 ms: 1.03x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_10x_checkpoint | 76.6 ms | 74.2 ms: 1.03x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_9x1200_sync | 18.2 ms | 17.7 ms: 1.03x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_15x600 | 27.9 ms | 27.0 ms: 1.03x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_25x300_checkpoint_sync | 252 ms | 244 ms: 1.03x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_9x1200 | 27.7 ms | 26.9 ms: 1.03x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_10x | 31.3 ms | 30.5 ms: 1.03x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_15x600_checkpoint | 440 ms | 429 ms: 1.02x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_10x_sync | 23.2 ms | 22.7 ms: 1.02x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_100x_sync | 275 ms | 269 ms: 1.02x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_9x1200_checkpoint | 286 ms | 280 ms: 1.02x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_10x | 62.1 ms | 60.9 ms: 1.0