Skip to content
Back to pull request #3036

Fix tracing hierarchy for imperative api #1419

Sign in to view logs

Fix tracing hierarchy for imperative api

Fix tracing hierarchy for imperative api #1419

Triggered via pull request January 15, 2025 17:02
@nfcamposnfcampos
synchronize #3036
nc/14jan/fix-tracing-hierarchy-imperative
Status Success
Total duration 44m 16s
Artifacts –

bench.yml

on: pull_request
benchmark
44m 7s
benchmark
Fit to window
Zoom out
Zoom in

Annotations

1 warning and 2 notices
benchmark
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Benchmark results: .github/workflows/_test_langgraph.yml#L1
......................................... fanout_to_subgraph_10x: Mean +- std dev: 61.8 ms +- 1.3 ms ......................................... fanout_to_subgraph_10x_sync: Mean +- std dev: 53.7 ms +- 0.7 ms ......................................... fanout_to_subgraph_10x_checkpoint: Mean +- std dev: 75.1 ms +- 1.0 ms ......................................... fanout_to_subgraph_10x_checkpoint_sync: Mean +- std dev: 96.1 ms +- 2.2 ms ......................................... fanout_to_subgraph_100x: Mean +- std dev: 620 ms +- 31 ms ......................................... fanout_to_subgraph_100x_sync: Mean +- std dev: 533 ms +- 20 ms ......................................... fanout_to_subgraph_100x_checkpoint: Mean +- std dev: 770 ms +- 16 ms ......................................... fanout_to_subgraph_100x_checkpoint_sync: Mean +- std dev: 969 ms +- 18 ms ......................................... react_agent_10x: Mean +- std dev: 30.9 ms +- 0.7 ms ......................................... react_agent_10x_sync: Mean +- std dev: 23.1 ms +- 0.2 ms ......................................... react_agent_10x_checkpoint: Mean +- std dev: 38.3 ms +- 0.6 ms ......................................... react_agent_10x_checkpoint_sync: Mean +- std dev: 36.7 ms +- 0.3 ms ......................................... react_agent_100x: Mean +- std dev: 343 ms +- 7 ms ......................................... react_agent_100x_sync: Mean +- std dev: 273 ms +- 2 ms ......................................... react_agent_100x_checkpoint: Mean +- std dev: 639 ms +- 8 ms ......................................... react_agent_100x_checkpoint_sync: Mean +- std dev: 621 ms +- 6 ms ......................................... wide_state_25x300: Mean +- std dev: 23.3 ms +- 0.5 ms ......................................... wide_state_25x300_sync: Mean +- std dev: 15.4 ms +- 0.2 ms ......................................... wide_state_25x300_checkpoint: Mean +- std dev: 249 ms +- 13 ms ......................................... wide_state_25x300_checkpoint_sync: Mean +- std dev: 246 ms +- 13 ms ......................................... wide_state_15x600: Mean +- std dev: 27.3 ms +- 0.8 ms ......................................... wide_state_15x600_sync: Mean +- std dev: 17.8 ms +- 0.2 ms ......................................... wide_state_15x600_checkpoint: Mean +- std dev: 428 ms +- 13 ms ......................................... wide_state_15x600_checkpoint_sync: Mean +- std dev: 425 ms +- 14 ms ......................................... wide_state_9x1200: Mean +- std dev: 27.4 ms +- 0.5 ms ......................................... wide_state_9x1200_sync: Mean +- std dev: 17.8 ms +- 0.2 ms ......................................... wide_state_9x1200_checkpoint: Mean +- std dev: 280 ms +- 14 ms ......................................... wide_state_9x1200_checkpoint_sync: Mean +- std dev: 275 ms +- 13 ms
Comparison against main: .github/workflows/_test_langgraph.yml#L1
+-----------------------------------------+----------+-----------------------+ | Benchmark | main | changes | +=========================================+==========+=======================+ | fanout_to_subgraph_100x_checkpoint | 951 ms | 770 ms: 1.24x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_100x | 731 ms | 620 ms: 1.18x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_100x_checkpoint | 725 ms | 639 ms: 1.13x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_100x_checkpoint_sync | 695 ms | 621 ms: 1.12x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_10x_checkpoint_sync | 39.6 ms | 36.7 ms: 1.08x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_100x_checkpoint_sync | 1.03 sec | 969 ms: 1.07x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_100x_sync | 290 ms | 273 ms: 1.06x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_100x | 364 ms | 343 ms: 1.06x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_10x_checkpoint | 40.5 ms | 38.3 ms: 1.06x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_10x | 65.0 ms | 61.8 ms: 1.05x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_25x300_checkpoint | 262 ms | 249 ms: 1.05x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_10x_checkpoint | 79.0 ms | 75.1 ms: 1.05x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_10x_checkpoint_sync | 101 ms | 96.1 ms: 1.05x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_25x300_checkpoint_sync | 257 ms | 246 ms: 1.05x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_9x1200_checkpoint | 292 ms | 280 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_10x_sync | 24.0 ms | 23.1 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_10x_sync | 55.8 ms | 53.7 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_9x1200_checkpoint_sync | 286 ms | 275 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_25x300_sync | 16.0 ms | 15.4 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_15x600_sync | 18.5 ms | 17.8 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_9x1200_sync | 18.4 ms | 17.8 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | fanout_to_subgraph_100x_sync | 553 ms | 533 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_15x600 | 28.3 ms | 27.3 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | react_agent_10x | 32.0 ms | 30.9 ms: 1.04x faster | +-----------------------------------------+----------+-----------------------+ | wide_state_9x1200 | 28.3 ms | 27.4 ms: 1.0