checkpoint: add DuckDB store #582
Annotations
1 warning and 2 notices
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/cache@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
libs/checkpoint-duckdb/langgraph/store/duckdb/__init__.py#L1
.........................................
fanout_to_subgraph_10x: Mean +- std dev: 48.0 ms +- 0.7 ms
.........................................
fanout_to_subgraph_10x_sync: Mean +- std dev: 45.9 ms +- 3.4 ms
.........................................
fanout_to_subgraph_10x_checkpoint: Mean +- std dev: 76.0 ms +- 1.6 ms
.........................................
fanout_to_subgraph_10x_checkpoint_sync: Mean +- std dev: 84.4 ms +- 1.0 ms
.........................................
fanout_to_subgraph_100x: Mean +- std dev: 475 ms +- 11 ms
.........................................
fanout_to_subgraph_100x_sync: Mean +- std dev: 433 ms +- 13 ms
.........................................
fanout_to_subgraph_100x_checkpoint: Mean +- std dev: 797 ms +- 39 ms
.........................................
fanout_to_subgraph_100x_checkpoint_sync: Mean +- std dev: 831 ms +- 17 ms
.........................................
react_agent_10x: Mean +- std dev: 29.0 ms +- 0.6 ms
.........................................
react_agent_10x_sync: Mean +- std dev: 22.4 ms +- 1.7 ms
.........................................
react_agent_10x_checkpoint: Mean +- std dev: 47.2 ms +- 3.0 ms
.........................................
react_agent_10x_checkpoint_sync: Mean +- std dev: 37.4 ms +- 3.1 ms
.........................................
react_agent_100x: Mean +- std dev: 328 ms +- 13 ms
.........................................
react_agent_100x_sync: Mean +- std dev: 261 ms +- 13 ms
.........................................
react_agent_100x_checkpoint: Mean +- std dev: 923 ms +- 16 ms
.........................................
react_agent_100x_checkpoint_sync: Mean +- std dev: 833 ms +- 14 ms
.........................................
wide_state_25x300: Mean +- std dev: 18.2 ms +- 0.4 ms
.........................................
wide_state_25x300_sync: Mean +- std dev: 10.9 ms +- 0.1 ms
.........................................
wide_state_25x300_checkpoint: Mean +- std dev: 273 ms +- 4 ms
.........................................
wide_state_25x300_checkpoint_sync: Mean +- std dev: 262 ms +- 3 ms
.........................................
wide_state_15x600: Mean +- std dev: 21.1 ms +- 0.4 ms
.........................................
wide_state_15x600_sync: Mean +- std dev: 12.6 ms +- 0.2 ms
.........................................
wide_state_15x600_checkpoint: Mean +- std dev: 475 ms +- 9 ms
.........................................
wide_state_15x600_checkpoint_sync: Mean +- std dev: 460 ms +- 5 ms
.........................................
wide_state_9x1200: Mean +- std dev: 21.1 ms +- 0.4 ms
.........................................
wide_state_9x1200_sync: Mean +- std dev: 12.5 ms +- 0.2 ms
.........................................
wide_state_9x1200_checkpoint: Mean +- std dev: 307 ms +- 5 ms
.........................................
wide_state_9x1200_checkpoint_sync: Mean +- std dev: 293 ms +- 2 ms
|
libs/checkpoint-duckdb/langgraph/store/duckdb/__init__.py#L1
+-----------------------------------+---------+-----------------------+
| Benchmark | main | changes |
+===================================+=========+=======================+
| wide_state_25x300 | 18.4 ms | 18.2 ms: 1.01x faster |
+-----------------------------------+---------+-----------------------+
| wide_state_15x600 | 21.3 ms | 21.1 ms: 1.01x faster |
+-----------------------------------+---------+-----------------------+
| wide_state_9x1200 | 21.3 ms | 21.1 ms: 1.01x faster |
+-----------------------------------+---------+-----------------------+
| fanout_to_subgraph_10x_checkpoint | 76.5 ms | 76.0 ms: 1.01x faster |
+-----------------------------------+---------+-----------------------+
| react_agent_100x_checkpoint | 928 ms | 923 ms: 1.00x faster |
+-----------------------------------+---------+-----------------------+
| wide_state_9x1200_checkpoint_sync | 293 ms | 293 ms: 1.00x slower |
+-----------------------------------+---------+-----------------------+
| wide_state_15x600_checkpoint | 472 ms | 475 ms: 1.01x slower |
+-----------------------------------+---------+-----------------------+
| react_agent_100x_checkpoint_sync | 827 ms | 833 ms: 1.01x slower |
+-----------------------------------+---------+-----------------------+
| Geometric mean | (ref) | 1.00x faster |
+-----------------------------------+---------+-----------------------+
Benchmark hidden because not significant (20): react_agent_10x_checkpoint_sync, react_agent_10x_checkpoint, fanout_to_subgraph_100x_sync, fanout_to_subgraph_100x_checkpoint_sync, fanout_to_subgraph_10x_sync, wide_state_15x600_checkpoint_sync, wide_state_25x300_checkpoint_sync, wide_state_9x1200_sync, fanout_to_subgraph_10x, wide_state_25x300_checkpoint, fanout_to_subgraph_100x, wide_state_9x1200_checkpoint, react_agent_10x, fanout_to_subgraph_10x_checkpoint_sync, wide_state_15x600_sync, wide_state_25x300_sync, fanout_to_subgraph_100x_checkpoint, react_agent_100x_sync, react_agent_100x, react_agent_10x_sync
|
The logs for this run have expired and are no longer available.
Loading