ci: Test2 #101

alankritdabral · 2024-04-08T16:24:46Z

Summary:
Briefly describe the changes made in this PR.

Issue Reference(s):
Fixes #... (Replace "..." with the issue number)

Build & Testing:

I ran cargo test successfully.
I have run ./lint.sh --mode=fix to fix all linting issues raised by ./lint.sh --mode=check.

Checklist:

I have added relevant unit & integration tests.
I have updated the documentation accordingly.
I have performed a self-review of my code.
PR follows the naming convention of <type>(<optional scope>): <title>

ci: update benchmarks

Revert "chore: update benchmarks"

Update benchmark.yml

github-actions · 2024-04-08T16:25:36Z

Bencher

Report	Mon, April 8, 2024 at 16:38:36 UTC
Project	tailcall
Branch	test2
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	✅ (view plot)	677.550 (+9.04%)	730.886 (92.70%)
input/args.missing	✅ (view plot)	28.537 (+7.91%)	30.523 (93.49%)
input/args.nested.existing	✅ (view plot)	49.570 (-7.50%)	61.426 (80.70%)
input/args.nested.missing	✅ (view plot)	35.203 (-5.60%)	41.363 (85.11%)
input/args.root	✅ (view plot)	41.373 (-15.42%)	63.612 (65.04%)
input/headers.existing	✅ (view plot)	36.109 (+9.13%)	38.977 (92.64%)
input/headers.missing	✅ (view plot)	34.967 (+9.79%)	37.926 (92.20%)
input/value.missing	✅ (view plot)	27.885 (+11.27%)	30.566 (91.23%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.45%)	42.269 (98.69%)
input/value.nested.missing	✅ (view plot)	33.873 (-5.01%)	39.138 (86.55%)
input/value.root	✅ (view plot)	36.188 (-3.43%)	39.977 (90.52%)
input/vars.existing	✅ (view plot)	11.291 (+20.84%)	13.139 (85.93%)
input/vars.missing	✅ (view plot)	10.649 (+21.76%)	12.455 (85.50%)
test_batched_body	✅ (view plot)	2332700.000 (+20.95%)	2716218.207 (85.88%)
test_data_loader	✅ (view plot)	641010.000 (+20.68%)	745264.182 (86.01%)
with_mustache_expressions	✅ (view plot)	1288.000 (+4.55%)	1341.215 (96.03%)
with_mustache_literal	✅ (view plot)	801.770 (+6.13%)	845.722 (94.80%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T16:44:08Z

Bencher

Report	Mon, April 8, 2024 at 16:47:29 UTC
Project	tailcall
Branch	test2_56966491c5fc1ffb2d101e469a76178e0c00f43f
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	✅ (view plot)	677.550 (+4.33%)	842.116 (80.46%)
input/args.missing	✅ (view plot)	28.537 (+3.80%)	34.664 (82.33%)
input/args.nested.existing	✅ (view plot)	49.570 (-3.90%)	65.363 (75.84%)
input/args.nested.missing	✅ (view plot)	35.203 (-2.88%)	43.408 (81.10%)
input/args.root	✅ (view plot)	41.373 (-8.35%)	70.997 (58.27%)
input/headers.existing	✅ (view plot)	36.109 (+4.37%)	44.957 (80.32%)
input/headers.missing	✅ (view plot)	34.967 (+4.67%)	44.098 (79.29%)
input/value.missing	✅ (view plot)	27.885 (+5.34%)	36.157 (77.12%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.22%)	42.454 (98.26%)
input/value.nested.missing	✅ (view plot)	33.873 (-2.57%)	40.887 (82.85%)
input/value.root	✅ (view plot)	36.188 (-1.74%)	41.235 (87.76%)
input/vars.existing	✅ (view plot)	11.291 (+9.44%)	16.994 (66.44%)
input/vars.missing	✅ (view plot)	10.649 (+9.81%)	16.222 (65.64%)
test_batched_body	✅ (view plot)	2332700.000 (+9.48%)	3516038.095 (66.34%)
test_data_loader	✅ (view plot)	641010.000 (+9.37%)	962684.286 (66.59%)
with_mustache_expressions	✅ (view plot)	1288.000 (+2.22%)	1452.195 (88.69%)
with_mustache_literal	✅ (view plot)	801.770 (+2.97%)	937.382 (85.53%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T17:09:11Z

Bencher

Report	Mon, April 8, 2024 at 17:09:10 UTC
Project	tailcall
Branch	test2_${github.event.pull_request.base.sha}
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	✅ (view plot)	677.550 (+6.63%)	1305.281 (51.91%)
input/args.missing	✅ (view plot)	28.537 (+5.82%)	51.907 (54.98%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	100.507 (49.32%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	61.668 (57.08%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	136.920 (30.22%)
input/headers.existing	✅ (view plot)	36.109 (+6.70%)	69.860 (51.69%)
input/headers.missing	✅ (view plot)	34.967 (+7.17%)	69.798 (50.10%)
input/value.missing	✅ (view plot)	27.885 (+8.22%)	59.439 (46.91%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	44.097 (94.60%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	56.495 (59.96%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	52.466 (68.97%)
input/vars.existing	✅ (view plot)	11.291 (+14.86%)	33.046 (34.17%)
input/vars.missing	✅ (view plot)	10.649 (+15.48%)	31.909 (33.37%)
test_batched_body	✅ (view plot)	2332700.000 (+14.93%)	6846491.815 (34.07%)
test_data_loader	✅ (view plot)	641010.000 (+14.75%)	1868022.604 (34.31%)
with_mustache_expressions	✅ (view plot)	1288.000 (+3.37%)	1914.316 (67.28%)
with_mustache_literal	✅ (view plot)	801.770 (+4.53%)	1319.058 (60.78%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T17:13:33Z

Bencher

Report	Mon, April 8, 2024 at 17:13:32 UTC
Project	tailcall
Branch	test2_add1be87e202196b69b088b7f0df931c6858bb33
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	✅ (view plot)	677.550 (+6.63%)	1305.281 (51.91%)
input/args.missing	✅ (view plot)	28.537 (+5.82%)	51.907 (54.98%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	100.507 (49.32%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	61.668 (57.08%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	136.920 (30.22%)
input/headers.existing	✅ (view plot)	36.109 (+6.70%)	69.860 (51.69%)
input/headers.missing	✅ (view plot)	34.967 (+7.17%)	69.798 (50.10%)
input/value.missing	✅ (view plot)	27.885 (+8.22%)	59.439 (46.91%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	44.097 (94.60%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	56.495 (59.96%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	52.466 (68.97%)
input/vars.existing	✅ (view plot)	11.291 (+14.86%)	33.046 (34.17%)
input/vars.missing	✅ (view plot)	10.649 (+15.48%)	31.909 (33.37%)
test_batched_body	✅ (view plot)	2332700.000 (+14.93%)	6846491.815 (34.07%)
test_data_loader	✅ (view plot)	641010.000 (+14.75%)	1868022.604 (34.31%)
with_mustache_expressions	✅ (view plot)	1288.000 (+3.37%)	1914.316 (67.28%)
with_mustache_literal	✅ (view plot)	801.770 (+4.53%)	1319.058 (60.78%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T17:48:23Z

Bencher

Report	Mon, April 8, 2024 at 17:48:22 UTC
Project	tailcall
Branch	test2_5270fc5ec77fee9654a9a965698c9cf5ebee745a
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	🚨 (view plot \| view alert)	677.550 (+6.63%)	666.025 (101.73%)
input/args.missing	🚨 (view plot \| view alert)	28.537 (+5.82%)	28.108 (101.53%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	54.776 (90.50%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	37.908 (92.87%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	51.137 (80.91%)
input/headers.existing	🚨 (view plot \| view alert)	36.109 (+6.70%)	35.489 (101.75%)
input/headers.missing	🚨 (view plot \| view alert)	34.967 (+7.17%)	34.328 (101.86%)
input/value.missing	🚨 (view plot \| view alert)	27.885 (+8.22%)	27.306 (102.12%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	41.958 (99.42%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	36.185 (93.61%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	37.852 (95.61%)
input/vars.existing	🚨 (view plot \| view alert)	11.291 (+14.86%)	10.892 (103.67%)
input/vars.missing	🚨 (view plot \| view alert)	10.649 (+15.48%)	10.259 (103.80%)
test_batched_body	🚨 (view plot \| view alert)	2332700.000 (+14.93%)	2249828.713 (103.68%)
test_data_loader	🚨 (view plot \| view alert)	641010.000 (+14.75%)	618482.573 (103.64%)
with_mustache_expressions	🚨 (view plot \| view alert)	1288.000 (+3.37%)	1276.501 (100.90%)
with_mustache_literal	🚨 (view plot \| view alert)	801.770 (+4.53%)	792.273 (101.20%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T17:49:21Z

Bencher

Report	Mon, April 8, 2024 at 17:49:20 UTC
Project	tailcall
Branch	test2_81e379d0f90a5ae36d0971307b084f84d1d67534
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	✅ (view plot)	677.550 (+6.63%)	693.413 (97.71%)
input/args.missing	✅ (view plot)	28.537 (+5.82%)	29.128 (97.97%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	56.735 (87.37%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	38.926 (90.44%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	54.813 (75.48%)
input/headers.existing	✅ (view plot)	36.109 (+6.70%)	36.962 (97.69%)
input/headers.missing	✅ (view plot)	34.967 (+7.17%)	35.847 (97.54%)
input/value.missing	✅ (view plot)	27.885 (+8.22%)	28.682 (97.22%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	42.050 (99.20%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	37.055 (91.41%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	38.478 (94.05%)
input/vars.existing	✅ (view plot)	11.291 (+14.86%)	11.841 (95.36%)
input/vars.missing	✅ (view plot)	10.649 (+15.48%)	11.186 (95.20%)
test_batched_body	✅ (view plot)	2332700.000 (+14.93%)	2446762.541 (95.34%)
test_data_loader	✅ (view plot)	641010.000 (+14.75%)	672016.343 (95.39%)
with_mustache_expressions	✅ (view plot)	1288.000 (+3.37%)	1303.827 (98.79%)
with_mustache_literal	✅ (view plot)	801.770 (+4.53%)	814.842 (98.40%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T17:50:18Z

Bencher

Report	Mon, April 8, 2024 at 17:50:16 UTC
Project	tailcall
Branch	test2_e1cdfb24faf4a21bcd1364d3ef8b64a902ea07f7
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	✅ (view plot)	677.550 (+6.63%)	677.550 (100.00%)
input/args.missing	✅ (view plot)	28.537 (+5.82%)	28.537 (100.00%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	55.600 (89.15%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	38.336 (91.83%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	52.684 (78.53%)
input/headers.existing	✅ (view plot)	36.109 (+6.70%)	36.109 (100.00%)
input/headers.missing	✅ (view plot)	34.967 (+7.17%)	34.967 (100.00%)
input/value.missing	✅ (view plot)	27.885 (+8.22%)	27.885 (100.00%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	41.997 (99.33%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	36.551 (92.67%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	38.115 (94.94%)
input/vars.existing	✅ (view plot)	11.291 (+14.86%)	11.291 (100.00%)
input/vars.missing	✅ (view plot)	10.649 (+15.48%)	10.649 (100.00%)
test_batched_body	✅ (view plot)	2332700.000 (+14.93%)	2332700.000 (100.00%)
test_data_loader	✅ (view plot)	641010.000 (+14.75%)	641010.000 (100.00%)
with_mustache_expressions	✅ (view plot)	1288.000 (+3.37%)	1288.000 (100.00%)
with_mustache_literal	✅ (view plot)	801.770 (+4.53%)	801.770 (100.00%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T17:51:17Z

Bencher

Report	Mon, April 8, 2024 at 17:51:15 UTC
Project	tailcall
Branch	test2_3bd5db1c168d474cf2e735307e7d65f36c8e035b
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	🚨 (view plot \| view alert)	677.550 (+6.63%)	671.400 (100.92%)
input/args.missing	🚨 (view plot \| view alert)	28.537 (+5.82%)	28.308 (100.81%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	55.160 (89.87%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	38.107 (92.38%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	51.859 (79.78%)
input/headers.existing	🚨 (view plot \| view alert)	36.109 (+6.70%)	35.778 (100.92%)
input/headers.missing	🚨 (view plot \| view alert)	34.967 (+7.17%)	34.626 (100.99%)
input/value.missing	🚨 (view plot \| view alert)	27.885 (+8.22%)	27.576 (101.12%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	41.976 (99.38%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	36.356 (93.17%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	37.974 (95.30%)
input/vars.existing	🚨 (view plot \| view alert)	11.291 (+14.86%)	11.078 (101.92%)
input/vars.missing	🚨 (view plot \| view alert)	10.649 (+15.48%)	10.441 (101.99%)
test_batched_body	🚨 (view plot \| view alert)	2332700.000 (+14.93%)	2288479.152 (101.93%)
test_data_loader	🚨 (view plot \| view alert)	641010.000 (+14.75%)	628989.167 (101.91%)
with_mustache_expressions	🚨 (view plot \| view alert)	1288.000 (+3.37%)	1281.864 (100.48%)
with_mustache_literal	🚨 (view plot \| view alert)	801.770 (+4.53%)	796.702 (100.64%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T17:55:11Z

Bencher

Report	Mon, April 8, 2024 at 17:55:10 UTC
Project	tailcall
Branch	test2_9ff766def67c896ee14ca02108881a40ac9a40ff
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	🚨 (view plot \| view alert)	677.550 (+6.63%)	672.561 (100.74%)
input/args.missing	🚨 (view plot \| view alert)	28.537 (+5.82%)	28.351 (100.66%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	55.243 (89.73%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	38.151 (92.27%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	52.014 (79.54%)
input/headers.existing	🚨 (view plot \| view alert)	36.109 (+6.70%)	35.841 (100.75%)
input/headers.missing	🚨 (view plot \| view alert)	34.967 (+7.17%)	34.690 (100.80%)
input/value.missing	🚨 (view plot \| view alert)	27.885 (+8.22%)	27.634 (100.91%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	41.980 (99.37%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	36.392 (93.08%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	38.001 (95.23%)
input/vars.existing	🚨 (view plot \| view alert)	11.291 (+14.86%)	11.118 (101.56%)
input/vars.missing	🚨 (view plot \| view alert)	10.649 (+15.48%)	10.480 (101.61%)
test_batched_body	🚨 (view plot \| view alert)	2332700.000 (+14.93%)	2296824.514 (101.56%)
test_data_loader	🚨 (view plot \| view alert)	641010.000 (+14.75%)	631257.740 (101.54%)
with_mustache_expressions	🚨 (view plot \| view alert)	1288.000 (+3.37%)	1283.022 (100.39%)
with_mustache_literal	🚨 (view plot \| view alert)	801.770 (+4.53%)	797.659 (100.52%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T17:59:07Z

Bencher

Report	Mon, April 8, 2024 at 17:59:06 UTC
Project	tailcall
Branch	test2_7b2f02e2f66e4e7d44c229c7c181d7b4d5e36c94
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	🚨 (view plot \| view alert)	677.550 (+6.63%)	674.982 (100.38%)
input/args.missing	🚨 (view plot \| view alert)	28.537 (+5.82%)	28.441 (100.34%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	55.416 (89.45%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	38.241 (92.06%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	52.339 (79.05%)
input/headers.existing	🚨 (view plot \| view alert)	36.109 (+6.70%)	35.971 (100.38%)
input/headers.missing	🚨 (view plot \| view alert)	34.967 (+7.17%)	34.824 (100.41%)
input/value.missing	🚨 (view plot \| view alert)	27.885 (+8.22%)	27.756 (100.47%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	41.988 (99.35%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	36.469 (92.88%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	38.056 (95.09%)
input/vars.existing	🚨 (view plot \| view alert)	11.291 (+14.86%)	11.202 (100.79%)
input/vars.missing	🚨 (view plot \| view alert)	10.649 (+15.48%)	10.562 (100.82%)
test_batched_body	🚨 (view plot \| view alert)	2332700.000 (+14.93%)	2314232.892 (100.80%)
test_data_loader	🚨 (view plot \| view alert)	641010.000 (+14.75%)	635989.969 (100.79%)
with_mustache_expressions	🚨 (view plot \| view alert)	1288.000 (+3.37%)	1285.438 (100.20%)
with_mustache_literal	🚨 (view plot \| view alert)	801.770 (+4.53%)	799.654 (100.26%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T18:00:10Z

Bencher

Report	Mon, April 8, 2024 at 18:00:08 UTC
Project	tailcall
Branch	test2_80407d0163f3791d3bf4e195401e7dffc4f93e15
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	✅ (view plot)	677.550 (+6.63%)	677.550 (100.00%)
input/args.missing	✅ (view plot)	28.537 (+5.82%)	28.537 (100.00%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	55.600 (89.15%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	38.336 (91.83%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	52.684 (78.53%)
input/headers.existing	✅ (view plot)	36.109 (+6.70%)	36.109 (100.00%)
input/headers.missing	✅ (view plot)	34.967 (+7.17%)	34.967 (100.00%)
input/value.missing	✅ (view plot)	27.885 (+8.22%)	27.885 (100.00%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	41.997 (99.33%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	36.551 (92.67%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	38.115 (94.94%)
input/vars.existing	✅ (view plot)	11.291 (+14.86%)	11.291 (100.00%)
input/vars.missing	✅ (view plot)	10.649 (+15.48%)	10.649 (100.00%)
test_batched_body	✅ (view plot)	2332700.000 (+14.93%)	2332700.000 (100.00%)
test_data_loader	✅ (view plot)	641010.000 (+14.75%)	641010.000 (100.00%)
with_mustache_expressions	✅ (view plot)	1288.000 (+3.37%)	1288.000 (100.00%)
with_mustache_literal	✅ (view plot)	801.770 (+4.53%)	801.770 (100.00%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T18:02:39Z

Bencher

Report	Mon, April 8, 2024 at 18:02:38 UTC
Project	tailcall
Branch	test2_404c31340afb13ed8c5ee08aded8ada3fc0a1639
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	✅ (view plot)	677.550 (+6.63%)	1305.281 (51.91%)
input/args.missing	✅ (view plot)	28.537 (+5.82%)	51.907 (54.98%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	100.507 (49.32%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	61.668 (57.08%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	136.920 (30.22%)
input/headers.existing	✅ (view plot)	36.109 (+6.70%)	69.860 (51.69%)
input/headers.missing	✅ (view plot)	34.967 (+7.17%)	69.798 (50.10%)
input/value.missing	✅ (view plot)	27.885 (+8.22%)	59.439 (46.91%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	44.097 (94.60%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	56.495 (59.96%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	52.466 (68.97%)
input/vars.existing	✅ (view plot)	11.291 (+14.86%)	33.046 (34.17%)
input/vars.missing	✅ (view plot)	10.649 (+15.48%)	31.909 (33.37%)
test_batched_body	✅ (view plot)	2332700.000 (+14.93%)	6846491.815 (34.07%)
test_data_loader	✅ (view plot)	641010.000 (+14.75%)	1868022.604 (34.31%)
with_mustache_expressions	✅ (view plot)	1288.000 (+3.37%)	1914.316 (67.28%)
with_mustache_literal	✅ (view plot)	801.770 (+4.53%)	1319.058 (60.78%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T18:10:14Z

Bencher

Report	Mon, April 8, 2024 at 18:10:13 UTC
Project	tailcall
Branch	test2_8dde85c92f24043e23159cebdd1a572fc0d08435
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	✅ (view plot)	677.550 (+6.63%)	698.945 (96.94%)
input/args.missing	✅ (view plot)	28.537 (+5.82%)	29.665 (96.20%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	57.843 (85.70%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	40.446 (87.04%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	51.731 (79.98%)
input/headers.existing	✅ (view plot)	36.109 (+6.70%)	37.227 (97.00%)
input/headers.missing	✅ (view plot)	34.967 (+7.17%)	35.891 (97.42%)
input/value.missing	✅ (view plot)	27.885 (+8.22%)	28.343 (98.38%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	46.042 (90.60%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	38.733 (87.45%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	40.867 (88.55%)
input/vars.existing	🚨 (view plot \| view alert)	11.291 (+14.86%)	10.813 (104.42%)
input/vars.missing	🚨 (view plot \| view alert)	10.649 (+15.48%)	10.144 (104.98%)
test_batched_body	🚨 (view plot \| view alert)	2332700.000 (+14.93%)	2232615.000 (104.48%)
test_data_loader	🚨 (view plot \| view alert)	641010.000 (+14.75%)	614493.000 (104.32%)
with_mustache_expressions	✅ (view plot)	1288.000 (+3.37%)	1370.545 (93.98%)
with_mustache_literal	✅ (view plot)	801.770 (+4.53%)	843.744 (95.03%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T18:23:45Z

Bencher

Report	Mon, April 8, 2024 at 18:23:43 UTC
Project	tailcall
Branch	test2_commit_0038d9b44ea067b80eef91ab9f1a4554b6eb9a9e
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	✅ (view plot)	677.550 (+6.63%)	698.945 (96.94%)
input/args.missing	✅ (view plot)	28.537 (+5.82%)	29.665 (96.20%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	57.843 (85.70%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	40.446 (87.04%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	51.731 (79.98%)
input/headers.existing	✅ (view plot)	36.109 (+6.70%)	37.227 (97.00%)
input/headers.missing	✅ (view plot)	34.967 (+7.17%)	35.891 (97.42%)
input/value.missing	✅ (view plot)	27.885 (+8.22%)	28.343 (98.38%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	46.042 (90.60%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	38.733 (87.45%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	40.867 (88.55%)
input/vars.existing	🚨 (view plot \| view alert)	11.291 (+14.86%)	10.813 (104.42%)
input/vars.missing	🚨 (view plot \| view alert)	10.649 (+15.48%)	10.144 (104.98%)
test_batched_body	🚨 (view plot \| view alert)	2332700.000 (+14.93%)	2232615.000 (104.48%)
test_data_loader	🚨 (view plot \| view alert)	641010.000 (+14.75%)	614493.000 (104.32%)
with_mustache_expressions	✅ (view plot)	1288.000 (+3.37%)	1370.545 (93.98%)
with_mustache_literal	✅ (view plot)	801.770 (+4.53%)	843.744 (95.03%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

github-actions · 2024-04-08T18:32:12Z

Bencher

Report	Mon, April 8, 2024 at 18:32:10 UTC
Project	tailcall
Branch	test2_commit_cfe3fa076544c735020cdcdc52dd33846a63d2cd
Testbed	benchmarking-runner

Benchmark	Latency	Latency Results nanoseconds (ns) \| (Δ%)	Latency Upper Boundary nanoseconds (ns) \| (%)
group_by	✅ (view plot)	677.550 (+6.63%)	698.945 (96.94%)
input/args.missing	✅ (view plot)	28.537 (+5.82%)	29.665 (96.20%)
input/args.nested.existing	✅ (view plot)	49.570 (-5.73%)	57.843 (85.70%)
input/args.nested.missing	✅ (view plot)	35.203 (-4.26%)	40.446 (87.04%)
input/args.root	✅ (view plot)	41.373 (-12.03%)	51.731 (79.98%)
input/headers.existing	✅ (view plot)	36.109 (+6.70%)	37.227 (97.00%)
input/headers.missing	✅ (view plot)	34.967 (+7.17%)	35.891 (97.42%)
input/value.missing	✅ (view plot)	27.885 (+8.22%)	28.343 (98.38%)
input/value.nested.existing	✅ (view plot)	41.715 (-0.34%)	46.042 (90.60%)
input/value.nested.missing	✅ (view plot)	33.873 (-3.80%)	38.733 (87.45%)
input/value.root	✅ (view plot)	36.188 (-2.59%)	40.867 (88.55%)
input/vars.existing	🚨 (view plot \| view alert)	11.291 (+14.86%)	10.813 (104.42%)
input/vars.missing	🚨 (view plot \| view alert)	10.649 (+15.48%)	10.144 (104.98%)
test_batched_body	🚨 (view plot \| view alert)	2332700.000 (+14.93%)	2232615.000 (104.48%)
test_data_loader	🚨 (view plot \| view alert)	641010.000 (+14.75%)	614493.000 (104.32%)
with_mustache_expressions	✅ (view plot)	1288.000 (+3.37%)	1370.545 (93.98%)
with_mustache_literal	✅ (view plot)	801.770 (+4.53%)	843.744 (95.03%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

alankritdabral added 11 commits April 8, 2024 17:55

Update benchmark.yml

93000a4

Update benchmark.yml

4a4fc17

Update benchmark.yml

64fba6f

Merge pull request #96 from alankritdabral/bencher

2a45801

ci: update benchmarks

Revert "chore: update benchmarks"

bfb8304

Merge pull request #98 from alankritdabral/revert-96-bencher

427fb18

Revert "chore: update benchmarks"

Update benchmark.yml

dd4f753

Merge branch 'main' into bencher

2bb1035

Merge pull request #99 from alankritdabral/bencher

5696649

Update benchmark.yml

Update benchmark.yml

cbe2f2e

Create change.txt

703ef33

alankritdabral added the ci: benchmark Runs benchmarks label Apr 8, 2024

alankritdabral added 3 commits April 8, 2024 22:05

Update benchmark.yml

a91599b

Update benchmark.yml

858b327

Update benchmark.yml

ab9a6ba

alankritdabral added 7 commits April 8, 2024 22:17

Update benchmark.yml

2291fc5

Update benchmark.yml

6ca1cc1

Update benchmark.yml

af9c78c

Update benchmark.yml

fb5e65e

Update benchmark.yml

31d19ba

Update benchmark.yml

848b9af

Update benchmark.yml

9be9cb9

alankritdabral added 3 commits April 8, 2024 22:40

Update benchmark.yml

d57e438

Update benchmark.yml

e5ab1b3

Update benchmark.yml

add1be8

Update benchmark.yml

060ebfb

Update benchmark.yml

5270fc5

Update benchmark.yml

81e379d

Update benchmark.yml

e1cdfb2

Update benchmark.yml

3bd5db1

Update benchmark.yml

9ff766d

Update benchmark.yml

7b2f02e

Update benchmark.yml

80407d0

Update benchmark.yml

404c313

alankritdabral added 2 commits April 8, 2024 23:38

Update benchmark.yml

706ee14

Update benchmark.yml

8dde85c

alankritdabral added 2 commits April 8, 2024 23:51

Update benchmark.yml

88ad037

Update benchmark.yml

0038d9b

alankritdabral added 4 commits April 8, 2024 23:54

Update benchmark.yml

4d8aa5a

Update benchmark.yml

c527afe

Update benchmark.yml

7ec5401

Update benchmark.yml

cfe3fa0

alankritdabral force-pushed the main branch from 5696649 to 3994fcf Compare April 8, 2024 18:32

alankritdabral closed this Apr 8, 2024

alankritdabral deleted the test2 branch April 8, 2024 18:32

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ci: Test2 #101

ci: Test2 #101

alankritdabral commented Apr 8, 2024

github-actions bot commented Apr 8, 2024 •

edited

Loading

github-actions bot commented Apr 8, 2024 •

edited

Loading

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

github-actions bot commented Apr 8, 2024

ci: Test2 #101

ci: Test2 #101

Conversation

alankritdabral commented Apr 8, 2024

github-actions bot commented Apr 8, 2024 • edited Loading

Bencher

github-actions bot commented Apr 8, 2024 • edited Loading

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024

Bencher

github-actions bot commented Apr 8, 2024 •

edited

Loading

github-actions bot commented Apr 8, 2024 •

edited

Loading