Prefix-String vs Standard Dictionary

[ellmau]

Compared Prefix-String stage2-prfstring vs Standard Dictionary stage2-stddict
on 82299b2 ~ evaluating the changes of #135

	LUBM 1pct L	LUBM 1pct U	LUBM 1pct LE	LUBM 5pct L	LUBM 5pct U	LUBM 5pct LE
standard	6.295	7.494	35.611	36.375	41.064	200.308
prefixed	8.209	9.817	37.530	46.133	51.751	210.428
factor	1.30	1.31	1.05	1.27	1.26	1.05

time is in seconds, hyperfine did 3 runs per experiment

Hyperfine output

Benchmark 1: ./stage2-stddict ./run-LUBM-01K-1pct-LE.rls -s -g --overwrite-results
  Time (mean ± σ):     35.611 s ±  0.305 s    [User: 34.808 s, System: 0.796 s]
  Range (min … max):   35.284 s … 35.889 s    3 runs

Benchmark 2: ./stage2-prfstring ./run-LUBM-01K-1pct-LE.rls -s -g --overwrite-results
  Time (mean ± σ):     37.530 s ±  1.049 s    [User: 36.637 s, System: 0.884 s]
  Range (min … max):   36.514 s … 38.609 s    3 runs

Summary
  './stage2-stddict ./run-LUBM-01K-1pct-LE.rls -s -g --overwrite-results' ran
    1.05 ± 0.03 times faster than './stage2-prfstring ./run-LUBM-01K-1pct-LE.rls -s -g --overwrite-results'
Benchmark 1: ./stage2-stddict ./run-LUBM-01K-1pct-L.rls -s -g --overwrite-results
  Time (mean ± σ):      6.295 s ±  0.041 s    [User: 6.184 s, System: 0.110 s]
  Range (min … max):    6.265 s …  6.342 s    3 runs

Benchmark 2: ./stage2-prfstring ./run-LUBM-01K-1pct-L.rls -s -g --overwrite-results
  Time (mean ± σ):      8.209 s ±  0.026 s    [User: 8.002 s, System: 0.207 s]
  Range (min … max):    8.182 s …  8.233 s    3 runs

Summary
  './stage2-stddict ./run-LUBM-01K-1pct-L.rls -s -g --overwrite-results' ran
    1.30 ± 0.01 times faster than './stage2-prfstring ./run-LUBM-01K-1pct-L.rls -s -g --overwrite-results'
Benchmark 1: ./stage2-stddict ./run-LUBM-01K-1pct-U.rls -s -g --overwrite-results
  Time (mean ± σ):      7.494 s ±  0.160 s    [User: 7.344 s, System: 0.148 s]
  Range (min … max):    7.310 s …  7.588 s    3 runs

  Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet PC without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options.

Benchmark 2: ./stage2-prfstring ./run-LUBM-01K-1pct-U.rls -s -g --overwrite-results
  Time (mean ± σ):      9.817 s ±  0.550 s    [User: 9.579 s, System: 0.237 s]
  Range (min … max):    9.358 s … 10.427 s    3 runs

Summary
  './stage2-stddict ./run-LUBM-01K-1pct-U.rls -s -g --overwrite-results' ran
    1.31 ± 0.08 times faster than './stage2-prfstring ./run-LUBM-01K-1pct-U.rls -s -g --overwrite-results'
Benchmark 1: ./stage2-stddict ./run-LUBM-01K-5pct-LE.rls -s -g --overwrite-results
  Time (mean ± σ):     200.308 s ± 13.271 s    [User: 195.781 s, System: 4.474 s]
  Range (min … max):   185.367 s … 210.728 s    3 runs

Benchmark 2: ./stage2-prfstring ./run-LUBM-01K-5pct-LE.rls -s -g --overwrite-results
  Time (mean ± σ):     210.428 s ± 14.126 s    [User: 205.467 s, System: 4.877 s]
  Range (min … max):   200.249 s … 226.556 s    3 runs

Summary
  './stage2-stddict ./run-LUBM-01K-5pct-LE.rls -s -g --overwrite-results' ran
    1.05 ± 0.10 times faster than './stage2-prfstring ./run-LUBM-01K-5pct-LE.rls -s -g --overwrite-results'
Benchmark 1: ./stage2-stddict ./run-LUBM-01K-5pct-L.rls -s -g --overwrite-results
  Time (mean ± σ):     36.375 s ±  3.942 s    [User: 35.744 s, System: 0.617 s]
  Range (min … max):   33.267 s … 40.810 s    3 runs

Benchmark 2: ./stage2-prfstring ./run-LUBM-01K-5pct-L.rls -s -g --overwrite-results
  Time (mean ± σ):     46.133 s ±  0.737 s    [User: 44.889 s, System: 1.235 s]
  Range (min … max):   45.651 s … 46.982 s    3 runs

Summary
  './stage2-stddict ./run-LUBM-01K-5pct-L.rls -s -g --overwrite-results' ran
    1.27 ± 0.14 times faster than './stage2-prfstring ./run-LUBM-01K-5pct-L.rls -s -g --overwrite-results'
Benchmark 1: ./stage2-stddict ./run-LUBM-01K-5pct-U.rls -s -g --overwrite-results
  Time (mean ± σ):     41.064 s ±  2.002 s    [User: 40.266 s, System: 0.797 s]
  Range (min … max):   38.809 s … 42.633 s    3 runs

Benchmark 2: ./stage2-prfstring ./run-LUBM-01K-5pct-U.rls -s -g --overwrite-results
  Time (mean ± σ):     51.751 s ±  0.671 s    [User: 50.477 s, System: 1.268 s]
  Range (min … max):   51.068 s … 52.408 s    3 runs

Summary
  './stage2-stddict ./run-LUBM-01K-5pct-U.rls -s -g --overwrite-results' ran
    1.26 ± 0.06 times faster than './stage2-prfstring ./run-LUBM-01K-5pct-U.rls -s -g --overwrite-results'

System Info

System:    Kernel: 6.1.7 x86_64 bits: 64 compiler: gcc v: 11.3.0
           parameters: initrd=\efi\nixos\l6x2p7wshsp9k7plz8anaan5ih5jwa1a-initrd-linux-6.1.7-initrd.efi
           init=/nix/store/d0krjy1w8yf6y21mz5agblgh4kvkas9v-nixos-system-stel-xps-22.11.20230122.ab12540/init
           mem_sleep_default=deep splash loglevel=4
           Desktop: sway 1.7 vt: 1 dm: N/A Distro: NixOS 22.11 (Raccoon)
Machine:   Type: Laptop System: Dell product: XPS 13 7390 v: N/A serial: <filter> Chassis: type: 10 serial: <filter>
           Mobo: Dell model: 0F3VKC v: A00 serial: <filter> UEFI: Dell v: 1.6.0 date: 07/07/2020
Battery:   ID-1: BAT0 charge: 52.0 Wh (100.0%) condition: 52.0/52.0 Wh (100.0%) volts: 8.4 min: 7.6
           model: LGC-LGC6.73 DELL H754V0B type: Li-ion serial: <filter> status: Full
CPU:       Info: Quad Core model: Intel Core i7-10510U bits: 64 type: MT MCP arch: Kaby Lake note: check family: 6
           model-id: 8E (142) stepping: C (12) microcode: F4 cache: L2: 8 MiB
           flags: avx avx2 lm nx pae sse sse2 sse3 sse4_1 sse4_2 ssse3 vmx bogomips: 36799
           Speed: 4300 MHz min/max: 400/4900 MHz Core speeds (MHz): 1: 4300 2: 4300 3: 4300 4: 2300 5: 4302 6: 4301 7: 4303
           8: 2300
Drives:    Local Storage: total: 953.87 GiB used: 142.73 GiB (15.0%)
           SMART Message: Required tool smartctl not installed. Check --recommends
           ID-1: /dev/nvme0n1 maj-min: 259:0 vendor: Samsung model: PM981a NVMe 1024GB size: 953.87 GiB block-size:
           physical: 512 B logical: 512 B speed: 31.6 Gb/s lanes: 4 rotation: SSD serial: <filter> rev: 15304129 scheme: GPT
Partition: ID-1: / raw-size: 936.35 GiB size: 920.58 GiB (98.32%) used: 141.59 GiB (15.4%) fs: ext4 dev: /dev/dm-0
           maj-min: 254:0 mapped: crypted
           ID-2: /boot raw-size: 511 MiB size: 510 MiB (99.80%) used: 144.7 MiB (28.4%) fs: vfat dev: /dev/nvme0n1p2
           maj-min: 259:2
Swap:      Kernel: swappiness: 60 (default) cache-pressure: 100 (default)
           ID-1: swap-1 type: partition size: 17 GiB used: 1021.2 MiB (5.9%) priority: -2 dev: /dev/nvme0n1p3 maj-min: 259:3
Info:      Processes: 260 Uptime: 7h 15m wakeups: 1189 Memory: 15.33 GiB used: 7.95 GiB (51.9%) Init: systemd v: 251
           target: graphical.target tool: systemctl Compilers: gcc: N/A clang: 11.1.0 Packages: 5962 nix-default: 2
           nix-sys: 5958 lib: 532 nix-usr: 2 Shell: Zsh v: 5.9 running-in: alacritty inxi: 3.3.04