Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

benchmarks should define code not data #329

Closed
vtjnash opened this issue Feb 5, 2025 · 1 comment
Closed

benchmarks should define code not data #329

vtjnash opened this issue Feb 5, 2025 · 1 comment

Comments

@vtjnash
Copy link
Member

vtjnash commented Feb 5, 2025

Some benchmarks allocate a lot of data instead of code. This is fixable (PR coming).

julia> varinfo(BaseBenchmarks, all=true, sortby=:size)                                                                                                                                                                     
  name                           size summary                                                                                                                                                                              
  ––––––––––––––––––––––– ––––––––––– ––––––––––––––––––––––––––––––––––––––––––––––––––––––                                                                                                                               
  BaseBenchmarks            2.444 GiB Module                                                                                                                                                                               
  SUITE                     2.361 GiB 23-element BenchmarkGroup([])                                                                                                                                                        
  SparseBenchmarks        779.200 MiB Module                                                                                                                                                                               
  IOBenchmarks            778.364 MiB Module                                                                                                                                                                               
  SortBenchmarks          461.147 MiB Module                                                                                                                                                                               
  LinAlgBenchmarks        216.722 MiB Module                                                                                                                                                                               
  ArrayBenchmarks         154.546 MiB Module                                                                                                                                                                               
  MiscellaneousBenchmarks  60.195 MiB Module                                                                                                                                                                               
  BroadcastBenchmarks      30.804 MiB Module                                                                                                                                                                               
  UnionBenchmarks           8.505 MiB Module                                                                                                                                                                               
  SIMDBenchmarks            5.960 MiB Module                                                                                                                                                                               
  CollectionBenchmarks      4.351 MiB Module                                                                                                                                                                               
  ProblemBenchmarks         2.587 MiB Module                                                                                                                                                                               
  InferenceBenchmarks       2.090 MiB Module                                                                                                                                                                               
  ShootoutBenchmarks      983.062 KiB Module                                                                                                                                                                               
  TupleBenchmarks         925.349 KiB Module                                                                                                                                                                               
  AllocBenchmarks         846.826 KiB Module                                                                                                                                                                               
  RandomBenchmarks        640.623 KiB Module                                                                                                                                                                               
  ScalarBenchmarks        537.010 KiB Module                                                                                                                                                                               
  StringBenchmarks        333.830 KiB Module                                                                                                                                                                               
  FindBenchmarks          124.907 KiB Module                                                                                                                                                                               
  DatesBenchmarks         118.212 KiB Module                                                                                                                                                                               
  MicroBenchmarks          52.814 KiB Module                                                                                                                                                                               
  ParallelBenchmarks        7.098 KiB Module                                                                                                                                                                               
  FrontendBenchmarks        5.248 KiB Module                                                                                                                                                                               
@vtjnash vtjnash closed this as completed Feb 6, 2025
@vtjnash
Copy link
Member Author

vtjnash commented Feb 6, 2025

The biggest ones are fixed, although LinAlgBenchmarks and BroadcastBenchmarks would still give a lot of savings

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant