Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add more benchmarks #574

Merged
merged 2 commits into from
Apr 4, 2024
Merged

Add more benchmarks #574

merged 2 commits into from
Apr 4, 2024

Conversation

avik-pal
Copy link
Member

@avik-pal avik-pal commented Apr 4, 2024

No description provided.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark Results

Benchmark suite Current: bb3775b Previous: dd608fc Ratio
Dense(2 => 2)/cpu/forward/NamedTuple/(2, 128) 1986.7 ns
Dense(2 => 2)/cpu/forward/ComponentArray/(2, 128) 1579.7784810126582 ns
Dense(20 => 20)/cpu/forward/NamedTuple/(20, 128) 5022.285714285715 ns
Dense(20 => 20)/cpu/forward/ComponentArray/(20, 128) 4919.142857142857 ns
Conv((3, 3), 3 => 3)/cpu/forward/NamedTuple/(64, 64, 3, 128) 10304048.5 ns
Conv((3, 3), 3 => 3)/cpu/forward/ComponentArray/(64, 64, 3, 128) 10314409 ns
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 1) 22730976.5 ns
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 16) 247061384 ns
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 64) 974748918 ns
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 1) 22631774 ns
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 16) 247413152.5 ns
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 64) 981800773 ns
Conv((3, 3), 64 => 64)/cpu/forward/NamedTuple/(64, 64, 64, 128) 379658895 ns
Conv((3, 3), 64 => 64)/cpu/forward/ComponentArray/(64, 64, 64, 128) 375372722 ns
Conv((3, 3), 1 => 1)/cpu/forward/NamedTuple/(64, 64, 1, 128) 3867233 ns
Conv((3, 3), 1 => 1)/cpu/forward/ComponentArray/(64, 64, 1, 128) 3869268 ns
Dense(200 => 200)/cpu/forward/NamedTuple/(200, 128) 87393 ns
Dense(200 => 200)/cpu/forward/ComponentArray/(200, 128) 87423 ns
Conv((3, 3), 16 => 16)/cpu/forward/NamedTuple/(64, 64, 16, 128) 55747528 ns
Conv((3, 3), 16 => 16)/cpu/forward/ComponentArray/(64, 64, 16, 128) 55644255 ns
Dense(2000 => 2000)/cpu/forward/NamedTuple/(2000, 128) 6540960.5 ns
Dense(2000 => 2000)/cpu/forward/ComponentArray/(2000, 128) 6503569.5 ns

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

codecov bot commented Apr 4, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 87.32%. Comparing base (dd608fc) to head (f7743b4).

❗ Current head f7743b4 differs from pull request most recent head 88dd1d5. Consider uploading reports for the commit 88dd1d5 to get more accurate results

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #574   +/-   ##
=======================================
  Coverage   87.32%   87.32%           
=======================================
  Files          33       33           
  Lines        1728     1728           
=======================================
  Hits         1509     1509           
  Misses        219      219           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@avik-pal avik-pal merged commit 1a9b75f into main Apr 4, 2024
4 of 5 checks passed
@avik-pal avik-pal deleted the ap/more_bench branch April 4, 2024 16:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant