Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor benchmark #743

Merged
merged 3 commits into from
Oct 4, 2024
Merged

refactor benchmark #743

merged 3 commits into from
Oct 4, 2024

Conversation

vincentsarago
Copy link
Member

closes #703


with MemoryFile() as cogfile:
copy(mem, cogfile.name, copy_src_overviews=True, **cog_profile)
return BytesIO(cogfile.read())
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the dataset_fixture now creates a valid COG

arr[:, range(height), range(width)] = max_value
arr[:, range(height - 1, 0, -1), range(width - 1)] = max_value
arr[:, :, width // 2] = max_value
arr[:, height // 2, :] = max_value
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we add some values
Screenshot 2024-10-04 at 12 44 15 PM

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'rio-tiler Benchmarks'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.50.

Benchmark suite Current: 05c3a84 Previous: a2302cb Ratio
tests/benchmarks/benchmarks.py::test_tile[nodata-int8-equator-full] 37.6985113603049 iter/sec (stddev: 0.00009388323837296986) 58.73894386413037 iter/sec (stddev: 0.0003316430918281945) 1.56
tests/benchmarks/benchmarks.py::test_tile[nodata-uint8-equator-full] 46.751325018785565 iter/sec (stddev: 0.00007611403919856133) 86.92182275362933 iter/sec (stddev: 0.0005025367383511807) 1.86
tests/benchmarks/benchmarks.py::test_tile[nodata-uint16-equator-full] 38.031313379956366 iter/sec (stddev: 0.00011873518785811553) 84.61156135201941 iter/sec (stddev: 0.00034267585124898934) 2.22
tests/benchmarks/benchmarks.py::test_tile[nodata-int16-equator-full] 37.55690337785251 iter/sec (stddev: 0.00012269645810690028) 85.9489689081468 iter/sec (stddev: 0.00039628379057214745) 2.29
tests/benchmarks/benchmarks.py::test_tile[nodata-uint32-equator-full] 30.675311581658935 iter/sec (stddev: 0.0009631913350317974) 65.09990524407355 iter/sec (stddev: 0.0005091315601991648) 2.12
tests/benchmarks/benchmarks.py::test_tile[nodata-int32-equator-full] 30.373991586895965 iter/sec (stddev: 0.00042888191333203) 60.95217742242523 iter/sec (stddev: 0.00017424104829224794) 2.01
tests/benchmarks/benchmarks.py::test_tile[nodata-float32-equator-full] 33.69999947162248 iter/sec (stddev: 0.0001290302962023234) 83.10565264491062 iter/sec (stddev: 0.00046613398894058023) 2.47
tests/benchmarks/benchmarks.py::test_tile[nodata-float64-equator-full] 25.08269158924091 iter/sec (stddev: 0.00020973248146040666) 67.85591531253166 iter/sec (stddev: 0.0005588400973240104) 2.71
tests/benchmarks/benchmarks.py::test_tile[nodata-int64-equator-full] 25.46372579252937 iter/sec (stddev: 0.0007902189125983953) 111.13948906109043 iter/sec (stddev: 0.0003020003559077106) 4.36
tests/benchmarks/benchmarks.py::test_tile[nodata-int64-dateline-full] 75.79354680466143 iter/sec (stddev: 0.00015475720735866707) 135.6956554474957 iter/sec (stddev: 0.00022990133426704378) 1.79
tests/benchmarks/benchmarks.py::test_tile[nodata-uint64-equator-full] 25.49554097163987 iter/sec (stddev: 0.0005046579552152672) 109.25269644303692 iter/sec (stddev: 0.0006215966178601235) 4.29
tests/benchmarks/benchmarks.py::test_tile[nodata-uint64-dateline-full] 75.35771664954473 iter/sec (stddev: 0.00019075069485867237) 134.03323648158926 iter/sec (stddev: 0.00021358998964920807) 1.78
tests/benchmarks/benchmarks.py::test_tile[alpha-int8-equator-full] 43.20693402653382 iter/sec (stddev: 0.0003960618265473104) 75.09284845495435 iter/sec (stddev: 0.00042539439880281575) 1.74
tests/benchmarks/benchmarks.py::test_tile[alpha-uint8-equator-full] 54.89300427908131 iter/sec (stddev: 0.0006313882870500917) 127.56952899259616 iter/sec (stddev: 0.0002356601252655428) 2.32
tests/benchmarks/benchmarks.py::test_tile[alpha-uint16-equator-full] 40.0783130236484 iter/sec (stddev: 0.0003371794224108913) 89.8606253119259 iter/sec (stddev: 0.00010061459612528018) 2.24
tests/benchmarks/benchmarks.py::test_tile[alpha-int16-equator-full] 39.96837218672785 iter/sec (stddev: 0.00061877867947542) 90.01317126730072 iter/sec (stddev: 0.00010174128633723553) 2.25
tests/benchmarks/benchmarks.py::test_tile[alpha-uint32-equator-full] 31.39323556139987 iter/sec (stddev: 0.00027330373543296883) 96.85972901050013 iter/sec (stddev: 0.00044718382968876727) 3.09
tests/benchmarks/benchmarks.py::test_tile[alpha-int32-equator-full] 30.109784126976322 iter/sec (stddev: 0.0008685989765864007) 93.57321463470302 iter/sec (stddev: 0.0003114010710618348) 3.11
tests/benchmarks/benchmarks.py::test_tile[alpha-float32-equator-full] 34.71631523692455 iter/sec (stddev: 0.00030991970487711043) 121.28939990427696 iter/sec (stddev: 0.0001795136198074633) 3.49
tests/benchmarks/benchmarks.py::test_tile[alpha-float64-equator-full] 21.914880434817917 iter/sec (stddev: 0.0008805121056525427) 100.06175219143564 iter/sec (stddev: 0.00011152426813951698) 4.57
tests/benchmarks/benchmarks.py::test_tile[alpha-float64-dateline-full] 85.90244466192391 iter/sec (stddev: 0.00019230170335036433) 135.4489334349369 iter/sec (stddev: 0.00017827201548010352) 1.58
tests/benchmarks/benchmarks.py::test_tile[alpha-int64-equator-full] 21.34184314623839 iter/sec (stddev: 0.0011417835261598507) 85.37190670954622 iter/sec (stddev: 0.0010213221812947963) 4.00
tests/benchmarks/benchmarks.py::test_tile[alpha-int64-dateline-full] 86.69592975641983 iter/sec (stddev: 0.0003794838501883249) 130.83243254438705 iter/sec (stddev: 0.00020013253185775172) 1.51
tests/benchmarks/benchmarks.py::test_tile[alpha-uint64-equator-full] 21.264447554993232 iter/sec (stddev: 0.0012695901938900428) 91.11147887016347 iter/sec (stddev: 0.0009370370583185412) 4.28
tests/benchmarks/benchmarks.py::test_tile[mask-int8-equator-full] 44.10945861563606 iter/sec (stddev: 0.00007443900420762879) 101.9549199759777 iter/sec (stddev: 0.0004337400004584392) 2.31
tests/benchmarks/benchmarks.py::test_tile[mask-uint8-equator-full] 48.3822685359441 iter/sec (stddev: 0.00032309124069597364) 136.73614997802255 iter/sec (stddev: 0.00036740485948098155) 2.83
tests/benchmarks/benchmarks.py::test_tile[mask-uint16-equator-full] 41.81322196498262 iter/sec (stddev: 0.00039601751504763255) 133.81934777047783 iter/sec (stddev: 0.0002321983639492418) 3.20
tests/benchmarks/benchmarks.py::test_tile[mask-int16-equator-full] 41.490043816110635 iter/sec (stddev: 0.00029158275337837724) 131.25753358123626 iter/sec (stddev: 0.0007613769247193867) 3.16
tests/benchmarks/benchmarks.py::test_tile[mask-uint32-equator-full] 33.811910817222184 iter/sec (stddev: 0.00027216444686192336) 106.43342665794336 iter/sec (stddev: 0.00018196754533511913) 3.15
tests/benchmarks/benchmarks.py::test_tile[mask-int32-equator-full] 32.48222325720914 iter/sec (stddev: 0.000385795789450675) 101.55627132794272 iter/sec (stddev: 0.00041544265791151576) 3.13
tests/benchmarks/benchmarks.py::test_tile[mask-float32-equator-full] 35.12415509124199 iter/sec (stddev: 0.0003170903649503079) 131.20812520022383 iter/sec (stddev: 0.0003745566079922805) 3.74
tests/benchmarks/benchmarks.py::test_tile[mask-float64-equator-full] 26.12468701795778 iter/sec (stddev: 0.00023353233958945904) 106.96449759121657 iter/sec (stddev: 0.00024643288103481334) 4.09
tests/benchmarks/benchmarks.py::test_tile[mask-int64-equator-full] 26.035255093940457 iter/sec (stddev: 0.0005092363566859814) 97.41606762517118 iter/sec (stddev: 0.0001049734411514715) 3.74
tests/benchmarks/benchmarks.py::test_tile[mask-uint64-equator-full] 26.181434750860852 iter/sec (stddev: 0.0004188833905549838) 101.53780384840532 iter/sec (stddev: 0.00012115695626199863) 3.88
tests/benchmarks/benchmarks.py::test_tile[none-int8-equator-full] 44.04657503281989 iter/sec (stddev: 0.000887123878231415) 90.2624592215988 iter/sec (stddev: 0.00036696941291495253) 2.05
tests/benchmarks/benchmarks.py::test_tile[none-uint8-equator-full] 48.61744698880945 iter/sec (stddev: 0.00032808651476738573) 130.9530240961301 iter/sec (stddev: 0.0002477486232608191) 2.69
tests/benchmarks/benchmarks.py::test_tile[none-uint16-equator-full] 43.61767936329111 iter/sec (stddev: 0.0001839434481281406) 151.57367600113537 iter/sec (stddev: 0.00005189281302002173) 3.48
tests/benchmarks/benchmarks.py::test_tile[none-int16-equator-full] 42.786421791804315 iter/sec (stddev: 0.00034663708025390986) 152.0183279500958 iter/sec (stddev: 0.00006293096555736133) 3.55
tests/benchmarks/benchmarks.py::test_tile[none-uint32-equator-full] 34.06922965751339 iter/sec (stddev: 0.00021296621741448345) 94.99615467312861 iter/sec (stddev: 0.00007271329172788946) 2.79
tests/benchmarks/benchmarks.py::test_tile[none-int32-equator-full] 32.81791128578503 iter/sec (stddev: 0.00015441493406216113) 90.27366509244763 iter/sec (stddev: 0.00027455201129458084) 2.75
tests/benchmarks/benchmarks.py::test_tile[none-float32-equator-full] 36.97750986557906 iter/sec (stddev: 0.00015864609360713447) 149.46685408612112 iter/sec (stddev: 0.0000797231570832586) 4.04
tests/benchmarks/benchmarks.py::test_tile[none-float64-equator-full] 26.855057320679993 iter/sec (stddev: 0.0002829550237846629) 98.67341666405854 iter/sec (stddev: 0.00004575740221656055) 3.67
tests/benchmarks/benchmarks.py::test_tile[none-int64-equator-full] 26.272804479771207 iter/sec (stddev: 0.0003862082811870264) 85.98258777539246 iter/sec (stddev: 0.000050203403107910584) 3.27
tests/benchmarks/benchmarks.py::test_tile[none-uint64-equator-full] 26.284629657112912 iter/sec (stddev: 0.0007278680182618283) 90.87615601322409 iter/sec (stddev: 0.00011892284301815447) 3.46

This comment was automatically generated by workflow using github-action-benchmark.

@vincentsarago vincentsarago merged commit bb33ffb into main Oct 4, 2024
8 checks passed
@vincentsarago vincentsarago deleted the refactor/benchmark branch October 4, 2024 11:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

refactor benchmark
1 participant