Promotion 2024-10-15 anvilprod (#6630)

[dsotirho-ucsc]

Connected issue: #6630

Checklist

Author

• Target branch is anvilprod
• Name of PR branch matches promotions/yyyy-mm-dd-anvilprod
• On ZenHub, PR is connected to the promotion issue it resolves
• PR description links to connected issue
• Title of connected issue matches Promotion yyyy-mm-dd
• PR title starts with title of connected issue followed by anvilprod
• PR title references the connected issue

Author (reindex, API changes)

• This PR is labeled reindex:anvilprod _{or the changes introduced by it will not require reindexing of anvilprod}
• This PR is labeled reindex:partial and its description documents the specific reindexing procedure for anvilprod _{or requires a full reindex or is not labeledreindex:anvilprod}

Author (upgrading deployments)

• This PR is labeled upgrade _{or does not require upgrading deployments}
• This PR is labeled deploy:shared _{or does not modify docker_images.json, and does not require deploying the shared component for any other reason}
• This PR is labeled deploy:gitlab _{or does not require deploying the gitlab component}
• This PR is labeled deploy:runner _{or does not require deploying the runner image}

System administrator (after approval)

• Actually approved the PR
• Decided if PR can be labeled no sandbox
• Moved connected issue to Approved column
• PR is assigned to only the operator

Operator (before pushing merge the commit)

• Pushed PR branch to GitHub
• Ran _select anvilprod.shared && CI_COMMIT_REF_NAME=anvilprod make -C terraform/shared apply_keep_unused _{or this PR is not labeled deploy:shared}
• Made a backup of the GitLab data volume in anvilprod (see operator manual for details) _{or this PR is not labeled backup:gitlab}
• Ran _select anvilprod.gitlab && CI_COMMIT_REF_NAME=anvilprod make -C terraform/gitlab apply _{or this PR is not labeled deploy:gitlab}
• Checked the items in the next section _{or this PR is labeled deploy:gitlab}
• PR is assigned to only the system administrator _{or this PR is not labeled deploy:gitlab}

System administrator

• Background migrations for anvilprod.gitlab are complete _{or this PR is not labeled deploy:gitlab}
• PR is assigned to only the operator

Operator (before pushing merge the commit)

• Ran _select anvilprod.gitlab && make -C terraform/gitlab/runner _{or this PR is not labeled deploy:runner}
• Added sandbox label _{or PR is labeled no sandbox}
• Pushed PR branch to GitLab anvilprod _{or PR is labeled no sandbox}
• Build passes in hammerbox deployment _{or PR is labeled no sandbox}
• Reviewed build logs for anomalies in hammerbox deployment _{or PR is labeled no sandbox}
• The title of the merge commit starts with the title of this PR
• Added PR # reference to merge commit title
• Collected commit title tags in merge commit title _{but excluded any p tags}
• Pushed merge commit to GitHub

Operator (after pushing the merge commit)

• Pushed merge commit to GitLab anvilprod
• Build passes on GitLab anvilprod
• Reviewed build logs for anomalies on GitLab anvilprod
• Ran _select anvilprod.shared && make -C terraform/shared apply _{or this PR is not labeled deploy:shared}
• Deleted PR branch from GitHub
• Deleted PR branch from GitLab anvilprod
• Moved connected issue to Merged stable column on ZenHub
• Moved promoted issues from Merged lower to Merged stable column on ZenHub
• Moved promoted issues from Lower to Stable column on ZenHub

Operator (reindex)

• Deindexed all unreferenced catalogs in anvilprod _{or this PR is neither labeled reindex:partial nor reindex:anvilprod}
• Deindexed specific sources in anvilprod _{or this PR is neither labeled reindex:partial nor reindex:anvilprod}
• Indexed specific sources in anvilprod _{or this PR is neither labeled reindex:partial nor reindex:anvilprod}
• Started reindex in anvilprod _{or this PR does not require reindexing anvilprod}
• Checked for, triaged and possibly requeued messages in both fail queues in anvilprod _{or this PR does not require reindexing anvilprod}
• Emptied fail queues in anvilprod _{or this PR does not require reindexing anvilprod}

Operator

• PR is assigned to only the system administrator

System administrator

• Removed unused image tags from pycharm image on DockerHub _{or this promotion does not alter references to that image}
• Removed unused image tags from elasticsearch image on DockerHub _{or this promotion does not alter references to that image}
• Removed unused image tags from bigquery_emulator image on DockerHub _{or this promotion does not alter references to that image}
• PR is assigned to no one

Shorthand for review comments

• L line is too long
• W line wrapping is wrong
• Q bad quotes
• F other formatting problem

[codecov]

Codecov Report

Attention: Patch coverage is 91.32420% with 19 lines in your changes missing coverage. Please review.

Project coverage is 85.36%. Comparing base (eea32cb) to head (54e12dd).
Report is 8 commits behind head on anvilprod.

Files with missing lines	Patch %	Lines
test/integration_test.py	0.00%	10 Missing ⚠️
src/azul/plugins/metadata/anvil/bundle.py	89.65%	3 Missing ⚠️
src/azul/terraform.py	25.00%	3 Missing ⚠️
src/azul/chalice.py	83.33%	1 Missing ⚠️
src/azul/indexer/index_service.py	91.66%	1 Missing ⚠️
src/humancellatlas/data/metadata/api.py	83.33%	1 Missing ⚠️

Additional details and impacted files

@@              Coverage Diff              @@
##           anvilprod    #6633      +/-   ##
=============================================
- Coverage      85.41%   85.36%   -0.05%     
=============================================
  Files            155      155              
  Lines          20760    20770      +10     
=============================================
- Hits           17732    17731       -1     
- Misses          3028     3039      +11     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[nadove-ucsc]

pro-forma approval