WorkerV2 - Cloud Run V2 API (#220)

* 👌 IMPROVE: started on cloud run v2 block, added foundation for all, building out abstract cmds now * 👌 IMPROVE: rough draft, still missing kill method, but ready to start on workerv2 * 🤖 TEST: testing * ‼️ BREAKING: removing memory string test * 👌 IMPROVE: creates successfully * 🐛 FIX: removed client * 🐛 FIX: fixed validation bug * 🐛 FIX: fix mispelling for var * 🐛 FIX: fixed and simplified job name generation * 🐛 FIX: fixed issue with observedGeneration keyerror * 🤖 TEST: test config job name as var * 🐛 FIX: made IDs use whole Prefect Name * 👌 IMPROVE: working cancelation functionality * 🤖 TEST: added cloud run v2 block unit tests * 📖 DOC: added some unit tests and docstrings * 🐛 FIX: applied some ci test fixes * 🐛 FIX: fixed some failing unit tests * 🐛 FIX: fix missing optional and remove | None * 🐛 FIX: added the Pydantic Version conditional import logic to cr2 worker and block * 🐛 FIX: PR feedback implemented, separate cloud run v2 block infra to models directory * 🐛 FIX: attempted fix on 3.8 test changing list to typing.List * 👌 IMPROVE: added get_prefect_image_name as default factory to image cloud run v2 * 🐛 FIX: fix ci test and hardcode default to prefect 2 latest image --------- Co-authored-by: nate nowack <[email protected]>
PrefectHQ · Nov 28, 2023 · 231f68a · 231f68a
1 parent 1f951a1
commit 231f68a
Show file tree

Hide file tree

Showing 10 changed files with 1,532 additions and 0 deletions.
diff --git a/.gitignore b/.gitignore
@@ -1,3 +1,6 @@
+# JetBrains
+.idea
+
 # Byte-compiled / optimized / DLL files
 __pycache__/
 *.py[cod]

diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -9,6 +9,8 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ### Added
 
+- Added `CloudRunJobV2` and `CloudRunWorkerV2` for executing Prefect flows via Google Cloud Run - [#220](https://github.com/PrefectHQ/prefect-gcp/pull/220)
+
 ### Changed
 
 ### Deprecated

diff --git a/docs/cloud_run_worker_v2.md b/docs/cloud_run_worker_v2.md
@@ -0,0 +1 @@
+::: prefect_gcp.workers.cloud_run_v2
diff --git a/mkdocs.yml b/mkdocs.yml
@@ -84,10 +84,12 @@ nav:
         - BigQuery: bigquery.md
         - Secret Manager: secret_manager.md
         - Cloud Run: cloud_run.md
+        - Cloud Run V2: cloud_run_v2.md
         - AI Platform: aiplatform.md
         - Deployment Steps: deployments/steps.md
         - Workers:
           - Cloud Run: cloud_run_worker.md
+          - Cloud Run V2: cloud_run_worker_v2.md
           - Vertex AI: vertex_worker.md
 
 extra:

diff --git a/prefect_gcp/__init__.py b/prefect_gcp/__init__.py
@@ -11,6 +11,7 @@
 from .secret_manager import GcpSecret  # noqa
 from .workers.vertex import VertexAIWorker  # noqa
 from .workers.cloud_run import CloudRunWorker  # noqa
+from .workers.cloud_run_v2 import CloudRunWorkerV2  # noqa
 
 register_renamed_module(
     "prefect_gcp.projects", "prefect_gcp.deployments", start_date="Jun 2023"

diff --git a/prefect_gcp/models/__init__.py b/prefect_gcp/models/__init__.py