Bug/db string #119

jonaraphael · 2024-09-18T02:51:10Z

• handle caspian bug
• handle antimeridian bug
• handle uvloop connection bug
• have pulumi handle revision names to avoid up errors

…ea, and unindent dry_run=False

github-actions · 2024-09-18T02:55:59Z

🍹 `preview` on cerulean-cloud-images/test

Pulumi report

Previewing update (test):
@ previewing update........

@ previewing update.........
pulumi:pulumi:Stack cerulean-cloud-images-test running
@ previewing update....
gcp:container:Registry cerulean-cloud-images-test-registry
@ previewing update.....
docker:index:Image cerulean-cloud-images-test-cr-orchestrator-image Building your image for linux/amd64 architecture.
docker:index:Image cerulean-cloud-images-test-cr-orchestrator-image Building your image for linux/amd64 architecture.
docker:index:Image cerulean-cloud-images-test-cr-offset-tile-image Building your image for linux/amd64 architecture.
docker:index:Image cerulean-cloud-images-test-cr-offset-tile-image Building your image for linux/amd64 architecture.
docker:index:Image cerulean-cloud-images-test-cr-tipg-image Building your image for linux/amd64 architecture.
docker:index:Image cerulean-cloud-images-test-cr-tipg-image Building your image for linux/amd64 architecture.
pulumi:pulumi:Stack cerulean-cloud-images-test
Diagnostics:
docker:index:Image (cerulean-cloud-images-test-cr-orchestrator-image):
Building your image for linux/amd64 architecture.
To ensure you are building for the correct platform, consider explicitly setting the `platform` field on ImageBuildOptions.

docker:index:Image (cerulean-cloud-images-test-cr-offset-tile-image):
Building your image for linux/amd64 architecture.
To ensure you are building for the correct platform, consider explicitly setting the `platform` field on ImageBuildOptions.

docker:index:Image (cerulean-cloud-images-test-cr-tipg-image):
Building your image for linux/amd64 architecture.
To ensure you are building for the correct platform, consider explicitly setting the `platform` field on ImageBuildOptions.

Resources:
5 unchanged

github-actions · 2024-09-18T02:58:09Z

🍹 `preview` on cerulean-cloud/test

Pulumi report

   Previewing update (test):

@ previewing update....
   pulumi:pulumi:Stack cerulean-cloud-test running 
@ previewing update....
   pulumi:providers:docker cerulean-cloud-images-test-gcr  
   gcp:storage:Bucket cerulean-cloud-test-bucket-cf-ais  
   gcp:sql:DatabaseInstance cerulean-cloud-test-database-instance  
   gcp:cloudtasks:Queue cerulean-cloud-test-queue-cloud-tasks-ais-analysis  
   gcp:serviceaccount:Account cerulean-cloud-test-cf-ais  
-- gcp:storage:BucketObject cerulean-cloud-test-source-cf-ais delete original 
+- gcp:storage:BucketObject cerulean-cloud-test-source-cf-ais replace [diff: ~detectMd5hash,name,source]
++ gcp:storage:BucketObject cerulean-cloud-test-source-cf-ais create replacement [diff: ~detectMd5hash,name,source]
   gcp:sql:User cerulean-cloud-test-database-users  
   gcp:projects:IAMMember cerulean-cloud-test-cf-ais-iam  
   gcp:sql:Database cerulean-cloud-test-database  
~  gcp:cloudfunctions:Function cerulean-cloud-test-cf-ais update [diff: ~environmentVariables,secretEnvironmentVariables,sourceArchiveObject]
   gcp:cloudfunctions:FunctionIamMember cerulean-cloud-test-cf-ais-invoker  [diff: ~cloudFunction]
@ previewing update.......
   gcp:serviceaccount:Account cerulean-cloud-test-cr-offset-tile  
   docker:index:RemoteImage cerulean-cloud-images-test-remote-orchestrator  
   docker:index:RemoteImage cerulean-cloud-images-test-remote-offset  
   docker:index:RemoteImage cerulean-cloud-images-test-remote-tipg  
   gcp:projects:IAMMember cerulean-cloud-test-cr-offset-tile-cloudSqlClient  
   gcp:projects:IAMMember cerulean-cloud-test-cr-offset-tile-secretmanagerSecretAccessor  
   gcp:secretmanager:SecretIamMember cerulean-cloud-test-cr-offset-tile-secret-accessor-binding  
   pulumi:pulumi:Stack cerulean-cloud-test running warning: serving_state is deprecated: `serving_state` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   pulumi:pulumi:Stack cerulean-cloud-test running warning: env_froms is deprecated: `env_from` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   pulumi:pulumi:Stack cerulean-cloud-test running warning: working_dir is deprecated: `working_dir` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
@ previewing update....
~  gcp:cloudrun:Service cerulean-cloud-test-cr-offset-tiles update [diff: ~metadata]
   gcp:cloudrun:IamPolicy cerulean-cloud-test-cr-noauth-iam-policy-offset  [diff: ~service]
@ previewing update....
   aws:iam:Role cerulean-cloud-test-lambda-titiler-role  
   aws:s3:Bucket cerulean-cloud-test-titiler-lambda-archive  
   aws:iam:Policy cerulean-cloud-test-lambda-titiler-policy  
   aws:apigatewayv2:Api cerulean-cloud-test-lambda-titiler-api  
@ previewing update....
   aws:sns:Topic cerulean-cloud-test-lambda-APIAbuseAlert  
   gcp:storage:Bucket cerulean-cloud-test-bucket-cf-sr  
   gcp:cloudtasks:Queue cerulean-cloud-test-queue-cr-orchestrator  
   gcp:serviceaccount:Account cerulean-cloud-test-cr-orchestrator  
   gcp:serviceaccount:Account cerulean-cloud-test-cf-sr  
   gcp:serviceaccount:Account cerulean-cloud-test-cr-tipg  
   aws:iam:Role cerulean-cloud-test-lambda-sentinel1-iam  
   aws:iam:RolePolicyAttachment cerulean-cloud-test-lambda-titiler-attachment2  
   aws:iam:RolePolicyAttachment cerulean-cloud-test-lambda-titiler-attachment  
   aws:sns:TopicSubscription cerulean-cloud-test-lambda-titiler-email-support  
   aws:sns:TopicSubscription cerulean-cloud-test-lambda-titiler-email-jason  
   aws:sns:TopicSubscription cerulean-cloud-test-lambda-titiler-email-jona  
   aws:sns:TopicSubscription cerulean-cloud-test-lambda-titiler-email-aemon  
-- gcp:storage:BucketObject cerulean-cloud-test-source-cf-sr delete original 
+- gcp:storage:BucketObject cerulean-cloud-test-source-cf-sr replace [diff: ~detectMd5hash,name,source]
++ gcp:storage:BucketObject cerulean-cloud-test-source-cf-sr create replacement [diff: ~detectMd5hash,name,source]
-- gcp:storage:BucketObject cerulean-cloud-test-source-cf-historical-run delete original 
+- gcp:storage:BucketObject cerulean-cloud-test-source-cf-historical-run replace [diff: ~detectMd5hash,name,source]
   gcp:projects:IAMMember cerulean-cloud-test-cr-orchestrator-cloudTasksEnqueuer  
++ gcp:storage:BucketObject cerulean-cloud-test-source-cf-historical-run create replacement [diff: ~detectMd5hash,name,source]
   gcp:projects:IAMMember cerulean-cloud-test-cr-orchestrator-cloudSqlClient  
   gcp:projects:IAMMember cerulean-cloud-test-cr-orchestrator-secretmanagerSecretAccessor  
   gcp:projects:IAMMember cerulean-cloud-test-cf-sr-iam  
   aws:iam:RolePolicyAttachment cerulean-cloud-test-lambda-sentinel1-basic-execution  
   gcp:projects:IAMMember cerulean-cloud-test-cr-tipg-cloudSqlClient  
   gcp:projects:IAMMember cerulean-cloud-test-cr-tipg-secretmanagerSecretAccessor  
   gcp:secretmanager:SecretIamMember cerulean-cloud-test-cr-tipg-secret-accessor-binding  
   gcp:secretmanager:SecretIamMember cerulean-cloud-test-cr-orchestrator-secret-accessor-binding  
   pulumi:pulumi:Stack cerulean-cloud-test running warning: serving_state is deprecated: `serving_state` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   pulumi:pulumi:Stack cerulean-cloud-test running warning: env_froms is deprecated: `env_from` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   pulumi:pulumi:Stack cerulean-cloud-test running warning: working_dir is deprecated: `working_dir` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   pulumi:pulumi:Stack cerulean-cloud-test running warning: serving_state is deprecated: `serving_state` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   pulumi:pulumi:Stack cerulean-cloud-test running warning: env_froms is deprecated: `env_from` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   pulumi:pulumi:Stack cerulean-cloud-test running warning: working_dir is deprecated: `working_dir` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
~  gcp:cloudrun:Service cerulean-cloud-test-cr-tipg update [diff: ~metadata]
~  gcp:cloudrun:Service cerulean-cloud-test-cr-orchestrator update [diff: ~metadata,template]
   gcp:cloudrun:IamPolicy cerulean-cloud-test-cr-noauth-iam-policy-tipg  
   gcp:cloudrun:IamPolicy cerulean-cloud-test-cr-noauth-iam-policy-orchestrator  [diff: ~service]
~  gcp:cloudfunctions:Function cerulean-cloud-test-cf-sr update [diff: ~secretEnvironmentVariables,sourceArchiveObject]
~  gcp:cloudfunctions:Function cerulean-cloud-test-cf-historical-run update [diff: ~secretEnvironmentVariables,sourceArchiveObject]
   aws:lambda:Function cerulean-cloud-test-lambda-sentinel1-sub  
   gcp:cloudfunctions:FunctionIamMember cerulean-cloud-test-cf-sr-invoker  [diff: ~cloudFunction]
   gcp:cloudfunctions:FunctionIamMember cerulean-cloud-test-cf-historical-run-invoker  [diff: ~cloudFunction]
   aws:sns:TopicSubscription cerulean-cloud-test-sentinel1-subscription  
   aws:lambda:Permission cerulean-cloud-test-lambda-sentinel1-permission  
@ previewing update...............................................................................................................
~  aws:s3:BucketObject cerulean-cloud-test-titiler-lambda-archive update [diff: ~source]
~  aws:lambda:Function cerulean-cloud-test-lambda-titiler-sentinel update [diff: ~sourceCodeHash]
   aws:apigatewayv2:Integration cerulean-cloud-test-lambda-titiler-integration  [diff: ~__defaults,passthroughBehavior]
   aws:cloudwatch:MetricAlarm cerulean-cloud-test-lambda-titiler-alarm  
   aws:lambda:Permission cerulean-cloud-test-lambda-titiler-permission  
   aws:apigatewayv2:Route cerulean-cloud-test-lambda-titiler-route  
   aws:apigatewayv2:Stage cerulean-cloud-test-lambda-titiler-stage  
   pulumi:pulumi:Stack cerulean-cloud-test running Creating lambda package in [/home/runner/work/cerulean-cloud/cerulean-cloud] [running in Docker]...
   pulumi:pulumi:Stack cerulean-cloud-test running Checking Docker is available...
   pulumi:pulumi:Stack cerulean-cloud-test running Building container image...
   pulumi:pulumi:Stack cerulean-cloud-test running Sucessfully built container image with id sha256:c24cffc944023f6b969b05b3a0a622d66fc5210b6d862d72f09f6be1345c77bb
   pulumi:pulumi:Stack cerulean-cloud-test running Creating installation package.zip ...
   pulumi:pulumi:Stack cerulean-cloud-test running Sucessfully created package.zip at /home/runner/work/cerulean-cloud/cerulean-cloud/package.zip
   pulumi:pulumi:Stack cerulean-cloud-test  9 warnings; 6 messages
Diagnostics:
 pulumi:pulumi:Stack (cerulean-cloud-test):
   warning: serving_state is deprecated: `serving_state` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   warning: env_froms is deprecated: `env_from` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   warning: working_dir is deprecated: `working_dir` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   warning: serving_state is deprecated: `serving_state` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   warning: env_froms is deprecated: `env_from` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   warning: working_dir is deprecated: `working_dir` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   warning: serving_state is deprecated: `serving_state` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   warning: env_froms is deprecated: `env_from` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.
   warning: working_dir is deprecated: `working_dir` is deprecated and will be removed in a future major release. This field is not supported by the Cloud Run API.

   Creating lambda package in [/home/runner/work/cerulean-cloud/cerulean-cloud] [running in Docker]...
   Checking Docker is available...
   Building container image...
   Sucessfully built container image with id sha256:c24cffc944023f6b969b05b3a0a622d66fc5210b6d862d72f09f6be1345c77bb
   Creating installation package.zip ...
   Sucessfully created package.zip at /home/runner/work/cerulean-cloud/cerulean-cloud/package.zip

Outputs:
 - database_instance_public_ip: "34.22.187.69"

Resources:
   ~ 8 to update
   +-3 to replace
   11 changes. 56 unchanged

tmeckel · 2024-09-18T14:41:54Z

stack/database.py

@@ -73,11 +73,12 @@
    db_name,
    ":",
    pulumi.Config("db").require_secret("db-password"),
-    "@/",
+    "@",


I'd prefer to increase the memory limit for the container instances, because I think the intermittently occurring errors connecting to the DB might be related to an out-of-memory condition and not by using an invalid connection string.

That the containers in the CloudRun Services run into out-of-memory conditions is to me a problem that has to be tackled anyways.

jonaraphael added 15 commits September 17, 2024 10:20

Remove caspian from SCENE RELEVANCY

5db811d

Catch failure of antimeridian, return more detailed case of caspian s…

699ae04

…ea, and unindent dry_run=False

Try updating the db connection string to avoid the UVloop error

98ef96a

Second location

963c7ff

Try different

6ff1192

try again?

9c3095b

GPT's attempt

2b97432

another way?

64e71db

try again?

0fe6bd5

now?

d55a691

Try a different way

02d03d4

Try letting pulumi handle names

63d744c

autogenerate name?

2b7af5c

Merge branch 'main' into bug/db-string

32ae116

remove IP exposure

fdc8d9a

Last try at using the public ip address!

336b66e

jonaraphael had a problem deploying to test September 18, 2024 04:22 — with GitHub Actions Failure

What's one more among friends?

a2ae407

jonaraphael had a problem deploying to test September 18, 2024 04:41 — with GitHub Actions Failure

oops.

80b4634

jonaraphael temporarily deployed to test September 18, 2024 04:50 — with GitHub Actions Inactive

tmeckel reviewed Sep 18, 2024

View reviewed changes

sstill88 had a problem deploying to test December 25, 2024 00:14 — with GitHub Actions Failure

sstill88 had a problem deploying to test December 25, 2024 00:45 — with GitHub Actions Failure

sstill88 had a problem deploying to test December 25, 2024 01:10 — with GitHub Actions Failure

jonaraphael closed this Jan 2, 2025

jonaraphael deleted the bug/db-string branch January 2, 2025 15:12

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Bug/db string #119

Bug/db string #119

jonaraphael commented Sep 18, 2024

github-actions bot commented Sep 18, 2024 •

edited

Loading

github-actions bot commented Sep 18, 2024 •

edited

Loading

tmeckel Sep 18, 2024

Bug/db string #119

Bug/db string #119

Conversation

jonaraphael commented Sep 18, 2024

github-actions bot commented Sep 18, 2024 • edited Loading

🍹 preview on cerulean-cloud-images/test

github-actions bot commented Sep 18, 2024 • edited Loading

🍹 preview on cerulean-cloud/test

tmeckel Sep 18, 2024

Choose a reason for hiding this comment

github-actions bot commented Sep 18, 2024 •

edited

Loading

🍹 `preview` on cerulean-cloud-images/test

github-actions bot commented Sep 18, 2024 •

edited

Loading

🍹 `preview` on cerulean-cloud/test