Skip to content

Commit

Permalink
Add variables to ease separate bucket config
Browse files Browse the repository at this point in the history
Signed-off-by: davidmirror-ops <david [email protected]>
  • Loading branch information
davidmirror-ops committed Mar 6, 2024
1 parent fd42f65 commit 03badc2
Show file tree
Hide file tree
Showing 2 changed files with 10 additions and 4 deletions.
7 changes: 5 additions & 2 deletions charts/flyte-core/values-eks.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,10 @@ userSettings:
certificateArn: <CERTIFICATE_ARN>
dbPassword: <DB_PASSWORD>
rdsHost: <RDS_HOST>
bucketName: <BUCKET_NAME>
# These two storage buckets could be the same or you could specify different buckets if required. Both keys are required.
# Learn more https://docs.flyte.org/en/latest/concepts/data_management.html#understand-how-flyte-handles-data
bucketName: <METADATA_BUCKET_NAME>
rawDataBucketName: <RAW_DATA_BUCKET_NAME>
logGroup: <LOG_GROUP_NAME>
redisHostUrl: <REDIS_HOST_URL>
redisHostKey: <REDIS_HOST_KEY>
Expand Down Expand Up @@ -238,7 +241,7 @@ configmap:

core:
propeller:
rawoutput-prefix: "s3://{{ .Values.userSettings.bucketName }}/"
rawoutput-prefix: "s3://{{ .Values.userSettings.rawDataBucketName }}/"
workers: 40
gc-interval: 12h
max-workflow-retries: 50
Expand Down
7 changes: 5 additions & 2 deletions charts/flyte-core/values-gcp.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,10 @@ userSettings:
googleProjectId: <PROJECT-ID>
dbHost: <CLOUD-SQL-IP>
dbPassword: <DBPASSWORD>
bucketName: <BUCKETNAME>
# These two storage buckets could be the same or you could specify different buckets if required. Both keys are required.
# Learn more https://docs.flyte.org/en/latest/concepts/data_management.html#understand-how-flyte-handles-data
bucketName: <METADATA_BUCKET_NAME>
rawDataBucketName: <RAW_DATA_BUCKET_NAME>
hostName: <HOSTNAME>

#
Expand Down Expand Up @@ -267,7 +270,7 @@ configmap:

core:
propeller:
rawoutput-prefix: "gs://{{ .Values.userSettings.bucketName }}/"
rawoutput-prefix: "gs://{{ .Values.userSettings.rawDataBucketName }}/"
workers: 40
gc-interval: 12h
max-workflow-retries: 50
Expand Down

0 comments on commit 03badc2

Please sign in to comment.