Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update CI workflows for E2E tests #13722

Closed
Closed
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
129 commits
Select commit Hold shift + click to select a range
8e21ca5
wip nightly pipeline
lukaszcl Jun 21, 2024
01d71a3
add reusable workflow
lukaszcl Jun 22, 2024
08eb8d0
on push
lukaszcl Jun 22, 2024
3b5a6e7
echo tests
lukaszcl Jun 22, 2024
2bf79bc
fix matrix
lukaszcl Jun 22, 2024
dfbdecf
fix
lukaszcl Jun 22, 2024
397ba14
add job name
lukaszcl Jun 22, 2024
6603e9b
run docker tests
lukaszcl Jun 22, 2024
e17499e
add reusable workflow
lukaszcl Jun 22, 2024
f255221
fix
lukaszcl Jun 22, 2024
1f3b5ca
fail if no test found
lukaszcl Jun 22, 2024
5901261
fix run selected workflow
lukaszcl Jun 22, 2024
d550f1d
Rename reusable workflow
lukaszcl Jun 22, 2024
04f2b32
Add nighly workflow
lukaszcl Jun 22, 2024
06f5922
try running k8s tests
lukaszcl Jun 22, 2024
099d654
cleanup
lukaszcl Jun 22, 2024
53858e0
add permissions
lukaszcl Jun 22, 2024
7db6612
fix
lukaszcl Jun 22, 2024
5611e17
test
lukaszcl Jun 22, 2024
f54a25b
Fix
lukaszcl Jun 22, 2024
a6ca1ff
fix
lukaszcl Jun 22, 2024
c2b411a
test remote runner
lukaszcl Jun 22, 2024
2c9ab53
Add test suite param
lukaszcl Jun 22, 2024
ada4954
Run all_tests_in_ocr_tests_go in parallel
lukaszcl Jun 22, 2024
3d587e8
Update e2e-tests.yml
lukaszcl Jun 22, 2024
fb95890
Add check-tests cmd
lukaszcl Jun 22, 2024
a82ad06
Unify tools into single cmd
lukaszcl Jun 22, 2024
79d3146
Add check tests step to workflow
lukaszcl Jun 22, 2024
0e6d314
show more info in annotation
lukaszcl Jun 22, 2024
cad8ebd
fix
lukaszcl Jun 22, 2024
880ae3b
Do not require check-tests
lukaszcl Jun 24, 2024
8079dab
fix go mod
lukaszcl Jun 24, 2024
2e112fc
temp: Disable checking test configuration
lukaszcl Jun 24, 2024
aa967ac
Add enable-check-test-configurations to reusable workflow. False by d…
lukaszcl Jun 24, 2024
acd558a
Add automation upgrade test to e2e list
lukaszcl Jun 24, 2024
f6c5049
Fix enable-check-test-configurations
lukaszcl Jun 24, 2024
74fb16d
Fix test cmd
lukaszcl Jun 24, 2024
27b3201
Make enable-check-test-configurations false by default
lukaszcl Jun 24, 2024
b7375e0
support test config override
lukaszcl Jun 24, 2024
be845a2
add more automation tests
lukaszcl Jun 24, 2024
b0acdda
Run automation upgrade tests on latest develop
lukaszcl Jun 24, 2024
73ed44e
Migrate automation-nightly-tests.yml to reusable workflow
lukaszcl Jun 24, 2024
8c19ba8
Update automation tests
lukaszcl Jun 24, 2024
092d8b0
Fix automation workflow
lukaszcl Jun 24, 2024
74d55e7
Fix
lukaszcl Jun 24, 2024
bbbbfc9
Fix
lukaszcl Jun 24, 2024
f4feb7f
Fx
lukaszcl Jun 24, 2024
5f44e12
Fix workflow_call inputs
lukaszcl Jun 24, 2024
c88a7f0
Select tests by github workflows
lukaszcl Jun 24, 2024
e7be8f1
Allow either test-ids or test-workflow in reusable workflow
lukaszcl Jun 24, 2024
ea39b14
Fix
lukaszcl Jun 24, 2024
a36fcee
Update workflow
lukaszcl Jun 24, 2024
0b02624
Add comment
lukaszcl Jun 24, 2024
8f7e27c
Fix
lukaszcl Jun 24, 2024
a4754da
Fix
lukaszcl Jun 24, 2024
3e0dcb7
Update e2e tests
lukaszcl Jun 24, 2024
da3b625
Add remote-runner-memory option
lukaszcl Jun 24, 2024
a780c75
Disable nightly run for now
lukaszcl Jun 24, 2024
52016f4
Fix output in k8s tests
lukaszcl Jun 24, 2024
f0b4a66
Add show test configuration step
lukaszcl Jun 24, 2024
d3bf504
Uncomment building test runner image
lukaszcl Jun 24, 2024
20e1409
Do not use json output for k8s tests
lukaszcl Jun 24, 2024
973cdff
test
lukaszcl Jun 24, 2024
104dbdc
Support custom runner version
lukaszcl Jun 24, 2024
1ff30f2
Fix test type env in remote runner
lukaszcl Jun 24, 2024
3d9820e
Update names and docs
lukaszcl Jun 25, 2024
9f0b76d
Add script to prepare test config override
lukaszcl Jun 26, 2024
b1f617b
Add CI test config override tools
lukaszcl Jun 26, 2024
d3cdd00
Add mask-secrets cmd and stop using reusable workflow
lukaszcl Jun 27, 2024
d388580
Use reusable workflow in run-selected-e2e-tests.yml
lukaszcl Jun 28, 2024
f917531
Remove unnecessary permissions
lukaszcl Jun 28, 2024
d8a330b
Add a sample test to quickly check CI workflows
lukaszcl Jun 28, 2024
48a40ae
Do not use mask cmd in reusable workflow
lukaszcl Jun 28, 2024
776f5a0
Clean up override test config cmd
lukaszcl Jun 28, 2024
265aac7
Fix masking of full chainlink image
lukaszcl Jun 28, 2024
535a49f
Finish "Set default test config override" step in reusable workflow
lukaszcl Jun 28, 2024
bb8f851
Remove env.CHAINLINK_IMAGE mask as it is not a scret
lukaszcl Jun 28, 2024
1742575
Fix reusable workflow
lukaszcl Jun 28, 2024
c7fa80e
Create create-default-e2e-config-override action
lukaszcl Jun 28, 2024
9861b6e
Fix
lukaszcl Jun 28, 2024
c67c854
Fix log targets in GHA and add test
lukaszcl Jun 28, 2024
494267c
Add create-default-e2e-config step to k8s tests
lukaszcl Jun 28, 2024
9194ff2
Fix ocr tests
lukaszcl Jun 28, 2024
a84b76a
Use sanitized id for artifact name
lukaszcl Jun 28, 2024
45b49ac
Update nightly workflow to test it
lukaszcl Jun 28, 2024
ff41f2e
Fail CI if test_config_base64_override is used
lukaszcl Jun 28, 2024
596e014
Use underscore for github inputs
lukaszcl Jun 28, 2024
3d1abd0
Fix
lukaszcl Jun 28, 2024
2cae0da
Fix inputs.chainlink_version
lukaszcl Jun 28, 2024
700f2f9
Remove test_config_base64_override from inputs until we are sure it d…
lukaszcl Jun 28, 2024
9b57657
Fix
lukaszcl Jun 28, 2024
0c88794
Remove unused action
lukaszcl Jun 28, 2024
9e04190
Fix
lukaszcl Jun 28, 2024
0c2979c
Update create config override cmd and action
lukaszcl Jun 28, 2024
5081809
Refactor client-compatibility-tests.yml to use actions/create-default…
lukaszcl Jun 28, 2024
e5a5782
Refactor on-demand-keeper-smoke-tests.yml
lukaszcl Jun 28, 2024
cd90826
Replace setup-create-base64-config with the new action in integration…
lukaszcl Jun 28, 2024
e4af6e0
Remove unused action
lukaszcl Jun 28, 2024
70493a8
Fix lint
lukaszcl Jun 28, 2024
2de3c68
Remove unused action
lukaszcl Jun 28, 2024
3692112
Fix handling selected_networks input
lukaszcl Jun 28, 2024
907cba8
Fix cache
lukaszcl Jun 28, 2024
cfe7de5
Do not run soak/ocr_test.go:^TestOCRSoak$ nightly
lukaszcl Jun 28, 2024
c3b1d4b
Enable nightly workflow to run some tests
lukaszcl Jun 28, 2024
94cdb4f
Merge branch 'develop' into TT-1297-Create-nightly-pipeline-for-all-e…
lukaszcl Jun 28, 2024
babde2b
Merge branch 'develop' into TT-1297-Create-nightly-pipeline-for-all-e…
lukaszcl Jun 28, 2024
2fccfbd
Remove config override input
lukaszcl Jun 28, 2024
a3eafeb
Remove temp test
lukaszcl Jun 28, 2024
71de825
Merge branch 'TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-co…
lukaszcl Jun 28, 2024
314f7e7
Fix setup go
lukaszcl Jun 28, 2024
69bee7c
go mod tidy in core/scripts
lukaszcl Jun 28, 2024
69453fb
Merge branch 'develop' into TT-1297-Create-nightly-pipeline-for-all-e…
lukaszcl Jun 28, 2024
ffb8bdd
Fix
lukaszcl Jun 28, 2024
6587671
Remove unready workflows
lukaszcl Jun 28, 2024
464c21d
Revert updates to core/scripts
lukaszcl Jun 28, 2024
a0470ba
Revert updates to go.mod
lukaszcl Jun 28, 2024
f23cee3
Remove unused script
lukaszcl Jun 28, 2024
5b0d11d
Add setup-gap id
lukaszcl Jul 1, 2024
210e4e8
Merge branch 'develop' into TT-1297-Create-nightly-pipeline-for-all-e…
lukaszcl Jul 1, 2024
74c1143
Remove unused steps
lukaszcl Jul 1, 2024
0e848db
test nightly workflow
lukaszcl Jul 1, 2024
63e2b2c
Add missing env vars in remote runner and fix lack of logs
lukaszcl Jul 1, 2024
d4a0a24
bump setup gap
lukaszcl Jul 1, 2024
f351eeb
Fix set-output
lukaszcl Jul 1, 2024
4f61a7a
update comment
lukaszcl Jul 1, 2024
5ceb64b
update test name
lukaszcl Jul 1, 2024
c3a8764
update cache
lukaszcl Jul 1, 2024
7a0466b
Fix empty output for k8s tests
lukaszcl Jul 1, 2024
2d0ae2b
Add a test workflow with overrides
lukaszcl Jul 1, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add mask-secrets cmd and stop using reusable workflow
  • Loading branch information
lukaszcl committed Jun 27, 2024
commit d3cdd001d50b4dc4ed63df57ba7603b15cfdb8b4
111 changes: 111 additions & 0 deletions .github/actions/run-e2e-docker-test/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,111 @@
name: 'Run E2E Docker Test'
inputs:
test:
required: true
description: 'Test to run'
test_config_base64_override_unsafe:
description: 'This is an unsafe way to pass custom base64 test config. It cannot contain any secrets as this value is exposed in Github logs (Set up job -> Inputs) when the workflow is called! The caller workflow must make sure to remove secrets from this input.'
required: false
type: string

runs:
using: 'composite'
steps:
- name: Install jq
run: sudo apt-get install -y jq
- name: Show test configuration
run: echo '${{ toJson(inputs.test) }}' | jq .
- name: Set up Go
uses: actions/setup-go@v2
with:
go-version: '1.21.7'

- name: Set default test config override
if: ${{ inputs.test_config_base64_override_unsafe == '' }}
run: |
# Mask secret args before using them
# For more, see https://docs.github.com/en/actions/using-workflows/workflow-commands-for-github-actions#masking-a-value-in-a-log
echo ::add-mask::${{ env.CHAINLINK_IMAGE }}
echo "cl image: ${{ env.CHAINLINK_IMAGE }}"

# Use overrides from e2e-tests.yml or defaults
chainlink_version="${{ inputs.test.testConfigOverride.chainlinkVersion || github.sha }}"
chainlink_image="${{ inputs.test.testConfigOverride.chainlinkImage || env.CHAINLINK_IMAGE }}"
chainlink_postgres_version="${{ inputs.test.testConfigOverride.chainlinkPostgresVersion }}"
chainlink_upgrade_version="${{ inputs.test.testConfigOverride.chainlinkUpgradeVersion }}"
selected_networks="${{ inputs.test.testConfigOverride.selectedNetworks || env.SELECTED_NETWORKS}}"

# Build the command line arguments
# Need to check if the variable is set before adding it to the command
# Otherwise "" will be passed as an argument which is not what we want
cmd_args=""
if [ -n "$chainlink_image" ]; then
cmd_args+="--chainlink-image=$chainlink_image "
fi
if [ -n "$chainlink_version" ]; then
cmd_args+="--chainlink-version=$chainlink_version "
fi
if [ -n "$chainlink_postgres_version" ]; then
cmd_args+="--chainlink-postgres-version=$chainlink_postgres_version "
fi
if [ -n "$chainlink_upgrade_version" ]; then
cmd_args+="--chainlink-upgrade-version=$chainlink_upgrade_version "
fi
if [ -n "$selected_networks" ]; then
cmd_args+="--selected-networks=$selected_networks "
fi

cd integration-tests/e2e_tests_ci_tool/

# Mask secrets inside the test config override (like resolved env vars)
go run main.go test-config mask-secrets $cmd_args

echo $chainlink_version

# Create a base64 encoded string of the test config override
config_override=$(go run main.go test-config create $cmd_args)

BASE64_CONFIG_OVERRIDE=$(echo "$config_override" | base64 -w 0)
echo ::add-mask::$BASE64_CONFIG_OVERRIDE
echo "BASE64_CONFIG_OVERRIDE=$BASE64_CONFIG_OVERRIDE" >> $GITHUB_ENV

- name: Mask secrets in test config base64 override
id: mask-secrets-in-test-config-base64-override
if: ${{ inputs.test_config_base64_override_unsafe != '' }}
run: |
# Mask secrets inside the test config override
cd integration-tests/e2e_tests_ci_tool/
go run main.go test-config mask-secrets --from-base64-config ${{ inputs.test_config_base64_override_unsafe }}

exit 1 # Fail the job

- name: Setup GAP for Grafana
uses: smartcontractkit/.github/actions/setup-gap@6c9d62fdad050cfb8b59376ded291f1350705944 # setup-gap@0.2.2
with:
aws-region: ${{ secrets.AWS_REGION }}
aws-role-arn: ${{ secrets.AWS_OIDC_IAM_ROLE_VALIDATION_PROD_ARN }}
api-gateway-host: ${{ secrets.AWS_API_GW_HOST_GRAFANA }}
duplicate-authorization-header: "true"
- name: Run Tests
uses: smartcontractkit/chainlink-github-actions/chainlink-testing-framework/run-tests@af92c5fae8dcf1659201e907db82d221fc304b94 # v2.3.21
with:
test_command_to_run: ${{ inputs.test.testCmd }} 2>&1 | tee /tmp/gotest.log | gotestloghelper -ci -singlepackage -hidepassingtests=false -hidepassinglogs
test_download_vendor_packages_command: cd ./integration-tests && go mod download
cl_repo: ${{ env.CHAINLINK_IMAGE }}
cl_image_tag: ${{ inputs.chainlink-version }}
aws_registries: ${{ secrets.QA_AWS_ACCOUNT_NUMBER }}
artifacts_name: ${{ inputs.test.id }}-test-logs
artifacts_location: |
./integration-tests/smoke/logs/
/tmp/gotest.log
publish_check_name: ${{ inputs.test.id }}
token: ${{ secrets.GITHUB_TOKEN }}
go_mod_path: ./integration-tests/go.mod
cache_key_id: core-e2e-${{ env.MOD_CACHE_VERSION }}
cache_restore_only: "true"
QA_AWS_REGION: ${{ secrets.QA_AWS_REGION }}
QA_AWS_ROLE_TO_ASSUME: ${{ secrets.QA_AWS_ROLE_TO_ASSUME }}
QA_KUBECONFIG: ""
should_tidy: "false"
go_coverage_src_dir: /var/tmp/go-coverage
go_coverage_dest_dir: ${{ github.workspace }}/.covdata
98 changes: 98 additions & 0 deletions .github/actions/setup-e2e-tests/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,98 @@
name: 'Setup E2E Tests'
description: 'Setup and generate test matrices for Docker and Kubernetes tests.'
inputs:
config-file-path:
required: true
description: 'Path to the configuration file for E2E tests'
enable-check-test-configurations:
required: true
description: 'Enable checking of test configurations'
test-ids:
required: false
description: 'Test IDs to filter on'
test-workflow:
required: false
description: 'Workflow name for filtering tests'
outputs:
run-docker-tests:
description: 'Indicator to run Docker tests'
value: ${{ steps.check-matrices.outputs.run-docker-tests }}
run-k8s-tests:
description: 'Indicator to run Kubernetes tests'
value: ${{ steps.check-matrices.outputs.run-k8s-tests }}
docker-matrix:
description: 'JSON matrix for Docker tests'
value: ${{ steps.set-docker-matrix.outputs.matrix }}
k8s-runner-matrix:
description: 'JSON matrix for Kubernetes tests'
value: ${{ steps.set-k8s-runner-matrix.outputs.matrix }}

runs:
using: 'composite'
steps:
- name: Install jq
run: sudo apt-get install jq
shell: bash

- name: Check Test Configurations
if: ${{ fromJSON(inputs.enable-check-test-configurations) }}
run: |
if ! go run integration-tests/e2e_tests_ci_tool/main.go check-tests ./integration-tests .github/e2e-tests.yml; then
echo "::error::Some E2E test configurations have to be added to .github/e2e-tests.yml." && exit 1
fi
shell: bash

- name: Set up Go
uses: actions/setup-go@v2
with:
go-version: '1.21.7'

- name: Generate Docker Tests Matrix
id: set-docker-matrix
run: |
cd integration-tests/e2e_tests_ci_tool/
MATRIX_JSON=$(go run main.go filter --file ${{ inputs.config-file-path }} --test-type 'docker' --test-ids '${{ inputs.test-ids }}' --workflow '${{ inputs.test-workflow }}')
echo "Docker tests:"
echo "$MATRIX_JSON" | jq
echo "matrix=$MATRIX_JSON" >> $GITHUB_ENV
shell: bash

- name: Generate K8s Tests Matrix
id: set-k8s-runner-matrix
run: |
cd integration-tests/e2e_tests_ci_tool/
MATRIX_JSON=$(go run main.go filter --file ${{ inputs.config-file-path }} --test-type 'k8s-remote-runner' --test-ids '${{ inputs.test-ids }}' --workflow '${{ inputs.test-workflow }}')
echo "K8s tests:"
echo "$MATRIX_JSON" | jq
echo "matrix=$MATRIX_JSON" >> $GITHUB_ENV
shell: bash

- name: Check Test Matrices
id: check-matrices
run: |
DOCKER_MATRIX_EMPTY=$(echo '${{ steps.set-docker-matrix.outputs.matrix }}' | jq '.tests == null or .tests == []')
K8S_MATRIX_EMPTY=$(echo '${{ steps.set-k8s-runner-matrix.outputs.matrix }}' | jq '.tests == null or .tests == []')

# Check if jq commands succeeded
if [ $? -ne 0 ]; then
echo "JSON parse error occurred."
exit 1
fi

if [[ "$DOCKER_MATRIX_EMPTY" == "true" ]]; then
echo "run-docker-tests=false" >> $GITHUB_ENV
else
echo "run-docker-tests=true" >> $GITHUB_ENV
fi
if [[ "$K8S_MATRIX_EMPTY" == "true" ]]; then
echo "run-k8s-tests=false" >> $GITHUB_ENV
else
echo "run-k8s-tests=true" >> $GITHUB_ENV
fi

# Check if both matrices are empty
if [[ "$DOCKER_MATRIX_EMPTY" == "true" ]] && [[ "$K8S_MATRIX_EMPTY" == "true" ]]; then
echo "No tests found for inputs: '${{ toJson(inputs) }}'. Both Docker and Kubernetes tests matrices are empty"
exit 1
fi
shell: bash
78 changes: 45 additions & 33 deletions .github/workflows/run-e2e-tests-reusable-workflow.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,8 @@ on:
description: 'Run tests by workflow name. Example: "Run Nightly E2E Tests"'
required: false
type: string
test-config-base64-override:
description: 'Custom base64 test config'
test-config-base64-override-unsafe:
description: 'This is an unsafe way to pass custom base64 test config. It cannot contain any secrets as this value is exposed in Github logs (Set up job -> Inputs) when the workflow is called! The caller workflow must make sure to remove secrets from this input.'
required: false
type: string
enable-check-test-configurations:
Expand Down Expand Up @@ -190,7 +190,7 @@ jobs:
go-version: '1.21.7'

- name: Set default test config override
if: ${{ inputs.test-config-base64-override == '' }}
if: ${{ inputs.test-config-base64-override-unsafe == '' }}
run: |
# Mask secret args before using them
# For more, see https://docs.github.com/en/actions/using-workflows/workflow-commands-for-github-actions#masking-a-value-in-a-log
Expand Down Expand Up @@ -238,38 +238,50 @@ jobs:
echo ::add-mask::$BASE64_CONFIG_OVERRIDE
echo "BASE64_CONFIG_OVERRIDE=$BASE64_CONFIG_OVERRIDE" >> $GITHUB_ENV

- name: Set custom test config override
if: ${{ inputs.test-config-base64-override != '' }}
run: |
# Show what parts of the test config are being overridden
go run main.go test-config override \
--dry-run \
--from-base64-config ${{ inputs.test-config-base64-override }} \
--perycope-server-url ${{ secrets.QA_PYROSCOPE_INSTANCE }} \
--peryscope-key ${{ secrets.QA_PYROSCOPE_KEY }} \
--loki-endpoint https://${{ secrets.GRAFANA_INTERNAL_HOST }}/loki/api/v1/push \
--loki-tenant-id ${{ secrets.GRAFANA_INTERNAL_TENANT_ID }} \
--loki-basic-auth ${{ secrets.GRAFANA_INTERNAL_BASIC_AUTH }} \
--grafana-url "http://localhost:8080/primary" \
--grafana-dashboard-url "/d/ddf75041-1e39-42af-aa46-361fe4c36e9e/ci-e2e-tests-logs" \
--grafana-bearer-token ${{ secrets.GRAFANA_INTERNAL_URL_SHORTENER_TOKEN }} \
- name: Mask secrets in test config base64 override
id: mask-secrets-in-test-config-base64-override
if: ${{ inputs.test-config-base64-override-unsafe != '' }}
run: "to do"
# - name: Remove secrets from test config base64 override
# id: mask-in
# - name: Set outputs
# id: set-outputs
# run: |
# echo "::set-output name=base64ConfigNoSecrets::$BASE64_CONFIG_OVERRIDE"

# Override custom test config with CI secrets
config_override=$(go run main.go test-config override \
--from-base64-config ${{ inputs.test-config-base64-override }} \
--perycope-server-url ${{ secrets.QA_PYROSCOPE_INSTANCE }} \
--peryscope-key ${{ secrets.QA_PYROSCOPE_KEY }} \
--loki-endpoint https://${{ secrets.GRAFANA_INTERNAL_HOST }}/loki/api/v1/push \
--loki-tenant-id ${{ secrets.GRAFANA_INTERNAL_TENANT_ID }} \
--loki-basic-auth ${{ secrets.GRAFANA_INTERNAL_BASIC_AUTH }} \
--grafana-url "http://localhost:8080/primary" \
--grafana-dashboard-url "/d/ddf75041-1e39-42af-aa46-361fe4c36e9e/ci-e2e-tests-logs" \
--grafana-bearer-token ${{ secrets.GRAFANA_INTERNAL_URL_SHORTENER_TOKEN }} \
)
# TODO: Remove this step since we allow custom secrets in the test config but we mask them
# - name: Override secrets in custom test config
# if: ${{ inputs.test-config-base64-override-unsafe != '' }}
# run: |
# # Show what parts of the test config are being overridden
# go run main.go test-config override \
# --dry-run \
# --from-base64-config ${{ inputs.test-config-base64-override-unsafe }} \
# --perycope-server-url ${{ secrets.QA_PYROSCOPE_INSTANCE }} \
# --peryscope-key ${{ secrets.QA_PYROSCOPE_KEY }} \
# --loki-endpoint https://${{ secrets.GRAFANA_INTERNAL_HOST }}/loki/api/v1/push \
# --loki-tenant-id ${{ secrets.GRAFANA_INTERNAL_TENANT_ID }} \
# --loki-basic-auth ${{ secrets.GRAFANA_INTERNAL_BASIC_AUTH }} \
# --grafana-url "http://localhost:8080/primary" \
# --grafana-dashboard-url "/d/ddf75041-1e39-42af-aa46-361fe4c36e9e/ci-e2e-tests-logs" \
# --grafana-bearer-token ${{ secrets.GRAFANA_INTERNAL_URL_SHORTENER_TOKEN }}

BASE64_CONFIG_OVERRIDE=$(echo "$config_override" | base64 -w 0)
echo ::add-mask::$BASE64_CONFIG_OVERRIDE
echo "BASE64_CONFIG_OVERRIDE=$BASE64_CONFIG_OVERRIDE" >> $GITHUB_ENV
# # Override custom test config with CI secrets
# config_override=$(go run main.go test-config override \
# --from-base64-config ${{ inputs.test-config-base64-override-unsafe }} \
# --perycope-server-url ${{ secrets.QA_PYROSCOPE_INSTANCE }} \
# --peryscope-key ${{ secrets.QA_PYROSCOPE_KEY }} \
# --loki-endpoint https://${{ secrets.GRAFANA_INTERNAL_HOST }}/loki/api/v1/push \
# --loki-tenant-id ${{ secrets.GRAFANA_INTERNAL_TENANT_ID }} \
# --loki-basic-auth ${{ secrets.GRAFANA_INTERNAL_BASIC_AUTH }} \
# --grafana-url "http://localhost:8080/primary" \
# --grafana-dashboard-url "/d/ddf75041-1e39-42af-aa46-361fe4c36e9e/ci-e2e-tests-logs" \
# --grafana-bearer-token ${{ secrets.GRAFANA_INTERNAL_URL_SHORTENER_TOKEN }}
# )

# BASE64_CONFIG_OVERRIDE=$(echo "$config_override" | base64 -w 0)
# echo ::add-mask::$BASE64_CONFIG_OVERRIDE
# echo "BASE64_CONFIG_OVERRIDE=$BASE64_CONFIG_OVERRIDE" >> $GITHUB_ENV

- name: Setup GAP for Grafana
uses: smartcontractkit/.github/actions/setup-gap@6c9d62fdad050cfb8b59376ded291f1350705944 # setup-gap@0.2.2
Expand Down
Loading