-
Notifications
You must be signed in to change notification settings - Fork 1.8k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge branch 'develop' into feature/bci-1180-implement-polygon-zkevm-…
…soak-v2
- Loading branch information
Showing
689 changed files
with
11,238 additions
and
23,222 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -31,7 +31,7 @@ runs: | |
| current_version=$(head -n1 ./VERSION) | ||
| echo "current_version=${current_version}" | tee -a "$GITHUB_OUTPUT" | ||
| - name: Compare semantic versions | ||
| uses: smartcontractkit/chainlink-github-actions/[email protected].0 | ||
| uses: smartcontractkit/chainlink-github-actions/semver-compare@e865e376b8c2d594028c8d645dd6c47169b72974 # v2.2.16 | ||
| id: compare | ||
| with: | ||
| version1: ${{ steps.get-current-version.outputs.current_version }} | ||
|
|
||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,5 +1,44 @@ | ||
| # Distributed Tracing | ||
|
|
||
| These config files are for an OTEL collector, grafana Tempo, and a grafana UI instance to run as containers on the same network. | ||
| As part of the LOOP plugin effort, we've added distributed tracing to the core node. This is helpful for initial development and maintenance of LOOPs, but will also empower product teams building on top of core. | ||
|
|
||
| ## Dev environment | ||
|
|
||
| One way to generate traces locally today is with the OCR2 basic smoke test. | ||
|
|
||
| 1. navigate to `.github/tracing/` and then run `docker compose --file local-smoke-docker-compose.yaml up` | ||
| 2. setup a local docker registry at `127.0.0.1:5000` (https://www.docker.com/blog/how-to-use-your-own-registry-2/) | ||
| 3. run `make build_push_plugin_docker_image` in `chainlink/integration-tests/Makefile` | ||
| 4. run `SELECTED_NETWORKS=SIMULATED CHAINLINK_IMAGE="127.0.0.1:5000/chainlink" CHAINLINK_VERSION="develop" go test -run TestOCRv2Basic ./smoke/ocr2_test.go` | ||
| 5. navigate to `localhost:3000/explore` in a web browser to query for traces | ||
|
|
||
| Core and the median plugins are instrumented with open telemetry traces, which are sent to the OTEL collector and forwarded to the Tempo backend. The grafana UI can then read the trace data from the Tempo backend. | ||
|
|
||
|
|
||
|
|
||
| A localhost client can send gRPC calls to the server. The gRPC server is instrumented with open telemetry traces, which are sent to the OTEL collector and forwarded to the Tempo backend. The grafana UI can then read the trace data from the Tempo backend. | ||
| ## CI environment | ||
|
|
||
| Another way to generate traces is by enabling traces for PRs. This will instrument traces for `TestOCRv2Basic` in the CI run. | ||
|
|
||
| 1. Cut a PR in the core repo | ||
| 2. Add the `enable tracing` label to the PR | ||
| 3. Navigate to `Integration Tests / ETH Smoke Tests ocr2-plugins (pull_request)` details | ||
| 4. Navigate to the summary of the integration tests | ||
| 5. After the test completes, the generated trace data will be saved as an artifact, currently called `trace-data` | ||
| 6. Download the artifact to this directory (`chainlink/.github/tracing`) | ||
| 7. `docker compose --file local-smoke-docker-compose.yaml up` | ||
| 8. Run `sh replay.sh` to replay those traces to the otel-collector container that was spun up in the last step. | ||
| 9. navigate to `localhost:3000/explore` in a web browser to query for traces | ||
|
|
||
| The artifact is not json encoded - each individual line is a well formed and complete json object. | ||
|
|
||
| ## Configuration | ||
| This folder contains the following config files: | ||
| * otel-collector-ci.yaml | ||
| * otel-collector-dev.yaml | ||
| * tempo.yaml | ||
| * grafana-datasources.yaml | ||
|
|
||
| These config files are for an OTEL collector, grafana Tempo, and a grafana UI instance to run as containers on the same network. | ||
| `otel-collector-dev.yaml` is the configuration for dev (i.e. your local machine) environments, and forwards traces from the otel collector to the grafana tempo instance on the same network. | ||
| `otel-collector-ci.yaml` is the configuration for the CI runs, and exports the trace data to the artifact from the github run. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| receivers: | ||
| otlp: | ||
| protocols: | ||
| grpc: | ||
| endpoint: "0.0.0.0:4317" | ||
| http: | ||
| endpoint: "0.0.0.0:3100" | ||
| exporters: | ||
| file: | ||
| path: /tracing/trace-data.json | ||
| otlp: | ||
| endpoint: tempo:4317 | ||
| tls: | ||
| insecure: true | ||
| service: | ||
| telemetry: | ||
| logs: | ||
| level: "debug" # Set log level to debug | ||
| pipelines: | ||
| traces: | ||
| receivers: [otlp] | ||
| exporters: [file,otlp] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| # Read JSON file and loop through each trace | ||
| while IFS= read -r trace; do | ||
| curl -X POST http://localhost:3100/v1/traces \ | ||
| -H "Content-Type: application/json" \ | ||
| -d "$trace" | ||
| done < "trace-data" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,105 @@ | ||
| name: Automation Load Test | ||
| on: | ||
| workflow_dispatch: | ||
| inputs: | ||
| chainlinkVersion: | ||
| description: Chainlink image version to use | ||
| required: true | ||
| type: string | ||
| default: 2.6.0 | ||
| chainlinkImage: | ||
| description: Chainlink image repo to use | ||
| required: true | ||
| type: string | ||
| default: public.ecr.aws/chainlink/chainlink | ||
| network: | ||
| description: Network to run tests on | ||
| required: true | ||
| type: choice | ||
| options: | ||
| - SIMULATED | ||
| TestInputs: | ||
| description: TestInputs | ||
| required: false | ||
| type: string | ||
| slackMemberID: | ||
| description: Notifies test results (Not your @) | ||
| required: true | ||
| default: U02Q14G80TY | ||
| type: string | ||
|
|
||
| jobs: | ||
| automation_load: | ||
| environment: integration | ||
| permissions: | ||
| checks: write | ||
| pull-requests: write | ||
| id-token: write | ||
| contents: read | ||
| name: ${{ inputs.network }} Automation Load Test | ||
| runs-on: ubuntu20.04-16cores-64GB | ||
| env: | ||
| SELECTED_NETWORKS: ${{ inputs.network }} | ||
| SLACK_API_KEY: ${{ secrets.QA_SLACK_API_KEY }} | ||
| SLACK_CHANNEL: C03KJ5S7KEK | ||
| TEST_INPUTS: ${{ inputs.TestInputs }} | ||
| CHAINLINK_ENV_USER: ${{ github.actor }} | ||
| REF_NAME: ${{ github.head_ref || github.ref_name }} | ||
| steps: | ||
| - name: Setup Push Tag | ||
| shell: bash | ||
| run: | | ||
| echo "### chainlink image used for this test run :link:" >>$GITHUB_STEP_SUMMARY | ||
| echo "\`${{ inputs.chainlinkVersion }}\`" >>$GITHUB_STEP_SUMMARY | ||
| echo "### chainlink-tests image tag for this test run :ship:" >>$GITHUB_STEP_SUMMARY | ||
| echo "\`${GITHUB_SHA}\`" >>$GITHUB_STEP_SUMMARY | ||
| - name: Add mask | ||
| run: | | ||
| SLACK_USER=$(jq -r '.inputs.slackMemberID' $GITHUB_EVENT_PATH) | ||
| echo ::add-mask::$SLACK_USER | ||
| echo SLACK_USER=$SLACK_USER >> $GITHUB_ENV | ||
| - name: Checkout the repo | ||
| uses: actions/checkout@b4ffde65f46336ab88eb53be808477a3936bae11 # v4.1.1 | ||
| with: | ||
| ref: ${{ env.REF_NAME }} | ||
| - name: Build Test Image | ||
| uses: ./.github/actions/build-test-image | ||
| with: | ||
| QA_AWS_ROLE_TO_ASSUME: ${{ secrets.QA_AWS_ROLE_TO_ASSUME }} | ||
| QA_AWS_REGION: ${{ secrets.QA_AWS_REGION }} | ||
| QA_AWS_ACCOUNT_NUMBER: ${{ secrets.QA_AWS_ACCOUNT_NUMBER }} | ||
| suites: benchmark load/automationv2_1 chaos reorg | ||
| - name: Run Tests | ||
| uses: smartcontractkit/chainlink-github-actions/chainlink-testing-framework/run-tests@e865e376b8c2d594028c8d645dd6c47169b72974 # v2.2.16 | ||
| env: | ||
| RR_CPU: 4000m | ||
| RR_MEM: 4Gi | ||
| DETACH_RUNNER: true | ||
| TEST_SUITE: automationv2_1 | ||
| TEST_ARGS: -test.timeout 720h | ||
| ENV_JOB_IMAGE: ${{ secrets.QA_AWS_ACCOUNT_NUMBER }}.dkr.ecr.${{ secrets.QA_AWS_REGION }}.amazonaws.com/chainlink-tests:${{ github.sha }} | ||
| INTERNAL_DOCKER_REPO: ${{ secrets.QA_AWS_ACCOUNT_NUMBER }}.dkr.ecr.${{ secrets.QA_AWS_REGION }}.amazonaws.com | ||
| PYROSCOPE_SERVER: ${{ secrets.QA_PYROSCOPE_INSTANCE }} | ||
| PYROSCOPE_KEY: ${{ secrets.QA_PYROSCOPE_KEY }} | ||
| with: | ||
| test_command_to_run: cd integration-tests && go test -timeout 1h -v -run TestLogTrigger ./load/automationv2_1 -count=1 | ||
| test_download_vendor_packages_command: make gomod | ||
| cl_repo: ${{ inputs.chainlinkImage }} | ||
| cl_image_tag: ${{ inputs.chainlinkVersion }} | ||
| token: ${{ secrets.GITHUB_TOKEN }} | ||
| should_cleanup: false | ||
| go_mod_path: ./integration-tests/go.mod | ||
| QA_AWS_REGION: ${{ secrets.QA_AWS_REGION }} | ||
| QA_AWS_ROLE_TO_ASSUME: ${{ secrets.QA_AWS_ROLE_TO_ASSUME }} | ||
| QA_KUBECONFIG: ${{ secrets.QA_KUBECONFIG }} | ||
| - name: Collect Metrics | ||
| if: always() | ||
| id: collect-gha-metrics | ||
| uses: smartcontractkit/push-gha-metrics-action@d1618b772a97fd87e6505de97b872ee0b1f1729a # v2.0.2 | ||
| with: | ||
| basic-auth: ${{ secrets.GRAFANA_CLOUD_BASIC_AUTH }} | ||
| hostname: ${{ secrets.GRAFANA_CLOUD_HOST }} | ||
| this-job-name: ${{ inputs.network }} Automation Load Test | ||
| test-results-file: '{"testType":"go","filePath":"/tmp/gotest.log"}' | ||
| continue-on-error: true |
Oops, something went wrong.