Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[APM] Migrate traces tests to deployment agnostic #200561

Merged
merged 7 commits into from
Nov 22, 2024

Conversation

crespocarlos
Copy link
Contributor

@crespocarlos crespocarlos commented Nov 18, 2024

Summary

Closes #198995
Closes #198996
Part of #193245

This PR contains the changes to migrate traces test folder to Deployment-agnostic testing strategy.
It also adds support for deployment-agnostic snapshots validation

How to test

  • Serverless
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts
node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep="APM"

It's recommended to be run against MKI

  • Stateful
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts
node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="APM"
  • (OPTIONAL, only if a test has been unskipped) Run flaky test suite
  • local run for serverless
  • local run for stateful
  • MKI run for serverless

@crespocarlos crespocarlos changed the title [APM] Migrate traces tests [APM] Migrate traces tests to deployment agnostic Nov 18, 2024
@crespocarlos
Copy link
Contributor Author

/ci

@crespocarlos
Copy link
Contributor Author

/ci

@crespocarlos crespocarlos added release_note:skip Skip the PR/issue when compiling release notes backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team labels Nov 19, 2024
@crespocarlos crespocarlos marked this pull request as ready for review November 19, 2024 15:51
@crespocarlos crespocarlos requested review from a team as code owners November 19, 2024 15:51
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services)

@botelastic botelastic bot added the ci:project-deploy-observability Create an Observability project label Nov 19, 2024
Copy link
Contributor

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

Copy link
Contributor

@iblancof iblancof left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@crespocarlos
Copy link
Contributor Author

@elasticmachine merge upstream

@elasticmachine
Copy link
Contributor

elasticmachine commented Nov 22, 2024

💛 Build succeeded, but was flaky

  • Buildkite Build
  • Commit: 2cea90d
  • Kibana Serverless Image: docker.elastic.co/kibana-ci/kibana-serverless:pr-200561-2cea90d98786

Failed CI Steps

Test Failures

  • [job] [logs] FTR Configs #97 / aiops log pattern analysis attaches log pattern analysis table to a case

Metrics [docs]

✅ unchanged

History

@crespocarlos crespocarlos merged commit 3917d02 into elastic:main Nov 22, 2024
24 checks passed
@crespocarlos crespocarlos deleted the 198996-migrate-traces-tests branch November 22, 2024 13:47
@kibanamachine
Copy link
Contributor

Starting backport for target branches: 8.x

https://github.com/elastic/kibana/actions/runs/11973821484

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Nov 22, 2024
## Summary

Closes [elastic#198995](elastic#198995)
Closes elastic#198996
Part of elastic#193245

This PR contains the changes to migrate `traces` test folder to
Deployment-agnostic testing strategy.
It also adds support for deployment-agnostic snapshots validation

### How to test

- Serverless

```
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts
node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep="APM"
```

It's recommended to be run against
[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)

- Stateful
```
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts
node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="APM"
```

- [ ] ~(OPTIONAL, only if a test has been unskipped) Run flaky test
suite~
- [x] local run for serverless
- [x] local run for stateful
- [x] MKI run for serverless

---------

Co-authored-by: Elastic Machine <[email protected]>
(cherry picked from commit 3917d02)
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.x

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

@kibanamachine
Copy link
Contributor

Looks like this PR has a backport PR but it still hasn't been merged. Please merge it ASAP to keep the branches relatively in sync.

@kibanamachine kibanamachine added the backport missing Added to PRs automatically when the are determined to be missing a backport. label Nov 25, 2024
kibanamachine added a commit that referenced this pull request Nov 26, 2024
…01386)

# Backport

This will backport the following commits from `main` to `8.x`:
- [[APM] Migrate traces tests to deployment agnostic
(#200561)](#200561)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Carlos
Crespo","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-22T13:47:06Z","message":"[APM]
Migrate traces tests to deployment agnostic (#200561)\n\n##
Summary\r\n\r\nCloses
[#198995](https://github.com/elastic/kibana/issues/198995)\r\nCloses
https://github.com/elastic/kibana/issues/198996\r\nPart of
https://github.com/elastic/kibana/issues/193245\r\n\r\nThis PR contains
the changes to migrate `traces` test folder to\r\nDeployment-agnostic
testing strategy.\r\nIt also adds support for deployment-agnostic
snapshots validation\r\n\r\n### How to test\r\n\r\n-
Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts
--grep=\"APM\"\r\n```\r\n\r\nIt's recommended to be run
against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n-
Stateful\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts
--grep=\"APM\"\r\n```\r\n\r\n- [ ] ~(OPTIONAL, only if a test has been
unskipped) Run flaky test\r\nsuite~\r\n- [x] local run for
serverless\r\n- [x] local run for stateful\r\n- [x] MKI run for
serverless\r\n\r\n---------\r\n\r\nCo-authored-by: Elastic Machine
<[email protected]>","sha":"3917d02c51e9c4a83013fe83c87b77fb12bd1fbb","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","backport:prev-minor","ci:project-deploy-observability","Team:obs-ux-infra_services"],"title":"[APM]
Migrate traces tests to deployment
agnostic","number":200561,"url":"https://github.com/elastic/kibana/pull/200561","mergeCommit":{"message":"[APM]
Migrate traces tests to deployment agnostic (#200561)\n\n##
Summary\r\n\r\nCloses
[#198995](https://github.com/elastic/kibana/issues/198995)\r\nCloses
https://github.com/elastic/kibana/issues/198996\r\nPart of
https://github.com/elastic/kibana/issues/193245\r\n\r\nThis PR contains
the changes to migrate `traces` test folder to\r\nDeployment-agnostic
testing strategy.\r\nIt also adds support for deployment-agnostic
snapshots validation\r\n\r\n### How to test\r\n\r\n-
Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts
--grep=\"APM\"\r\n```\r\n\r\nIt's recommended to be run
against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n-
Stateful\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts
--grep=\"APM\"\r\n```\r\n\r\n- [ ] ~(OPTIONAL, only if a test has been
unskipped) Run flaky test\r\nsuite~\r\n- [x] local run for
serverless\r\n- [x] local run for stateful\r\n- [x] MKI run for
serverless\r\n\r\n---------\r\n\r\nCo-authored-by: Elastic Machine
<[email protected]>","sha":"3917d02c51e9c4a83013fe83c87b77fb12bd1fbb"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/200561","number":200561,"mergeCommit":{"message":"[APM]
Migrate traces tests to deployment agnostic (#200561)\n\n##
Summary\r\n\r\nCloses
[#198995](https://github.com/elastic/kibana/issues/198995)\r\nCloses
https://github.com/elastic/kibana/issues/198996\r\nPart of
https://github.com/elastic/kibana/issues/193245\r\n\r\nThis PR contains
the changes to migrate `traces` test folder to\r\nDeployment-agnostic
testing strategy.\r\nIt also adds support for deployment-agnostic
snapshots validation\r\n\r\n### How to test\r\n\r\n-
Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts
--grep=\"APM\"\r\n```\r\n\r\nIt's recommended to be run
against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n-
Stateful\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts
--grep=\"APM\"\r\n```\r\n\r\n- [ ] ~(OPTIONAL, only if a test has been
unskipped) Run flaky test\r\nsuite~\r\n- [x] local run for
serverless\r\n- [x] local run for stateful\r\n- [x] MKI run for
serverless\r\n\r\n---------\r\n\r\nCo-authored-by: Elastic Machine
<[email protected]>","sha":"3917d02c51e9c4a83013fe83c87b77fb12bd1fbb"}}]}]
BACKPORT-->

Co-authored-by: Carlos Crespo <[email protected]>
Co-authored-by: Elastic Machine <[email protected]>
@kibanamachine kibanamachine added v8.18.0 and removed backport missing Added to PRs automatically when the are determined to be missing a backport. labels Nov 26, 2024
paulinashakirova pushed a commit to paulinashakirova/kibana that referenced this pull request Nov 26, 2024
## Summary

Closes [elastic#198995](elastic#198995)
Closes elastic#198996
Part of elastic#193245

This PR contains the changes to migrate `traces` test folder to
Deployment-agnostic testing strategy.
It also adds support for deployment-agnostic snapshots validation

### How to test

- Serverless

```
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts
node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep="APM"
```

It's recommended to be run against
[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)

- Stateful
```
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts
node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="APM"
```

- [ ] ~(OPTIONAL, only if a test has been unskipped) Run flaky test
suite~
- [x] local run for serverless
- [x] local run for stateful
- [x] MKI run for serverless

---------

Co-authored-by: Elastic Machine <[email protected]>
@Bluefinger
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.17

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

Bluefinger pushed a commit to Bluefinger/kibana that referenced this pull request Dec 9, 2024
## Summary

Closes [elastic#198995](elastic#198995)
Closes elastic#198996
Part of elastic#193245

This PR contains the changes to migrate `traces` test folder to
Deployment-agnostic testing strategy.
It also adds support for deployment-agnostic snapshots validation

### How to test

- Serverless

```
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts
node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep="APM"
```

It's recommended to be run against
[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)

- Stateful
```
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts
node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="APM"
```

- [ ] ~(OPTIONAL, only if a test has been unskipped) Run flaky test
suite~
- [x] local run for serverless
- [x] local run for stateful
- [x] MKI run for serverless

---------

Co-authored-by: Elastic Machine <[email protected]>
(cherry picked from commit 3917d02)
Bluefinger added a commit that referenced this pull request Dec 11, 2024
…203475)

# Backport

This will backport the following commits from `main` to `8.17`:
- [[APM] Migrate traces tests to deployment agnostic
(#200561)](#200561)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Carlos
Crespo","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-22T13:47:06Z","message":"[APM]
Migrate traces tests to deployment agnostic (#200561)\n\n##
Summary\r\n\r\nCloses
[#198995](https://github.com/elastic/kibana/issues/198995)\r\nCloses
https://github.com/elastic/kibana/issues/198996\r\nPart of
https://github.com/elastic/kibana/issues/193245\r\n\r\nThis PR contains
the changes to migrate `traces` test folder to\r\nDeployment-agnostic
testing strategy.\r\nIt also adds support for deployment-agnostic
snapshots validation\r\n\r\n### How to test\r\n\r\n-
Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts
--grep=\"APM\"\r\n```\r\n\r\nIt's recommended to be run
against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n-
Stateful\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts
--grep=\"APM\"\r\n```\r\n\r\n- [ ] ~(OPTIONAL, only if a test has been
unskipped) Run flaky test\r\nsuite~\r\n- [x] local run for
serverless\r\n- [x] local run for stateful\r\n- [x] MKI run for
serverless\r\n\r\n---------\r\n\r\nCo-authored-by: Elastic Machine
<[email protected]>","sha":"3917d02c51e9c4a83013fe83c87b77fb12bd1fbb","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","backport:prev-minor","ci:project-deploy-observability","Team:obs-ux-infra_services","v8.18.0"],"number":200561,"url":"https://github.com/elastic/kibana/pull/200561","mergeCommit":{"message":"[APM]
Migrate traces tests to deployment agnostic (#200561)\n\n##
Summary\r\n\r\nCloses
[#198995](https://github.com/elastic/kibana/issues/198995)\r\nCloses
https://github.com/elastic/kibana/issues/198996\r\nPart of
https://github.com/elastic/kibana/issues/193245\r\n\r\nThis PR contains
the changes to migrate `traces` test folder to\r\nDeployment-agnostic
testing strategy.\r\nIt also adds support for deployment-agnostic
snapshots validation\r\n\r\n### How to test\r\n\r\n-
Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts
--grep=\"APM\"\r\n```\r\n\r\nIt's recommended to be run
against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n-
Stateful\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts
--grep=\"APM\"\r\n```\r\n\r\n- [ ] ~(OPTIONAL, only if a test has been
unskipped) Run flaky test\r\nsuite~\r\n- [x] local run for
serverless\r\n- [x] local run for stateful\r\n- [x] MKI run for
serverless\r\n\r\n---------\r\n\r\nCo-authored-by: Elastic Machine
<[email protected]>","sha":"3917d02c51e9c4a83013fe83c87b77fb12bd1fbb"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","labelRegex":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/200561","number":200561,"mergeCommit":{"message":"[APM]
Migrate traces tests to deployment agnostic (#200561)\n\n##
Summary\r\n\r\nCloses
[#198995](https://github.com/elastic/kibana/issues/198995)\r\nCloses
https://github.com/elastic/kibana/issues/198996\r\nPart of
https://github.com/elastic/kibana/issues/193245\r\n\r\nThis PR contains
the changes to migrate `traces` test folder to\r\nDeployment-agnostic
testing strategy.\r\nIt also adds support for deployment-agnostic
snapshots validation\r\n\r\n### How to test\r\n\r\n-
Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts
--grep=\"APM\"\r\n```\r\n\r\nIt's recommended to be run
against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n-
Stateful\r\n```\r\nnode scripts/functional_tests_server --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\r\nnode
scripts/functional_test_runner --config
x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts
--grep=\"APM\"\r\n```\r\n\r\n- [ ] ~(OPTIONAL, only if a test has been
unskipped) Run flaky test\r\nsuite~\r\n- [x] local run for
serverless\r\n- [x] local run for stateful\r\n- [x] MKI run for
serverless\r\n\r\n---------\r\n\r\nCo-authored-by: Elastic Machine
<[email protected]>","sha":"3917d02c51e9c4a83013fe83c87b77fb12bd1fbb"}},{"branch":"8.x","label":"v8.18.0","labelRegex":"^v8.18.0$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/201386","number":201386,"state":"MERGED","mergeCommit":{"sha":"e127a2902a0bb93731aa02d5825fbdeee60bdfb9","message":"[8.x]
[APM] Migrate traces tests to deployment agnostic (#200561)
(#201386)\n\n# Backport\n\nThis will backport the following commits from
`main` to `8.x`:\n- [[APM] Migrate traces tests to deployment
agnostic\n(#200561)](https://github.com/elastic/kibana/pull/200561)\n\n<!---
Backport version: 9.4.3 -->\n\n### Questions ?\nPlease refer to the
[Backport
tool\ndocumentation](https://github.com/sqren/backport)\n\n<!--BACKPORT
[{\"author\":{\"name\":\"Carlos\nCrespo\",\"email\":\"[email protected]\"},\"sourceCommit\":{\"committedDate\":\"2024-11-22T13:47:06Z\",\"message\":\"[APM]\nMigrate
traces tests to deployment agnostic
(#200561)\\n\\n##\nSummary\\r\\n\\r\\nCloses\n[#198995](https://github.com/elastic/kibana/issues/198995)\\r\\nCloses\nhttps://github.com/elastic/kibana/issues/198996\\r\\nPart
of\nhttps://github.com//issues/193245\\r\\n\\r\\nThis PR
contains\nthe changes to migrate `traces` test folder
to\\r\\nDeployment-agnostic\ntesting strategy.\\r\\nIt also adds support
for deployment-agnostic\nsnapshots validation\\r\\n\\r\\n### How to
test\\r\\n\\r\\n-\nServerless\\r\\n\\r\\n```\\r\\nnode
scripts/functional_tests_server
--config\nx-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\\r\\nnode\nscripts/functional_test_runner
--config\nx-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\n--grep=\\\"APM\\\"\\r\\n```\\r\\n\\r\\nIt's
recommended to be
run\nagainst\\r\\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\\r\\n\\r\\n-\nStateful\\r\\n```\\r\\nnode
scripts/functional_tests_server
--config\nx-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\\r\\nnode\nscripts/functional_test_runner
--config\nx-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\n--grep=\\\"APM\\\"\\r\\n```\\r\\n\\r\\n-
[ ] ~(OPTIONAL, only if a test has been\nunskipped) Run flaky
test\\r\\nsuite~\\r\\n- [x] local run for\nserverless\\r\\n- [x] local
run for stateful\\r\\n- [x] MKI run
for\nserverless\\r\\n\\r\\n---------\\r\\n\\r\\nCo-authored-by: Elastic
Machine\n<[email protected]>\",\"sha\":\"3917d02c51e9c4a83013fe83c87b77fb12bd1fbb\",\"branchLabelMapping\":{\"^v9.0.0$\":\"main\",\"^v8.18.0$\":\"8.x\",\"^v(\\\\d+).(\\\\d+).\\\\d+$\":\"$1.$2\"}},\"sourcePullRequest\":{\"labels\":[\"release_note:skip\",\"v9.0.0\",\"backport:prev-minor\",\"ci:project-deploy-observability\",\"Team:obs-ux-infra_services\"],\"title\":\"[APM]\nMigrate
traces tests to
deployment\nagnostic\",\"number\":200561,\"url\":\"https://github.com/elastic/kibana/pull/200561\",\"mergeCommit\":{\"message\":\"[APM]\nMigrate
traces tests to deployment agnostic
(#200561)\\n\\n##\nSummary\\r\\n\\r\\nCloses\n[#198995](https://github.com/elastic/kibana/issues/198995)\\r\\nCloses\nhttps://github.com/elastic/kibana/issues/198996\\r\\nPart
of\nhttps://github.com//issues/193245\\r\\n\\r\\nThis PR
contains\nthe changes to migrate `traces` test folder
to\\r\\nDeployment-agnostic\ntesting strategy.\\r\\nIt also adds support
for deployment-agnostic\nsnapshots validation\\r\\n\\r\\n### How to
test\\r\\n\\r\\n-\nServerless\\r\\n\\r\\n```\\r\\nnode
scripts/functional_tests_server
--config\nx-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\\r\\nnode\nscripts/functional_test_runner
--config\nx-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\n--grep=\\\"APM\\\"\\r\\n```\\r\\n\\r\\nIt's
recommended to be
run\nagainst\\r\\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\\r\\n\\r\\n-\nStateful\\r\\n```\\r\\nnode
scripts/functional_tests_server
--config\nx-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\\r\\nnode\nscripts/functional_test_runner
--config\nx-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\n--grep=\\\"APM\\\"\\r\\n```\\r\\n\\r\\n-
[ ] ~(OPTIONAL, only if a test has been\nunskipped) Run flaky
test\\r\\nsuite~\\r\\n- [x] local run for\nserverless\\r\\n- [x] local
run for stateful\\r\\n- [x] MKI run
for\nserverless\\r\\n\\r\\n---------\\r\\n\\r\\nCo-authored-by: Elastic
Machine\n<[email protected]>\",\"sha\":\"3917d02c51e9c4a83013fe83c87b77fb12bd1fbb\"}},\"sourceBranch\":\"main\",\"suggestedTargetBranches\":[],\"targetPullRequestStates\":[{\"branch\":\"main\",\"label\":\"v9.0.0\",\"branchLabelMappingKey\":\"^v9.0.0$\",\"isSourceBranch\":true,\"state\":\"MERGED\",\"url\":\"https://github.com/elastic/kibana/pull/200561\",\"number\":200561,\"mergeCommit\":{\"message\":\"[APM]\nMigrate
traces tests to deployment agnostic
(#200561)\\n\\n##\nSummary\\r\\n\\r\\nCloses\n[#198995](https://github.com/elastic/kibana/issues/198995)\\r\\nCloses\nhttps://github.com/elastic/kibana/issues/198996\\r\\nPart
of\nhttps://github.com//issues/193245\\r\\n\\r\\nThis PR
contains\nthe changes to migrate `traces` test folder
to\\r\\nDeployment-agnostic\ntesting strategy.\\r\\nIt also adds support
for deployment-agnostic\nsnapshots validation\\r\\n\\r\\n### How to
test\\r\\n\\r\\n-\nServerless\\r\\n\\r\\n```\\r\\nnode
scripts/functional_tests_server
--config\nx-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\\r\\nnode\nscripts/functional_test_runner
--config\nx-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\n--grep=\\\"APM\\\"\\r\\n```\\r\\n\\r\\nIt's
recommended to be
run\nagainst\\r\\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\\r\\n\\r\\n-\nStateful\\r\\n```\\r\\nnode
scripts/functional_tests_server
--config\nx-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\\r\\nnode\nscripts/functional_test_runner
--config\nx-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\n--grep=\\\"APM\\\"\\r\\n```\\r\\n\\r\\n-
[ ] ~(OPTIONAL, only if a test has been\nunskipped) Run flaky
test\\r\\nsuite~\\r\\n- [x] local run for\nserverless\\r\\n- [x] local
run for stateful\\r\\n- [x] MKI run
for\nserverless\\r\\n\\r\\n---------\\r\\n\\r\\nCo-authored-by: Elastic
Machine\n<[email protected]>\",\"sha\":\"3917d02c51e9c4a83013fe83c87b77fb12bd1fbb\"}}]}]\nBACKPORT-->\n\nCo-authored-by:
Carlos Crespo <[email protected]>\nCo-authored-by:
Elastic Machine <[email protected]>"}}]}]
BACKPORT-->

Co-authored-by: Carlos Crespo <[email protected]>
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this pull request Dec 12, 2024
## Summary

Closes [elastic#198995](elastic#198995)
Closes elastic#198996
Part of elastic#193245

This PR contains the changes to migrate `traces` test folder to
Deployment-agnostic testing strategy.
It also adds support for deployment-agnostic snapshots validation

### How to test

- Serverless

```
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts
node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep="APM"
```

It's recommended to be run against
[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)

- Stateful
```
node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts
node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="APM"
```

- [ ] ~(OPTIONAL, only if a test has been unskipped) Run flaky test
suite~
- [x] local run for serverless
- [x] local run for stateful
- [x] MKI run for serverless

---------

Co-authored-by: Elastic Machine <[email protected]>
@mistic
Copy link
Member

mistic commented Dec 12, 2024

This PR didn't make it on time for the latest v8.17.0 BC. Updating the labels.

@mistic mistic added v8.17.1 and removed v8.17.0 labels Dec 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) ci:project-deploy-observability Create an Observability project release_note:skip Skip the PR/issue when compiling release notes Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team v8.17.1 v8.18.0 v9.0.0
Projects
None yet
7 participants