Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Security Solution] Rule Management failed tests 8.18 #209132

Open
1 of 22 tasks
banderror opened this issue Jan 31, 2025 · 3 comments
Open
1 of 22 tasks

[Security Solution] Rule Management failed tests 8.18 #209132

banderror opened this issue Jan 31, 2025 · 3 comments
Labels
8.18 candidate Meta Team:Detection Rule Management Security Detection Rule Management Team Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. technical debt Improvement of the software architecture and operational architecture test_ui_functional test test-api-integration

Comments

@banderror
Copy link
Contributor

banderror commented Jan 31, 2025 •
edited
Loading

Summary

Fix and unskip flaky/failing tests that belong to the Rule Management team.

Our "inbox" of failed and skipped tests:

Sub-tasks

Prebuilt rules
Preview Give feedback
  1. [Security Solution] Unskip tests for preventing non-customizable fields from updating for Prebuilt rule types #195921
    8.18 candidate Feature:Prebuilt Detection Rules Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp skipped-test
    dplumlee jpdjere
  2. Failing test: Rules Management - Prebuilt Rules Management Integration Tests - ESS Env - Trial License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/bootstrap_prebuilt_rules·ts - Rules Management - Prebuilt Rules - Prebuilt Rules Management @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules should skip installing fleet packages if they are already installed #197108
    8.18 candidate Feature:Prebuilt Detection Rules Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp failed-test
    banderror xcrzx
  3. Failing test: Rules Management - Prebuilt Rules Management Integration Tests - ESS Env - Trial License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/bootstrap_prebuilt_rules·ts - Rules Management - Prebuilt Rules - Prebuilt Rules Management @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules should install fleet packages required for detection engine to function #203632
    8.18 candidate Feature:Prebuilt Detection Rules Team:Detection Rule Management failed-test
    banderror xcrzx
  4. Failing test: Rules Management - Prebuilt Rules Management Integration Tests - Serverless Env - Complete License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/bootstrap_prebuilt_rules·ts - Rules Management - Prebuilt Rules - Prebuilt Rules Management @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules should skip installing fleet packages if they are already installed #202037
    8.18 candidate Feature:Prebuilt Detection Rules Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp blocker failed-test legit-flake skipped-test v9.0.0 v9.1.0
    banderror xcrzx
  5. Failing test: Rules Management - Prebuilt Rules Management Integration Tests - Serverless Env - Complete License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/install_prebuilt_rules_with_historical_versions·ts - Rules Management - Prebuilt Rules - Prebuilt Rules Management @ess @serverless @skipInServerlessMKI install prebuilt rules from package with historical versions with mock rule assets using current endpoint should install prebuilt rules #201715
    8.18 candidate Feature:Prebuilt Detection Rules Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp failed-test legit-flake
  6. Failing test: Rules Management - Prebuilt Rules Management Integration Tests - Serverless Env - Complete License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/fleet_integration·ts - Rules Management - Prebuilt Rules - Prebuilt Rules Management @ess @serverless @skipInServerlessMKI install_prebuilt_rules_from_real_package should install prebuilt rules from the package storage #208492
    8.18 candidate Feature:Prebuilt Detection Rules Team:Detection Rule Management failed-test legit-flake
  7. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/prebuilt_rules_preview·cy·ts - Detection rules, Prebuilt Rules Installation and Update workflow Installation of prebuilt rules User can see correct rule information in preview before installing New terms rule properties New terms rule properties #200015
    8.18 candidate Feature:Prebuilt Detection Rules Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp failed-test legit-flake
    nikitaindik
  8. Failing test: Rules Management - Bundled Prebuilt Rules Integration Tests - Serverless Env - Complete License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/bundled_prebuilt_rules_package/trial_license_complete_tier/install_latest_bundled_prebuilt_rules·ts - Rules Management - Prebuilt Rules - Bundled Prebuilt Rules Package @ess @serverless @skipInQA install_bundled_prebuilt_rules should install prebuilt rules from the package that comes bundled with Kibana #180087
    Feature:Prebuilt Detection Rules Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp blocker failed-test legit-flake skipped-test

Rule management
Preview Give feedback
  1. Failing test: Rules Management - Rule Bulk Actions Integration Tests - ESS Env - Trial License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/rule_bulk_actions/trial_license_complete_tier/perform_bulk_action_ess·ts - Rules Management - Rule Bulk Action API @ess perform_bulk_action - ESS specific logic should disable rules and migrate actions #196462
    2 of 3
    8.18 candidate Feature:Rule Management Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp blocker failed-test skipped-test v8.19.0 v9.1.0
    maximpn
  2. Failing test: Rules Management - Rule Import And Export Integration Tests - ESS Env - Trial License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/rule_import_export/trial_license_complete_tier/import_rules·ts - Rules Management - Rule import export API @ess @serverless @skipInServerlessMKI import_rules importing rules with an index @skipInServerless migrate pre-8.0 action connector ids "before each" hook for "importing a non-default-space 7.16 rule with a connector made in the non-default space into the default space should result in a 404 if the file does not contain connectors" #205777
    8.18 candidate Feature:Rule Import/Export Team:Detection Rule Management failed-test
  3. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_details/common_flows·cy·ts - Common rule detail flows Deletes one rule from detail page Deletes one rule from detail page #206365
    8.18 candidate Feature:Rule Details Team:Detection Rule Management failed-test
  4. [Security Solution] Flaky test: bulk_edit_rules_actions.cy.ts #176908
    Feature:Rule Actions Feature:Rule Management Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp failed-test
  5. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/bulk_actions/bulk_edit_rules_actions·cy·ts - Detection rules, bulk edit of rule actions Restricted action privileges User with no privileges can't add rule actions User with no privileges can't add rule actions #178810
    Feature:Rule Actions Feature:Rule Management Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp failed-test
  6. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/bulk_actions/bulk_edit_rules_actions·cy·ts - Detection rules, bulk edit of rule actions Restricted action privileges User with no privileges can't add rule actions User with no privileges can't add rule actions #179256
    Feature:Rule Actions Feature:Rule Management Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp failed-test
  7. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rules_table/rules_table_persistent_state·cy·ts - Rules table: persistent state while on a happy path "before each" hook for "loads from the url" "before each" hook for "loads from the url" #179477
    Feature:Rule Management Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp failed-test

Rule monitoring
Preview Give feedback
  1. Failing test: Rules Management - Rule Management Integration Tests - Serverless Env - Complete Tier.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/rule_management/trial_license_complete_tier/get_rule_execution_results·ts - Rules Management - Rule Management API @ess @serverless Get Rule Execution Results should return execution events ordered by @timestamp desc when a status filter is active and there are more than 1000 executions #177223
    Feature:Rule Monitoring Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp blocker failed-test legit-flake skipped-test
  2. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_details/execution_log·cy·ts - Event log should display the execution log should display the execution log #184360
    Team:Detection Rule Management blocker failed-test skipped-test v8.15.0

Rule creation
Preview Give feedback
  1. Failing test: Jest Tests.x-pack/plugins/security_solution/public/detection_engine/rule_creation_ui/components/step_define_rule - StepDefineRule related integrations submits saved early related integrations #199700
    8.18 candidate Team:Detection Rule Management blocker failed-test skipped-test v8.17.0
    maximpn
  2. Failing test: Jest Tests.x-pack/plugins/security_solution/public/detection_engine/rule_creation_ui/components/step_define_rule - StepDefineRule related integrations submits a selected related integration #199648
    8.18 candidate Team:Detection Rule Management blocker failed-test skipped-test v8.17.0 v9.0.0
    maximpn

Misc
Preview Give feedback
  1. [Security Solution] Unskip tests broken by 181616 and fixed by 182432 #182682
    0 of 8
    Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp test
    banderror
  2. [Security Solution] Fix the periodic pipeline for the Rule Management tests #182685
    3 of 3
    Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp test
    banderror
  3. [Security Solution] Unskip maintenance window callout Cypress tests skipped because of a bug in serverless roles #184160
    Feature:Rule Management Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp skipped-test
    nikitaindik
@banderror banderror added 8.18 candidate Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:Detection Rule Management Security Detection Rule Management Team Team:Detections and Resp Security Detection Response Team test labels Jan 31, 2025
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@elasticmachine
Copy link
Contributor

Pinging @elastic/security-detection-rule-management (Team:Detection Rule Management)

@elasticmachine
Copy link
Contributor

Pinging @elastic/security-detections-response (Team:Detections and Resp)

@banderror banderror added Meta test_ui_functional technical debt Improvement of the software architecture and operational architecture test-api-integration labels Jan 31, 2025
@banderror banderror marked this as a duplicate of #187301 Jan 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
8.18 candidate Meta Team:Detection Rule Management Security Detection Rule Management Team Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. technical debt Improvement of the software architecture and operational architecture test_ui_functional test test-api-integration
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@banderror @elasticmachine