Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Fleet] Periodically clean up revisions in .fleet-policies system index #206993

Open
kpollich opened this issue Jan 16, 2025 · 2 comments
Open

[Fleet] Periodically clean up revisions in .fleet-policies system index #206993

kpollich opened this issue Jan 16, 2025 · 2 comments
Labels
Team:Fleet Team label for Observability Data Collection Fleet team

Comments

@kpollich
Copy link
Member

We've introduced automatic cleanup of .fleet-agents records through the inactivity + unenrollment timeout feature. We should also have some notion of automatic cleanup for .fleet-policies, where we currently store the full revision history of all agent policies. This causes performance issues on long-running clusters.

Options to consider

  • Kibana background task to clean up revision data
  • ILM policy to trigger cleanup at a certain index size or only keeps documents newer than some age
@kpollich kpollich added the Team:Fleet Team label for Observability Data Collection Fleet team label Jan 16, 2025
@elasticmachine
Copy link
Contributor

Pinging @elastic/fleet (Team:Fleet)

@kpollich
Copy link
Member Author

cc @lucabelluccini

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Team:Fleet Team label for Observability Data Collection Fleet team
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@kpollich @elasticmachine