Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support flattened data_stream fields #3191

Closed
belimawr opened this issue Aug 4, 2023 · 3 comments · Fixed by elastic/beats#36516 or #3465
Closed

Support flattened data_stream fields #3191

belimawr opened this issue Aug 4, 2023 · 3 comments · Fixed by elastic/beats#36516 or #3465
Assignees
Labels
bug Something isn't working Team:Elastic-Agent Label for the Agent team

Comments

@belimawr
Copy link
Contributor

belimawr commented Aug 4, 2023

The Elastic-Agent supports flattened YAML keys in its configuration files (e.g: agent.logging.level) however the data_stream object in input configurations (both the input root and the streams array) do not recognise flattened data_stream.* keys.

The following does not work:

inputs:
  - type: filestream
    id: unique-id-per-input
    data_stream.dataset: mystuff
    paths:
      - /var/log/my-file/my.log*

And this works:

inputs:
  - type: filestream
    id: unique-id-per-input
    data_stream:
      dataset: mystuff
    paths:
      - /var/log/my-file/my.log*

Both notations should work.

@belimawr belimawr added bug Something isn't working Team:Elastic-Agent Label for the Agent team labels Aug 4, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/elastic-agent (Team:Elastic-Agent)

@ruflin
Copy link
Contributor

ruflin commented Sep 11, 2023

@mdbirnstiehl @yngrdyn This should allow us to simplify some of our configs in the docs and potentially onboarding flow.

@cmacknz
Copy link
Member

cmacknz commented Sep 18, 2023

Re-opening as part of this work had to be reverted due to a bug starting Elastic Agent inputs: elastic/beats#36610

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Team:Elastic-Agent Label for the Agent team
Projects
None yet
4 participants