[Helm] Implement values.schema.json

[pkoutsovasilis]

What does this PR do?

This PR does the following:

• introduces a value.schema.json inside the chart which is used by Helm to validate the input values.yaml
• splits ESPlainAuth output type into ESPlainAuthBasic and ESPlainAuthAPI types, favouring explicitness, for better validation and
• introduces hostNetwork as an option in an Agent preset

Why is it important?

By having a value.schema.json we can reduce validation checks inside the templates of the Helm chart (less ifs inside templates). Furthermore, many text editors/IDEs offer the capability to import the schema and hence get hints and proposal write writing a values.yaml for the Helm chart

Checklist

• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I have made corresponding change to the default configuration files
• I have added tests that prove my fix is effective or that my feature works
• I have added an entry in ./changelog/fragments using the changelog tool
• I have added an integration test or an E2E test

Disruptive User Impact

N/A

How to test this PR locally

Checking validation

run the following which is actually missing required values

helm template test ./deploy/helm/elastic-agent --set kubernetes.enabled=true  --set outputs.default.type=ESSecretAuthBasic  --set agent.fleet.enabled=true --set agent.fleet.token=""

you should see the following errors

Error: values don't meet the specifications of the schema(s) in the following chart(s):
elastic-agent:
- agent.fleet: Must validate "then" as "if" was valid
- agent.fleet: Must validate at least one schema (anyOf)
- agent.fleet.url: Does not match format 'uri'
- agent.fleet.kibanaHost: Does not match format 'uri'
- agent.fleet.kibanaUser: String length must be greater than or equal to 1
- agent.fleet.kibanaPassword: String length must be greater than or equal to 1
- outputs.default: Must validate "then" as "if" was valid
- outputs.default.secretName: String length must be greater than or equal to 1
- outputs.default: Must validate all the schemas (allOf)

Checking hints

1. Create a new values.yaml file with your text editor/IDE (tested with vscode)
2. Add on top this comment

   # yaml-language-server: $schema=elastic-agent/deploy/helm/elastic-agent/values.schema.json

3. For any fields you add below the above line you should get hints

Related issues

N/A

[mergify]

This pull request does not have a backport label. Could you fix it @pkoutsovasilis? 🙏
To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

• backport-./d./d is the label to automatically backport to the 8./d branch. /d is the digit

[mergify]

backport-v8.x has been added to help with the transition to the new branch 8.x.
If you don't need it please use backport-skip label and remove the backport-8.x label.

[elasticmachine]

Pinging @elastic/elastic-agent-control-plane (Team:Elastic-Agent-Control-Plane)

[pchila]

I had a quick glance at the values.schema.json for a couple of validations that were moved from the helm template itself and it looks consistent.

LGTM

[swiatekm]

Nice!

[elastic-sonarqube]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarQube