lens esql generation

[ppisljar]

Summary

updates lens so it uses ESQL when requesting data from elasticsearch rather than DSL when that is possible.

nothing should change for the user, everything should work exactly as before

but when going to inspector you will be able to see that in some cases we will send out ESQL request.

the feature is only enabled when the lens.enable_esql feature flag is enabled.

at the moment this covers very few cases, but rather builds the necessary infrastructure so we can keep improving this over time:

• user has to be in UTC timezone
• user needs to use set of lens operations that are supported

how to test:

1. put this in your kibana.dev.yaml:

feature_flags.overrides:
  lens.enable_esql: true

2. go to advanced settings and set timezone to UTC
3. go to lens, configure a chart (for example a metric chart showing average of products.price
4. go to inspector -> requests and you can see that we sent out ESQL query
5. visually nothing should change

todo:

• make sure CI is green when the feature flag is enabled

[stratoula]

I see an error in the console when I drop Records "field"

yes something goes wrong with the xAxis label

[stratoula]

ok console error gone and x-axis working as expected. This is the only thing not working correctly #196049 (comment)

[lukasolson]

I think we need to round up here . . . right now the quick range of "Today" ends up being the same exact from/to.

Suggested change

	to: DateMath.parse(input.timeRange.to),
	to: DateMath.parse(input.timeRange.to, { roundUp: true }),

Screen.Recording.2025-01-22.at.1.42.08.PM.mov

[lukasolson]

Hmm, not sure why but this issue is still happening after the change I suggested.

[ppisljar]

resolved in ec2506e

[stratoula]

This looks great Peter, LGTM!

[afharo]

Is this the first use of the Feature Flags service? Nice! 🙌

[afharo]

Please, remember to remove this before merging

[ppisljar]

this was just added in the commit named revert before merging to check once again that CI is passing when this flag is on

[afharo]

Thanks for confirming! I'm sure that Core won't be needed when this is removed :)

Core review won't be needed when the changes to kibana.yml are removed

[elasticmachine]

⏳ Build in-progress, with failures

• Buildkite Build
• Commit: b4555d3

Failed CI Steps

• FTR Configs #65
• FTR Configs #65
• FTR Configs #102

Test Failures

• [job] [logs] FTR Configs #102 / lens app - group 6 lens rollup tests should allow seamless transition to and from table view
• [job] [logs] FTR Configs #65 / Search session sharing Search session sharing with lens should share search session with by value lens and don't share with by reference
• [job] [logs] FTR Configs #65 / Search session sharing Search session sharing with lens should share search session with by value lens and don't share with by reference

History

• 💚 Build #271393 succeeded dd72779
• 💚 Build #270478 succeeded 1e12b49
• 💔 Build #270427 failed c5c6108
• 💛 Build #270317 was flaky e90b6af
• 💚 Build #270252 succeeded f92dbf4
• 💔 Build #269251 failed 317c93b

[ppisljar]

as expected rollup and search sessions tests fail when turning the flag on, everything else passes