You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#7502 & #7475 broke the e2e test suite because the e2e Studio is importing the schema types from the test-studio but those PRs didn't add the required plugins to the e2e Studio config.
efps — editor "frames per second". The number of updates assumed to be possible within a second.
Derived from input latency. efps = 1000 / input_latency
Detailed information
🏠 Reference result
The performance result of sanity@latest
Benchmark
latency
p75
p90
p99
blocking time
test duration
article (title)
53ms
60ms
67ms
141ms
326ms
12.7s
article (body)
21ms
26ms
40ms
156ms
382ms
6.5s
article (string inside object)
46ms
52ms
59ms
298ms
411ms
8.0s
article (string inside array)
52ms
56ms
66ms
169ms
522ms
8.5s
recipe (name)
22ms
26ms
31ms
46ms
0ms
7.6s
recipe (description)
18ms
20ms
26ms
38ms
0ms
4.7s
recipe (instructions)
7ms
9ms
9ms
11ms
0ms
3.2s
synthetic (title)
52ms
55ms
70ms
127ms
629ms
14.1s
synthetic (string inside object)
56ms
62ms
91ms
542ms
1522ms
9.3s
🧪 Experiment result
The performance result of this branch
Benchmark
latency
p75
p90
p99
blocking time
test duration
article (title)
51ms
57ms
73ms
253ms
238ms
12.6s
article (body)
19ms
22ms
28ms
197ms
226ms
6.1s
article (string inside object)
47ms
50ms
57ms
118ms
206ms
7.6s
article (string inside array)
53ms
58ms
68ms
297ms
400ms
8.2s
recipe (name)
22ms
24ms
28ms
42ms
0ms
7.2s
recipe (description)
19ms
20ms
22ms
28ms
0ms
4.7s
recipe (instructions)
7ms
9ms
10ms
12ms
0ms
3.4s
synthetic (title)
54ms
56ms
65ms
153ms
658ms
13.4s
synthetic (string inside object)
55ms
56ms
60ms
71ms
208ms
7.7s
📚 Glossary
column definitions
benchmark — the name of the test, e.g. "article", followed by the label of the field being measured, e.g. "(title)".
latency — the time between when a key was pressed and when it was rendered. derived from a set of samples. the median (p50) is shown to show the most common latency.
p75 — the 75th percentile of the input latency in the test run. 75% of the sampled inputs in this benchmark were processed faster than this value. this provides insight into the upper range of typical performance.
p90 — the 90th percentile of the input latency in the test run. 90% of the sampled inputs were faster than this. this metric helps identify slower interactions that occurred less frequently during the benchmark.
p99 — the 99th percentile of the input latency in the test run. only 1% of sampled inputs were slower than this. this represents the worst-case scenarios encountered during the benchmark, useful for identifying potential performance outliers.
blocking time — the total time during which the main thread was blocked, preventing user input and UI updates. this metric helps identify performance bottlenecks that may cause the interface to feel unresponsive.
test duration — how long the test run took to complete.
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
#7502 & #7475 broke the e2e test suite because the e2e Studio is importing the schema types from the
test-studio
but those PRs didn't add the required plugins to the e2e Studio config.What to review
If CI is happy we should be good
Notes for release
n/a