Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests: do not merge #8236

Closed
wants to merge 1 commit into from
Closed

tests: do not merge #8236

wants to merge 1 commit into from

Conversation

pedrobonamin
Copy link
Contributor

Description

What to review

Testing

Notes for release

Copy link

vercel bot commented Jan 10, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
performance-studio ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 10, 2025 2:52pm
test-studio ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 10, 2025 2:52pm
3 Skipped Deployments
Name Status Preview Comments Updated (UTC)
studio-workshop ⬜️ Ignored (Inspect) Jan 10, 2025 2:52pm
test-next-studio ⬜️ Ignored (Inspect) Jan 10, 2025 2:52pm
page-building-studio ⬜️ Skipped (Inspect) Jan 10, 2025 2:52pm

Copy link
Contributor

No changes to documentation

Copy link
Contributor

Component Testing Report Updated Jan 10, 2025 2:58 PM (UTC)

❌ Failed Tests (48) -- expand for details
File Status Duration Passed Skipped Failed
comments/CommentInput.spec.tsx ❌ Failed (Inspect) 40s 10 0 5
formBuilder/ArrayInput.spec.tsx ❌ Failed (Inspect) 7s 2 0 1
formBuilder/inputs/PortableText/Annotations.spec.tsx ❌ Failed (Inspect) 23s 4 0 2
formBuilder/inputs/PortableText/copyPaste/CopyPaste.spec.tsx ❌ Failed (Inspect) 50s 11 1 6
formBuilder/inputs/PortableText/copyPaste/CopyPasteFields.spec.tsx ✅ Passed (Inspect) 0s 0 12 0
formBuilder/inputs/PortableText/Decorators.spec.tsx ❌ Failed (Inspect) 16s 4 0 2
formBuilder/inputs/PortableText/DisableFocusAndUnset.spec.tsx ❌ Failed (Inspect) 8s 2 0 1
formBuilder/inputs/PortableText/DragAndDrop.spec.tsx ❌ Failed (Inspect) 16s 4 0 2
formBuilder/inputs/PortableText/FocusTracking.spec.tsx ❌ Failed (Inspect) 40s 10 0 5
formBuilder/inputs/PortableText/Input.spec.tsx ❌ Failed (Inspect) 53s 14 0 7
formBuilder/inputs/PortableText/ObjectBlock.spec.tsx ❌ Failed (Inspect) 1m 1s 12 0 6
formBuilder/inputs/PortableText/PresenceCursors.spec.tsx ❌ Failed (Inspect) 7s 2 9 1
formBuilder/inputs/PortableText/Styles.spec.tsx ❌ Failed (Inspect) 16s 4 0 2
formBuilder/inputs/PortableText/Toolbar.spec.tsx ❌ Failed (Inspect) 1m 41s 13 0 8
formBuilder/tree-editing/TreeEditing.spec.tsx ✅ Passed (Inspect) 0s 0 3 0
formBuilder/tree-editing/TreeEditingNestedObjects.spec.tsx ✅ Passed (Inspect) 0s 0 3 0

Copy link
Contributor

⚡️ Editor Performance Report

Updated Fri, 10 Jan 2025 15:00:18 GMT

Benchmark reference
latency of sanity@latest
experiment
latency of this branch
Δ (%)
latency difference
article (title) 24.1 efps (42ms) 20.2 efps (50ms) +8ms (+19.3%)
article (body) 59.9 efps (17ms) 50.5 efps (20ms) +3ms (+18.6%)
article (string inside object) 25.6 efps (39ms) 19.6 efps (51ms) +12ms (+30.8%) 🔴
article (string inside array) 22.2 efps (45ms) 18.3 efps (55ms) +10ms (+21.1%) 🔴
recipe (name) 50.0 efps (20ms) 32.3 efps (31ms) +11ms (+55.0%) 🔴
recipe (description) 58.8 efps (17ms) 35.7 efps (28ms) +11ms (+64.7%) 🔴
recipe (instructions) 99.9+ efps (5ms) 99.9+ efps (6ms) +1ms (-/-%)
synthetic (title) 18.0 efps (56ms) 7.3 efps (137ms) +82ms (+146.8%) 🔴
synthetic (string inside object) 18.5 efps (54ms) 7.6 efps (132ms) +78ms (+143.5%) 🔴

efps — editor "frames per second". The number of updates assumed to be possible within a second.

Derived from input latency. efps = 1000 / input_latency

Detailed information

🏠 Reference result

The performance result of sanity@latest

Benchmark latency p75 p90 p99 blocking time test duration
article (title) 42ms 51ms 65ms 433ms 871ms 10.4s
article (body) 17ms 19ms 27ms 212ms 368ms 6.1s
article (string inside object) 39ms 41ms 44ms 169ms 166ms 6.6s
article (string inside array) 45ms 48ms 54ms 85ms 317ms 7.3s
recipe (name) 20ms 21ms 24ms 37ms 0ms 7.6s
recipe (description) 17ms 19ms 23ms 38ms 0ms 4.5s
recipe (instructions) 5ms 6ms 7ms 10ms 0ms 2.9s
synthetic (title) 56ms 60ms 68ms 303ms 1018ms 28.1s
synthetic (string inside object) 54ms 56ms 61ms 485ms 801ms 8.5s

🧪 Experiment result

The performance result of this branch

Benchmark latency p75 p90 p99 blocking time test duration
article (title) 50ms 75ms 93ms 458ms 1155ms 11.7s
article (body) 20ms 23ms 37ms 194ms 391ms 5.9s
article (string inside object) 51ms 54ms 60ms 92ms 439ms 8.3s
article (string inside array) 55ms 60ms 68ms 298ms 966ms 8.5s
recipe (name) 31ms 33ms 37ms 49ms 5ms 8.1s
recipe (description) 28ms 32ms 35ms 74ms 37ms 5.6s
recipe (instructions) 6ms 7ms 8ms 41ms 0ms 3.1s
synthetic (title) 137ms 145ms 167ms 602ms 6525ms 21.1s
synthetic (string inside object) 132ms 140ms 166ms 748ms 7134ms 17.2s

📚 Glossary

column definitions

  • benchmark — the name of the test, e.g. "article", followed by the label of the field being measured, e.g. "(title)".
  • latency — the time between when a key was pressed and when it was rendered. derived from a set of samples. the median (p50) is shown to show the most common latency.
  • p75 — the 75th percentile of the input latency in the test run. 75% of the sampled inputs in this benchmark were processed faster than this value. this provides insight into the upper range of typical performance.
  • p90 — the 90th percentile of the input latency in the test run. 90% of the sampled inputs were faster than this. this metric helps identify slower interactions that occurred less frequently during the benchmark.
  • p99 — the 99th percentile of the input latency in the test run. only 1% of sampled inputs were slower than this. this represents the worst-case scenarios encountered during the benchmark, useful for identifying potential performance outliers.
  • blocking time — the total time during which the main thread was blocked, preventing user input and UI updates. this metric helps identify performance bottlenecks that may cause the interface to feel unresponsive.
  • test duration — how long the test run took to complete.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant