Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NoQA] Skip calling specific APIs in the E2E tests #53704

Merged

Conversation

hannojg
Copy link
Contributor

@hannojg hannojg commented Dec 6, 2024

Explanation of Change

Earlier we had this PR:

but we add the network interception to the wrong place. This moves it to the right one.

Fixed Issues

$
PROPOSAL:

Tests

Run npm run test:e2e:dev and make sure:

  • the tests are still working
  • you see in the logs that the calls are skipped

CleanShot 2024-12-06 at 16 36 52

Offline tests

QA Steps

See testing

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I used JaimeGPT to get English > Spanish translation. I then posted it in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
iOS: Native
iOS: mWeb Safari
MacOS: Chrome / Safari
MacOS: Desktop

@@ -155,6 +155,13 @@ export default function installNetworkInterceptor(
const options = fetchArgsGetRequestInit(args);
const headers = getFetchRequestHeadersAsObject(options);
const url = fetchArgsGetUrl(args);

// Don't process these specific API commands because running them over and over again in the tests hammers the server in a bad way.
if (url.includes('command=OptInToPushNotifications') || url.includes('command=OptOutOfPushNotifications')) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if (url.includes('command=OptInToPushNotifications') || url.includes('command=OptOutOfPushNotifications')) {
if (url.includes('api/OptInToPushNotifications') || url.includes('api/OptOutOfPushNotifications')) {

src/libs/E2E/utils/NetworkInterceptor.ts Outdated Show resolved Hide resolved
@hannojg hannojg changed the title Skip calling specific APIs in the E2E tests [NoQA] Skip calling specific APIs in the E2E tests Dec 6, 2024
@hannojg hannojg marked this pull request as ready for review December 6, 2024 15:41
@hannojg hannojg requested a review from a team as a code owner December 6, 2024 15:41
@melvin-bot melvin-bot bot requested review from stitesExpensify and removed request for a team December 6, 2024 15:41
Copy link

melvin-bot bot commented Dec 6, 2024

@stitesExpensify Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@hannojg hannojg requested a review from tgolen December 6, 2024 15:44
@tgolen
Copy link
Contributor

tgolen commented Dec 6, 2024

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • For any bug fix or new feature in this PR, I verified that sufficient unit tests are included to prevent regressions in this flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
iOS: Native
iOS: mWeb Safari
MacOS: Chrome / Safari
MacOS: Desktop

@tgolen tgolen merged commit 33c5f76 into Expensify:main Dec 6, 2024
18 checks passed
@OSBotify
Copy link
Contributor

OSBotify commented Dec 6, 2024

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Dec 6, 2024
Copy link
Contributor

github-actions bot commented Dec 6, 2024

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Linking 795.466 ms → 904.723 ms (+109.257 ms, +13.7%) 🔴
Show details
Name Duration
Linking Baseline
Mean: 795.466 ms
Stdev: 224.402 ms (28.2%)
Runs: 518.663290001452 525.6589350029826 530.9691160023212 531.3445240035653 531.803915001452 540.2083749994636 557.0328769981861 557.275634996593 563.0047610029578 563.6645509973168 564.8861080035567 572.3428549990058 572.5804039984941 580.9011640027165 589.8726800009608 591.0540369972587 593.0786140039563 599.297201000154 599.9302570000291 603.1387119963765 605.9416100010276 606.4703779965639 607.7200520038605 613.8310950025916 623.3238120004535 624.4352219998837 655.2619230002165 822.6243490055203 831.522747002542 849.2006020024419 850.824585005641 851.3915610015392 857.4461269974709 859.2365720048547 859.7983810007572 862.329223997891 868.4462889954448 872.0655929967761 876.0036219954491 882.584718003869 885.2995610013604 896.1495370045304 905.0748299956322 909.7833660021424 914.0699060037732 918.0161540061235 937.5397140011191 937.8571780025959 939.2568369954824 942.7633469998837 946.4438479989767 954.2552899941802 954.6983240023255 958.6542969942093 961.1858320012689 963.6820480003953 967.8759769946337 1023.7637130022049 1024.470336996019 1032.5883790031075 1446.3231609985232 1450.6615410000086 1476.795330002904

Current
Mean: 904.723 ms
Stdev: 52.235 ms (5.8%)
Runs: 831.8734949976206 833.6820890009403 834.375610999763 839.7092289999127 841.4712330028415 847.7201339974999 848.0083009973168 850.485027000308 851.694499000907 852.8586829975247 855.5885009989142 857.5589199960232 860.2794189974666 860.6557620018721 864.1403409987688 864.4370119944215 865.2761650010943 869.6169030070305 879.5311279967427 891.3554280027747 893.0794680044055 912.8229169994593 915.8203129991889 922.3326009958982 923.0244549959898 928.7430020049214 929.6690279990435 932.4859630018473 935.2843830063939 935.8862709999084 936.7513440027833 940.9298919960856 943.4360359981656 945.172811999917 951.2114259973168 951.437297001481 955.0377609953284 976.3964850008488 981.1455489993095 987.4737550020218 993.6041669994593 994.9821380004287 1016.046916000545

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunchEnd_To_appCreationStart 78.783 ms → 79.404 ms (+0.620 ms, +0.8%)
App start time nativeLaunch 24.655 ms → 25.695 ms (+1.040 ms, +4.2%)
App start time appCreation 84.117 ms → 82.683 ms (-1.433 ms, -1.7%)
App start time appCreationEnd_To_contentAppeared 646.500 ms → 646.902 ms (+0.402 ms, ±0.0%)
App start time runJsBundle 457.250 ms → 452.567 ms (-4.683 ms, -1.0%)
App start time TTI 1429.035 ms → 1441.430 ms (+12.396 ms, +0.9%)
App start time regularAppStart 0.022 ms → 0.022 ms (-0.000 ms, ±0.0%)
App start time contentAppeared_To_screenTTI 593.815 ms → 600.878 ms (+7.063 ms, +1.2%)
App start time (CPU) 119.425 % → 120.539 % (+1.113 %, +0.9%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 348.439 MB → 346.771 MB (-1.668 MB, ±0.0%)
App start time (CPU/JS) 76.863 % → 75.563 % (-1.300 %, -1.7%)
App start time (CPU/UI) 17.156 % → 16.369 % (-0.786 %, -4.6%)
Open search router TTI Load Search Options 97.077 ms → 96.341 ms (-0.737 ms, -0.8%)
Open search router TTI Open Search Router TTI 750.109 ms → 749.825 ms (-0.284 ms, ±0.0%)
Open search router TTI (CPU) 146.558 % → 146.335 % (-0.223 %, ±0.0%)
Open search router TTI (FPS) 59.470 FPS → 59.681 FPS (+0.211 FPS, ±0.0%)
Open search router TTI (RAM) 373.756 MB → 374.653 MB (+0.897 MB, ±0.0%)
Open search router TTI (CPU/JS) 79.205 % → 78.908 % (-0.297 %, ±0.0%)
Open search router TTI (CPU/UI) 27.400 % → 27.415 % (+0.015 %, ±0.0%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 432.210 ms → 429.769 ms (-2.441 ms, -0.6%)
Report typing (CPU) 103.590 % → 103.404 % (-0.186 %, ±0.0%)
Report typing (FPS) 59.999 FPS → 60.000 FPS (+0.001 FPS, ±0.0%)
Report typing (RAM) 461.001 MB → 461.407 MB (+0.406 MB, ±0.0%)
Report typing (CPU/JS) 46.763 % → 47.085 % (+0.322 %, +0.7%)
Report typing (CPU/UI) 26.398 % → 26.468 % (+0.070 %, ±0.0%)
Chat opening Chat TTI 473.695 ms → 500.995 ms (+27.300 ms, +5.8%)
Chat opening (CPU) 156.293 % → 157.804 % (+1.511 %, +1.0%)
Chat opening (FPS) 57.605 FPS → 57.547 FPS (-0.058 FPS, ±0.0%)
Chat opening (RAM) 376.016 MB → 375.132 MB (-0.885 MB, ±0.0%)
Chat opening (CPU/JS) 76.172 % → 76.350 % (+0.178 %, ±0.0%)
Chat opening (CPU/UI) 32.716 % → 32.675 % (-0.041 %, ±0.0%)
Linking (CPU) 159.392 % → 159.591 % (+0.200 %, ±0.0%)
Linking (FPS) 59.997 FPS → 60.000 FPS (+0.003 FPS, ±0.0%)
Linking (RAM) 406.328 MB → 407.486 MB (+1.158 MB, ±0.0%)
Linking (CPU/JS) 84.103 % → 84.237 % (+0.133 %, ±0.0%)
Linking (CPU/UI) 34.634 % → 34.378 % (-0.257 %, -0.7%)
Show details
Name Duration
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 78.783 ms
Stdev: 10.275 ms (13.0%)
Runs: 58 62 63 64 66 66 67 67 69 70 70 70 71 71 72 72 72 72 74 74 75 75 75 75 76 76 76 76 76 76 76 77 77 78 79 80 81 81 81 81 82 82 82 84 84 86 86 86 87 87 91 92 92 92 94 96 97 101 103 106

Current
Mean: 79.404 ms
Stdev: 9.201 ms (11.6%)
Runs: 63 66 66 66 67 67 68 69 69 69 69 70 71 72 73 73 74 74 75 75 76 76 76 76 77 78 78 79 79 79 80 80 80 81 82 82 83 83 83 83 84 86 86 86 86 87 89 89 90 91 91 91 92 93 94 95 109
App start time nativeLaunch Baseline
Mean: 24.655 ms
Stdev: 3.467 ms (14.1%)
Runs: 20 21 21 21 21 21 21 21 22 22 22 22 22 22 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 25 25 25 25 25 25 26 26 27 27 27 28 28 28 29 30 30 30 31 31 32 33 35

Current
Mean: 25.695 ms
Stdev: 3.185 ms (12.4%)
Runs: 21 21 21 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 24 24 25 25 25 25 26 26 26 26 26 26 26 27 27 27 27 27 27 27 27 28 28 28 29 29 30 30 30 30 31 31 32 34 34
App start time appCreation Baseline
Mean: 84.117 ms
Stdev: 11.492 ms (13.7%)
Runs: 66 66 66 70 70 70 71 71 72 72 73 73 73 74 74 74 74 74 75 76 77 78 78 79 79 80 81 82 82 82 83 83 84 84 84 86 87 87 87 90 90 91 92 93 93 94 95 95 97 97 97 99 99 100 102 103 103 106 107 107

Current
Mean: 82.683 ms
Stdev: 9.133 ms (11.0%)
Runs: 65 67 68 68 69 71 73 73 73 73 73 74 74 75 75 76 77 77 78 78 78 79 79 79 80 81 81 81 81 81 82 82 82 83 83 84 85 85 85 86 87 88 89 89 89 90 90 91 92 92 92 93 95 95 96 96 99 99 102 103
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 646.500 ms
Stdev: 40.564 ms (6.3%)
Runs: 532 571 571 577 586 587 588 589 590 597 598 606 614 617 619 621 623 629 633 635 639 641 643 644 645 646 647 650 652 653 656 657 658 662 664 665 669 671 672 673 674 677 681 683 683 684 684 687 687 689 690 695 696 696 698 700 701 702

Current
Mean: 646.902 ms
Stdev: 31.967 ms (4.9%)
Runs: 576 585 587 589 592 595 596 596 604 611 620 631 634 634 636 637 641 643 643 645 645 646 648 649 650 650 652 653 655 657 658 662 662 664 664 664 668 670 670 672 675 677 680 680 680 683 685 689 695 696 698
App start time runJsBundle Baseline
Mean: 457.250 ms
Stdev: 28.155 ms (6.2%)
Runs: 383 388 409 411 413 414 417 424 426 429 430 432 434 434 437 439 440 442 442 445 447 447 450 451 458 459 460 460 461 461 463 463 463 464 466 467 467 467 468 468 473 473 476 477 479 480 481 483 484 488 488 488 489 491 492 492 494 494 503 511

Current
Mean: 452.567 ms
Stdev: 25.413 ms (5.6%)
Runs: 391 392 399 404 405 408 408 414 423 427 428 435 435 436 437 437 437 439 442 447 448 448 449 452 452 453 457 459 459 459 460 460 463 463 464 465 467 467 468 469 469 469 470 470 470 470 470 471 472 473 473 474 476 479 482 485 485 486 490 494
App start time TTI Baseline
Mean: 1429.035 ms
Stdev: 92.382 ms (6.5%)
Runs: 1251.0937310010195 1258.6724760010839 1265.2597979977727 1266.3109880015254 1268.9898110032082 1280.180160999298 1300.7948409989476 1315.209385998547 1315.976452998817 1316.9895059987903 1324.8785450011492 1325.354236997664 1326.586208999157 1331.3288540020585 1331.8754670023918 1333.9803859964013 1344.4155500009656 1364.409933000803 1392.1610990017653 1402.5165340006351 1410.0389079973102 1415.6446710005403 1421.463978998363 1426.4393820017576 1428.0045389980078 1431.8277480006218 1437.4313630014658 1439.1521980017424 1442.6818239986897 1448.688454002142 1455.3459030017257 1455.4245460033417 1456.18041100353 1458.4929609969258 1461.4403870031238 1461.8715839982033 1465.4180829972029 1467.215204000473 1471.9327450022101 1474.8366940021515 1475.0438620001078 1480.3229610025883 1482.5577120035887 1486.5067699998617 1500.4842140004039 1501.3517199978232 1505.0722120031714 1506.1516780033708 1508.1997909992933 1512.1077840030193 1521.118371002376 1522.2170910015702 1530.5268260017037 1542.071723997593 1542.1666480004787 1556.705606997013 1559.3686859980226 1566.8262270018458 1593.9943350031972 1602.773379996419

Current
Mean: 1441.430 ms
Stdev: 81.158 ms (5.6%)
Runs: 1261.6872539967299 1272.521017998457 1300.478704996407 1302.093588002026 1309.17310000211 1317.3245700001717 1324.4291919991374 1325.15864200145 1335.3589510023594 1336.743488997221 1337.5873640030622 1340.8895569965243 1368.678414002061 1382.2360140010715 1398.582933999598 1406.7837439998984 1413.8355690017343 1415.6866820007563 1419.1116859987378 1420.0167829990387 1422.62029799819 1431.6770370006561 1431.724324002862 1433.4182809963822 1434.7254519984126 1440.3163489997387 1440.7562830001116 1440.8595919981599 1442.7669230028987 1450.9272520020604 1451.320913001895 1451.510356001556 1454.8288360014558 1459.0084040015936 1464.1932469978929 1465.6158479973674 1465.9177849963307 1471.566701002419 1473.4470890015364 1476.7562709972262 1478.1213850006461 1482.1809109970927 1489.2211880013347 1490.5826240032911 1511.3914379999042 1514.6008789986372 1515.2899179980159 1517.0304810032248 1521.4473000019789 1526.30366499722 1530.9587410017848 1532.9476160034537 1536.3409989997745 1545.196791999042 1563.526643998921 1566.9874150007963 1567.8760069981217 1570.4765470027924 1591.5805400013924
App start time regularAppStart Baseline
Mean: 0.022 ms
Stdev: 0.002 ms (8.4%)
Runs: 0.01896200329065323 0.019124001264572144 0.019409000873565674 0.019491001963615417 0.019612997770309448 0.019652999937534332 0.019856996834278107 0.019937999546527863 0.020020000636577606 0.020141996443271637 0.02018299698829651 0.020344994962215424 0.020427003502845764 0.02046699821949005 0.02075199782848358 0.02087400108575821 0.021036997437477112 0.021077997982501984 0.021118000149726868 0.02115900069475174 0.021199002861976624 0.021199002861976624 0.021361999213695526 0.021443001925945282 0.02156500518321991 0.021566003561019897 0.021646998822689056 0.021768994629383087 0.021931998431682587 0.02197299897670746 0.0220939964056015 0.02225799858570099 0.022298000752925873 0.022583000361919403 0.02266400307416916 0.022665001451969147 0.022704996168613434 0.022746004164218903 0.022867001593112946 0.02307099848985672 0.023194000124931335 0.02335599809885025 0.023396998643875122 0.023517996072769165 0.023518994450569153 0.023559994995594025 0.023844003677368164 0.023885004222393036 0.024129994213581085 0.024130001664161682 0.024372994899749756 0.024576999247074127 0.02461700141429901 0.024657994508743286 0.024658001959323883 0.025633998215198517 0.02567499876022339 0.026083000004291534 0.02657099813222885

Current
Mean: 0.022 ms
Stdev: 0.002 ms (8.3%)
Runs: 0.01810699701309204 0.018472999334335327 0.018880002200603485 0.01953200250864029 0.019571997225284576 0.019694000482559204 0.019734002649784088 0.019856005907058716 0.019898004829883575 0.02018199861049652 0.02030400186777115 0.020386002957820892 0.020548000931739807 0.020548000931739807 0.020548999309539795 0.020670004189014435 0.02075199782848358 0.021035999059677124 0.0215659961104393 0.021606996655464172 0.02164800465106964 0.021810002624988556 0.02185099571943283 0.021890997886657715 0.0218920037150383 0.0219310000538826 0.02197299897670746 0.022134996950626373 0.022257000207901 0.022338993847370148 0.022339001297950745 0.022339001297950745 0.022419996559619904 0.0224200040102005 0.022501997649669647 0.022663995623588562 0.022665001451969147 0.022704996168613434 0.02278599888086319 0.022867999970912933 0.02290799468755722 0.022908002138137817 0.023029997944831848 0.023111999034881592 0.02319299429655075 0.023194000124931335 0.023396000266075134 0.023680999875068665 0.02380400151014328 0.023844003677368164 0.024170003831386566 0.024170003831386566 0.02433200180530548 0.024658001959323883 0.024821005761623383 0.024943001568317413 0.025064997375011444 0.02587900310754776 0.025960996747016907 0.026205003261566162
App start time contentAppeared_To_screenTTI Baseline
Mean: 593.815 ms
Stdev: 54.100 ms (9.1%)
Runs: 496.8754670023918 502.58620899915695 508.1801609992981 508.97645299881697 516.2597979977727 527.3109880015254 527.7948409989476 527.9898110032082 529.9895059987903 530.0937310010195 530.3288540020585 534.6724760010839 542.354236997664 554.409933000803 556.9803859964013 559.6818239986897 564.5165340006351 568.2093859985471 569.1610990017653 569.4155500009656 570.8785450011492 575.4180829972029 575.4403870031238 576.0389079973102 587.0045389980078 589.4929609969258 590.463978998363 592.8277480006218 593.4313630014658 594.1521980017424 596.3459030017257 597.4245460033417 597.8715839982033 599.1077840030193 600.5577120035887 605.9327450022101 608.0722120031714 610.0438620001078 613.3229610025883 613.4393820017576 614.688454002142 619.1516780033708 619.8366940021515 622.3517199978232 627.215204000473 627.4842140004039 640.1183710023761 650.0717239975929 655.1666480004787 657.2170910015702 659.5268260017037 668.1997909992933 669.8262270018458 681.5067699998617 688.7056069970131 704.3686859980226 704.773379996419 717.9943350031972

Current
Mean: 600.878 ms
Stdev: 51.854 ms (8.6%)
Runs: 482.52101799845695 496.47870499640703 528.7669230028987 530.5873640030622 535.6872539967299 547.743488997221 550.0935880020261 552.2360140010715 556.1586420014501 556.6866820007563 559.4182809963822 559.4291919991374 561.3589510023594 563.6784140020609 567.6202979981899 567.8895569965243 573.1932469978929 573.8355690017343 574.582933999598 577.724324002862 577.8288360014558 580.17310000211 582.6770370006561 591.5266439989209 593.3163489997387 594.5103560015559 598.7562830001116 599.0167829990387 603.0084040015936 603.7254519984126 607.320913001895 610.2211880013347 611.1809109970927 612.566701002419 621.3914379999042 621.8595919981599 628.0304810032248 629.9177849963307 631.1213850006461 633.5826240032911 634.7562709972262 642.6158479973674 646.3409989997745 646.9587410017848 650.4473000019789 652.9272520020604 658.2899179980159 659.9476160034537 666.6008789986372 667.30366499722 713.5805400013924 718.4765470027924 740.8760069981217
App start time (CPU) Baseline
Mean: 119.425 %
Stdev: 8.842 % (7.4%)
Runs: 101.57198025241806 106.58415841584156 107.60586183497819 107.85786284298217 108.8920478820505 110.5405745967742 110.57094426006165 110.94265938531879 111.8897835432296 112.07729468599037 112.72564612326046 112.79901071985239 112.85991466033458 113.05331991951712 113.81274900398404 113.90419161676647 113.9987384927384 114.3939393939394 114.47154664358304 114.60039761431413 115.67104834156383 115.8659266843827 116.00677062125247 116.09649785639857 116.12853887814767 116.83168316831684 117.94305742960022 118.29394749768049 118.80743922997445 119.01412853213307 119.31589458585907 119.62326817972726 119.84206982553579 119.89605204555579 120.73573306450021 121.03946194058398 121.81673306772906 121.95107346166434 121.96521427290658 123.11251538388719 123.66062693225845 123.81673306772906 123.84211763487211 123.86345760578892 124.35491190656914 124.98103777275665 126.36209255153548 129.03989181879643 133.7285902503294 133.90466628418437 137.2545182726854 137.78486055776895 138.17009222346888 140.88496844520944 141.64214711729628

Current
Mean: 120.539 %
Stdev: 7.425 % (6.2%)
Runs: 106.76710563985112 107 109.8247011952191 110.95298166053217 111.73736361612114 111.95498566854822 112.91017964071855 113.04165919550537 113.54581673306771 113.6173537024178 114.04675238068776 114.290542664906 114.8207171314741 115.58730158730161 115.74537964818526 116.04185666970669 116.1263253342666 116.75732417215384 117.62698412698415 117.8221253640482 117.86196647768699 117.8779029231425 117.9430574296002 117.96740790227143 117.97299778840546 118.30398147038858 118.7414511562808 118.83209759479196 118.92074987322515 118.9510495093773 118.9851983186246 119.52191235059759 120.3119605812384 120.804780876494 120.92511716660408 121.31173079918992 121.47406192818613 121.63492063492065 121.70178926441355 121.80876494023903 122.75940770429749 123.43159848921324 123.61002952884301 123.83882111669236 123.87168862980258 125 126.70885087102567 126.76334767206475 126.96022183973994 127.55847953216376 128.10020040080158 132.63361796331435 132.79681274900403 133.93919312729045 135.850229285609 137.28782682391713 138.67196819085493 139.3997718848019
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 348.439 MB
Stdev: 7.324 MB (2.1%)
Runs: 339.259765625 339.83203125 340.486328125 340.74609375 340.939453125 341.03125 341.04296875 341.15234375 341.455078125 341.498046875 342.009765625 342.013671875 342.07421875 342.396484375 342.48828125 342.69921875 343.142578125 343.21875 343.47265625 343.814453125 343.9765625 343.984375 344.041015625 344.185546875 344.521484375 344.921875 345.029296875 345.044921875 345.05078125 345.716796875 345.73046875 346.3671875 347.3359375 347.525390625 348.32421875 348.70703125 349.060546875 349.470703125 349.703125 350.3125 350.556640625 350.603515625 352.609375 352.7734375 353.259765625 354.171875 354.990234375 356.236328125 356.283203125 356.3671875 357.921875 358.435546875 358.623046875 359.64453125 359.95703125 361.203125 364.16796875 367.02734375 369.275390625

Current
Mean: 346.771 MB
Stdev: 5.300 MB (1.5%)
Runs: 338.130859375 339.048828125 339.693359375 340.01171875 340.060546875 340.314453125 340.91796875 342.166015625 342.177734375 342.248046875 342.310546875 342.376953125 342.494140625 342.5078125 342.697265625 342.779296875 342.880859375 342.970703125 343.6796875 343.80078125 343.80859375 343.95703125 343.982421875 344.01171875 344.12890625 344.365234375 344.5546875 345.087890625 345.125 345.91015625 346.2265625 346.40625 346.88671875 346.94140625 347.13671875 347.62109375 347.623046875 348.439453125 348.62890625 348.810546875 348.873046875 348.900390625 350.28125 350.349609375 350.87109375 351.169921875 351.294921875 352.15234375 352.267578125 352.728515625 352.892578125 353.0859375 354.099609375 355.248046875 356.12109375 358.1953125 360.12890625 361.126953125
App start time (CPU/JS) Baseline
Mean: 76.863 %
Stdev: 3.917 % (5.1%)
Runs: 65.8 69.7 70.4 71 71.5 71.8 71.9 71.9 71.9 71.9 73.7 73.7 73.8 73.9 73.9 74.7 74.9 74.9 74.9 75 75 75.1 75.2 75.7 75.9 75.9 76 76.7 76.8 76.9 77 77 77.4 77.4 78.1 78.1 78.2 78.9 78.9 79 79.1 79.2 79.4 79.9 80.8 80.9 80.9 80.9 80.9 81.2 81.4 81.5 81.8 82 82.1 82.7 82.8 82.9 84.1

Current
Mean: 75.563 %
Stdev: 3.439 % (4.6%)
Runs: 67 67.9 70.8 70.9 70.9 70.9 71.1 71.7 71.7 71.8 71.9 72 72.8 72.9 72.9 73 73 73.6 73.8 73.9 73.9 73.9 74.1 74.7 74.7 74.8 74.9 75 75.2 75.8 75.9 76 76.3 76.7 76.9 77 77.1 77.7 77.9 77.9 78 78 78.5 78.6 78.7 78.8 78.8 78.8 78.8 78.9 78.9 79 79 79.1 79.6 80 80.2 81 84.6
App start time (CPU/UI) Baseline
Mean: 17.156 %
Stdev: 4.846 % (28.2%)
Runs: 10 10.9 11 11.8 11.8 11.9 11.9 12 12 12.9 13 13 13.7 13.8 13.9 13.9 13.9 13.9 13.9 14 14 14 14 14.8 14.8 14.9 14.9 15 15 15.9 16 16 16 16.9 17.8 17.8 17.9 17.9 18 18 18.1 18.9 19 19.1 19.8 20 20.8 23 23 24 24 24.2 24.5 24.7 25.1 26 28 28.1 29.1

Current
Mean: 16.369 %
Stdev: 3.869 % (23.6%)
Runs: 9 10 10 10.9 11 12.8 12.9 12.9 13 13 13 13.9 13.9 13.9 14 14 14 14 14 14 14 14.9 14.9 15 15 15 15 15.1 15.6 15.8 15.9 15.9 15.9 15.9 16 16 16 16 16.9 17 17 17.9 17.9 17.9 18 18.8 19 19.9 21 21.6 22 22 23 23 23 23.9 23.9 24 26
Open search router TTI Load Search Options Baseline
Mean: 97.077 ms
Stdev: 5.753 ms (5.9%)
Runs: 85.28181999921799 87.19600399583578 87.33394300192595 88.02677399665117 88.26171899586916 88.56026200205088 89.15140800178051 89.16426599770784 89.36177600175142 89.43697100132704 89.79207400232553 89.88468499481678 89.93094899505377 90.04134099930525 90.10994499921799 90.4310300052166 90.88110300153494 90.88293400406837 91.10176599770784 91.1046549975872 91.13496900349855 91.33300799876451 91.45873999595642 91.6282560005784 91.71260600537062 91.82975300401449 92.04325400292873 92.36775700002909 92.81156400591135 92.85782899707556 93.08178700506687 93.19689900428057 93.41430699825287 93.41430699825287 93.42919900268316 93.47131399810314 93.56396400183439 93.6427000015974 93.79117900133133 93.865275003016 93.92366499453783 94.0660400018096 94.08166499435902 94.09989400207996 94.19474299997091 94.75687700510025 94.99959299713373 95.08129899948835 95.13501000404358 95.15441899746656 95.51765999943018 95.67447999864817 96.0570480003953 96.06551099568605 96.07177700102329 96.25903400033712 96.34680199623108 96.36775700002909 96.6575529947877 97.05619399994612 97.13171399384737 97.32332300394773 97.35827600210905 97.36018799990416 97.62784799933434 97.64554899930954 97.87829599529505 97.89530399441719 98.20133499801159 98.23823999613523 98.42447900027037 98.42460100352764 98.49601200222969 98.53023299574852 98.58524599671364 98.60538700222969 98.63000500202179 98.88728799670935 98.96895299851894 99.12797000259161 99.33422800153494 99.82165499776602 99.87040200084448 99.99719200283289 100.03621499985456 100.19124399870634 100.4043380022049 100.79846199601889 100.9361569955945 100.93831399828196 100.95723500102758 101.08764600008726 101.20934999734163 101.44689900428057 101.55240900069475 101.72176100313663 102.44669599831104 102.62231399863958 102.76912499964237 102.76977600157261 102.97119099646807 103.4305820018053 103.90429699420929 104.60803300142288 105.80786199867725 105.82320100069046 106.18819099664688 106.39917000383139 106.43859799951315 106.54117800295353 107.04744499921799 107.0925699993968 108.30590800195932 108.7087410017848 108.79488100111485 110.12744099646807 110.15218099951744 110.96834299713373

Current
Mean: 96.341 ms
Stdev: 6.364 ms (6.6%)
Runs: 83.42073599994183 85.54288700222969 86.40836599469185 87.10286500304937 87.6258950009942 87.9532469958067 88.51025400310755 88.60298600047827 88.88622999936342 89.00699900090694 89.19299300014973 89.26375299692154 89.73799699544907 89.83841999620199 90.02518799901009 90.07316099852324 90.10917099565268 90.14086899906397 90.25891099870205 90.34232600033283 90.4666740000248 90.46728499978781 90.5173739939928 90.87154199928045 91.01794500648975 91.0607510060072 91.17195600271225 91.24149600416422 91.24149600416422 91.32564300298691 91.33304800093174 91.52160700410604 91.61966999620199 91.71744799613953 91.82372999936342 91.92858900129795 92.08243899792433 92.21512800455093 92.2311199977994 92.25785300135612 92.41910799592733 92.48364299535751 92.55566400289536 92.77783200144768 92.99914599955082 93.34187800437212 93.34379100054502 93.55000799894333 93.7077230066061 93.9164220020175 94.02058900147676 94.03169799596071 94.08101499825716 94.29219499975443 94.63720700144768 94.66544599831104 95.21358200162649 95.25463899970055 95.30965200066566 95.32942700386047 95.49751799553633 95.50203499943018 95.558390006423 95.63114400207996 95.65958700329065 95.69848600029945 95.88346400111914 95.8851720020175 96.77437400072813 96.79435300081968 96.86010700464249 96.89835600554943 97.23059100657701 97.25419200211763 97.44197599589825 97.59692399948835 97.60233499854803 97.66638199985027 97.72192399948835 97.8873699977994 98.03865600377321 98.2654619961977 98.52339699864388 98.5464269965887 98.73974599689245 99.00333599746227 99.2467449977994 99.70621700584888 99.78645899891853 100.38785800337791 101.01179999858141 101.49650099873543 101.58642599731684 101.6002189964056 101.9762770012021 102.05424000322819 103.0076499953866 103.23238199949265 103.43351199477911 103.6015620008111 103.89790800213814 103.9206949993968 104.42883300036192 104.5433349981904 105.02982600033283 105.27014099806547 105.28116900473833 105.624715000391 106.83081100136042 107.04439300298691 107.47102799266577 107.50390700250864 107.50980599969625 107.99523899704218 108.9147949963808 111.37422700226307 111.87666899710894 112.23640900105238 113.38936300575733
Open search router TTI Open Search Router TTI Baseline
Mean: 750.109 ms
Stdev: 25.085 ms (3.3%)
Runs: 678.000041000545 714.58426900208 719.2386879995465 720.9558109939098 721.6814370006323 721.9304609969258 722.1893720030785 723.1868899986148 730.6558030024171 732.1173099949956 733.9625250026584 733.9984539970756 734.2760419994593 735.6226809993386 738.0974529981613 739.6894939988852 741.7768959999084 741.9972739964724 743.181884996593 743.5375579968095 744.8377279937267 746.5888679996133 746.8680020049214 748.7285970002413 750.032348997891 750.2540279999375 751.7721350044012 751.775675997138 754.5135909989476 755.5651459991932 758.006755001843 758.3356529995799 759.9646809995174 761.1969000026584 761.7648519948125 762.8667809963226 763.3934329971671 764.656291000545 766.3184010013938 767.0750730037689 775.7277429997921 789.8958340063691 791.203653998673 791.954061999917 798.3601490035653 805.0733639970422 807.7091879993677

Current
Mean: 749.825 ms
Stdev: 25.936 ms (3.5%)
Runs: 706.6246750056744 707.0027259960771 707.0772709995508 710.6519780009985 720.2050779983401 720.5288899987936 721.7721760049462 721.9272869974375 722.3718269988894 723.602904997766 725.4888919964433 727.3420410007238 727.5971269980073 728.843993999064 734.0124109983444 735.3498939946294 735.5053310021758 735.9654550030828 738.9785970002413 739.4954840019345 739.6338300034404 741.344319999218 743.0435380041599 745.328653998673 746.8940019980073 747.7622480019927 747.9503180012107 748.7148439958692 750.7258710041642 750.8409430012107 751.2766929939389 752.1713059991598 752.486084997654 752.7937419936061 753.9414879977703 759.0887050032616 760.1128339990973 761.1534430012107 761.9579270035028 765.8963219970465 768.4765219986439 770.5568450018764 772.948079995811 774.6001389995217 778.2990320026875 779.5502930060029 781.8311360031366 788.6168629974127 791.475749000907 791.6647949963808 792.4773769974709 804.0808110013604 822.688598997891
Open search router TTI (CPU) Baseline
Mean: 146.558 %
Stdev: 4.142 % (2.8%)
Runs: 136.2131474103586 136.75013813244925 139.82937614560504 140.06649303028064 141.08002124734415 141.24116847294363 141.76485674070193 142.2198273286135 142.4271926838336 143.2996039792925 143.44289258000438 143.4981954256764 143.57181363562557 143.6465986904583 143.8026386659548 143.92526839946942 143.9703358449068 144.2087916577467 144.21361485317334 144.24741400371622 144.38951978909998 144.6930081849065 144.82264308789587 144.9633839393068 145.43081293206367 145.5526838966202 145.64074072598467 145.691911346377 146.1349301270729 146.17912712357307 146.2890137557715 146.31513521200662 146.64146791236894 147.07883717725295 147.60018500798432 148.14106972029012 148.24327367217614 148.55940906933603 148.72952134945794 148.9384598430937 149.08896658636027 149.1411977690259 149.28160119251294 149.56002109886575 149.77640077476244 149.86116997340716 150.32108638369166 150.39951583252068 150.5543099885969 150.60101913568687 150.65420720835985 151.1077887221179 151.7444648066684 151.74507489881725 152.51254913622606 152.79723796126603 154.1088482789493 155.02169197710052 155.1684156016087

Current
Mean: 146.335 %
Stdev: 3.440 % (2.4%)
Runs: 139.04349221249956 140.22111553784868 141.5474369895655 141.6186093520057 141.70522633873958 142.49686155661715 142.82492548965473 143.04214928344027 143.09034961645168 143.16111247182667 143.25059269097443 143.26632547964462 143.2669552997983 143.28828635785987 143.44301794903853 143.5692602933258 143.577164984443 143.7414938429678 143.7859838866981 144.33605738618672 144.34048302912387 144.67204810306725 144.802594015157 145.1668578127715 145.25045622309824 145.47472380544713 145.527827824096 145.54371166415018 145.57061967776244 145.62575234212983 146.4103988825877 146.56566646688202 146.95883389784922 147.03409707814671 147.11206519742743 147.14406810606826 147.34080901901925 147.39147354238074 147.70519623664575 147.8541250981657 148.13491794095705 148.22393059576746 148.34269094337256 148.34391805714426 148.442775931783 148.60122953565087 148.752705967619 149.07272499111315 149.69877135545255 149.70264921064134 149.82879562865836 150.30409757159248 150.93758300132788 151.08661294218953 152.30109667052224 152.44639152051366 153.07338755329366 153.4807057078661 155.22734695409517
Open search router TTI (FPS) Baseline
Mean: 59.470 FPS
Stdev: 0.715 FPS (1.2%)
Runs: 57.435446926234405 57.62422065237834 57.90752361185635 57.92325131426359 58.16829935971406 58.49395272754442 58.515311018829514 58.52573491382316 58.66821507262385 58.72851858340263 58.7889406914347 58.82314171783476 58.841091916171095 58.84417891076743 58.878283823525 59.03545713908069 59.0720010582702 59.15574919665787 59.4142973585637 59.43925511187386 59.49446409976659 59.51675797907251 59.65471932458395 59.66170707310422 59.74943902956787 59.770405738700276 59.778035883634224 59.8547480038342 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.681 FPS
Stdev: 0.500 FPS (0.8%)
Runs: 58.106847113747776 58.20248496179675 58.42316729254971 58.70531485549061 58.89259203659387 58.92602274538069 58.93686564744457 59.06944208839249 59.25384572297204 59.27161405296827 59.4003756393541 59.48992629793872 59.5417682717918 59.575907825897445 59.58208660908244 59.593751979907125 59.59654446317277 59.66717532516611 59.69366928794025 59.724900130207146 59.750393383887385 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 373.756 MB
Stdev: 3.410 MB (0.9%)
Runs: 365.9453125 366.5559895833333 368.0598958333333 368.3828125 368.75390625 368.7643229166667 369.2552083333333 369.6158854166667 370.4287109375 371.0009765625 371.3372395833333 371.65625 371.7197265625 371.96484375 372.080078125 372.28125 372.609375 372.74609375 372.79296875 372.7958984375 372.8606770833333 372.875 372.921875 373.0087890625 373.044921875 373.09375 373.1162109375 373.2877604166667 373.5322265625 373.6064453125 373.7044270833333 373.75390625 373.80859375 373.8740234375 373.896484375 374.1806640625 374.4873046875 374.5029296875 374.95703125 374.982421875 375.1962890625 375.3583984375 376.169921875 376.365234375 377.251953125 377.5146484375 377.7041015625 377.7119140625 378.0703125 378.4296875 378.5390625 378.65234375 378.962890625 380.1689453125 380.4501953125 381.5224609375

Current
Mean: 374.653 MB
Stdev: 3.313 MB (0.9%)
Runs: 366.9518229166667 367.4544270833333 369.1770833333333 369.6783854166667 369.689453125 369.69921875 369.9677734375 370.6106770833333 370.8544921875 371.23046875 371.6748046875 372.158203125 372.2177734375 372.3723958333333 372.47265625 372.7890625 373.1455078125 373.4501953125 373.453125 373.5947265625 373.6962890625 373.740234375 373.875 373.8798828125 373.9091796875 374.0009765625 374.03515625 374.201171875 374.3515625 374.61328125 374.65625 374.6826171875 374.919921875 374.984375 375.330078125 375.5087890625 375.63671875 375.640625 375.673828125 375.8098958333333 376.2216796875 376.4375 376.501953125 377.076171875 377.1611328125 377.1822916666667 377.4033203125 377.4580078125 377.4951171875 377.685546875 377.6962890625 377.7802734375 378.6015625 379.482421875 379.9169921875 380.474609375 380.75390625 381.2109375 382.1943359375
Open search router TTI (CPU/JS) Baseline
Mean: 79.205 %
Stdev: 2.235 % (2.8%)
Runs: 75.6 75.9 76 76.1 76.1 76.2 76.3 76.3 76.4 76.8 77 77 77.1 77.2 77.3 77.3 77.4 77.6 77.8 77.8 78.1 78.2 78.4 78.5 78.5 78.9 78.9 79 79 79.1 79.1 79.4 79.4 79.6 79.6 79.7 79.8 79.9 80.3 80.3 80.4 80.4 80.4 80.6 80.9 80.9 80.9 81.2 81.2 81.2 81.3 81.7 82.3 82.9 82.9 83.1 83.2 84.1 84.6

Current
Mean: 78.908 %
Stdev: 2.316 % (2.9%)
Runs: 74 74.3 74.6 74.9 75.2 75.5 75.8 76.2 76.2 76.8 76.8 76.9 77.1 77.1 77.4 77.4 77.5 77.7 77.8 77.8 78 78.1 78.2 78.2 78.4 78.4 78.4 78.7 78.9 78.9 79 79.1 79.3 79.3 79.4 79.4 79.8 79.8 79.8 79.8 79.9 80.1 80.2 80.3 80.5 80.5 80.6 80.6 80.8 81.2 81.2 81.2 81.5 82.2 82.3 82.4 82.8 83 83 84.3
Open search router TTI (CPU/UI) Baseline
Mean: 27.400 %
Stdev: 1.499 % (5.5%)
Runs: 24.5 24.9 25.1 25.1 25.3 25.4 25.5 25.6 25.8 25.8 25.8 26.2 26.3 26.4 26.4 26.4 26.5 26.6 26.7 26.7 26.7 26.7 26.8 26.9 26.9 26.9 26.9 27 27.1 27.2 27.4 27.4 27.4 27.6 27.6 27.8 27.9 27.9 27.9 27.9 27.9 28.2 28.3 28.4 28.4 28.5 28.5 28.5 28.5 29.1 29.3 29.4 29.4 29.6 29.6 29.9 30.6 30.6 31

Current
Mean: 27.415 %
Stdev: 1.546 % (5.6%)
Runs: 24.2 24.9 25 25 25.2 25.4 25.5 25.7 25.8 25.8 25.8 25.9 25.9 26 26.2 26.5 26.5 26.5 26.6 26.6 26.8 26.8 27 27.1 27.1 27.2 27.3 27.3 27.4 27.4 27.5 27.5 27.5 27.5 27.6 27.6 27.7 27.8 27.8 27.9 28.1 28.2 28.2 28.4 28.4 28.4 28.6 28.8 28.9 29 29.2 29.3 29.4 29.4 29.8 30.1 30.4 30.9 31.2
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 432.210 ms
Stdev: 32.318 ms (7.5%)
Runs: 366.94242300093174 370.98710200190544 371.38138800114393 374.7025149986148 381.4721269980073 384.84159399569035 385.134968996048 385.9977630004287 395.04915300011635 395.78413899987936 398.7360030040145 399.3491619974375 401.6140539944172 403.17679899930954 406.2481290027499 409.8923740014434 410.3725180029869 412.2420659959316 412.3424480035901 412.7170819938183 414.7526850029826 419.0242110043764 420.4562180042267 420.73018400371075 427.187784999609 427.19714300334454 428.48722299933434 429.5824379995465 429.7999679967761 431.0170900002122 432.78621400147676 440.88733000308275 442.734659999609 446.09940699487925 446.90161100029945 447.86356700211763 448.80375200510025 451.4183759987354 455.50862700492144 455.64021899551153 456.65527299791574 457.70259600132704 457.74047899991274 458.2887369990349 460.78865599632263 462.36930400133133 462.43770399689674 462.6278080046177 462.76407899707556 463.42549700289965 463.469889998436 465.62744200229645 466.1453860029578 466.9723310023546 468.19787599891424 469.24609400331974 480.53629499673843 480.66235399991274 482.0445559993386 489.0487469956279

Current
Mean: 429.769 ms
Stdev: 31.563 ms (7.3%)
Runs: 366.04634600132704 366.4376630038023 371.0788580030203 376.4565030038357 377.1785080060363 377.84899900108576 378.78173899650574 394.1851810067892 396.3174240067601 396.4999599978328 397.8637690022588 402.0135900005698 404.26053900271654 407.01041699945927 408.75402899831533 409.4949960038066 410.61625099927187 413.44449900090694 413.8514410033822 414.6817220002413 416.1054280027747 416.20735700428486 416.40559899806976 417.44201600551605 418.3948980048299 420.2479650005698 423.39762400090694 423.78593000024557 427.2705079987645 428.16162099689245 429.5511069968343 429.9111330062151 433.95247400552034 440.05106700211763 440.65291299670935 441.12422700226307 442.1649580001831 447.0036619976163 448.5275880023837 448.72798699885607 451.74450700730085 455.7634680047631 456.66544599831104 457.23311399668455 458.1325279995799 459.3674729987979 459.69905599951744 461.9464519992471 461.96915700286627 463.0515960007906 463.34456399828196 464.13659700006247 464.2342530041933 464.42476399987936 464.79899199306965 469.45406100153923 469.60677099972963 470.8299160003662 478.09175699949265 499.7593180015683
Report typing (CPU) Baseline
Mean: 103.590 %
Stdev: 3.510 % (3.4%)
Runs: 97.49098485451344 98.40432972366966 98.41037978390668 98.73403536437115 99.1655258770457 99.38418823942713 99.45750616653527 99.71074786607981 99.85066690886214 99.92310728411766 100.1998609500348 100.22911415673052 100.37556310093083 100.59421114740063 100.72030642032641 100.75671517787929 100.92617510292888 101.03076468026428 101.15680212746268 101.2899441295526 101.40067260149782 101.47856722152308 101.5687201779255 101.85989803455183 102.1268003145619 102.18758571803808 102.23052578067204 102.64536593725464 103.23188036872368 103.27953907816642 103.43751236687224 103.46445815661417 103.81843587076773 103.88904078629639 104.010859765018 104.22075410525753 104.2839895907059 104.51555454722502 104.61025356327326 105.21573568248228 105.71374931884245 106.16566920229695 106.42935631562662 106.5445587087329 106.62754249213174 106.8528188212106 107.19560097943395 107.24226932282554 107.3321535187301 107.39439494006311 107.55301877031786 107.86042429948424 108.11219723061434 108.61295335685624 108.81384476922388 109.8145460742595 110.25890241009878 110.45564279733652 111.54407987571321

Current
Mean: 103.404 %
Stdev: 3.426 % (3.3%)
Runs: 97.31542576984909 98.50840691560329 99.26498936751254 99.29720127492148 99.32995691526996 99.5000229113268 99.53422725746964 99.64284424918942 99.78664759428756 99.83579685524293 99.95523898666727 100.40822111149208 100.43758870934228 100.483847384059 100.63426714961643 100.80850454701185 100.81319356391094 100.81869874226709 100.82767885127484 101.04224882428831 101.04712036520284 101.07674324175431 101.2862186052212 101.61212864465148 101.86523287540926 101.89376789315018 101.92227449337668 101.96091789140205 102.19373099929408 102.34493423337732 102.53554348743876 102.92931676709527 103.74574284343869 103.83895374866937 104.08924153947072 104.11539695797394 104.25521639672893 104.25573999439659 104.30962856721628 104.54681343594012 104.71850339850914 104.96981907854803 105.57256306390543 105.73999917096835 105.96604517402479 106.20438832092654 106.21210127829848 106.22717566498414 106.90913498800947 106.99489989583915 107.17044154532557 107.81833476236679 107.97980659883065 108.18091932310583 108.40895444580751 108.74290919311726 109.8202715269169 110.56351057530163 110.6319905365772 111.3288975428006
Report typing (FPS) Baseline
Mean: 59.999 FPS
Stdev: 0.003 FPS (0.0%)
Runs: 59.980801059597475 59.986623538105505 59.99552265823119 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 461.001 MB
Stdev: 4.247 MB (0.9%)
Runs: 449.82313368055554 453.2916666666667 454.2180989583333 454.69140625 455.48155381944446 456.0290798611111 456.1013454861111 456.1184895833333 456.13589638157896 456.1848958333333 456.8895970394737 456.92491319444446 457.13448660714283 457.1388888888889 457.5611979166667 458.39561631944446 458.3982204861111 458.5392795138889 458.92230902777777 459.0388454861111 459.44249131944446 459.50434027777777 459.53624131944446 459.80772569444446 460.0696614583333 460.07769097222223 460.15933388157896 460.2366365131579 460.3190104166667 460.4869791666667 460.87314967105266 460.9563802083333 461.70723684210526 461.90625 462.31293402777777 462.47222222222223 462.9958767361111 463.0735677083333 463.07833059210526 463.30946180555554 463.40386284722223 463.47450657894734 463.7388980263158 463.8050986842105 464.04991319444446 464.1315104166667 464.2986111111111 464.4084201388889 464.88953993055554 465.1907552083333 466.20616319444446 466.537109375 466.60394965277777 466.8372395833333 467.27690972222223 467.62196180555554 468.36827256944446 468.5657552083333 470.294921875

Current
Mean: 461.407 MB
Stdev: 4.562 MB (1.0%)
Runs: 450.98155381944446 451.88194444444446 453.01258680555554 454.251953125 455.9607204861111 456.40863715277777 456.4202302631579 456.478515625 456.56336805555554 456.7111545138889 457.2213541666667 457.25151909722223 457.5221354166667 457.62767269736844 457.95160590277777 458.45551215277777 458.6860608552632 458.77734375 458.7810329861111 458.87934027777777 458.9075520833333 458.9505208333333 459.25303819444446 459.58637152777777 459.7516447368421 460.12109375 460.34375 460.681640625 460.72894965277777 460.8024259868421 461.056640625 461.5314670138889 461.6228298611111 461.6560329861111 462.13237847222223 462.86610243055554 463.1149259868421 463.3606770833333 463.7931857638889 463.8207236842105 464.18901909722223 464.2975260416667 464.3072916666667 464.3899739583333 464.4361979166667 464.67491319444446 464.73589409722223 464.82833059210526 465.6271701388889 466.2643229166667 466.32660590277777 466.3509114583333 466.50477430555554 467.93706597222223 467.9557291666667 468.3151041666667 468.58680555555554 468.671875 469.9333767361111 472.1521267361111
Report typing (CPU/JS) Baseline
Mean: 46.763 %
Stdev: 3.152 % (6.7%)
Runs: 40.5 41.2 41.3 41.5 41.6 42 42.9 42.9 43.2 43.2 43.3 43.7 43.9 44 44.5 44.6 44.6 44.8 44.8 44.9 45.1 45.2 45.2 45.6 45.9 46 46.3 46.5 46.8 47 47.3 47.3 47.8 47.8 48 48.4 48.7 48.7 48.8 48.8 48.9 48.9 49.2 49.3 49.3 49.7 49.8 49.9 49.9 49.9 49.9 50 50.1 50.2 50.4 50.9 51.3 53.2 53.6

Current
Mean: 47.085 %
Stdev: 2.908 % (6.2%)
Runs: 41.4 41.7 41.9 42 42.2 42.6 43.3 43.4 43.5 43.7 44.6 44.8 44.9 44.9 44.9 45.1 45.1 45.3 45.4 45.5 45.6 45.6 45.6 45.6 46 46.2 46.2 46.4 46.7 46.8 47.1 47.4 47.9 48.3 48.5 48.7 48.7 48.8 48.8 48.9 48.9 49.2 49.2 49.4 49.4 49.5 49.6 49.6 49.7 49.8 49.9 50 50.4 50.5 50.6 51.2 51.5 51.7 51.9 53.1
Report typing (CPU/UI) Baseline
Mean: 26.398 %
Stdev: 0.628 % (2.4%)
Runs: 25 25.3 25.3 25.4 25.4 25.5 25.5 25.6 25.8 25.9 25.9 25.9 25.9 26 26 26 26 26.1 26.2 26.2 26.2 26.3 26.4 26.4 26.4 26.4 26.4 26.4 26.4 26.5 26.5 26.5 26.6 26.6 26.6 26.6 26.6 26.7 26.7 26.8 26.8 26.8 26.8 26.8 26.8 26.8 26.9 27 27.1 27.2 27.2 27.5 27.6 27.7 28

Current
Mean: 26.468 %
Stdev: 0.797 % (3.0%)
Runs: 24.8 24.9 24.9 25 25.1 25.1 25.2 25.3 25.4 25.4 25.5 25.9 26 26 26.1 26.1 26.1 26.1 26.2 26.2 26.2 26.3 26.3 26.4 26.5 26.5 26.5 26.5 26.5 26.5 26.6 26.6 26.6 26.7 26.7 26.7 26.8 26.8 26.8 26.9 26.9 27 27 27 27 27.1 27.2 27.2 27.2 27.2 27.3 27.3 27.4 27.4 27.5 27.6 27.6 27.8 28.2
Chat opening Chat TTI Baseline
Mean: 473.695 ms
Stdev: 132.323 ms (27.9%)
Runs: 235.9018149971962 239.6307379975915 256.31477899849415 269.17093899846077 272.48140500485897 289.7213950008154 289.99186200648546 299.7595620006323 300.305744998157 302.60872400552034 306.3326830044389 313.09749399870634 320.50732400268316 325.1106770038605 333.00358099490404 349.3297529965639 358.73872900009155 358.9370520040393 366.61934400349855 378.5980629995465 391.16312699764967 392.8357749953866 393.024494998157 425.900349996984 478.3831380009651 481.79443400353193 513.6402180045843 517.5754809975624 521.447550997138 525.3430590033531 531.8503829985857 533.9028320014477 534.3878990039229 542.3623460009694 542.7235110029578 545.1954750046134 545.768920995295 548.6400559991598 550.755982004106 557.8026529997587 561.9446210041642 563.6439220011234 571.2253829985857 572.625610999763 576.0617270022631 580.8330080062151 583.9763190001249 585.0835370048881 590.3677579984069 599.3606769964099 620.4173579961061 625.734090000391 626.0179859995842 630.8008219972253 630.8961590006948 632.5846349969506 637.022421002388 643.2620860040188 647.8646650016308 701.3194179981947

Current
Mean: 500.995 ms
Stdev: 122.894 ms (24.5%)
Runs: 287.14880400151014 303.91516199707985 307.75960299372673 308.12923200428486 308.4273279979825 309.1605229973793 311.6495769992471 314.9720050022006 323.25740599632263 324.4336749985814 325.85591699928045 326.99918600171804 335.9147959947586 356.2594409957528 357.1470140069723 357.9077560007572 377.18424500525 381.7193190008402 383.38525399565697 492.00126200169325 493.78397700190544 494.40869099646807 497.80004899948835 518.90625 522.9426679983735 526.7147219926119 530.3392739966512 532.4316809996963 534.0390219986439 552.960124000907 554.4322509989142 556.4156090021133 563.121175006032 563.5338129997253 563.7142750024796 569.5251470059156 570.5678309947252 571.2352290004492 578.1592620015144 579.3524580001831 584.6909999996424 587.9049480035901 589.9062099978328 593.9604900032282 594.3961179926991 603.2799070030451 603.5355229973793 604.7649340033531 609.7171630039811 613.798014998436 621.9650880023837 622.3727620020509 624.6635340005159 630.9822179973125 631.2591150030494 633.4577229991555 646.5911870002747 652.2241619974375 655.3154700025916 687.2770999968052
Chat opening (CPU) Baseline
Mean: 156.293 %
Stdev: 5.336 % (3.4%)
Runs: 147.56316561694422 148.20879669232966 148.32709151917862 148.9971029652304 149.06374111616626 149.30737969963826 149.33571994743664 149.6279178562096 149.9622452108005 150.16560002534598 150.2470119521912 150.26498229919247 150.45067400375004 151.63012006967423 151.75310091491497 152.65081963309953 153.16096082236993 153.21756601529918 153.43532220325056 153.49210054444345 153.51078723180154 153.79831316464984 153.86614845773147 154.28326016969154 154.67729106039812 154.7501429663178 154.75859304085887 154.923561541263 155.02537419775268 155.47532930729838 155.50116770928588 156.09732046354955 156.26038531245766 156.63874903552775 156.70376840093894 156.7373903690446 157.54531029872277 157.91331537272265 157.98285720008658 158.46024338491566 158.70972341032223 158.96817320163623 159.29364458689645 159.73202014055954 160.47117967994748 160.762846337621 160.887118193891 161.0519447225025 161.42771447941615 161.71542618576044 161.91747718308415 162.98522838568567 163.48446567508495 164.42958403131615 165.3203896687422 165.34350824424794 165.8969799155903 166.06530212997737 166.29820487535923 167.06668919958742

Current
Mean: 157.804 %
Stdev: 6.287 % (4.0%)
Runs: 143.12624498836388 145.27997992944358 145.61221779548464 146.63557685495024 147.66786215086427 149.13893435613375 149.34434827405997 150.6582776924479 150.9193808716617 151.43092774671726 152.71276570365256 152.9717966882568 153.06582345909908 153.24404852102788 153.71787377625705 153.81910377285033 154.28883090024374 154.94523378614696 155.45234304663379 155.92476981243212 156.01872129427446 156.10948934008155 156.2337317397078 156.2347217914769 156.24179716731115 156.53493013972053 156.90480256310178 157.03102987659503 157.5226284430282 157.56756603230286 157.84778335481369 158.07587097434322 158.63803950149747 158.8419853222082 159.10127677874445 160.27145708582844 160.44036448121628 160.74271615898348 160.82387082489876 160.84265926775583 161.14028240487968 161.18710273893444 161.3006199207327 161.4211832258372 161.79994377120371 162.29530870264722 162.3622502670621 162.7638812059922 163.41640647777442 164.04957489447662 164.3534277622061 164.7500226191382 165.68725099601602 166.61285103739323 167.02851047350453 168.18554126466418 168.2327759708791 169.33582202373788 172.55613688180526
Chat opening (FPS) Baseline
Mean: 57.605 FPS
Stdev: 1.834 FPS (3.2%)
Runs: 53.944081210696744 54.088022923335586 54.19317734491218 54.946911893034496 55.04470271945763 55.049145522268006 55.25593060771667 55.28124136177121 55.36627754113725 55.47462876708204 55.520839731437 55.748647413555986 55.89727973049357 56.11738399753996 56.173899424616565 56.34916141771683 56.41609516190354 56.528434953123316 56.55044525066999 56.60366830773524 56.60678523932012 56.61989218083047 56.6762261381679 56.67784954274568 57.04359284866891 57.05272864220353 57.27033483947854 57.40357623311628 57.51024158559662 57.59936571357743 57.61198446988656 57.701864745646255 57.77756505766401 58.01118638453785 58.230279965397045 58.27817775376646 58.579518726840256 58.593021299437396 58.91737786490346 58.97289215209487 59.16816801134523 59.20836042586328 59.31260448158242 59.372269874583864 59.43800291945248 59.49147119336468 59.66932702110251 59.76796764279157 59.82786107530136 59.863720638084885 59.893898776305626 59.99621967565241 60 60 60 60 60 60 60

Current
Mean: 57.547 FPS
Stdev: 1.668 FPS (2.9%)
Runs: 53.394115544242304 54.45969352255774 55.06245583463405 55.19992695058877 55.20636490180391 55.221866081945855 55.27011893102794 55.27332719449302 55.39406263845669 55.498485868863646 55.64994044030143 55.82451337214093 55.858384242133205 55.939364290126846 56.16084969391144 56.49124638268369 56.671152763312236 56.70552659439561 56.710771578895766 56.78133719193478 56.94573586854073 56.99041641115338 56.999379120313854 57.026788547260765 57.06042176838192 57.09651384906791 57.15160448633027 57.24032244601587 57.738769686009206 57.753539451055936 57.81359717392894 57.9820415400704 58.11585289456912 58.145101380859984 58.177072040861646 58.19204678383201 58.31980107985866 58.327072692033994 58.37888876640375 58.5248491223196 58.533235359570966 58.545834859458765 58.54891864024924 58.66651956235765 58.943647036933655 59.05735804034048 59.06604269170645 59.07454253841108 59.09787802239491 59.39443542073235 59.71262558485529 59.875268806633116 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 376.016 MB
Stdev: 4.119 MB (1.1%)
Runs: 364.8580729166667 365.6471354166667 367.6536458333333 368.0559895833333 368.9114583333333 370.9970703125 371.3567708333333 371.6142578125 371.8619791666667 372.33203125 372.5403645833333 372.7333984375 373.126953125 373.349609375 373.859375 374.044921875 374.1650390625 374.2177734375 374.8193359375 374.8271484375 374.9228515625 375.19140625 375.302734375 375.75390625 375.8232421875 376.087890625 376.259765625 376.2646484375 376.4638671875 376.4677734375 376.5927734375 376.677734375 376.869140625 377.2451171875 377.544921875 377.7177734375 378.15234375 378.1708984375 378.3349609375 378.3642578125 378.4189453125 378.70703125 378.912109375 379.3216145833333 379.40625 379.4443359375 379.5126953125 380.3115234375 380.39453125 380.7021484375 380.8408203125 381.0400390625 381.2060546875 381.8095703125 381.888671875 382.671875 383.1650390625

Current
Mean: 375.132 MB
Stdev: 5.285 MB (1.4%)
Runs: 360.87109375 362.2018229166667 362.7721354166667 367.5576171875 367.7356770833333 368.1705729166667 368.2578125 368.3841145833333 368.4830729166667 368.7669270833333 369.9466145833333 370.07421875 370.7864583333333 370.8372395833333 371.0888671875 371.49609375 371.5065104166667 371.6744791666667 371.7109375 372.9599609375 373.689453125 374.3818359375 374.4951171875 374.7626953125 374.7841796875 375.15625 375.8017578125 375.94921875 376.037109375 376.56640625 376.654296875 377.021484375 377.1162109375 377.23046875 377.2841796875 377.3193359375 377.431640625 377.9248046875 377.9482421875 377.998046875 378.228515625 378.33984375 378.4462890625 378.6298828125 378.830078125 379.1376953125 379.298828125 379.912109375 379.98046875 380.166015625 380.3017578125 380.609375 380.6640625 380.880859375 380.888671875 381.5966796875 382.30078125 382.4921875 382.619140625 383.75390625
Chat opening (CPU/JS) Baseline
Mean: 76.172 %
Stdev: 2.558 % (3.4%)
Runs: 69.7 71.6 71.8 72.4 72.4 72.9 72.9 72.9 73.3 73.4 73.5 73.8 73.8 74 74.2 74.7 74.7 74.9 75.2 75.2 75.2 75.2 75.2 75.3 75.4 75.5 75.5 75.7 75.9 75.9 76.6 76.6 76.7 76.8 76.9 77 77.1 77.2 77.2 77.4 77.6 77.6 77.8 77.9 77.9 78 78.1 78.4 78.4 78.5 78.5 78.6 78.8 79.1 79.1 79.2 80.6 80.8 81.3 82.5

Current
Mean: 76.350 %
Stdev: 3.305 % (4.3%)
Runs: 68.9 69.7 70.5 71.6 71.9 72 72.7 73.1 73.2 73.4 73.4 73.4 73.8 73.8 73.9 74.1 74.1 74.5 74.7 74.9 74.9 75 75.1 75.2 75.2 75.3 75.4 75.4 76.1 76.1 76.2 76.4 76.4 76.5 76.7 77.1 77.1 77.3 77.7 77.8 77.9 77.9 78.1 78.5 78.5 78.8 78.8 78.9 78.9 78.9 79.4 79.7 79.7 80.4 81.4 81.5 82.4 82.4 83.9 84.5
Chat opening (CPU/UI) Baseline
Mean: 32.716 %
Stdev: 1.727 % (5.3%)
Runs: 29.7 29.7 29.8 29.9 30 30.1 30.3 30.4 30.6 30.6 30.7 31.1 31.3 31.8 31.8 31.9 31.9 31.9 31.9 32 32 32 32.2 32.2 32.3 32.4 32.4 32.4 32.5 32.5 32.8 32.9 32.9 33 33 33.2 33.4 33.5 33.7 33.7 33.7 33.9 33.9 34 34.1 34.1 34.4 34.4 34.6 34.7 34.7 34.9 34.9 35.1 35.2 35.3 36.3 36.9

Current
Mean: 32.675 %
Stdev: 2.724 % (8.3%)
Runs: 26.6 26.9 27.9 27.9 28 28.7 29.1 29.1 29.2 29.8 29.9 30.1 30.3 31.3 31.4 31.4 31.4 31.5 31.7 31.9 31.9 32 32.1 32.1 32.3 32.3 32.4 32.6 32.6 32.7 32.7 32.8 32.9 32.9 33.3 33.5 33.7 33.7 33.7 33.9 34 34.3 34.4 34.5 34.6 34.7 35.2 35.3 35.4 35.4 35.5 35.8 35.8 35.9 36 36.8 37.2 37.4 39.4
Linking (CPU) Baseline
Mean: 159.392 %
Stdev: 3.096 % (1.9%)
Runs: 152.12660579807422 153.49937868829082 153.59583756501578 153.70937226838186 154.2507922103712 154.82862084806152 155.3787476228568 155.4888599784692 155.65140260668474 156.24992786345078 156.64146187229966 156.88895212799596 157.05994089720278 157.20995932323555 157.52901321690427 157.58189017252712 157.66414816718876 157.98030013761655 158.04004608769168 158.08330224178144 158.40273925844585 158.4266295502919 158.47610980031467 158.51381278617768 158.8093721346822 158.86354476066367 158.90923941249335 159.10864964865385 159.2162396809405 159.2364671055604 159.4247633681424 159.4248028429979 159.80079681274904 159.81426827494516 159.89734748908157 160.10559152442286 160.22981589579754 160.6472703764596 160.8363704501567 160.9467485990914 160.95038060468593 161.21420137069032 161.35466231532155 161.37985451659816 161.56754427169372 161.6150770836285 161.74254615383393 161.97914048875268 162.03599917029044 162.14283924706257 162.32074677998432 162.40429874000208 163.18630513731975 163.21705442283638 163.31349096408493 163.47447827593476 164.3204302674207 165.525290274609 165.53918803081882 165.66199995678411

Current
Mean: 159.591 %
Stdev: 3.228 % (2.0%)
Runs: 153.19357414053735 153.27653137892935 154.7219845971838 154.81083723315325 154.87939276319716 155.19022751665628 155.23522012234136 156.05012259407175 156.1742164527291 156.18121217952242 156.3362740437068 156.99134237108996 157.13142838269323 157.18295984124524 157.31097339363882 157.4071630471899 157.4801919593266 157.5745964983768 157.6457800032837 157.83435222475626 157.88638074713742 158.0004371408508 158.2444700359563 158.2577726475092 158.42118179045306 158.49591249857815 158.63295594910764 159.10968462178653 159.20535496228595 159.22879364062425 159.32872050419178 159.35041388214697 159.46350670540178 159.54366847381078 160.1750882750687 160.21223616054465 160.5413624792735 160.55421921210208 160.8275797619915 161.1237455746682 161.36826373721846 161.50919347724826 161.66686329413372 161.75290672642058 161.758437868157 161.80659581493413 162.06413622729062 162.2865387865851 162.46700291415382 163.1409230278475 163.28706309578027 163.67083765777159 163.9532249897243 164.07996225344797 164.12980800819977 164.2608708247448 164.37927607103643 165.59139305137674 166.4192221317893 166.67541852945766
Linking (FPS) Baseline
Mean: 59.997 FPS
Stdev: 0.011 FPS (0.0%)
Runs: 59.94158922197264 59.965092609048476 59.966054189270835 59.97962995384062 59.98800672291086 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Linking (RAM) Baseline
Mean: 406.328 MB
Stdev: 3.214 MB (0.8%)
Runs: 398.8391927083333 399.1022135416667 400.0826822916667 401.0553385416667 401.2233072916667 401.3684895833333 401.9622395833333 402.1477864583333 402.86640625 402.9309895833333 403.1640625 403.2584635416667 403.5266927083333 403.9095052083333 404.6243489583333 404.7669270833333 404.96875 405.09375 405.423828125 405.4544270833333 405.513671875 405.521484375 405.9583333333333 405.974609375 406.03738839285717 406.0748697916667 406.1595052083333 406.2864583333333 406.3802083333333 406.3990885416667 406.548828125 407.1770833333333 407.2669270833333 407.3053385416667 407.3619791666667 407.5052083333333 407.5475260416667 407.6692708333333 407.7571614583333 407.8580729166667 407.9563802083333 408.234375 408.43359375 408.4466145833333 408.4973958333333 408.6380208333333 408.8424479166667 409.0983072916667 409.4479166666667 409.8020833333333 410.1165364583333 410.4817708333333 410.6635044642857 410.7533482142857 411.2864583333333 411.8170572916667 411.96484375 412.4856770833333

Current
Mean: 407.486 MB
Stdev: 3.688 MB (0.9%)
Runs: 398.65234375 399.3313802083333 400.03125 400.509765625 400.53515625 401.4752604166667 401.7571614583333 402.5462239583333 402.6178385416667 403.17578125 404.2727864583333 404.28236607142856 405.20535714285717 405.4752604166667 405.6881510416667 405.84765625 406.11328125 406.4772135416667 406.5774739583333 406.78125 406.7916666666667 406.876953125 407.115234375 407.32421875 407.46651785714283 407.5794270833333 407.6510416666667 407.9993489583333 408.11328125 408.2415364583333 408.30189732142856 408.3880208333333 408.4095052083333 408.4681919642857 408.52957589285717 408.7278645833333 408.798828125 409.0260416666667 409.19363839285717 409.58203125 409.58203125 409.8541666666667 409.9537760416667 410.24609375 410.2526041666667 410.4557291666667 410.5638020833333 410.72488839285717 410.9596354166667 411.00390625 411.4419642857143 412.22544642857144 412.3125 412.3138020833333 412.3177083333333 413.099609375 413.10379464285717 413.8626302083333
Linking (CPU/JS) Baseline
Mean: 84.103 %
Stdev: 1.434 % (1.7%)
Runs: 80.4 81.1 81.7 82.1 82.1 82.2 82.2 82.3 82.3 82.4 82.6 82.8 82.8 82.9 83 83.4 83.5 83.6 83.6 83.6 83.7 83.7 83.7 83.7 83.8 83.9 83.9 83.9 84 84.1 84.1 84.1 84.5 84.5 84.6 84.6 84.7 84.8 84.8 84.8 84.9 85 85 85.1 85.2 85.2 85.3 85.3 85.4 85.4 85.5 85.8 85.8 86 86 86.1 86.3 86.6 87.7

Current
Mean: 84.237 %
Stdev: 1.766 % (2.1%)
Runs: 80.1 81 81.2 81.6 81.8 81.9 82 82 82.2 82.2 82.3 82.5 82.5 82.6 82.7 82.7 82.9 83 83.2 83.4 83.5 83.5 83.6 83.6 83.6 83.6 84.1 84.3 84.4 84.5 84.6 84.7 84.7 84.8 84.9 85 85 85.1 85.2 85.3 85.3 85.3 85.4 85.5 85.5 85.6 85.6 85.6 85.6 85.8 85.8 85.9 86.1 86.2 86.6 86.9 86.9 87.3 87.5 88
Linking (CPU/UI) Baseline
Mean: 34.634 %
Stdev: 1.456 % (4.2%)
Runs: 31.5 32.3 32.5 32.5 32.5 32.7 32.7 32.8 32.9 32.9 33.2 33.4 33.5 33.5 33.5 33.6 33.7 33.8 33.8 33.9 33.9 33.9 34.1 34.2 34.2 34.5 34.5 34.5 34.6 34.6 34.8 34.8 34.9 34.9 35.1 35.2 35.2 35.2 35.2 35.3 35.4 35.4 35.4 35.5 35.6 35.7 35.9 36.2 36.5 36.5 36.5 36.5 36.7 36.8 37 37.1 37.1 38.2

Current
Mean: 34.378 %
Stdev: 1.599 % (4.7%)
Runs: 30.4 30.4 30.9 31.8 32.2 32.2 32.4 32.8 32.9 33 33.1 33.2 33.2 33.2 33.3 33.5 33.5 33.6 33.6 33.8 33.9 33.9 34.1 34.1 34.2 34.3 34.3 34.3 34.4 34.5 34.5 34.5 34.5 34.6 34.7 34.8 34.8 34.8 34.9 35 35.1 35.1 35.1 35.3 35.5 35.5 35.5 35.7 35.9 36.1 36.2 36.5 36.5 36.7 36.9 36.9 37 37.1 37.6

Copy link
Contributor

github-actions bot commented Dec 6, 2024

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

Copy link
Contributor

github-actions bot commented Dec 9, 2024

🚀 Deployed to staging by https://github.com/tgolen in version: 9.0.73-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 failure ❌

Copy link
Contributor

🚀 Deployed to production by https://github.com/luacmartins in version: 9.0.73-8 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DeployBlockerCash This issue or pull request should block deployment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants