Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Don't complete onboarding if not an invited user #52656

Merged
merged 1 commit into from
Nov 18, 2024

Conversation

deetergp
Copy link
Contributor

Explanation of Change

Users that were not invited to Expensify by another user, but did go through the organic onboarding process were seeing the invite onboarding message when adding an account to their wallet. This PR adds a check to make sure the user has an inviteType set to their introSelected NVP which is a property that will not be set for users the came to Expensify organically.

Fixed Issues

$ https://github.com/Expensify/Expensify/issues/444853
PROPOSAL: N/A

Tests

  1. Sign up for a new account at NewDot
  2. Choose the last option from the list on the onboarding modal
  3. Navigate to Settings > Wallet and click on Add bank account
  4. Verify that you DO NOT get a message from Concierge that looks like the following
Screenshot 2024-11-15 at 3 37 59 PM
2024-11-15_15-42-43.mp4
  • Verify that no errors appear in the JS console

Offline tests

N/A as Concierge requires connectivity

QA Steps

Same as the Test steps

  • Verify that no errors appear in the JS console

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I verified the translation was requested/reviewed in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
iOS: Native
iOS: mWeb Safari
MacOS: Chrome / Safari
MacOS: Desktop

@deetergp deetergp self-assigned this Nov 15, 2024
@deetergp deetergp marked this pull request as ready for review November 15, 2024 23:49
@deetergp deetergp requested a review from a team as a code owner November 15, 2024 23:49
@melvin-bot melvin-bot bot requested review from allgandalf and removed request for a team November 15, 2024 23:49
Copy link

melvin-bot bot commented Nov 15, 2024

@allgandalf Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@allgandalf
Copy link
Contributor

allgandalf commented Nov 16, 2024

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
Screen.Recording.2024-11-17.at.9.26.21.PM.mov
Android: mWeb Chrome
Screen.Recording.2024-11-17.at.9.35.17.PM.mov
iOS: Native
Screen.Recording.2024-11-17.at.9.37.09.PM.mov
iOS: mWeb Safari
Screen.Recording.2024-11-17.at.9.38.25.PM.mov
MacOS: Chrome / Safari
Screen.Recording.2024-11-17.at.8.58.14.PM.mov
MacOS: Desktop
Screen.Recording.2024-11-17.at.9.00.38.PM.mov

Copy link
Contributor

@allgandalf allgandalf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change tests well and LGTM

@melvin-bot melvin-bot bot requested a review from Julesssss November 17, 2024 16:10
Copy link

melvin-bot bot commented Nov 17, 2024

@Julesssss Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

Copy link

melvin-bot bot commented Nov 17, 2024

🎯 @allgandalf, thanks for reviewing and testing this PR! 🎉

An E/App issue has been created to issue payment here: #52676.

@Julesssss Julesssss merged commit b0378aa into main Nov 18, 2024
17 checks passed
@Julesssss Julesssss deleted the scott-fixErrantOnboardingMessage branch November 18, 2024 09:53
@OSBotify
Copy link
Contributor

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Nov 18, 2024
Copy link
Contributor

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Linking 778.001 ms → 970.450 ms (+192.448 ms, +24.7%) 🔴
Show details
Name Duration
Linking Baseline
Mean: 778.001 ms
Stdev: 31.365 ms (4.0%)
Runs: 677.4761560000479 680.8329269997776 729.7279050014913 729.7586270011961 734.4964599981904 738.7595210000873 740.484172001481 746.4325769990683 750.7561849988997 753.6048590019345 754.3495690003037 757.1055499985814 757.2315270006657 759.5131429992616 761.547079000622 763.6735839992762 764.4121100008488 766.3405769988894 767.1126310005784 767.1479899995029 767.1661380007863 768.8775230012834 770.2353110015392 772.5373129993677 774.8189699985087 775.6392419971526 777.178223002702 778.9170739986002 780.18819199875 782.5691329985857 785.0685629993677 786.4280189983547 790.2229010015726 790.5552980005741 791.890788000077 792.8773200027645 793.0541589967906 795.171346001327 796.1735839992762 796.406086999923 797.3052169978619 799.1195480003953 799.6140139997005 806.4680589996278 806.4825439974666 806.5641690008342 807.7021490000188 807.7737630009651 808.6221520006657 809.3485919982195 809.756185002625 811.3110360018909 811.6202809996903 813.1717130020261 821.9648439995944 827.7612709999084 834.7521569989622

Current
Mean: 970.450 ms
Stdev: 271.742 ms (28.0%)
Runs: 706.1827390007675 727.6145840026438 732.2942309975624 740.2100830003619 743.6058360002935 751.1309409998357 751.2552089989185 753.9742840006948 755.9099540002644 759.2700200006366 760.2201739996672 760.437663000077 760.5140389986336 760.9344080016017 762.6951499991119 767.6440430022776 768.7308759987354 769.1533210016787 769.2140300013125 770.1826580017805 770.8202720023692 772.5599780008197 775.2460939995944 777.008910998702 778.4086510017514 779.0703129991889 779.6514899991453 780.7947999984026 781.7643229998648 782.7403570003808 783.1818040013313 783.5808509998024 783.6290279999375 784.2161459997296 784.756266001612 784.829549998045 786.6049399971962 787.4575200006366 787.6560059972107 787.9007170014083 788.5755209997296 789.0177000015974 790.5961919985712 791.9490559995174 792.8536389991641 799.1163749992847 799.9397380016744 802.054119002074 803.5933439992368 806.8672690019011 810.1276040002704 810.2490650005639 811.3638920001686 815.9480799995363 820.3329269997776 823.9877929985523 835.3085540011525 845.376709997654 947.3482670001686 986.5691730007529 1229.3960779979825 1251.444784000516 1256.766845997423 1270.2845880016685 1278.1907150000334 1284.8458659984171 1290.4188239984214 1292.4861660003662 1298.9991049990058 1300.525553997606 1304.0917980000377 1313.9626880027354 1316.0410970002413 1318.5448819994926 1327.2141520008445 1336.1230469979346 1339.5075289979577 1342.0265309996903 1349.8387870006263 1350.8010259978473 1357.312989000231 1377.256878003478 1395.960694000125 1432.046672001481 1485.5736500024796 1500.7058519981802 1519.3663339987397 1525.069784000516 1550.9834810011089

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunchEnd_To_appCreationStart 61.508 ms → 79.729 ms (+18.220 ms, +29.6%) 🟡
App start time nativeLaunch 31.018 ms → 25.700 ms (-5.318 ms, -17.1%) 🟢
App start time appCreation 80.712 ms → 82.567 ms (+1.855 ms, +2.3%)
App start time appCreationEnd_To_contentAppeared 655.017 ms → 697.610 ms (+42.593 ms, +6.5%)
App start time runJsBundle 469.900 ms → 496.183 ms (+26.283 ms, +5.6%)
App start time regularAppStart 0.025 ms → 0.025 ms (+0.000 ms, +0.6%)
App start time TTI 1492.898 ms → 1546.409 ms (+53.510 ms, +3.6%)
App start time contentAppeared_To_screenTTI 662.136 ms → 662.981 ms (+0.845 ms, ±0.0%)
App start time (CPU) 135.307 % → 135.639 % (+0.332 %, ±0.0%)
App start time (FPS) 60.000 FPS → 59.830 FPS (-0.170 FPS, ±0.0%)
App start time (RAM) 363.920 MB → 365.429 MB (+1.508 MB, ±0.0%)
App start time (CPU/JS) 74.076 % → 72.507 % (-1.569 %, -2.1%)
App start time (CPU/UI) 28.033 % → 29.089 % (+1.056 %, +3.8%)
Open search router TTI Load Search Options 120.740 ms → 119.801 ms (-0.939 ms, -0.8%)
Open search router TTI Open Search Router TTI 551.849 ms → 558.138 ms (+6.289 ms, +1.1%)
Open search router TTI (CPU) 133.990 % → 134.035 % (+0.045 %, ±0.0%)
Open search router TTI (FPS) 59.773 FPS → 59.821 FPS (+0.048 FPS, ±0.0%)
Open search router TTI (RAM) 370.291 MB → 370.717 MB (+0.425 MB, ±0.0%)
Open search router TTI (CPU/JS) 68.883 % → 68.857 % (-0.026 %, ±0.0%)
Open search router TTI (CPU/UI) 27.492 % → 28.172 % (+0.680 %, +2.5%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 434.808 ms → 431.976 ms (-2.833 ms, -0.7%)
Report typing (CPU) 99.711 % → 99.009 % (-0.702 %, -0.7%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 505.146 MB → 506.017 MB (+0.871 MB, ±0.0%)
Report typing (CPU/JS) 46.985 % → 46.318 % (-0.667 %, -1.4%)
Report typing (CPU/UI) 24.657 % → 24.719 % (+0.062 %, ±0.0%)
Chat opening Chat TTI 518.744 ms → 532.408 ms (+13.664 ms, +2.6%)
Chat opening (CPU) 141.556 % → 144.612 % (+3.057 %, +2.2%)
Chat opening (FPS) 59.911 FPS → 59.988 FPS (+0.076 FPS, ±0.0%)
Chat opening (RAM) 386.007 MB → 393.287 MB (+7.281 MB, +1.9%)
Chat opening (CPU/JS) 71.152 % → 72.408 % (+1.257 %, +1.8%)
Chat opening (CPU/UI) 28.795 % → 29.619 % (+0.824 %, +2.9%)
Linking (CPU) 148.900 % → 148.299 % (-0.601 %, ±0.0%)
Linking (FPS) 60.000 FPS → 60.000 FPS
Linking (RAM) 425.098 MB → 424.462 MB (-0.636 MB, ±0.0%)
Linking (CPU/JS) 80.826 % → 80.648 % (-0.178 %, ±0.0%)
Linking (CPU/UI) 28.468 % → 28.193 % (-0.275 %, -1.0%)
Show details
Name Duration
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 61.508 ms
Stdev: 8.763 ms (14.2%)
Runs: 47 48 48 50 50 51 51 52 52 52 52 53 54 55 55 56 56 56 57 58 58 58 58 58 59 59 59 59 59 59 60 60 60 61 61 62 63 63 64 65 65 67 67 68 68 69 69 69 69 70 70 72 75 76 77 77 79 82 82

Current
Mean: 79.729 ms
Stdev: 11.442 ms (14.4%)
Runs: 58 64 64 64 65 65 66 66 66 68 70 70 70 71 71 71 71 72 72 72 72 73 74 75 76 76 76 77 77 77 78 79 80 81 81 82 83 84 84 86 86 86 86 89 90 90 91 91 91 91 92 92 96 97 97 100 101 104 107
App start time nativeLaunch Baseline
Mean: 31.018 ms
Stdev: 3.017 ms (9.7%)
Runs: 27 27 27 27 28 28 28 28 28 28 29 29 29 29 29 29 29 29 29 29 29 29 29 29 30 30 30 30 30 30 30 31 31 31 31 32 32 32 32 32 32 32 33 33 33 34 34 34 34 35 35 35 35 36 38 39 40

Current
Mean: 25.700 ms
Stdev: 4.492 ms (17.5%)
Runs: 21 21 21 21 22 22 22 22 22 22 22 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 25 25 25 25 26 26 26 26 26 27 29 29 30 30 30 30 31 31 32 32 33 35 35 36 37 38
App start time appCreation Baseline
Mean: 80.712 ms
Stdev: 9.386 ms (11.6%)
Runs: 63 65 66 68 69 69 70 70 70 72 72 72 72 72 72 73 74 74 74 75 76 76 76 78 78 78 80 80 80 81 81 81 82 83 83 83 83 83 84 84 85 85 86 87 87 87 88 89 90 90 92 93 93 94 95 96 96 100 107

Current
Mean: 82.567 ms
Stdev: 10.487 ms (12.7%)
Runs: 60 65 66 68 69 70 71 71 72 72 72 72 73 74 74 74 74 74 75 75 76 76 77 77 78 79 81 82 82 82 83 83 83 85 85 86 86 87 87 87 88 88 88 88 89 90 91 93 94 95 95 96 96 96 98 98 100 101 101 106
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 655.017 ms
Stdev: 51.616 ms (7.9%)
Runs: 534 538 569 571 574 576 579 583 584 587 588 590 594 605 614 621 637 637 639 650 654 655 656 661 662 664 665 665 667 671 672 674 674 675 680 680 681 682 684 686 687 687 687 688 689 693 694 695 700 705 710 712 714 720 721 732 736 743

Current
Mean: 697.610 ms
Stdev: 52.468 ms (7.5%)
Runs: 588 590 591 602 610 616 618 620 622 624 625 635 637 652 672 677 679 683 684 688 689 692 693 693 696 696 699 700 710 711 716 716 717 718 718 718 720 726 727 728 728 730 732 735 740 743 745 746 746 748 748 752 756 759 761 764 776 776 778
App start time runJsBundle Baseline
Mean: 469.900 ms
Stdev: 35.466 ms (7.5%)
Runs: 394 396 407 407 418 419 419 422 425 425 428 431 431 434 435 439 448 457 460 464 465 465 468 469 469 471 471 471 472 474 477 477 477 478 479 481 484 487 487 487 489 490 490 491 491 493 495 495 501 504 505 506 508 509 511 518 524 526 532 548

Current
Mean: 496.183 ms
Stdev: 38.019 ms (7.7%)
Runs: 415 422 422 425 425 438 441 443 445 446 447 451 453 454 460 466 487 487 489 491 492 495 495 496 496 497 499 501 502 503 503 504 504 510 512 513 515 515 518 520 521 522 522 523 523 524 527 527 528 528 530 530 533 535 537 538 553 554 557 562
App start time regularAppStart Baseline
Mean: 0.025 ms
Stdev: 0.003 ms (10.9%)
Runs: 0.019531000405550003 0.020020000636577606 0.02042599767446518 0.02075200155377388 0.020791999995708466 0.021199997514486313 0.02128100022673607 0.02132200077176094 0.0215659998357296 0.021646998822689056 0.02185099944472313 0.021931998431682587 0.022175997495651245 0.022339001297950745 0.022461000829935074 0.022583000361919403 0.022828001528978348 0.023274999111890793 0.023396998643875122 0.023600000888109207 0.023763000965118408 0.023802999407052994 0.023843999952077866 0.023966997861862183 0.024007000029087067 0.02421100065112114 0.024576999247074127 0.024942997843027115 0.024983000010252 0.025105997920036316 0.025269001722335815 0.025432001799345016 0.025511998683214188 0.025513000786304474 0.025553997606039047 0.02567499876022339 0.025675002485513687 0.025675002485513687 0.025675002485513687 0.025756999850273132 0.02595999836921692 0.02595999836921692 0.02624499797821045 0.026652000844478607 0.026937000453472137 0.027180999517440796 0.027222000062465668 0.02738500013947487 0.027424998581409454 0.0276699997484684 0.02795400097966194 0.028077002614736557 0.028239000588655472 0.02831999957561493 0.02888999879360199 0.029133997857570648 0.029378000646829605 0.029784999787807465 0.031209997832775116

Current
Mean: 0.025 ms
Stdev: 0.003 ms (10.1%)
Runs: 0.01932699978351593 0.019531000405550003 0.020426001399755478 0.02046700194478035 0.02063000202178955 0.021035999059677124 0.02103700116276741 0.021239999681711197 0.021768998354673386 0.022461000829935074 0.022665001451969147 0.022746000438928604 0.023031000047922134 0.023600000888109207 0.023681003600358963 0.023723002523183823 0.023885998874902725 0.023924998939037323 0.02396700158715248 0.024087999016046524 0.02433300018310547 0.024454999715089798 0.024495001882314682 0.02449600026011467 0.024658001959323883 0.024698998779058456 0.02473900094628334 0.024984002113342285 0.0251460000872612 0.025227997452020645 0.0253090001642704 0.02538999915122986 0.025391001254320145 0.02559399977326393 0.025756999850273132 0.025756999850273132 0.02587899938225746 0.025960002094507217 0.025961000472307205 0.026204999536275864 0.026611000299453735 0.026815000921487808 0.026895999908447266 0.026937000453472137 0.027058999985456467 0.027098998427391052 0.027139998972415924 0.027302999049425125 0.027383998036384583 0.027587998658418655 0.02795400097966194 0.02795400097966194 0.027995001524686813 0.028239000588655472 0.028605002909898758 0.02864600345492363 0.02888999879360199 0.03055800125002861
App start time TTI Baseline
Mean: 1492.898 ms
Stdev: 119.628 ms (8.0%)
Runs: 1271.4318640008569 1276.1028480008245 1278.532349999994 1311.0183460004628 1316.7237519994378 1316.8364880010486 1326.3241889998317 1328.8868089988828 1329.5436640009284 1331.3346629999578 1343.6545259989798 1357.7349900007248 1366.9009510017931 1368.645135000348 1371.9790839999914 1374.8934220001101 1384.5385809987783 1409.679825000465 1412.3680140003562 1442.191018998623 1465.411901999265 1476.2499459981918 1491.176982998848 1493.9423419982195 1496.3022589981556 1501.9027119986713 1502.5680890008807 1502.7207270003855 1504.225462000817 1505.4350889995694 1506.1169090010226 1525.1672360002995 1531.7901119999588 1533.4913370013237 1539.8270029984415 1541.9207849986851 1542.4919589981437 1544.7171460017562 1547.9968600012362 1555.5506809987128 1556.6101649999619 1560.3536569997668 1560.8960909992456 1567.4875879995525 1575.1592799983919 1578.4040170013905 1580.416455000639 1592.8504859991372 1600.2733590006828 1602.7840639986098 1604.2086869999766 1607.930160999298 1608.8904800005257 1620.068737000227 1663.1392909996212 1664.5668479986489 1665.8449000008404 1681.8795059993863 1714.630651999265 1739.1839860007167

Current
Mean: 1546.409 ms
Stdev: 111.143 ms (7.2%)
Runs: 1318.7758769989014 1324.840854998678 1334.4581630006433 1344.904617998749 1351.8871969990432 1362.0773970000446 1383.3990969993174 1388.9068000018597 1389.1421369984746 1415.0947489999235 1418.3847759999335 1431.790569998324 1437.6453449986875 1446.1484640017152 1451.0866539999843 1473.9463590011 1485.7700459994376 1501.4774420000613 1509.7912990003824 1510.7249270007014 1519.9291319996119 1525.3960900008678 1525.4423649981618 1528.6840599998832 1529.1256989985704 1550.9438680000603 1554.6066390015185 1555.9302520006895 1560.2000360004604 1565.8146860003471 1570.0854060016572 1573.739932000637 1586.439222998917 1588.9083879999816 1595.2267750017345 1595.6716060005128 1597.1089369989932 1597.1626849994063 1598.8195069991052 1600.151344999671 1601.9534929990768 1604.0936929993331 1607.3852420002222 1608.6611450016499 1622.71614100039 1623.2563060000539 1625.7770190015435 1635.1726340018213 1652.8041490018368 1662.3244840018451 1666.7465989999473 1668.3772710002959 1670.4727090001106 1672.1166319996119 1689.9039469994605 1691.6614230014384 1692.194332998246 1699.0496199987829 1714.925377998501 1775.2946979999542
App start time contentAppeared_To_screenTTI Baseline
Mean: 662.136 ms
Stdev: 65.639 ms (9.9%)
Runs: 544.1028480008245 559.8364880010486 567.4318640008569 567.9009510017931 568.8868089988828 571.0183460004628 572.3346629999578 579.7237519994378 583.6545259989798 597.532349999994 602.3241889998317 603.6798250004649 605.1910189986229 612.5385809987783 612.7349900007248 614.3680140003562 618.9790839999914 621.6451350003481 626.8934220001101 631.411901999265 638.8960909992456 643.5680890008807 646.9423419982195 647.7901119999588 651.176982998848 653.2499459981918 655.1169090010226 658.8270029984415 662.3022589981556 668.1672360002995 671.3536569997668 672.2254620008171 672.4350889995694 677.2733590006828 677.4913370013237 680.7171460017562 680.9207849986851 684.9027119986713 685.5506809987128 689.7840639986098 693.4919589981437 695.416455000639 696.068737000227 697.4875879995525 699.6101649999619 702.9968600012362 710.8504859991372 714.2086869999766 719.4040170013905 735.1592799983919 739.9301609992981 745.1392909996212 786.5668479986489 787.8904800005257 805.8449000008404 814.1839860007167 816.630651999265

Current
Mean: 662.981 ms
Stdev: 53.767 ms (8.1%)
Runs: 545.904617998749 562.840854998678 571.0773970000446 580.4581630006433 582.8871969990432 589.1484640017152 595.1421369984746 600.7700459994376 607.3990969993174 608.7905699983239 610.3847759999335 613.7912990003824 621.7249270007014 623.0866539999843 626.0947489999235 627.9463590011001 632.9438680000603 633.3960900008678 639.1256989985704 647.4774420000613 648.0854060016572 650.4423649981618 655.2000360004604 655.9291319996119 656.8195069991052 658.6066390015185 658.6840599998832 658.739932000637 666.9083879999816 667.3852420002222 670.9302520006895 673.1089369989932 673.2267750017345 673.4392229989171 674.6611450016499 681.0936929993331 681.151344999671 682.1726340018213 683.9534929990768 684.7770190015435 685.2563060000539 686.8146860003471 688.6453449986875 691.1626849994063 699.4727090001106 702.71614100039 719.6716060005128 721.9253779985011 722.7465989999473 723.3772710002959 724.3244840018451 727.8041490018368 728.0496199987829 730.1166319996119 775.194332998246 793.2946979999542 793.6614230014384
App start time (CPU) Baseline
Mean: 135.307 %
Stdev: 4.457 % (3.3%)
Runs: 124.70831944378305 126.05199400682204 127.31609080073488 128.98810591118283 129.08484967273205 129.20558188957583 129.83633023437065 130.6826531228622 130.68986083499007 130.8695377221274 130.94042838018743 131.06013201969324 131.23032837416875 131.50321069838043 131.67418216630168 131.83656128718448 132.42220742220738 132.43156542526816 132.50272368363815 132.86945340331798 133.03046513422817 133.33588236313736 133.47408366123733 133.7057654075547 133.75805626462878 134.1551117636418 134.9249821386044 135.26171076515757 135.50535964323953 135.81312127236583 135.8410707686622 136.07782520489798 136.4833997343957 136.48794419120745 136.6051426974684 136.86878049157102 136.88028988503723 136.90225891416347 137.03650210762194 137.17029819344785 137.18221411642094 137.64432656663917 137.95238095238105 138.17447325876364 138.20068690304836 138.20566039236266 138.9312489520875 139.05575463571697 139.42359276896713 139.76897689768984 139.8609045577815 139.92208286686807 140.31023102310223 140.5333697007363 141.81775532618735 142.32122952062463 142.7519753630263 142.8402366863906 144.02572357516257 144.26630180559457

Current
Mean: 135.639 %
Stdev: 3.481 % (2.6%)
Runs: 126.72757879515233 126.91284098469724 129.4657826852651 129.8960843747508 129.9410323326095 130.51733509469557 130.68644326662704 131.20410354288438 132.10339297444514 132.625175257242 132.65818659469537 132.9178044531061 133.50763446375078 133.57220535505152 133.85142830991052 133.9195241723816 133.98318648580127 134.2993863173988 134.42160216776574 134.46910995556814 134.71784556402943 135.07645075265532 135.17702316704333 135.1902698312097 135.33813659064168 135.72854291417175 135.84226106288125 135.92903850258415 135.99814714494715 136.02088339621662 136.28950863213802 136.3680500065587 136.41094287626584 136.62783507895804 136.87417384707018 136.95366696567413 137.00921680513417 137.16748841598542 137.198871126272 137.2663544233448 137.5563008327663 137.66810871506226 138.17335561663216 138.23963213768968 138.42206688879872 138.5697509509987 138.71504801043298 139.06564789605764 139.19533538517004 139.2186945129491 139.70969828102415 139.75595669371427 139.86985391766265 140.58421650993515 140.84896768097957 141.21519357483373 143.73816865691197
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.002 FPS (0.0%)
Runs: 59.98900918442919 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.830 FPS
Stdev: 0.305 FPS (0.5%)
Runs: 58.821866971483 58.92285760845971 59.01634016100889 59.062541033082105 59.37942585629994 59.43949577801889 59.46666007138765 59.53203968061044 59.62947993515798 59.64426338703623 59.66341453978683 59.73454068281912 59.76757337390089 59.78452309427763 59.801171085391395 59.84782571326192 59.920174497676804 59.94654306919731 59.953087420345675 59.97789205550419 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 363.920 MB
Stdev: 3.662 MB (1.0%)
Runs: 355.529296875 356.126953125 356.1354166666667 357.162109375 357.669921875 359.1328125 359.1705729166667 360.5208333333333 361.1614583333333 361.3684895833333 361.6015625 361.8359375 361.865234375 361.97265625 362.0377604166667 362.3255208333333 362.5221354166667 362.5533854166667 362.6614583333333 362.7122395833333 362.8177083333333 362.92578125 362.99609375 363.4192708333333 363.4830729166667 363.5078125 363.66796875 363.68359375 364 364.1458333333333 364.2395833333333 364.2877604166667 364.82421875 364.8294270833333 364.9661458333333 365.08203125 365.1015625 365.5911458333333 365.724609375 366.0208333333333 366.0755208333333 366.3203125 366.7057291666667 366.7174479166667 367.1393229166667 367.244140625 367.6653645833333 367.7317708333333 367.9830729166667 368.2825520833333 368.3580729166667 369.4765625 370.1822916666667 371.328125 373.0325520833333

Current
Mean: 365.429 MB
Stdev: 3.628 MB (1.0%)
Runs: 357.583984375 359.09765625 359.83984375 360.61328125 360.7473958333333 360.86328125 360.9674479166667 361.4661458333333 362.0169270833333 362.1328125 362.3723958333333 362.37890625 362.3932291666667 362.59765625 362.6471354166667 363.4192708333333 363.62890625 364.1067708333333 364.109375 364.1106770833333 364.15625 364.1822916666667 364.23828125 364.3515625 364.4778645833333 364.5169270833333 364.5260416666667 364.6197916666667 364.7005208333333 364.9388020833333 365.2604166666667 365.2721354166667 365.73046875 365.7643229166667 365.90625 366.03125 366.05078125 366.1575520833333 366.3763020833333 366.4127604166667 366.5859375 366.7994791666667 367.30859375 368.2265625 368.44140625 368.6341145833333 368.83984375 369.1015625 369.453125 369.8658854166667 369.9466145833333 371.8138020833333 372.3697916666667 372.3919270833333 372.5703125 372.6653645833333 373.6575520833333
App start time (CPU/JS) Baseline
Mean: 74.076 %
Stdev: 4.368 % (5.9%)
Runs: 63.8 66.5 67.7 67.8 69.1 69.2 69.3 69.4 69.9 70.4 70.6 70.6 71.1 71.1 71.2 71.3 71.7 71.7 71.7 71.9 71.9 72 72 72.4 72.4 72.5 73.2 73.3 73.3 73.9 73.9 73.9 74 74.3 74.5 74.6 74.8 74.9 74.9 75.1 75.2 75.6 75.7 75.8 76.3 76.9 76.9 77.2 77.9 78 78 80.9 80.9 80.9 82.4 82.8 83.7 83.8 83.8

Current
Mean: 72.507 %
Stdev: 4.071 % (5.6%)
Runs: 63.8 63.9 64 64.5 65.7 65.8 65.8 66.4 66.6 67.4 68.3 69.7 69.8 69.9 69.9 70.6 70.9 71.5 71.9 72.1 72.3 72.5 72.6 72.9 73.2 73.2 73.3 73.3 73.3 73.3 73.8 73.9 74 74.1 74.1 74.3 74.3 74.4 74.5 74.5 74.6 74.9 75.1 75.2 75.2 75.2 75.8 76.3 76.6 76.7 77 77.2 77.2 77.3 77.8 78.9 81.6
App start time (CPU/UI) Baseline
Mean: 28.033 %
Stdev: 2.220 % (7.9%)
Runs: 23 23 23.1 23.8 24 24 24.1 25 26 26.1 26.3 26.5 26.6 26.6 26.9 27.1 27.2 27.3 27.4 27.4 27.6 27.7 27.8 27.9 27.9 28 28 28.5 28.6 28.6 28.6 28.6 28.6 28.7 28.8 28.9 29.2 29.2 29.2 29.2 29.2 29.3 29.3 29.4 29.6 29.9 29.9 29.9 29.9 29.9 29.9 30.6 30.7 30.8 31.1 31.1 31.9 32.5

Current
Mean: 29.089 %
Stdev: 1.701 % (5.8%)
Runs: 25 25.1 25.8 26.7 26.8 27 27.2 27.2 27.2 27.2 27.8 27.9 28 28 28.3 28.3 28.5 28.5 28.5 28.6 28.6 28.9 29 29 29.1 29.1 29.2 29.2 29.2 29.3 29.3 29.4 29.4 29.8 29.8 29.9 29.9 29.9 29.9 29.9 29.9 29.9 30 30 30.1 30.7 30.8 31.2 31.6 31.9 31.9 32.4 32.5 32.5
Open search router TTI Load Search Options Baseline
Mean: 120.740 ms
Stdev: 10.253 ms (8.5%)
Runs: 103.07971199974418 103.25284799933434 103.83203100040555 105.84973100200295 106.1516930013895 106.4396969974041 106.68741900101304 107.94909600168467 109.4419350028038 112.06030299887061 112.50577799975872 113.18990099802613 113.25960300117731 113.43758099898696 113.58170600235462 113.61625099927187 114.11995399743319 114.37247699871659 115.49845400080085 115.74316399917006 116.27319400012493 116.59061699733138 116.93636099994183 117.00105799734592 117.04463700205088 117.3459469974041 117.61987299844623 117.66666599735618 117.96053100004792 118.63464299961925 118.75533099845052 119.01452599838376 119.0229899995029 119.70141699910164 120.29618399962783 122.3492019996047 122.43628000095487 123.27193200215697 123.28902199864388 123.70751899853349 123.85213200002909 124.1282560005784 125.30716999992728 125.57169600203633 126.56892899796367 129.4410399980843 129.72997999936342 129.8870850019157 130.70690900087357 132.90100100263953 133.77115900069475 135.41918899863958 135.48067300021648 136.48885099962354 136.53605199977756 136.97615600004792 137.97001099959016 138.00085400044918 143.13391200080514 143.57035300135612

Current
Mean: 119.801 ms
Stdev: 8.817 ms (7.4%)
Runs: 103.5866700001061 105.94608600065112 108.34822599962354 108.71484299749136 108.73372400179505 108.8965249992907 109.54528900235891 109.73087600246072 110.7690019980073 110.81783099845052 111.07047500088811 111.32682299986482 112.14050300046802 112.45906600356102 112.52640799805522 112.9183350019157 113.30428100004792 113.68330899998546 113.83646599948406 114.23445599898696 114.62251800298691 115.43916800245643 115.77201300114393 115.78092399984598 116.17720500007272 116.93103000149131 117.0383299998939 117.25362100079656 118.76737499982119 119.15608699992299 119.47688800096512 119.725098002702 119.9197999984026 120.21114100143313 120.37548900023103 120.38952700048685 120.43697100132704 120.81420900300145 121.58089199662209 122.1491700001061 123.29101499915123 123.78674400225282 123.98514799773693 124.97717300057411 125.29964200034738 125.55757699906826 125.93847599998116 126.71472200006247 127.77335600182414 129.06579599902034 129.59570299834013 130.52266500145197 132.0653079971671 133.33439100161195 133.48771100118756 133.68371600285172 136.9985349997878 138.78275600075722 139.02661199867725 139.57287600263953
Open search router TTI Open Search Router TTI Baseline
Mean: 551.849 ms
Stdev: 49.580 ms (9.0%)
Runs: 428.2840170003474 463.2343349978328 465.0047199986875 465.11299700289965 472.85603800043464 478.7644039988518 487.04370100051165 492.19258600100875 492.39131699874997 492.69482400268316 493.0054119974375 495.8111979998648 502.6487639993429 507.05004899948835 509.0976970009506 514.5340170003474 515.8079019971192 526.272624000907 528.4836019985378 529.609294001013 530.8542479984462 532.5904950015247 533.4282229989767 537.4583339989185 537.9630529992282 542.296590000391 554.6711019985378 560.3079029992223 561.0946450009942 563.75948099792 564.5056560002267 568.1506350003183 568.7959800027311 569.9056000001729 572.8568930029869 574.1422929987311 576.016072999686 576.4823810011148 577.8992919996381 579.2469080016017 581.4483649991453 581.6358649991453 585.9233810007572 589.3208010010421 589.9562579989433 590.2012940011919 593.0608730018139 593.4322509989142 593.7670900002122 595.6472979970276 599.140340000391 599.2451590001583 606.6905519999564 613.9360349997878 616.5584720000625 618.0009359978139 622.093099001795 622.4281419999897 630.9841320030391 645.1194260008633

Current
Mean: 558.138 ms
Stdev: 55.280 ms (9.9%)
Runs: 421.4648029990494 446.3555100001395 461.42167200148106 477.9724530018866 480.1297200024128 490.50638800114393 492.1698000021279 494.26790399849415 495.61857100203633 496.33496199920774 497.75626600161195 499.2777510024607 502.3279630020261 503.45434599742293 506.52986700087786 509.18021699786186 512.906900998205 513.6235760003328 517.9659419991076 523.6130780018866 525.4702560007572 525.8980310000479 543.2332359999418 551.9466149993241 554.8027749992907 555.5813400000334 561.7989909984171 565.5410160012543 569.4615890011191 574.8611249998212 578.2007239982486 578.6273190006614 579.859701000154 581.390992000699 582.2590749971569 582.7473139986396 583.5688889995217 586.1968990005553 587.7954099997878 588.2935380004346 593.5740149989724 594.1357419975102 594.6145029999316 597.4617110006511 597.5056160017848 598.0363770015538 598.1143389977515 598.2059729993343 598.2583409994841 599.4551189988852 602.5486660003662 602.6639810018241 605.1111660003662 615.6587320007384 622.4659430012107 632.2096760012209 650.194214001298 660.9512530006468 662.9817709997296 663.6963710002601
Open search router TTI (CPU) Baseline
Mean: 133.990 %
Stdev: 2.938 % (2.2%)
Runs: 128.24599696410715 128.25765997884713 128.66846968867117 128.71807676892735 128.88982997678653 129.1032980536375 129.1289295412707 129.28045506256487 130.3605298328026 130.5105666798894 131.70641975455663 131.8173536584721 132.00841745929642 132.09065676371478 132.2546699429826 132.36067179743083 132.62009297732035 132.62353241852566 132.72016691955974 132.75613603444512 132.86015190293554 133.11580516898601 133.36618414585004 133.41332509632392 133.44834539058837 133.64349682139525 133.83616264560547 133.886675760502 134.14164711132 134.199248171252 134.3115841334451 134.3519120331764 134.45115214015092 134.46521351424397 134.54204683059575 134.6069567855287 134.68552290951723 134.73323755340985 134.9475765872326 135.0207632900176 135.4813735108848 135.51697522911724 135.63286584061152 135.63918050987965 135.66961973180833 135.70680127650925 135.89578862077823 136.80807705708676 136.84878324955005 137.21713828803624 137.31637317581874 137.54413807635896 137.65956255942686 137.74059727207643 137.94770321878548 138.0097635742366 138.48762801676003 138.82673723121752 139.0676109176242 140.21991110562197

Current
Mean: 134.035 %
Stdev: 2.642 % (2.0%)
Runs: 127.09289019952469 127.17284481106121 128.73536260811713 129.79916226476075 130.12864287556056 130.83547216351337 131.08305170435577 131.11761643923558 131.3185816982373 131.91360948302517 131.9237555286733 132.00908448333914 132.05428857949417 132.191597283783 132.53396313646874 132.58074105855064 132.60311882038008 132.68406849103525 132.6933659704785 133.19101386197448 133.24969371306062 133.25961544441884 133.51396065775967 133.53426351561598 133.62332844944567 133.68680964763706 133.70633170118484 133.86376134494023 133.87984529801957 133.9803140001363 134.07974400728887 134.3290957334628 134.37366395452767 134.64062046957147 134.85573279075535 134.87732912873298 134.90091040784176 135.18282160778054 135.29961626729158 135.42609184969086 135.64856469390736 135.94876584879813 136.1246377924452 136.23759671475665 136.4542438779767 136.6698392944458 136.69321000146823 136.77616279991983 136.77888446215147 136.98165033724206 137.0534004726926 137.05393767552417 137.09169967792457 137.62125561802222 137.76494023904385 137.79997205087875 137.82313273972292 139.5799241316228
Open search router TTI (FPS) Baseline
Mean: 59.773 FPS
Stdev: 0.311 FPS (0.5%)
Runs: 58.82661541345427 59.075611993056974 59.121317377174826 59.23402607236474 59.2448810119795 59.27539515048488 59.30056053919653 59.30665863994032 59.360367151591454 59.4228568076788 59.46850678174329 59.50539476348801 59.52865910097066 59.53254062441245 59.561874082917285 59.58107012397793 59.65356143929332 59.66452652543832 59.76910733217389 59.77033619541878 59.79145090754018 59.80249520037316 59.87773462911277 59.92972279483412 59.94678095816381 59.96263289997071 59.9813030524694 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.821 FPS
Stdev: 0.306 FPS (0.5%)
Runs: 59.00952670794587 59.04028850683744 59.0952910780277 59.09853809790941 59.13750539953894 59.165329713629454 59.18501094989268 59.57879187461253 59.594106333853134 59.612569111755214 59.621478877270654 59.73978084626593 59.77165873992817 59.8329202459626 59.83385791152116 59.83576065931313 59.86535937084439 59.88746061464629 59.88981783707844 59.95525863188525 59.95736278775156 59.990778619224486 59.99443479839048 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 370.291 MB
Stdev: 2.766 MB (0.7%)
Runs: 364.3818359375 364.806640625 365.2841796875 365.8828125 365.9228515625 366.1591796875 366.8037109375 367.1298828125 367.2841796875 367.3466796875 367.3525390625 368.14453125 368.1796875 368.4130859375 368.529296875 368.845703125 368.880859375 369.18515625 369.44609375 369.5361328125 369.65390625 369.751953125 369.81640625 369.9296875 370.044921875 370.1220703125 370.2529296875 370.287109375 370.462890625 370.57421875 370.62890625 370.6611328125 370.701171875 370.84375 371.0771484375 371.091796875 371.1765625 371.486328125 371.6279296875 371.62890625 371.7390625 371.7607421875 371.8564453125 371.873046875 372.0703125 372.2109375 372.48046875 372.4873046875 372.63671875 372.6953125 373.57734375 373.89453125 373.970703125 373.9765625 376.3703125 376.65234375 377.02734375

Current
Mean: 370.717 MB
Stdev: 3.582 MB (1.0%)
Runs: 362.931640625 363.982421875 364.384765625 366.3173828125 366.7294921875 366.8857421875 366.935546875 367.3994140625 367.447265625 367.49609375 367.78125 367.7880859375 367.8203125 367.8330078125 367.9501953125 368.1455078125 368.5625 368.6005859375 368.8076171875 369.076171875 369.27734375 369.27734375 369.7392578125 369.892578125 369.921875 369.982421875 370.1162109375 370.244140625 370.294921875 370.6630859375 370.666015625 370.705078125 370.7978515625 370.96171875 371.0625 371.158203125 371.17578125 371.265625 371.271484375 371.30078125 371.365234375 371.4140625 371.6328125 372.5087890625 373.45234375 373.6015625 373.6181640625 374.27578125 374.54140625 374.9853515625 375.5796875 375.65703125 375.822265625 376.1 377.31171875 378.45625 378.865625 379.7412109375
Open search router TTI (CPU/JS) Baseline
Mean: 68.883 %
Stdev: 1.940 % (2.8%)
Runs: 63.5 65.4 65.5 65.8 65.9 66.4 66.8 66.8 66.8 66.9 67 67.3 67.4 67.5 67.5 67.5 67.6 67.7 67.9 67.9 68 68.2 68.4 68.4 68.4 68.5 68.8 68.9 69 69.1 69.1 69.2 69.3 69.3 69.4 69.4 69.5 69.6 69.8 69.8 69.9 69.9 70 70.1 70.2 70.3 70.4 70.5 70.8 70.9 71 71.1 71.4 71.5 71.6 71.6 71.7 71.8 74.2

Current
Mean: 68.857 %
Stdev: 2.261 % (3.3%)
Runs: 63.9 64.9 65.4 65.4 65.6 66.4 66.4 66.4 66.4 66.4 66.5 66.9 67 67.1 67.2 67.3 67.4 67.5 67.7 67.8 67.8 67.8 67.8 68 68.1 68.3 68.4 68.8 68.8 68.8 68.8 68.8 68.8 68.9 68.9 69.1 69.3 69.3 69.6 69.8 69.8 69.9 69.9 69.9 70 70.3 70.5 70.6 70.8 70.8 71.1 71.3 72 72 72.2 72.6 72.7 73 73.9 74.6
Open search router TTI (CPU/UI) Baseline
Mean: 27.492 %
Stdev: 1.627 % (5.9%)
Runs: 23.6 24.4 24.8 24.9 25.3 25.4 25.4 25.7 25.9 26 26 26.2 26.2 26.4 26.4 26.4 26.4 26.4 26.4 26.5 26.8 26.9 26.9 27 27.1 27.2 27.2 27.2 27.3 27.4 27.6 27.6 27.7 27.7 27.8 27.9 27.9 28 28 28.2 28.3 28.4 28.4 28.5 28.6 28.7 28.9 28.9 29.1 29.1 29.4 29.6 29.7 29.8 30.3 30.3 30.4 30.7 30.8

Current
Mean: 28.172 %
Stdev: 1.555 % (5.5%)
Runs: 25.3 25.4 25.4 26.3 26.3 26.3 26.4 26.5 26.5 26.6 26.8 26.9 26.9 26.9 26.9 27 27 27 27.1 27.2 27.4 27.4 27.5 27.8 27.8 27.9 27.9 28 28 28 28.1 28.2 28.2 28.2 28.2 28.2 28.2 28.3 28.3 28.4 28.5 28.8 28.8 28.8 29.3 29.3 29.3 29.4 29.5 29.9 29.9 30.3 30.4 30.5 30.8 30.9 31 31.2 31.4 31.6
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 434.808 ms
Stdev: 33.135 ms (7.6%)
Runs: 378.85473600029945 378.88126600161195 379.91516099870205 380.1175949983299 380.5782480016351 386.1574300006032 391.1238609999418 392.36580500006676 392.7532140016556 394.9734699986875 396.00390700250864 398.6488860026002 400.88773600012064 402.0834149979055 405.6691090017557 406.58850100263953 406.69242399930954 410.44291200116277 413.00948099792004 415.1429859995842 416.37638400122523 417.6516919992864 418.8967689983547 421.2473150007427 423.0714519992471 423.27526900172234 423.3993330001831 427.4498289972544 435.80725099891424 438.1975510008633 439.11633299663663 440.6955970004201 443.57922400161624 452.3518479987979 455.6092540025711 456.32971300184727 456.73506699874997 457.58585599809885 458.0890300013125 458.8991700001061 459.1287030018866 459.13985200226307 459.454142998904 461.600546002388 462.7987879998982 463.6658530011773 463.81062800064683 465.0119230002165 465.96573900058866 467.2154949977994 470.8813080005348 471.1201580017805 474.81909200176597 475.48856699839234 475.99271700158715 480.8345949985087 480.9957280009985 482.9824630022049 485.4167070016265 486.91296500340104

Current
Mean: 431.976 ms
Stdev: 31.472 ms (7.3%)
Runs: 375.0675049982965 380.90604700148106 381.89188599959016 382.94954499974847 384.1692299991846 385.3300379998982 386.4427090026438 387.48828199878335 390.6369629986584 394.58349600061774 395.8579100035131 399.39571100100875 400.8701579980552 401.0881760008633 403.64436899870634 413.5300289988518 415.7913819998503 416.5933030024171 417.33585700020194 417.74711100012064 417.75313299894333 418.3636890016496 419.0211999975145 422.0582280009985 423.41117399930954 423.54650900140405 427.2860920019448 428.1736249998212 428.39672899991274 429.9129230007529 430.7771000005305 435.89302599802613 441.2153320014477 443.5336109995842 443.80135099962354 443.86002599820495 446.030517000705 447.63199900090694 448.80708899721503 450.6459559984505 452.5898030027747 454.7629809975624 457.8055830001831 458.2560219988227 458.8931079991162 459.39571100100875 460.53088400140405 461.31656899675727 462.37491899728775 462.7115480005741 466.07910099998116 466.61694400012493 466.9265949986875 468.25569700077176 476.9430749975145 477.13541699945927 478.51525899767876 490.9598799981177 505.0533449985087
Report typing (CPU) Baseline
Mean: 99.711 %
Stdev: 3.521 % (3.5%)
Runs: 90.2363477432669 93.32162228657086 94.39617141107901 94.59291644393281 95.13221821842987 95.4833310305415 95.51778526209948 95.64052474778806 96.02733968296621 96.25525856040483 96.32069956311805 96.78866466711877 96.95765617813763 97.28752644477896 97.33315053122 97.52846623968833 97.60924574335644 97.6673560452425 97.68616910081566 97.70414656144864 97.70729841566835 97.79278209867857 97.80033862818283 97.91829773388083 98.45869194420906 98.76891903658263 99.15546359070717 99.21286835361153 99.26833434776114 99.52538767645454 99.62193616145628 99.95211477403183 100.02150806130787 100.11020133288045 100.39499072772709 100.4011992864 100.56902288977757 100.59257436125415 100.6821361360173 100.79467222263523 101.04181897244214 101.43446856662572 101.48513701543874 101.49617037872817 102.5299930255733 102.93102739247878 102.98604995545848 103.23760565835319 103.38212719038178 103.45826199710257 103.55825994588116 103.86131863929978 103.95867870515552 104.60870125209115 104.78177044217709 104.84563425725923 105.08363555601252 106.09990202319246 106.76312437946656 106.87330682326409

Current
Mean: 99.009 %
Stdev: 4.480 % (4.5%)
Runs: 89.09486848271321 89.2760664949311 90.46226418757624 90.46934870319267 90.67722827514888 91.65887908654135 93.19288405515323 93.61439166477837 94.42393800672697 94.65795815821586 95.0395319896309 95.10795179936024 95.37881010005414 95.71008527300795 95.74393373486573 95.87003758486458 96.3334132252929 96.9832656125007 97.48233245009648 97.75652255475137 97.98023303396391 98.38516239565504 98.48019829361279 98.53185720824038 98.55505815287634 98.57244871087242 98.72356109832393 98.78834964008524 98.86785695030369 99.06165021956765 99.108464373697 99.11781090676679 99.38535740427292 99.44938120168126 99.59163816906582 99.77151571158694 99.83430225941049 100.65071934806853 100.88497464819856 101.26336421256823 101.39468691026731 101.78475610256744 101.98955397286288 102.01612033748756 102.07685029104492 102.26460467789637 102.76444502754768 103.1655035266673 103.17176917988284 103.69765653078095 103.74037131575557 103.74952345515949 103.81876357768267 104.044222799016 104.241283138804 104.90938352747925 105.6473159007749 106.47848770337927 107.70766823935962 107.92602184891379
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 505.146 MB
Stdev: 5.372 MB (1.1%)
Runs: 493.84498355263156 496.16558159722223 497.07074652777777 497.5096726190476 497.8756510416667 498.0713404605263 498.11245888157896 498.98355263157896 499.3658854166667 499.65125868055554 499.81229440789474 499.8441611842105 499.9732730263158 500.17845394736844 500.2087673611111 500.2220394736842 500.2868009868421 500.4411892361111 501.01128472222223 501.6206825657895 501.6578947368421 502.04995888157896 503.2111545138889 504.0071614583333 504.12456597222223 504.12623355263156 504.5881076388889 504.7534950657895 505.0627170138889 505.46202256944446 505.7847450657895 505.93564967105266 506.6147203947368 506.7334449404762 506.9752604166667 507.2053865131579 507.22142269736844 507.4821134868421 507.8190104166667 508.1539884868421 508.24761284722223 508.2711759868421 509.0543154761905 509.1891447368421 509.1996299342105 509.3296130952381 509.3604029605263 509.5328947368421 509.8803453947368 510.50185032894734 510.6657986111111 510.7857730263158 511.0228207236842 511.0770970394737 511.248046875 511.9397615131579 512.3034539473684 512.3817845394736 513.6410361842105 521.8990542763158

Current
Mean: 506.017 MB
Stdev: 5.943 MB (1.2%)
Runs: 495.1009114583333 495.4088541666667 497.361328125 497.79296875 497.9751233552632 499.64605034722223 499.78597861842104 500.15972222222223 500.2710193452381 500.34331597222223 500.3630642361111 500.59058779761904 500.76644736842104 500.78624131944446 500.9407552083333 501.4964657738095 501.6469983552632 501.8888888888889 502.33120888157896 502.3959703947368 502.4123263888889 503.18955592105266 503.62934027777777 503.8921130952381 504.4993832236842 504.6197916666667 505.0696957236842 505.2743675595238 505.3578869047619 505.3951480263158 505.50760690789474 505.70970394736844 505.9358552631579 506.18136160714283 506.5080295138889 506.6792763157895 506.8244357638889 507.4233141447368 507.51254111842104 507.5727796052632 507.7997532894737 507.88199013157896 508.2534950657895 508.4163240131579 509.1626233552632 509.35546875 510.22113715277777 510.91591282894734 511.58223684210526 511.88519965277777 511.9290364583333 512.4138569078947 513.645275297619 513.6539884868421 514.6021792763158 515.1060855263158 516.9856770833334 519.4720052083334 520.4475740131579 521.0438368055555
Report typing (CPU/JS) Baseline
Mean: 46.985 %
Stdev: 2.824 % (6.0%)
Runs: 41 41.1 43.4 43.4 43.6 43.7 44 44.2 44.3 44.3 44.3 44.4 44.5 44.5 44.5 44.8 44.9 44.9 45.1 45.1 45.2 45.3 45.5 45.6 45.7 45.8 45.9 45.9 46.1 46.5 46.7 46.7 47 47.1 47.3 47.8 47.8 47.9 48.2 48.2 48.3 48.3 48.5 49.2 49.3 49.6 49.7 49.9 50.2 50.3 50.5 50.8 50.9 51.2 51.2 51.5 51.6 51.6 52.1 52.2

Current
Mean: 46.318 %
Stdev: 3.324 % (7.2%)
Runs: 39.2 40.3 40.6 41.4 41.9 42.3 42.5 42.7 42.7 43.2 43.3 43.3 43.4 43.5 43.6 43.8 43.9 44.1 44.2 44.3 44.5 44.8 44.9 44.9 45.1 45.1 45.2 45.2 45.3 45.4 45.7 46.1 46.4 47 47.3 47.4 47.4 47.7 47.9 48.1 48.3 48.3 48.5 48.8 48.9 49.2 49.4 49.8 49.8 50.1 50.2 50.2 50.5 50.6 50.9 51 51.4 51.6 51.8 54.2
Report typing (CPU/UI) Baseline
Mean: 24.657 %
Stdev: 0.986 % (4.0%)
Runs: 22.3 22.5 22.6 22.7 22.9 23.3 23.5 23.6 23.6 23.6 23.8 23.8 23.8 23.9 24 24 24 24.1 24.2 24.3 24.3 24.4 24.4 24.5 24.6 24.6 24.7 24.8 24.8 24.8 24.9 24.9 25 25 25 25 25 25 25 25.1 25.1 25.1 25.2 25.2 25.3 25.3 25.3 25.3 25.5 25.5 25.6 25.6 25.7 25.7 25.9 26.1 26.3 26.3 26.5 26.6

Current
Mean: 24.719 %
Stdev: 0.858 % (3.5%)
Runs: 22.6 23.1 23.2 23.3 23.3 23.6 23.6 23.7 23.8 24 24 24 24.1 24.1 24.1 24.2 24.3 24.3 24.3 24.4 24.4 24.5 24.5 24.5 24.5 24.6 24.6 24.6 24.7 24.7 24.9 24.9 24.9 24.9 24.9 25 25 25 25 25.1 25.2 25.2 25.3 25.3 25.3 25.4 25.5 25.5 25.6 25.6 25.7 25.8 25.8 25.9 26.1 26.1 26.5 26.7
Chat opening Chat TTI Baseline
Mean: 518.744 ms
Stdev: 38.512 ms (7.4%)
Runs: 419.47265700250864 441.45336899906397 448.368692997843 450.79280599951744 457.0265710018575 457.1791989989579 459.5505370013416 464.12817399948835 465.81848100200295 472.9059250019491 478.1387130022049 478.72957400232553 485.27351900190115 490.17313699796796 497.5887040011585 499.5954190008342 499.62255899980664 502.2626549974084 506.3341479972005 507.86242699995637 508.1776130013168 508.85343400016427 510.16752199828625 510.97725399956107 511.0368660017848 514.6011560000479 518.1051839999855 521.5435799993575 521.5454920008779 521.9489750005305 524.6868900023401 526.0247809998691 526.3809820003808 527.3704020008445 527.7541910000145 528.2125249989331 528.5285639986396 529.43135599792 537.6348470002413 538.7537840008736 543.0649829991162 549.461872998625 549.6196699999273 551.3370369970798 551.3984370008111 554.8930259980261 555.6987719982862 556.4788409993052 556.8025720007718 557.4235030002892 559.9287519976497 559.930907998234 560.0249020010233 562.9735920019448 564.0325930006802 567.9710690006614 569.7040210030973 573.6844490021467 573.7003180012107 582.5091150030494

Current
Mean: 532.408 ms
Stdev: 34.549 ms (6.5%)
Runs: 450.77807600051165 468.69759099930525 480.47530200332403 480.4975179992616 481.5697429999709 482.9572350010276 484.21590200066566 486.91105199977756 490.7088630013168 491.9326580017805 499.02502500265837 499.271688003093 499.7935789972544 502.9407550022006 506.476116001606 511.1746830008924 512.0890710018575 516.165608998388 516.4147550016642 517.3214920014143 522.4703369997442 523.703735999763 524.500447999686 525.218913000077 525.7712399996817 525.8607989996672 525.8964029997587 526.1344409994781 526.8181970007718 528.5363360010087 530.0745849981904 530.1290279999375 532.110351998359 533.015625 538.687378000468 540.9700520001352 551.00614400208 553.4728190004826 554.2563889995217 555.7016599997878 557.437297001481 557.6373700015247 559.149535998702 559.5240079984069 559.7731940001249 564.140746999532 564.9387209974229 565.5725100003183 566.9805910028517 568.0507810004056 570.366822000593 570.4282229989767 572.7631019987166 573.0861009992659 577.7757969982922 579.250365998596 581.9503990001976 594.5668950006366 614.944499000907
Chat opening (CPU) Baseline
Mean: 141.556 %
Stdev: 6.396 % (4.5%)
Runs: 129.1998936161392 131.36626721460615 132.31356546571908 132.3249541813039 132.79279094591107 132.8336643917368 133.13676243896222 133.28187247827725 133.40266809873486 133.54838261459201 134.295171615547 134.32862651424733 134.78760407471916 135.11977342295432 135.60098267982332 135.75106847906423 136.7748520600264 136.9761802932693 137.2736660652526 137.53688510425033 137.90362394198505 138.61537571439285 138.9615130783442 139.222809361357 139.39061823619056 139.87446950009289 139.93636169004625 140.09575160309626 140.1625296644068 141.50900756107134 142.49742679202163 142.70247043634603 142.82608756702953 142.84415843639476 143.8027541456317 143.80363400870684 144.14917849810243 144.31137724550902 144.52947365780076 144.7356385199597 145.33028041033492 146.56890545081768 146.77446040945713 147.2128782578718 147.36332223359662 147.66187582092488 147.84270410935477 147.85590743956612 148.23269787823565 148.83902814214497 148.88948104592603 149.21844166106246 149.5000039914241 149.88393192439756 150.1543608873549 150.18263985925228 150.27732830380555 151.0399024456337 152.78039673676219 153.22075768781175

Current
Mean: 144.612 %
Stdev: 4.798 % (3.3%)
Runs: 134.23249088148276 135.0635735530519 136.8136027748157 137.33034677696114 137.46292693857828 137.7180648643072 137.7402620867466 137.77125088619644 138.65401260342347 138.66695062600863 138.93739637490032 140.25236015657438 140.68621206890396 140.98312202998483 141.37831336752777 141.55201793786011 141.7105230095993 141.71842261614776 141.74387267277527 142.65947496379863 142.77580134307084 143.15756070181342 143.25508624897319 144.17914421458016 144.27694630091042 144.4996621251979 144.65572073309593 144.91952379155265 145.0521125469618 145.30523586677373 145.36714666300767 145.42679588967516 145.436013696493 145.74201623147954 145.74313182262227 145.86468318302457 145.90927740378584 146.34031850458277 146.59839840740278 146.64275186500947 147.00392719346715 147.3528548229343 147.38241423085228 147.5826652229668 147.7164095907381 147.8924251058105 147.9723809164446 149.16604391361741 149.4619005691821 149.62593859899252 150.21314741035866 150.4327151649043 150.62161226883123 150.65687185003804 151.03941846129325 152.07104263451822 153.3040717744618 153.5515939817747 154.85734475436178
Chat opening (FPS) Baseline
Mean: 59.911 FPS
Stdev: 0.161 FPS (0.3%)
Runs: 59.41375859266398 59.41972874089452 59.43393805634845 59.58752651290914 59.6548400816352 59.67880110977403 59.68831312274307 59.733942141346574 59.77175913563382 59.77670968018721 59.833776862213014 59.85714533872035 59.86066688519816 59.9180719811999 59.92808093087041 59.932396781434534 59.948020906723904 59.95645535299737 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.988 FPS
Stdev: 0.042 FPS (0.1%)
Runs: 59.79838638010613 59.84041227298905 59.88217770799086 59.91115624558952 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 386.007 MB
Stdev: 12.195 MB (3.2%)
Runs: 365.7822265625 367.3515625 368.6884765625 368.9091796875 369.5419921875 369.669921875 369.7900390625 369.9755859375 370.05859375 370.205078125 370.77734375 371.3837890625 371.4423828125 371.5234375 371.5888671875 371.927734375 372.203125 372.22265625 373.0478515625 373.6376953125 373.7841796875 377.5341796875 377.5986328125 382.4384765625 387.666015625 387.7197265625 389.06640625 389.173828125 389.6552734375 391.32421875 393.537109375 393.6943359375 394.0048828125 394.2109375 394.6611328125 394.830078125 394.8720703125 394.9814453125 395.0078125 395.13671875 395.3603515625 395.416015625 395.515625 395.8408203125 395.9619140625 396.560546875 396.7099609375 397.205078125 397.4189453125 397.435546875 398.38671875 398.76171875 398.8994140625 399.021484375 399.4130859375 399.67578125 399.7724609375 400.091796875 400.263671875 402.060546875

Current
Mean: 393.287 MB
Stdev: 4.497 MB (1.1%)
Runs: 380.3424479166667 383.275390625 384.4208984375 384.56640625 385.9775390625 387.181640625 389.220703125 390.29296875 391.126953125 391.5185546875 391.609375 391.6318359375 391.7216796875 391.7314453125 391.8603515625 391.90234375 391.9091796875 392.1123046875 392.3076171875 392.4970703125 392.736328125 393.0810546875 393.095703125 393.11328125 393.2744140625 393.2802734375 393.3095703125 393.3388671875 393.4052734375 394.0400390625 394.138671875 394.1513671875 394.7763671875 394.8046875 394.8642578125 395.08984375 395.142578125 395.173828125 395.5810546875 395.7529296875 396.634765625 396.8671875 398.1591796875 398.80078125 399.865234375 400.291015625 400.8046875 401.0068359375 401.169921875 401.4013671875
Chat opening (CPU/JS) Baseline
Mean: 71.152 %
Stdev: 2.490 % (3.5%)
Runs: 65.4 66 66.7 67.3 67.6 67.8 68.4 68.5 68.6 68.8 68.9 68.9 68.9 69.1 69.3 69.4 69.4 69.4 69.6 69.7 69.7 69.7 70 70.2 70.3 70.4 70.5 70.8 70.9 70.9 71 71.4 71.5 71.9 72.1 72.4 72.4 72.4 72.8 72.9 72.9 72.9 72.9 72.9 72.9 73 73.1 73.1 73.3 73.5 73.6 73.9 73.9 74 74.1 74.2 75.1 75.3 75.7 76.9

Current
Mean: 72.408 %
Stdev: 2.140 % (3.0%)
Runs: 68.2 68.2 68.4 68.6 68.8 69.4 69.4 69.6 69.9 69.9 70.2 70.3 70.5 70.8 70.9 70.9 71 71.5 71.8 71.8 71.9 72 72 72.2 72.4 72.4 72.4 72.5 72.5 72.5 72.5 72.5 72.6 72.9 73 73.2 73.2 73.3 73.4 73.4 73.4 73.4 73.5 73.6 73.6 73.7 73.8 74.3 74.4 74.4 74.5 74.8 74.9 75.4 75.6 75.8 76.3 76.7 77.1
Chat opening (CPU/UI) Baseline
Mean: 28.795 %
Stdev: 1.528 % (5.3%)
Runs: 25.6 25.7 26.6 26.7 27.1 27.1 27.3 27.3 27.3 27.4 27.4 27.4 27.4 27.5 27.6 27.8 27.8 27.9 27.9 27.9 28 28.1 28.1 28.3 28.4 28.4 28.4 28.4 28.4 28.5 28.5 28.6 28.8 28.8 28.9 28.9 29 29 29.2 29.2 29.4 29.6 29.7 29.8 29.9 29.9 29.9 29.9 30 30.1 30.4 30.4 30.7 30.8 30.8 30.9 31.6 32 32.4 32.9

Current
Mean: 29.619 %
Stdev: 1.335 % (4.5%)
Runs: 26.6 26.8 26.9 27.3 27.4 27.5 27.9 27.9 28.4 28.4 28.7 28.7 28.8 28.9 28.9 28.9 29 29 29.2 29.3 29.3 29.3 29.3 29.3 29.3 29.4 29.4 29.4 29.4 29.5 29.6 29.7 29.7 29.9 29.9 30 30 30.2 30.3 30.4 30.5 30.5 30.6 30.6 30.7 30.7 30.8 30.8 30.8 30.9 30.9 30.9 31.4 31.4 31.9 31.9 31.9 32.9
Linking (CPU) Baseline
Mean: 148.900 %
Stdev: 3.084 % (2.1%)
Runs: 142.88023952095813 143.02582326721358 143.38677342948398 143.8770106007141 143.8785049663615 143.91790458434315 143.92300295802826 144.40517790527792 145.24325437888456 145.51175304175686 145.60438921152075 145.68327781943265 146.4997350980858 146.52683706582562 146.63814296765 146.7493852662225 146.9778283895978 147.20605163564554 147.296525829888 147.61087087385434 147.66643938565386 148.39961721779412 148.45850763521784 148.76201843475502 148.97382595587874 149.0121371612688 149.10367318520224 149.2187492521643 149.3457480818249 149.41043579831998 149.44005801391714 149.4458381551986 149.45300741985972 149.49532605626126 149.6362769249605 149.72344392687577 149.84869453715305 149.8582352108333 150.08510388472737 150.14204229260096 150.15162656886633 150.22788954473486 150.31454784268442 150.3299267247857 150.41383352350283 150.4491822318193 150.827974323407 151.16354325825642 151.19805475332828 151.62593584619395 151.95702777041274 152.11438199291595 152.30199892755434 152.7633918628318 153.2164399723029 153.30596229820438 153.559393407266 154.5364929103673 155.23557452152212 155.95988388575066

Current
Mean: 148.299 %
Stdev: 3.071 % (2.1%)
Runs: 141.2601020105062 141.85553368649053 143.15171403408397 143.58900562053725 144.0830178305805 144.091385220009 144.25633712017842 144.63311087535453 144.88022338213517 145.16435346361553 145.4431399337038 145.7635209202175 145.83047185840803 146.1201949164971 146.21908553240047 146.40872462770795 146.67685520663818 146.79734554794797 147.22302810256267 147.2292958879901 147.38331124698084 147.48012053084616 147.62480804063446 147.7685869306254 147.7779408549647 147.8752803046164 147.91509680725622 147.9586927526316 148.10190675863223 148.1298190666761 148.2597881527821 148.51280008788223 148.61361208521103 148.62483621211348 148.7417444136317 148.84391210000538 149.10950398738643 149.1907476167766 149.3022430904559 149.35480152788733 149.3760354569748 149.37717649104624 149.88994628362536 150.34137369373408 150.44809087203166 150.546408598213 150.88199701114846 151.22249626510788 151.23737676062638 151.58164679165677 151.6226662751901 151.7062306359389 151.7609850985607 151.8636022996832 152.3501651919697 152.76709029964022 153.94888113141553 154.50594259539815 156.94349493695006
Linking (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Linking (RAM) Baseline
Mean: 425.098 MB
Stdev: 4.242 MB (1.0%)
Runs: 414.1471354166667 416.8958333333333 418.9876302083333 419.5338541666667 419.80078125 420.01171875 420.33203125 421.2727864583333 421.5944010416667 421.8684895833333 421.8893229166667 421.9505208333333 421.982421875 422.04520089285717 422.5891927083333 422.634765625 422.826171875 422.865234375 422.9375 423.0462239583333 423.0833333333333 423.205078125 423.41796875 423.7037760416667 423.8092447916667 423.845703125 423.939453125 424.01171875 424.0279947916667 424.6432291666667 424.9772135416667 425.173828125 425.6087239583333 425.9635416666667 425.9641927083333 426.103515625 426.13671875 426.1875 426.5703125 426.6705729166667 427.732421875 427.7506510416667 427.8899739583333 427.9518229166667 427.9908854166667 428.6549479166667 428.9622395833333 429.033203125 429.2734375 430.193359375 430.4186197916667 431.2291666666667 431.4921875 432.447265625 432.5572916666667 433.9505208333333 436.79575892857144

Current
Mean: 424.462 MB
Stdev: 5.542 MB (1.3%)
Runs: 411.5279947916667 413.86328125 414.4127604166667 417.2434895833333 417.404296875 417.6790364583333 417.685546875 419.5755208333333 419.5787760416667 420.0813802083333 420.841796875 420.8854166666667 421.1477864583333 421.185546875 421.3229166666667 421.5501302083333 421.6373697916667 421.767578125 421.767578125 422.2486979166667 422.3235677083333 422.498046875 422.5065104166667 422.5149739583333 422.8697916666667 422.8834635416667 422.9895833333333 423.2936197916667 423.328125 423.6822916666667 423.9557291666667 424.1328125 424.2057291666667 425.0787760416667 425.2584635416667 425.3333333333333 425.4986979166667 425.5188802083333 425.9479166666667 426.6119791666667 427.275390625 427.3463541666667 427.7265625 427.818359375 428.0305989583333 428.5071614583333 428.609375 430.248046875 430.4270833333333 431.73828125 431.994140625 432.3098958333333 432.93359375 433.7700892857143 435.67801339285717 438.04520089285717 438.0463169642857
Linking (CPU/JS) Baseline
Mean: 80.826 %
Stdev: 1.363 % (1.7%)
Runs: 77.5 77.6 78.1 78.5 78.5 78.9 78.9 79.2 79.2 79.3 79.4 79.5 79.7 79.9 80 80.1 80.2 80.2 80.2 80.2 80.5 80.6 80.6 80.8 80.9 80.9 80.9 80.9 81 81.1 81.2 81.3 81.4 81.4 81.4 81.5 81.5 81.6 81.6 81.6 81.6 81.7 81.7 81.7 81.8 81.9 82 82 82 82.1 82.2 82.2 82.4 82.6 83 83 83 83.2

Current
Mean: 80.648 %
Stdev: 1.580 % (2.0%)
Runs: 76.9 77 77.4 77.6 77.9 78.5 78.5 78.6 78.7 78.8 79.2 79.2 79.3 79.5 79.6 79.7 79.8 79.8 79.9 80 80 80.2 80.2 80.3 80.6 80.7 80.7 80.8 80.9 80.9 81 81 81.1 81.1 81.2 81.2 81.3 81.4 81.4 81.5 81.7 81.7 81.8 81.8 81.8 81.8 81.9 81.9 81.9 82.2 82.2 82.2 82.5 82.6 82.6 82.7 82.7 83.1 83.1 83.3
Linking (CPU/UI) Baseline
Mean: 28.468 %
Stdev: 1.621 % (5.7%)
Runs: 24.6 24.8 25 26.1 26.3 26.3 26.4 26.6 26.7 26.9 26.9 27 27 27.1 27.2 27.2 27.5 27.6 27.6 27.7 27.8 27.9 27.9 27.9 28.1 28.2 28.4 28.6 28.6 28.6 28.6 28.6 28.8 28.8 28.9 28.9 28.9 29.2 29.3 29.4 29.4 29.4 29.6 29.6 29.6 29.6 29.6 29.8 29.9 29.9 30.1 30.1 30.6 30.6 30.8 30.8 30.9 31.1 31.4 31.4

Current
Mean: 28.193 %
Stdev: 1.843 % (6.5%)
Runs: 23.6 23.8 25.9 26 26 26.2 26.3 26.4 26.5 26.5 26.5 26.6 26.6 26.8 26.9 27 27 27.2 27.2 27.2 27.3 27.3 27.4 27.5 27.5 27.5 27.7 27.8 27.8 28.1 28.2 28.2 28.3 28.4 28.8 28.9 28.9 28.9 29 29.1 29.2 29.2 29.2 29.2 29.3 29.6 29.6 29.8 29.9 29.9 29.9 30 30.3 30.5 30.6 31.2 31.2 32.9 33.1

Copy link
Contributor

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

@hannojg
Copy link
Contributor

hannojg commented Nov 18, 2024

The performance decrease is a false positive, no need to treat this as blocker

Copy link
Contributor

🚀 Deployed to staging by https://github.com/Julesssss in version: 9.0.64-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 failure ❌

@chiragsalian chiragsalian removed the DeployBlockerCash This issue or pull request should block deployment label Nov 21, 2024
Copy link
Contributor

🚀 Deployed to production by https://github.com/chiragsalian in version: 9.0.64-4 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 failure ❌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants