Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deploy Checklist: New Expensify 2023-07-17 #23033

Closed
OSBotify opened this issue Jul 17, 2023 · 36 comments
Closed

Deploy Checklist: New Expensify 2023-07-17 #23033

OSBotify opened this issue Jul 17, 2023 · 36 comments
Assignees
Labels
Daily KSv2 🔐 LockCashDeploys 🔐 Prevent new code from being deployed to staging StagingDeployCash

Comments

@OSBotify
Copy link
Contributor

OSBotify commented Jul 17, 2023

Release Version: 1.3.42-26
Compare Changes: production...staging

This release contains changes from the following pull requests:

Internal QA:

Deploy Blockers:

Deployer verifications:

  • I checked the App Timing Dashboard and verified this release does not cause a noticeable performance regression.
  • I checked Firebase Crashlytics and verified that this release does not introduce any new crashes. More detailed instructions on this verification can be found here.
  • I checked GitHub Status and verified there is no reported incident with Actions.

cc @Expensify/applauseleads

@mvtglobally mvtglobally added the 🔐 LockCashDeploys 🔐 Prevent new code from being deployed to staging label Jul 17, 2023
@OSBotify
Copy link
Contributor Author

🚀 All staging deploys are complete, @Expensify/applauseleads please begin QA on version https://github.com/Expensify/App/releases/tag/1.3.42-0 🚀

@dangrous
Copy link
Contributor

dangrous commented Jul 17, 2023

If I already QAed the PR I was assigned for the previous Deploy Checklist, do I need to again? Is there a possibility it's broken now? Not sure on the process (or what happened here to have it show up again)

@jasperhuangg jasperhuangg self-assigned this Jul 17, 2023
@jasperhuangg
Copy link
Contributor

@dangrous I accidentally deployed the old checklist during the stress test, but cancelled that deploy.

So your PR was checked off, and in the process of being deployed, but didn't actually get deployed. So it was included in this checklist again.

I would QA it again just to be sure that it still works with the new items in this checklist. Sorry for the hassle!

@mvtglobally
Copy link

@jasperhuangg similar question. Should we re-QA ALL of the PRs from previous checklist as well?

@jasperhuangg
Copy link
Contributor

ah @mvtglobally I didn't think about this.. yes, I think it's best, otherwise regressions might get through. Thanks for asking.

@isagoico
Copy link

@jasperhuangg As a heads up - this will increase the result turnaround time considerably since it's another 30 PRs to verify. We will keep you posted on the progress.

@jasperhuangg
Copy link
Contributor

@isagoico that's fine, thanks for letting me know!

@Julesssss
Copy link
Contributor

I checked off #23070 after cherry-picking the revert PR here

@mvtglobally
Copy link

@Julesssss @jasperhuangg I see the build is upped. Can you pls share the CPs we need to test as I dont see them in checklist

@mountiny
Copy link
Contributor

Checking #23083 off, not a blocker.

@mvtglobally I think if you have verified some PRs yesterday in the checklist, I dont think we have to be verifying them again, any reason for that @jasperhuangg?

@dangrous
Copy link
Contributor

Confirmed #22590 works well!

@aimane-chnaif
Copy link
Contributor

@mountiny
Copy link
Contributor

mountiny commented Jul 18, 2023

@aimane-chnaif Yep, the CP failed https://github.com/Expensify/App/actions/runs/5588876019/jobs/10216344982 trying to get that resolved

All good, its deployed

@jasperhuangg jasperhuangg added the Daily KSv2 label Jul 18, 2023
@jasperhuangg
Copy link
Contributor

Checking #23083 off, not a blocker.

@mvtglobally I think if you have verified some PRs yesterday in the checklist, I dont think we have to be verifying them again, any reason for that @jasperhuangg?

@mountiny I'm concerned that a new combination of PRs may cause regressions/blockers that we weren't previously aware of. I'd rather catch those bugs now rather than later.

@jasperhuangg
Copy link
Contributor

Checking off #23050 as it isn't reproducible in the latest release and shouldn't be a blocker

@mvtglobally
Copy link

We are working on the full list Will be sharing update shortly

@francoisl
Copy link
Contributor

Checking off blocker 23106, not an issue

@jasperhuangg
Copy link
Contributor

Checking off #17452, was able to QA this myself successfully

@jasperhuangg
Copy link
Contributor

Checking off #23102 since we CP'd a fix to staging.

@jasperhuangg
Copy link
Contributor

@mvtglobally I tested #17452 myself and it works as expected, gonna remove it from your list

@mvtglobally
Copy link

mvtglobally commented Jul 18, 2023

Current summary
#20142 pending validation on all platforms
#21594 CP pending validation on all platforms
#21938 CP pending validation on all platforms
#22154 CP pending validation on all platforms
#22243 CP pending validation on all platforms
#22248 CP pending validation on all platforms
#22260 pending validation on all platforms
#22329 pending validation on all platforms
#22403 is failing #23052
#22431 pending validation on all platforms
#22473 CP pending validation on all platforms
#22484 is failing #23083 & pending IOS validation
#22484 pending validation on all platforms
#22551 checking off #22551 (comment)
#22586 is failing #23049. Repro in PROD checking off
#22616 pending validation on all platforms
#22620 pending validation on all platforms
#22628 is failing 6132992
#22639 pending validation on all platforms
#22653 pending validation on all platforms
#22734 CP pending validation on all platforms
#22755 CP pending validation on all platforms
#22761 pending validation on all platforms
#22777 is failing #22777. Repro in PROD checking off
#22784 CP pending validation on all platforms
#22808 CP pending validation on all platforms
#22817 CP pending validation on all platforms
#22818 CP pending validation on all platforms
#22820 pending validation on all platforms
#22827 is failing #23084 Repro in PROD checking off

#22830 CP pending validation on all platforms
#22845 pending validation on all platforms
#22866 pending validation on all platforms
#22869 is failing #23082 Repro in PROD checking off
#22898 CP pending validation on all platforms
#22903 pending validation on all platforms
#22908 & #22917 Can we check off since this is PROD QA?
#22928 CP pending validation on all platforms
#23023 CP pending validation on all platforms
#23053 CP pending validation on all platforms
#23107 CP pending validation on all platforms

@jasperhuangg
Copy link
Contributor

@mvtglobally

#22908 & #22917 Can we check off since this is PROD QA?

Checked them off!

@mvtglobally
Copy link

sorry for the long summary @jasperhuangg but I wanted to provide the actual feedback on all unchecked so we have a better visibility

@jasperhuangg
Copy link
Contributor

#22403 is failing #23052

It seems the root cause of #23052 is actually #21852, so checking off #22403

@jasperhuangg
Copy link
Contributor

QA'd #22243 successfully myself, checking it off

@jasperhuangg
Copy link
Contributor

QA'd #22755 successfully myself, checking it off

@jasperhuangg
Copy link
Contributor

QA'd #22734 successfully myself, checking it off

@jasperhuangg
Copy link
Contributor

Checking off #23077 repro in prod

@jasperhuangg
Copy link
Contributor

jasperhuangg commented Jul 18, 2023

We CP'd a fix for #23123, just retested on staging and it works now, checking it off

@mvtglobally
Copy link

Current summary
Checked a bunch of the PRs. working on the last ones
#20142 pending validation on all platforms
#22154 CP pending validation on all platforms
#22243 CP pending validation on all platforms
#22248 CP pending validation on all platforms
#22403 is failing #23052
#22431 pending validation on all platforms
#22473 CP pending validation on all platforms
#22484 is failing #23083 & pending Android validation
#22620 pending validation on all platforms
#22628 is failing #23144. repro in PROD
#22639 pending validation on all platforms
#22653 pending validation on all platforms
#22761 pending validation on all platforms
#22784 CP pending validation on all platforms
#22808 CP pending validation on all platforms
#22817 CP pending validation on all platforms
#22818 CP pending validation on all platforms
#22820 pending validation on all platform

#22830 CP pending validation on all platforms
#22845 pending validation on all platforms
#22866 pending validation on all platforms
#22898 CP pending validation on all platforms
#22903 pending validation on all platforms
#22928 CP pending validation on all platforms
#23023 CP pending validation on all platforms
#23053 CP pending validation on all platforms
#23107 CP pending validation on all platforms

@jasperhuangg
Copy link
Contributor

QA'd #23107 myself and it works, checking it off

@jasperhuangg
Copy link
Contributor

Checking off #23073 and #23052, they were fixed by #23145 and passed QA successfully.

@Julesssss
Copy link
Contributor

Cherry-picked this minor PR to staging and checked it off: #23155

@mvtglobally
Copy link

@jasperhuangg Regression is completed

Final summary
#20142 is failing #23170. repro in PROD. We are also blocked from validation on Native apps. Ok to check off?
#22243 is failing #23173. repro in prod, checking off
#22403 is failing #23052
#22473 is failing #22473 (comment)
#22484 is failing #23083
#22628 is failing #23144. repro in PROD
#22761 is failing #23106
#22817 is failing #22803

@jasperhuangg
Copy link
Contributor

#22473 is failing #22473 (comment)

That seems to exist in prod already, so no need to block the deploy.

#22484 is failing #23083

A fix was CP'd for this

#22761 is failing #23106

Reproducible in prod, so no need to block deploy on this.

Also, I'm checking off #22817 as it was reverted.

@jasperhuangg
Copy link
Contributor

:shipit:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Daily KSv2 🔐 LockCashDeploys 🔐 Prevent new code from being deployed to staging StagingDeployCash
Projects
None yet
Development

No branches or pull requests

10 participants