Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deploy Checklist: New Expensify 2022-09-05 #10808

Closed
33 tasks done
OSBotify opened this issue Sep 5, 2022 · 50 comments
Closed
33 tasks done

Deploy Checklist: New Expensify 2022-09-05 #10808

OSBotify opened this issue Sep 5, 2022 · 50 comments
Assignees
Labels
🔐 LockCashDeploys 🔐 Prevent new code from being deployed to staging StagingDeployCash

Comments

@OSBotify
Copy link
Contributor

OSBotify commented Sep 5, 2022

Release Version: 1.1.97-7
Compare Changes: production...staging

This release contains changes from the following pull requests:

Deploy Blockers:

Deployer verifications:

  • I checked the App Timing Dashboard and verified this release does not cause a noticeable performance regression.
  • I checked Firebase Crashlytics and verified that this release does not introduce any new crashes.

cc @Expensify/applauseleads

@mvtglobally mvtglobally added the 🔐 LockCashDeploys 🔐 Prevent new code from being deployed to staging label Sep 5, 2022
@OSBotify
Copy link
Contributor Author

OSBotify commented Sep 5, 2022

🚀 All staging deploys are complete, @Expensify/applauseleads please begin QA on version https://github.com/Expensify/App/releases/tag/1.1.97-2 🚀

@mvtglobally
Copy link

@Julesssss still waiting for IOS build. Rest is almost completed

@Julesssss
Copy link
Contributor

Two blockers, but they don't seem too problematic. Will chase up the iOS build and work on the blockers after lunch

@Julesssss
Copy link
Contributor

The iOS release is blocked, but this is being resolved internally. Will share an update later.

@AndrewGable
Copy link
Contributor

Agreed ☝️

@Julesssss
Copy link
Contributor

I removed 10826 as a blocker because it is only affecting high-traffic Android devices, and even then has not been reproduced by us yet. Made the issue external and we'll continue to investigate.

@Julesssss
Copy link
Contributor

I just finished updating the Apple certs and provisioning profile, and we're awaiting the CP to see if the iOS build is successfull. This will hopefully unblock iOS Applause testing soon 🤞

@Julesssss
Copy link
Contributor

Unfortunately, I ran into a different error when running the CP. I wonder if it would make sense to begin a regression test on all platforms excluding iOS in the meantime, to save a bit of time tomorrow?

@Julesssss Julesssss self-assigned this Sep 6, 2022
@Julesssss
Copy link
Contributor

Created a new issue for the CP issue here

@mvtglobally
Copy link

@Julesssss All other platforms are done, we are just waiting for IOS to finish this run

@Julesssss
Copy link
Contributor

Ah that's great, I hadn't had a chance to review individual issues. In that case there's nothing else we can do until tomorrow morning, unfortunately. I'll be treating the iOS release blocker as a fire and will give you an update as soon as possible!

@OSBotify
Copy link
Contributor Author

OSBotify commented Sep 7, 2022

👏 Heads up @Expensify/applauseleads 👏
A new pull request has been 🍒 cherry-picked 🍒 to staging, and will be deployed to staging in version 1.1.97-6 🚀

@OSBotify
Copy link
Contributor Author

OSBotify commented Sep 7, 2022

🎉 All set?…You bet! @Expensify/applauseleads https://github.com/Expensify/App/releases/tag/1.1.97-6 has been deployed to staging 🎉

@Julesssss
Copy link
Contributor

iOS is still blocked, but shouldn't be too far away now 🤞

@Julesssss
Copy link
Contributor

iOS build has been uploaded to Testflight and should be available soon. After this, there will be one more staging release which should follow shortly.

@mvtglobally
Copy link

@Julesssss i can see build 1.1.97-4 in TestFlight. Are we ok to resume IOS?

@Julesssss
Copy link
Contributor

Hey @mvtglobally, there should be another iOS build released very shortly. I'll confirm the exact version shortly

@Julesssss
Copy link
Contributor

Hi again @mvtglobally. Unfortunately a 3rd issue has blocked the release for a moment. Could you please start testing against version 1.1.97-4 in the meantime, to ensure we're not too delayed? Thanks!

@OSBotify
Copy link
Contributor Author

OSBotify commented Sep 7, 2022

👏 Heads up @Expensify/applauseleads 👏
A new pull request has been 🍒 cherry-picked 🍒 to staging, and will be deployed to staging in version 1.1.97-7 🚀

@Julesssss
Copy link
Contributor

Hey @mvtglobally, this is the release we've been waiting for. Please go ahead and restart testing against this build

@OSBotify
Copy link
Contributor Author

OSBotify commented Sep 7, 2022

🎉 All set?…You bet! @Expensify/applauseleads https://github.com/Expensify/App/releases/tag/1.1.97-7 has been deployed to staging 🎉

@Julesssss
Copy link
Contributor

Hey @Expensify/applauseleads. Please restart testing when ready. All platforms are ready

@mvtglobally
Copy link

@Julesssss We are almost done. Will share summary in a few
7% test rail pending and couple IOS PRs

@mvtglobally
Copy link

@Julesssss Interim summary.

PR #9772 Can you validate internally
PR #10494 is blocked partially on mWeb due to #10282. Are we ok to check off?
PR #10692 is failing due to #10821. Re-testing
PR #10739 just retesting IOS
PRs #10809 & #10749 are dependent on the Web deploy. https://github.com/Expensify/Expensify/issues/224690. Are we ok to check off?

@Julesssss
Copy link
Contributor

Marking off #9772

@chiragsalian
Copy link
Contributor

PR #10494 is blocked partially on mWeb due to #10282. Are we ok to check off?

Yes checking off #10494 since it looks like its not supported on mobile atm.

@mvtglobally
Copy link

@Julesssss @chiragsalian Can you also help out with #10557 It seems we are not able to trigger the error in staging same way to check

@chiragsalian
Copy link
Contributor

Checking off #10692. Its working great for me on staging.

@Julesssss
Copy link
Contributor

I also think this should be tested: #10749

And we can check off this one: https://github.com/Expensify/Expensify/issues/224690

@chiragsalian
Copy link
Contributor

Checking off #10557. It works well for me. Unfortunately, there is no easy way to test the errors part so its okay to skip that bit for now.

@Julesssss
Copy link
Contributor

#10282 can be checked off, but I don't see it in the list, and it's not merged. Not sure why that was listed

@Julesssss
Copy link
Contributor

Ah, my mistake. It's linked to by 10809 and 10749

@chiragsalian
Copy link
Contributor

Both #10692 and #10821, work great for me on staging. @mvtglobally, if it helps maybe you need to sign out and sign in to re-test them.

@mvtglobally
Copy link

#10692 #10692 (comment) @chiragsalian , Not sure if this is related to #10557 changed. Not repro by all testers, so we are still checking

@chiragsalian
Copy link
Contributor

chiragsalian commented Sep 7, 2022

#10780 We are facing #10753. It was closed. Are we ok to check it off or log again?

Can you log it as an issue. I don't think its deploy blocker worthy though.

@Julesssss
Copy link
Contributor

Julesssss commented Sep 7, 2022

Just checked off the last blocker (10821), and added a screencast of the resolved issue.

@mvtglobally
Copy link

mvtglobally commented Sep 7, 2022

Ok, so latest summary

#10739 - just finishing IOS. Rest is ok
PRs testing #10749 not waiting on the Web deploy of https://github.com/Expensify/Expensify/issues/224690. What do we do with #10809?
PR ##10780 logging an issue non-blocker. will check off once all platforms re-tested

@mvtglobally
Copy link

mvtglobally commented Sep 7, 2022

1 more note. Some non-US testers did not receive new IOS build. I have just 2 slots pending in Test Rail for IOS 16 BETA (since those testers dont have build yet). We tested exact same steps on IOS 15/14. Let me know if you want to wait for build or we ok this time
https://expensify.testrail.io/index.php?/plans/view/8805

@Julesssss
Copy link
Contributor

I marked off #10809 as it cannot be tested yet... we're waiting on a Web-E PR.

@Julesssss
Copy link
Contributor

@mvtglobally excellent, thanks for the update. Let's wait for the remaining Apple invite. I'm happy to try resending manually if you have the email to hand.

@mvtglobally
Copy link

Sent you details in Slack @Julesssss

@mvtglobally
Copy link

#10877 when running #10692

@Julesssss
Copy link
Contributor

Julesssss commented Sep 7, 2022

#10877 when running #10692

@chiragsalian would you mind taking a look at this today if you have a moment. Thanks 🙏

@Julesssss
Copy link
Contributor

Checking off #10749 because it's dependent on another PR that isn't merged.

@Julesssss
Copy link
Contributor

Checking off #10739 which tested flawlessly.

@Julesssss
Copy link
Contributor

No new crashes, marking off Firebase

@Julesssss
Copy link
Contributor

Julesssss commented Sep 7, 2022

Some non-US testers did not receive new IOS build. I have just 2 slots pending in Test Rail for IOS 16 BETA (since those testers dont have build yet). We tested exact same steps on IOS 15/14. Let me know if you want to wait for build or we ok this time

We discussed this internally and are happy to move forward given that we don't see any users on this specific iOS beta version.

@Julesssss
Copy link
Contributor

Closed the final remaining blocker 10877. Thanks so much, @yuwenmemon & @chiragsalian for your help.

@Julesssss
Copy link
Contributor

:shipit:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🔐 LockCashDeploys 🔐 Prevent new code from being deployed to staging StagingDeployCash
Projects
None yet
Development

No branches or pull requests

6 participants