Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[$500] CORS error is displayed when opening attachment #51888

Open
1 of 8 tasks
isagoico opened this issue Nov 1, 2024 · 78 comments
Open
1 of 8 tasks

[$500] CORS error is displayed when opening attachment #51888

isagoico opened this issue Nov 1, 2024 · 78 comments
Assignees
Labels
Bug Something is broken. Auto assigns a BugZero manager. External Added to denote the issue can be worked on by a contributor Reviewing Has a PR in review Weekly KSv2

Comments

@isagoico
Copy link

isagoico commented Nov 1, 2024

If you haven’t already, check out our contributing guidelines for onboarding and email [email protected] to request to join our Slack channel!


Version Number: v9.0.56-5
Reproducible in staging?: Yes
Reproducible in production?: Unknown (we assume yes)

Email or phone of affected tester (no customers): [email protected]
Logs: https://stackoverflow.com/c/expensify/questions/4856

Issue reported by: @quinthar
Slack conversation #quality

Action Performed:

  1. Open dev tools > Network tab
  2. Send a image to a conversation
  3. Open the image to view it's preview

Expected Result:

There's no error displayed in the network tab when opening a image.

Actual Result:

There's a CORS error when opening an image sent by the current user. (check screenshot)
Issue is not constantly reproducible.

Workaround:

N/A

Platforms:

Which of our officially supported platforms is this issue occurring on?

  • Android: Standalone
  • Android: HybridApp
  • Android: mWeb Chrome
  • iOS: Standalone
  • iOS: HybridApp
  • iOS: mWeb Safari
  • MacOS: Chrome / Safari
  • MacOS: Desktop

Screenshots/Videos

image

image

View all open jobs on GitHub

Upwork Automation - Do Not Edit
  • Upwork Job URL: https://www.upwork.com/jobs/~021854953413121158499
  • Upwork Job ID: 1854953413121158499
  • Last Price Increase: 2024-11-27
Issue OwnerCurrent Issue Owner: @hungvu193
@isagoico isagoico added Daily KSv2 Needs Reproduction Reproducible steps needed Bug Something is broken. Auto assigns a BugZero manager. labels Nov 1, 2024
Copy link

melvin-bot bot commented Nov 1, 2024

Triggered auto assignment to @greg-schroeder (Bug), see https://stackoverflow.com/c/expensify/questions/14418 for more details. Please add this bug to a GH project, as outlined in the SO.

@MelvinBot
Copy link

This has been labelled "Needs Reproduction". Follow the steps here: https://stackoverflowteams.com/c/expensify/questions/16989

@greg-schroeder
Copy link
Contributor

I couldn't reproduce this

@greg-schroeder greg-schroeder added the retest-weekly Apply this label if you want this issue tested on a Weekly basis by Applause label Nov 1, 2024
@justinpersaud
Copy link
Contributor

We have had similar reports of this before. I won't be able to help here unless it's still open when I'm back on the 11th, but I think the issue is has something to do with the exitTo being inserted into the request for the image from NewDot. I could be wrong, but that suggests to me that the token being used to request the image has expired and now we're serving back the exitTo to reauthenticate the user.

The CORS headers that it says are missing should be inserted here in nginx: https://github.com/Expensify/Salt/blob/main/shared_pkgs/nginx/files/conf.d/www.conf.template#L289-L302

but that line above does not match if the request is something like https://www.expensify.com/?exitTo=/chat-attachments/...

I think that is the problem.

cc @luacmartins since we were discussing a similar issue in another GH

@justinpersaud
Copy link
Contributor

@Beamanator I think I worked with you on getting this CORS stuff working awhile back when we started using X-Chat-Attachment-Token so maybe you have some insight to the above

@Kalydosos
Copy link
Contributor

Kalydosos commented Nov 3, 2024

Edited by proposal-police: This proposal was edited at 2024-11-03 18:47:58 UTC.

Proposal

Please re-state the problem that we are trying to solve in this issue.

CORS error is displayed when opening attachment

What is the root cause of that problem?

There are in fact 2 causes to this issue

cause 1 Some attachments are seen as of external source
These attachments miss the data-expensify-source attribute and then are requested from the BE without authentication token. Per example the attachment in the image below (see in video below also)
old_structure_textimage_comment

"html": "fixpdf10 updated<br /><br /><img src="https://www.expensify.com/chat-attachments/3502317922698459004/w_b0b3af58e7d67648f4a81469e82f9e0f409960d4.jpg.1024.jpg" alt="w_b0b3af58e7d67648f4a81469e82f9e0f409960d4.jpg.1024.jpg" />",
"text": "fixpdf10 updated\n\n[Attachment]",

they are requested without authentication token from the following lines

if (isAuthTokenRequired && authToken) {
return {
...propsSource,
headers: {
[CONST.CHAT_ATTACHMENT_TOKEN_KEY]: authToken,
},
};
}

The BE then send a redirect as exitTo url but which is requested without the proper "Access-Control-Allow-Origin" header. it doesnt reproduce all the time because sometimes the image is in the cache and is not requested from the BE

video_cause1.mp4

cause 2 The second cause is that the images are, at the very beginning of the screen loading (deeplinking to report), requested with an expired authentication token even though in most cases a reauthentication have been made. That should not happen but in fact the images loading were disconnected from direct session changes because of a bug in the past #26034

// The session prop is not required, as it causes the image to reload whenever the session changes. For more information, please refer to issue #26034.
// eslint-disable-next-line react-compiler/react-compiler, react-hooks/exhaustive-deps
}, [propsSource, isAuthTokenRequired]);

Then even though a reauthentication happens like in the images below (after reconnectApp gets a 407 from the BE) some of the images are firstly requested with an expired authentication token
reconnectapp_a_eu_407_d'ou_authenticate
authenticate_apres_reconnect_avant_openreport

These 2 causes are well sumed up in the video below

requetes_302_200_302.mp4

What changes do you think we should make in order to solve the problem?

For cause 1
We should change the code below to include these attachments, from

const attachmentSourceAttribute = htmlAttribs[CONST.ATTACHMENT_SOURCE_ATTRIBUTE];

into

const attachmentSourceAttribute = htmlAttribs[CONST.ATTACHMENT_SOURCE_ATTRIBUTE]??(htmlAttribs.src?.includes("expensify.com/chat-attachments")?htmlAttribs.src:null);

For cause 2
After evaluating other options, the safer is to apply the principle of not loading the images when the session is older then a certain amount of time (in fact the max idle time to expire a session in the BE. To be determined with the relevant Expensify team. I have setted 3 hours in this code and use 3 minutes for testing purpose). For that we should induce a notion of session age and if the session is older than the max idle time allowed, we display a loading-spinner-like icon (i have used hourglass in the code. To be determined with Design team) on the images until the session change have been propagated to induce a redraw of the screen. For that we add the following

in type Session.tsx https://github.com/Expensify/App/blob/f2e295fd174c87f7a516800c22028b637746b22c/src/types/onyx/Session.ts we added
session_age

we change the following lines

const source = useMemo(() => {
if (typeof propsSource === 'object' && 'uri' in propsSource) {
if (typeof propsSource.uri === 'number') {
return propsSource.uri;
}
const authToken = session?.encryptedAuthToken ?? null;
if (isAuthTokenRequired && authToken) {
return {
...propsSource,
headers: {
[CONST.CHAT_ATTACHMENT_TOKEN_KEY]: authToken,
},
};
}
}
return propsSource;
// The session prop is not required, as it causes the image to reload whenever the session changes. For more information, please refer to issue #26034.
// eslint-disable-next-line react-compiler/react-compiler, react-hooks/exhaustive-deps
}, [propsSource, isAuthTokenRequired]);

into

OPTION6_component_image_modified

we force useMemo to recalculate and rerender when the session is outdated and we cover cases like the first outdated session without age and the first still valid session without age. Based on the experience working on this issue, we think that any update of the session by Onyx in less than 60s after the previous update may be related to a reauthentication and thus we must recalculate the image source and rerender the image

we also change https://github.com/Expensify/App/blob/f2e295fd174c87f7a516800c22028b637746b22c/src/libs/actions/Session/updateSessionAuthTokens.ts into this

export default function updateSessionAuthTokens(authToken?: string, encryptedAuthToken?: string) {
Onyx.merge(ONYXKEYS.SESSION, {authToken, encryptedAuthToken, age: new Date().getTime()});
}

and

Authenticate(e2eUserCredentials)
.then((response) => {
Onyx.merge(ONYXKEYS.SESSION, {
authToken: response.authToken,
email: e2eUserCredentials.email,
});
console.debug('[E2E] Signed in finished!');
return waitForBeginSignInToFinish();
})
.catch((error) => {
console.error('[E2E] Error while signing in', error);
reject(error);
});

into

e2e ts modif

in Session/index.tsx https://github.com/Expensify/App/blob/f2e295fd174c87f7a516800c22028b637746b22c/src/libs/actions/Session/index.ts we added
modif_session

RESULT

It works like a charm, the attachments are properly displayed in both cases .

video before
https://github.com/user-attachments/assets/72295591-3162-4acd-8431-98c8da2ef195

video after
https://github.com/user-attachments/assets/367d36b8-1f72-4047-8a35-d67c6114b195

video testing the 2 Hours expired token
https://github.com/user-attachments/assets/ccd73db5-d00a-49cd-83b2-0b3fb7388577

What alternative solutions did you explore? (Optional)

None

@Kalydosos
Copy link
Contributor

it doesnt reproduce all the time because sometimes the image is in the cache and is not requested from the BE

@CyberAndrii
Copy link
Contributor

@justinpersaud you are correct, see details here #51699 (comment)

@greg-schroeder let's close this as a dupe of #51699 ?

@melvin-bot melvin-bot bot added the Overdue label Nov 4, 2024
@Beamanator
Copy link
Contributor

This def does look like a dupe 👍 Also @CyberAndrii 's reproduction steps look pretty good in the other issue, would be nice if @Kalydosos could try to reproduce w/out their fix & with their fix to see if that solves the issue every time 🙏

@Kalydosos
Copy link
Contributor

Kalydosos commented Nov 4, 2024

This def does look like a dup

@Beamanator #51699 is about the reproduction steps but this ticket is about the solution to the problem. So this is not a duplicate. I will provide simpler repro steps in #51699

would be nice if @Kalydosos could try to reproduce w/out their fix & with their fix

They provide no fix afaik in #51699, they just propose some potential repro steps. Let me know if i'm wrong.

I have read the recents edits #51699 (comment) and recents comments #51699 (comment) of @CyberAndrii. I will provide simpler reproduction step. And in fact his statement is not correct as the issue has nothing to do with "expired authentication token", the token are just not sent. We cannot send expired token because the token that is send is from the session and the user session is refresh way before retrieving the images. (EDIT : @CyberAndrii is right in fact on this point, cf #51888 (comment))

The image url is passed directly to RN's component bypassing our middleware so a new token is not issued.

this part is not correct neither as the token is not just sent and it is a deliberate choice, see ligne 50 of

const source = useMemo(() => {
if (typeof propsSource === 'object' && 'uri' in propsSource) {
if (typeof propsSource.uri === 'number') {
return propsSource.uri;
}
const authToken = session?.encryptedAuthToken ?? null;
if (isAuthTokenRequired && authToken) {
return {
...propsSource,
headers: {
[CONST.CHAT_ATTACHMENT_TOKEN_KEY]: authToken,
},
};
}
}

and what proves even more my point and made my proposed fix correct is the deliberate intent of not sending the token made clear in the following comments from the code itself. It is just the some attachments were not taken in consideration as of "local" source cf #51888 (comment)

// There are two kinds of images that need to be displayed:
//
// - Chat Attachment images
//
// Images uploaded by the user via the app or email.
// These have a full-sized image `htmlAttribs[CONST.ATTACHMENT_SOURCE_ATTRIBUTE]`
// and a thumbnail `htmlAttribs.src`. Both of these URLs need to have
// an authToken added to them in order to control who
// can see the images.
//
// - Non-Attachment Images
//
// These could be hosted from anywhere (Expensify or another source)
// and are not protected by any kind of access control e.g. certain
// Concierge responder attachments are uploaded to S3 without any access
// control and thus require no authToken to verify access.
//

@Beamanator
Copy link
Contributor

Beamanator commented Nov 4, 2024

would be nice if @Kalydosos could try to reproduce w/out their fix & with their fix

They provide no fix afaik in #51699, they just propose some potential repro steps. Let me know if i'm wrong.

Yes that's my bad on phrasing - I was talking to the air, but i should have asked you specifically if you could reproduce consistently & if your fix solves all cases 🙏 I def agree there were no solutions proposed in the linked issue

@Kalydosos
Copy link
Contributor

@Beamanator yes i could reproduce the issue consistently and yes my fix solve all cases. I will provide a repro steps here and in the linked issue asap

@Beamanator
Copy link
Contributor

Thanks very much for confirming 🙏

@greg-schroeder
Copy link
Contributor

Okay so I should set this to External and have us assign @Kalydosos?

@melvin-bot melvin-bot bot removed the Overdue label Nov 4, 2024
@Kalydosos
Copy link
Contributor

@Beamanator i've been having some issue with my test account since yesterday, i will make a proposal for the repro steps in #51699 once i get that fixed, this proposal here anyway still the fix for the problem

Capture d’écran de 2024-11-05 10-47-52

@CyberAndrii
Copy link
Contributor

@Kalydosos this happens sometimes. Create a new account with the + postfix as described in CONTRIBUTING.md

@mvtglobally
Copy link

Issue not reproducible during KI retests. (First week)

@melvin-bot melvin-bot bot added the Overdue label Nov 8, 2024
@Kalydosos
Copy link
Contributor

@Beamanator @greg-schroeder i have updated my proposal, it was a tough issue with multiple causes. I have given a sumup in the proposal details. Reproduction and evolution on the resolution was not easy as eachstep required waiting some hours but i can say that the different aspects of the issue are taken in consideration by my proposal. Some information (the maximum session idle time allowed by the BE) and a choice of Design for a loading spinner must be made if my proposal is accepted.

@Kalydosos
Copy link
Contributor

@CyberAndrii my bad, you were right on the point that expired token was also send as a cause of the issue. It shouldn't have happen but an old bug allow the code to do so #26034

@Kalydosos
Copy link
Contributor

Kalydosos commented Nov 8, 2024

@mvtglobally the repro steps will be more like #51699 (comment)

@greg-schroeder greg-schroeder added the External Added to denote the issue can be worked on by a contributor label Nov 8, 2024
Copy link

melvin-bot bot commented Nov 27, 2024

Triggered auto assignment to @rlinoz, see https://stackoverflow.com/c/expensify/questions/7972 for more details.

@Kalydosos
Copy link
Contributor

Kalydosos commented Nov 27, 2024

@hungvu193 ok to discuss the BE change if it can be done. We will also need Design

@rlinoz
Copy link
Contributor

rlinoz commented Nov 27, 2024

Thanks for all the hard work on this issue!

What is the BE change that we might need to fix the second issue? Is it sending back when the token expires?

@hungvu193
Copy link
Contributor

What is the BE change that we might need to fix the second issue? Is it sending back when the token expires?

Yeah, we need an expiredTime for our token, @Kalydosos can you confirm?

@Kalydosos
Copy link
Contributor

Kalydosos commented Nov 28, 2024

@rlinoz thanks for helping out !

If possible, we will need the BE, when it send a new session to the FE (like in response to Authenticate), to add the session creation date timestamp. That prop of the session can be named "creation" or "creationTime" per example and its value must take in consideration the timezone of the FE device.

What do you think of it ?

cc @hungvu193

@rlinoz
Copy link
Contributor

rlinoz commented Nov 28, 2024

@mvtglobally
Copy link

Issue not reproducible during KI retests. (Fourth week)

Copy link

melvin-bot bot commented Nov 29, 2024

@rlinoz @hungvu193 @greg-schroeder this issue is now 4 weeks old, please consider:

  • Finding a contributor to fix the bug
  • Closing the issue if BZ has been unable to add the issue to a VIP or Wave project
  • If you have any questions, don't hesitate to start a discussion in #expensify-open-source

Thanks!

@hungvu193
Copy link
Contributor

Still discussing

@melvin-bot melvin-bot bot removed the Help Wanted Apply this label when an issue is open to proposals by contributors label Nov 29, 2024
Copy link

melvin-bot bot commented Nov 29, 2024

❌ There was an error making the offer to @Kalydosos for the Contributor role. The BZ member will need to manually hire the contributor.

@rlinoz
Copy link
Contributor

rlinoz commented Nov 29, 2024

assigning @Kalydosos per thread https://expensify.slack.com/archives/C01GTK53T8Q/p1732798975726319

@Kalydosos
Copy link
Contributor

thanks for helping out @rlinoz

@hungvu193 we will also need Design team's help

@hungvu193
Copy link
Contributor

thanks for helping out @rlinoz

@hungvu193 we will also need Design team's help

About the loading image right? Let's use a temporary image and create the PR. We can discuss about it during PR phrase

@Kalydosos
Copy link
Contributor

@hungvu193 sounds good 👍

@hungvu193
Copy link
Contributor

@Kalydosos any ETA for the PR?

@Kalydosos
Copy link
Contributor

The PR will be available in a few hours

@greg-schroeder
Copy link
Contributor

Draft PR created

Copy link

melvin-bot bot commented Dec 5, 2024

@Kalydosos, @rlinoz, @hungvu193, @greg-schroeder Whoops! This issue is 2 days overdue. Let's get this updated quick!

@melvin-bot melvin-bot bot added the Overdue label Dec 5, 2024
@hungvu193
Copy link
Contributor

Draft PR is up. We're still working on it

@melvin-bot melvin-bot bot removed the Overdue label Dec 5, 2024
@greg-schroeder
Copy link
Contributor

Thanks @hungvu193

@mvtglobally
Copy link

Issue not reproducible during KI retests. (Fifth week)

@melvin-bot melvin-bot bot added Reviewing Has a PR in review Weekly KSv2 and removed Daily KSv2 labels Dec 8, 2024
@greg-schroeder
Copy link
Contributor

Work on linked PR continues

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something is broken. Auto assigns a BugZero manager. External Added to denote the issue can be worked on by a contributor Reviewing Has a PR in review Weekly KSv2
Projects
Status: CRITICAL
Development

No branches or pull requests