Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add prefix to GCS and S3 uri separators #7949

Closed
wants to merge 1 commit into from

Conversation

tigrux
Copy link
Contributor

@tigrux tigrux commented Dec 9, 2023

Storage adapters for both GCS and S3 use a separator for their URIs. The symbols in each adapter use a prefix to avoid collisions. However, this is not the case for the symbol kSep. This change fixes such potential collision.

Copy link

netlify bot commented Dec 9, 2023

Deploy Preview for meta-velox canceled.

Name Link
🔨 Latest commit 6e34e5d
🔍 Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/65afed97cc748900081e9987

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 9, 2023
@tigrux
Copy link
Contributor Author

tigrux commented Dec 9, 2023

Hello @majetideepak. We found an issue related to symbol collisions, and this contribution solves that problem. Thanks.

kgpai
kgpai previously approved these changes Jan 11, 2024
@facebook-github-bot
Copy link
Contributor

@kgpai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@kgpai kgpai dismissed their stale review January 11, 2024 23:59

Need further clarifications.

@kgpai
Copy link
Contributor

kgpai commented Jan 12, 2024

Hi @tigrux ,
Thank you for this change, However can you open an issue with the exact problem you are seeing ? Are you seeing issues during compile or link time ? Can you add these details to your issue ? Is this because of the anonymous namespacing ?

Thanks !

@majetideepak
Copy link
Collaborator

majetideepak commented Jan 12, 2024

@kgpai I can see that users would see redefinition of 'kSep' compile-time error if they include both GCSUtil.h and S3Util.h

@tigrux
Copy link
Contributor Author

tigrux commented Jan 12, 2024

Hello @kgpai, I filed the bug with exactly what @majetideepak described:
#8372

@facebook-github-bot
Copy link
Contributor

@kgpai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

Storage adapters for both GCS and S3 use a separator for their URIs.
The symbols in each adapter use a prefix to avoid collisions.
However, this is not the case for the symbol kSep.
This change fixes such potential collision.

Fixes facebookincubator#8372
@kgpai
Copy link
Contributor

kgpai commented Jan 24, 2024

Hi again @tigrux ,

Apologies for my late response on this, we are trying to move away from using anonymous namespaces in header files and I am going to create a PR shortly against our coding convention to highlight that. I do realize that this is present in more places than we would like in Velox, but we are trying to not add more.
Hopefully you can make this minor change and I will work on merging this.

@majetideepak
Copy link
Collaborator

we are trying to move away from using anonymous namespaces in header files

@kgpai Can you share some details on doing this? I am curious.

@tigrux
Copy link
Contributor Author

tigrux commented Jan 24, 2024

Hi again @tigrux ,

Apologies for my late response on this, we are trying to move away from using anonymous namespaces in header files and I am going to create a PR shortly against our coding convention to highlight that. I do realize that this is present in more places than we would like in Velox, but we are trying to not add more. Hopefully you can make this minor change and I will work on merging this.

Hello, I understand. Should I then modify this PR to remove the anonymous namespaces (in S3 and GCS)?

@kgpai
Copy link
Contributor

kgpai commented Jan 24, 2024

@tigrux Yes that would be great.
@majetideepak I will create a PR with more details soon.

Copy link

stale bot commented Apr 24, 2024

This pull request has been automatically marked as stale because it has not had recent activity. If you'd still like this PR merged, please comment on the PR, make sure you've addressed reviewer comments, and rebase on the latest main. Thank you for your contributions!

@stale stale bot added the stale label Apr 24, 2024
@stale stale bot closed this May 8, 2024
@tigrux tigrux deleted the velox-prefix-ksep branch June 5, 2024 19:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. stale
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants