Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SNOW-1824418: Enable setting properties in the RuntimeConf / session.conf object for migration scenarions #2672

Open
sfc-gh-mrojas opened this issue Nov 23, 2024 · 0 comments
Assignees
Labels
feature New feature or request

Comments

@sfc-gh-mrojas
Copy link
Collaborator

What is the current behavior?

Currently session.conf can only set actual properties, but in spark the conf object can be used as a dictionary to hold program settings

What is the desired behavior?

when session.conf.compatibility_mode = True allow setting/getting random properties

How would this improve snowflake-snowpark-python?

This will ease migration scenarios from spark code.

References, Other Background

https://spark.apache.org/docs/latest/api/java/org/apache/spark/SparkConf.html#set-java.lang.String-java.lang.String-

@sfc-gh-mrojas sfc-gh-mrojas added the feature New feature or request label Nov 23, 2024
@github-actions github-actions bot changed the title Enable setting properties in the RuntimeConf / session.conf object for migration scenarions SNOW-1824418: Enable setting properties in the RuntimeConf / session.conf object for migration scenarions Nov 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants