Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Can we enhance VerificationSuite to supports more than one Dataframe? #548

Open
Sat30 opened this issue Mar 14, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@Sat30
Copy link

Sat30 commented Mar 14, 2024

Is your feature request related to a problem? Please describe.
Many Quality checks involve table which is result of joins

Describe the solution you'd like
Curious to find an Optimized Approach for handling Multiple Dataframe.

Describe alternatives you've considered
Now I'm joining two dataframe and passing resulting dataframe for verification.
But this way is not efficient for large scale data quality Checks. Deequ is build to handle large scale Data

Additional context
I'm always looking for ways to optimize. If anyone has ideas or would like to collaborate on optimizing this process, I'd be happy to connect and discuss further.

@Sat30 Sat30 added the enhancement New feature or request label Mar 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant