Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support UDTF in pathway. #93

Open
tempbottle opened this issue Jan 15, 2025 · 1 comment
Open

support UDTF in pathway. #93

tempbottle opened this issue Jan 15, 2025 · 1 comment
Labels
enhancement New feature or request

Comments

@tempbottle
Copy link

Is your feature request related to a problem? Please describe.
Query external tables in pathway task exec.

Describe the solution you'd like
Solution like datafusion, it support UDTF to query another database. For example, https://github.com/datafusion-contrib/datafusion-table-providers can support many database.

Describe alternatives you've considered

Additional context

@tempbottle tempbottle added the enhancement New feature or request label Jan 15, 2025
@KamilPiechowiak
Copy link
Contributor

Hey @tempbottle,
thank you for a suggestion. However, I'd like to clarify what exactly you're proposing. If you mean operating on multiple rows at once in a single UDF, it is on our roadmap. If you mean the possibility to query other sources than those currently available, you can do that using the python connector. If you mean adding the possibility to write new connectors in rust by external users, it is not currently planned, but we may consider it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants