Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unsupported Redshift type: binary #2550

Closed
misteliy opened this issue Dec 8, 2023 · 1 comment · Fixed by #2573
Closed

Unsupported Redshift type: binary #2550

misteliy opened this issue Dec 8, 2023 · 1 comment · Fixed by #2573
Labels
bug Something isn't working

Comments

@misteliy
Copy link

misteliy commented Dec 8, 2023

Describe the bug

When using

                wr.redshift.copy_from_files(
                    path=path,
                    con=con,
                    table=file_name.replace(".parquet", ""),
                    schema="staging",
                    parquet_infer_sampling = 1,
                    varchar_lengths_default = 65535
                )

I'm getting following error:

image

most likely the data type should be mapped to varchar

How to Reproduce

*P.S. Please do not attach files as it's considered a security risk. Add code snippets directly in the message body as much as possible.*

Expected behavior

No response

Your project

No response

Screenshots

No response

OS

Linux

Python version

3.10.12

AWS SDK for pandas version

3.4.2

Additional context

No response

@misteliy misteliy added the bug Something isn't working label Dec 8, 2023
@kukushking
Copy link
Contributor

kukushking commented Dec 22, 2023

Hi @misteliy thanks for opening this. There is VARBYTE data type that is missing from type mappings. I will cut a PR to fix this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants