We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
It is needed to support writing Spark dataframes with StringType columns to YTsaurus tables with Utf8 type columns. Two ways should be supported:
df.write.option("string_to_utf8", "true").yt("//path/to/table")
import yt.type_info as ti; df.write.schema_hint({"some_string_column": ti.Utf8})
The text was updated successfully, but these errors were encountered:
@faucct I think we've implemented it. Please link appropriate commit to this Issue and close it.
Sorry, something went wrong.
#26
faucct
No branches or pull requests
It is needed to support writing Spark dataframes with StringType columns to YTsaurus tables with Utf8 type columns. Two ways should be supported:
df.write.option("string_to_utf8", "true").yt("//path/to/table")
to convert all string columns to Utf8 type on writing;import yt.type_info as ti; df.write.schema_hint({"some_string_column": ti.Utf8})
to convert explicitly specified fields to utf8The text was updated successfully, but these errors were encountered: