Skip to content

Commit

Permalink
Release v0.13.0 (#317)
Browse files Browse the repository at this point in the history
* Added `escape_name` function to escape individual SQL names and
`escape_full_name` function to escape dot-separated full names
([#316](#316)). Two new
functions, `escape_name` and `escape_full_name`, have been added to the
`databricks.labs.lsql.escapes` module for escaping SQL names. The
`escape_name` function takes a single name as an input and returns it
enclosed in backticks, while `escape_full_name` handles dot-separated
full names by escaping each individual component. These functions have
been ported from the `databrickslabs/ucx` repository and are designed to
provide a consistent way to escape names and full names in SQL
statements, improving the robustness of the system by preventing issues
caused by unescaped special characters in SQL names. The test suite
includes various cases, including single names, full names with
different combinations of escaped and unescaped components, and special
characters, with a specific focus on the scenario where the column name
contains a period.
* Bump actions/checkout from 4.2.0 to 4.2.1
([#304](#304)). In this
pull request, the `actions/checkout` dependency is updated from version
4.2.0 to 4.2.1 in the `.github/workflows/release.yml` file. This update
includes a new feature where `refs/*` are checked out by commit if
provided, falling back to the ref specified by the `@orhantoy` user.
This change improves the flexibility of the action, allowing users to
specify a commit or branch for checkout. The pull request also
introduces a new contributor, `@Jcambass`, who added a workflow file for
publishing releases to an immutable action package. The commits for this
release include changes to prepare for the 4.2.1 release, add a workflow
file for publishing releases, and check out other `refs/*` by commit if
provided, falling back to ref. This pull request has been reviewed and
approved by Dependabot.
* Bump actions/checkout from 4.2.1 to 4.2.2
([#310](#310)). This is a
pull request to update the `actions/checkout` dependency from version
4.2.1 to 4.2.2, which includes improvements to the `url-helper.ts` file
that now utilize well-known environment variables and expanded unit test
coverage for the `isGhes` function. The `actions/checkout` action is
commonly used in GitHub Actions workflows for checking out a repository
at a specific commit or branch. The changes in this update are internal
to the `actions/checkout` action and should not affect the functionality
of the project utilizing this action. The pull request also includes
details on the commits and compatibility score for the upgrade, and
reviewers can manage and merge the request using Dependabot commands
once the changes have been verified.
* Bump databrickslabs/sandbox from acceptance/v0.3.0 to 0.3.1
([#307](#307)). In this
release, the `databrickslabs/sandbox` dependency has been updated from
version `acceptance/v0.3.0` to `0.3.1`. This update includes previously
tagged commits, bug fixes for git-related libraries, and resolution of
the `unsupported protocol scheme` error. The README has been updated
with more information on using the `databricks labs sandbox` command,
and installation instructions have been improved. Additionally, there
have been dependency updates for `go-git` libraries and
`golang.org/x/crypto` in the `/go-libs` and `/runtime-packages`
directories. New commits in this release allow larger logs from
acceptance tests and implement experimental OIDC refresh functionality.
Ignore conditions have been applied to prevent conflicts with previous
versions of the dependency. This update is recommended for users who
want to take advantage of the latest bug fixes and improvements.
* Bump databrickslabs/sandbox from acceptance/v0.3.1 to 0.4.2
([#315](#315)). In this
release, the `databrickslabs/sandbox` dependency has been updated from
version `acceptance/v0.3.1` to `0.4.2`. This update includes bug fixes,
dependency updates, and additional go-git libraries. Specifically, the
`Run integration tests` job in the GitHub Actions workflow has been
updated to use the new version of the
`databrickslabs/sandbox/acceptance` Docker image. The updated version
also includes install instructions, usage instructions in the README,
and a modification to provide more git-related libraries. Additionally,
there were several updates to dependencies, including
`golang.org/x/crypto` version `0.16.0` to `0.17.0`. Dependabot, a tool
that manages dependencies in GitHub projects, is responsible for the
update and provides instructions for resolving any conflicts or merging
the changes into the project. This update is intended to improve the
functionality and reliability of the `databrickslabs/sandbox`
dependency.
* Deprecate `Row.as_dict()`
([#309](#309)). In this
release, we are introducing a deprecation warning for the `as_dict()`
method in the `Row` class, which will be removed in favor of the
`asDict()` method. This change aims to maintain consistency with Spark's
`Row` behavior and prevent subtle bugs when switching between different
backends. The deprecation warning will be implemented using Python's
warnings mechanism, including the new annotation in Python 3.13 for
static code analysis. The existing functionality of fetching values from
the database through `StatementExecutionExt` remains unchanged. We
recommend that clients update their code to use `.asDict()` instead of
`.as_dict()` to avoid any disruptions. A new test case
`test_row_as_dict_deprecated()` has been added to verify the deprecation
warning for `Row.as_dict()`.
* Minor improvements for `.save_table(mode="overwrite")`
([#298](#298)). In this
release, the `.save_table()` method has been improved, particularly when
using the `overwrite` mode. If no rows are supplied, the table will now
be truncated, ensuring consistency with the mock backend behavior. This
change has been optimized for SQL-based backends, which now perform
truncation as part of the insert for the first batch. Type hints on the
abstract method have been updated to match the concrete implementations.
Unit tests and integration tests have been updated to cover the new
functionality, and new methods have been added to test the truncation
behavior in overwrite mode. These improvements enhance the consistency
and efficiency of the `.save_table()` method when using `overwrite` mode
across different backends.
* Updated databrickslabs/sandbox requirement to acceptance/v0.3.0
([#305](#305)). In this
release, we have updated the requirement for the
`databrickslabs/sandbox` package to version `acceptance/v0.3.0` in the
`downstreams.yml` file. This update is necessary to use the latest
version of the package, which includes several bug fixes and dependency
updates. The `databrickslabs/sandbox` package is used in the acceptance
tests, which are run as part of the CI/CD pipeline. It provides a set of
tools and utilities for developing and testing code in a sandbox
environment. The changelog for this version includes the addition of
install instructions, more git-related libraries, and the modification
of the README to include information about how to use it with the
`databricks labs sandbox` command. Specifically, the version of the
`databrickslabs/sandbox` package used in the `acceptance` job has been
updated from `acceptance/v0.1.4` to `acceptance/v0.3.0`, allowing the
integration tests to be run using the latest version of the package. The
ignore conditions for this PR ensure that Dependabot will resolve any
conflicts that may arise and can be manually triggered with the
`@dependabot rebase` command.

Dependency updates:

* Bump actions/checkout from 4.2.0 to 4.2.1
([#304](#304)).
* Updated databrickslabs/sandbox requirement to acceptance/v0.3.0
([#305](#305)).
* Bump databrickslabs/sandbox from acceptance/v0.3.0 to 0.3.1
([#307](#307)).
* Bump actions/checkout from 4.2.1 to 4.2.2
([#310](#310)).
* Bump databrickslabs/sandbox from acceptance/v0.3.1 to 0.4.2
([#315](#315)).
  • Loading branch information
nfx authored Nov 8, 2024
1 parent 776e1cf commit 48c287e
Show file tree
Hide file tree
Showing 2 changed files with 20 additions and 1 deletion.
19 changes: 19 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,24 @@
# Version changelog

## 0.13.0

* Added `escape_name` function to escape individual SQL names and `escape_full_name` function to escape dot-separated full names ([#316](https://github.com/databrickslabs/lsql/issues/316)). Two new functions, `escape_name` and `escape_full_name`, have been added to the `databricks.labs.lsql.escapes` module for escaping SQL names. The `escape_name` function takes a single name as an input and returns it enclosed in backticks, while `escape_full_name` handles dot-separated full names by escaping each individual component. These functions have been ported from the `databrickslabs/ucx` repository and are designed to provide a consistent way to escape names and full names in SQL statements, improving the robustness of the system by preventing issues caused by unescaped special characters in SQL names. The test suite includes various cases, including single names, full names with different combinations of escaped and unescaped components, and special characters, with a specific focus on the scenario where the column name contains a period.
* Bump actions/checkout from 4.2.0 to 4.2.1 ([#304](https://github.com/databrickslabs/lsql/issues/304)). In this pull request, the `actions/checkout` dependency is updated from version 4.2.0 to 4.2.1 in the `.github/workflows/release.yml` file. This update includes a new feature where `refs/*` are checked out by commit if provided, falling back to the ref specified by the `@orhantoy` user. This change improves the flexibility of the action, allowing users to specify a commit or branch for checkout. The pull request also introduces a new contributor, `@Jcambass`, who added a workflow file for publishing releases to an immutable action package. The commits for this release include changes to prepare for the 4.2.1 release, add a workflow file for publishing releases, and check out other `refs/*` by commit if provided, falling back to ref. This pull request has been reviewed and approved by Dependabot.
* Bump actions/checkout from 4.2.1 to 4.2.2 ([#310](https://github.com/databrickslabs/lsql/issues/310)). This is a pull request to update the `actions/checkout` dependency from version 4.2.1 to 4.2.2, which includes improvements to the `url-helper.ts` file that now utilize well-known environment variables and expanded unit test coverage for the `isGhes` function. The `actions/checkout` action is commonly used in GitHub Actions workflows for checking out a repository at a specific commit or branch. The changes in this update are internal to the `actions/checkout` action and should not affect the functionality of the project utilizing this action. The pull request also includes details on the commits and compatibility score for the upgrade, and reviewers can manage and merge the request using Dependabot commands once the changes have been verified.
* Bump databrickslabs/sandbox from acceptance/v0.3.0 to 0.3.1 ([#307](https://github.com/databrickslabs/lsql/issues/307)). In this release, the `databrickslabs/sandbox` dependency has been updated from version `acceptance/v0.3.0` to `0.3.1`. This update includes previously tagged commits, bug fixes for git-related libraries, and resolution of the `unsupported protocol scheme` error. The README has been updated with more information on using the `databricks labs sandbox` command, and installation instructions have been improved. Additionally, there have been dependency updates for `go-git` libraries and `golang.org/x/crypto` in the `/go-libs` and `/runtime-packages` directories. New commits in this release allow larger logs from acceptance tests and implement experimental OIDC refresh functionality. Ignore conditions have been applied to prevent conflicts with previous versions of the dependency. This update is recommended for users who want to take advantage of the latest bug fixes and improvements.
* Bump databrickslabs/sandbox from acceptance/v0.3.1 to 0.4.2 ([#315](https://github.com/databrickslabs/lsql/issues/315)). In this release, the `databrickslabs/sandbox` dependency has been updated from version `acceptance/v0.3.1` to `0.4.2`. This update includes bug fixes, dependency updates, and additional go-git libraries. Specifically, the `Run integration tests` job in the GitHub Actions workflow has been updated to use the new version of the `databrickslabs/sandbox/acceptance` Docker image. The updated version also includes install instructions, usage instructions in the README, and a modification to provide more git-related libraries. Additionally, there were several updates to dependencies, including `golang.org/x/crypto` version `0.16.0` to `0.17.0`. Dependabot, a tool that manages dependencies in GitHub projects, is responsible for the update and provides instructions for resolving any conflicts or merging the changes into the project. This update is intended to improve the functionality and reliability of the `databrickslabs/sandbox` dependency.
* Deprecate `Row.as_dict()` ([#309](https://github.com/databrickslabs/lsql/issues/309)). In this release, we are introducing a deprecation warning for the `as_dict()` method in the `Row` class, which will be removed in favor of the `asDict()` method. This change aims to maintain consistency with Spark's `Row` behavior and prevent subtle bugs when switching between different backends. The deprecation warning will be implemented using Python's warnings mechanism, including the new annotation in Python 3.13 for static code analysis. The existing functionality of fetching values from the database through `StatementExecutionExt` remains unchanged. We recommend that clients update their code to use `.asDict()` instead of `.as_dict()` to avoid any disruptions. A new test case `test_row_as_dict_deprecated()` has been added to verify the deprecation warning for `Row.as_dict()`.
* Minor improvements for `.save_table(mode="overwrite")` ([#298](https://github.com/databrickslabs/lsql/issues/298)). In this release, the `.save_table()` method has been improved, particularly when using the `overwrite` mode. If no rows are supplied, the table will now be truncated, ensuring consistency with the mock backend behavior. This change has been optimized for SQL-based backends, which now perform truncation as part of the insert for the first batch. Type hints on the abstract method have been updated to match the concrete implementations. Unit tests and integration tests have been updated to cover the new functionality, and new methods have been added to test the truncation behavior in overwrite mode. These improvements enhance the consistency and efficiency of the `.save_table()` method when using `overwrite` mode across different backends.
* Updated databrickslabs/sandbox requirement to acceptance/v0.3.0 ([#305](https://github.com/databrickslabs/lsql/issues/305)). In this release, we have updated the requirement for the `databrickslabs/sandbox` package to version `acceptance/v0.3.0` in the `downstreams.yml` file. This update is necessary to use the latest version of the package, which includes several bug fixes and dependency updates. The `databrickslabs/sandbox` package is used in the acceptance tests, which are run as part of the CI/CD pipeline. It provides a set of tools and utilities for developing and testing code in a sandbox environment. The changelog for this version includes the addition of install instructions, more git-related libraries, and the modification of the README to include information about how to use it with the `databricks labs sandbox` command. Specifically, the version of the `databrickslabs/sandbox` package used in the `acceptance` job has been updated from `acceptance/v0.1.4` to `acceptance/v0.3.0`, allowing the integration tests to be run using the latest version of the package. The ignore conditions for this PR ensure that Dependabot will resolve any conflicts that may arise and can be manually triggered with the `@dependabot rebase` command.

Dependency updates:

* Bump actions/checkout from 4.2.0 to 4.2.1 ([#304](https://github.com/databrickslabs/lsql/pull/304)).
* Updated databrickslabs/sandbox requirement to acceptance/v0.3.0 ([#305](https://github.com/databrickslabs/lsql/pull/305)).
* Bump databrickslabs/sandbox from acceptance/v0.3.0 to 0.3.1 ([#307](https://github.com/databrickslabs/lsql/pull/307)).
* Bump actions/checkout from 4.2.1 to 4.2.2 ([#310](https://github.com/databrickslabs/lsql/pull/310)).
* Bump databrickslabs/sandbox from acceptance/v0.3.1 to 0.4.2 ([#315](https://github.com/databrickslabs/lsql/pull/315)).

## 0.12.1

* Bump actions/checkout from 4.1.7 to 4.2.0 ([#295](https://github.com/databrickslabs/lsql/issues/295)). In this version 4.2.0 release of the `actions/checkout` library, the team has added `Ref` and `Commit` outputs, which provide the ref and commit that were checked out, respectively. The update also includes dependency updates to `braces`, `minor-npm-dependencies`, `docker/build-push-action`, and `docker/login-action`, all of which were automatically resolved by Dependabot. These updates improve compatibility and stability for users of the library. This release is a result of contributions from new team members @yasonk and @lucacome. Users can find a detailed commit history, pull requests, and release notes in the associated links. The team strongly encourages all users to upgrade to this new version to access the latest features and improvements.
Expand Down
2 changes: 1 addition & 1 deletion src/databricks/labs/lsql/__about__.py
Original file line number Diff line number Diff line change
@@ -1 +1 @@
__version__ = "0.12.1"
__version__ = "0.13.0"

0 comments on commit 48c287e

Please sign in to comment.