New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fixes merge statement casting for JSONB and array types #830

Merged

iskakaushik merged 1 commit into main from bigquery-json-array-fixes

Dec 15, 2023

Contributor

heavycrystal commented Dec 15, 2023

Replaces the legacy JSON_EXTRACT_* functions with JSON_VALUE_* equivalents which fixes quoting issues in certain types.
Changes some logging and Pyroscope to be less noisy.


          fixes merge statement casting for JSONB and array types

a7560ba

heavycrystal requested review from saisrirampur and Amogh-Bharadwaj

December 15, 2023 11:26

Amogh-Bharadwaj approved these changes

View reviewed changes

Contributor

Amogh-Bharadwaj left a comment

Tested

iskakaushik merged commit 99ccad7 into main

12 checks passed

Amogh-Bharadwaj mentioned this pull request

PG to BQ, CDC messes up format of JSONB columns, whereas initial load doesn't #828

Closed

Amogh-Bharadwaj mentioned this pull request

SF JSON (Variant): Remove escaped quotes #948

Merged

iskakaushik pushed a commit that referenced this pull request


          SF JSON (Variant): Remove escaped quotes (#948)

5efe284

Similar to how #830 fixes JSON structure for BigQuery, this one does it
for Snowflake by performing a [PARSE_JSON
transformation](https://docs.snowflake.com/en/sql-reference/functions/parse_json)
in Copy (for initial load) and Merge (CDC) steps

<img width="1111" alt="Screenshot 2024-01-01 at 5 23 52 PM"
src="https://github.com/PeerDB-io/peerdb/assets/65964360/03549553-56c5-475b-b668-0e83b68c8eb0">

You can now query synced Postgres JSONs by PeerDB to Snowflake Variants
using:
```sql
SELECT j:tags FROM mysftable
``` 
Adds a test for this. Also tested manually

Fixes #828

serprex deleted the bigquery-json-array-fixes branch

July 19, 2024 15:23

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet