Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Releases/v0.6.latest #24

Merged
merged 11 commits into from
Apr 30, 2024
Merged

Releases/v0.6.latest #24

merged 11 commits into from
Apr 30, 2024

Conversation

fivetran-jamie
Copy link
Contributor

@fivetran-jamie fivetran-jamie commented Apr 25, 2024

PR Overview

This PR will address the following Issue/Feature:
#16 (also contains merged PR #20)

This PR will result in the following new package version:

v0.6.2

Please provide the finalized CHANGELOG entry which details the relevant changes included in this PR:

Bug Fixes

  • Adjust the severity of the ad_account_id test in snapchat_ads__account_report to warn. This is required since Snapchat can hard-delete records from the history tables, but not from the reporting tables. This ensures that accurate statistics are being reported and production pipelines aren't failing. (PR #20)

Under the Hood

  • Updated the repo-maintainer PR template to our most up-to-date format.

Contributors

PR Checklist

Basic Validation

Please acknowledge that you have successfully performed the following commands locally:

  • dbt run –full-refresh && dbt test
  • dbt run (if incremental models are present) && dbt test

Before marking this PR as "ready for review" the following have been applied:

  • The appropriate issue has been linked, tagged, and properly assigned
  • All necessary documentation and version upgrades have been applied
  • docs were regenerated (unless this PR does not include any code or yml updates)
  • BuildKite integration tests are passing
  • Detailed validation steps have been provided below

Detailed Validation

Please share any and all of your validation steps:

Confirmed working by @bthomson22, but i also recreated the issue in a somewhat hacky way by

  1. running the package as normal

  2. updating the stg_snapchat_ads__ad_account_history to have null account IDs

  3. running dbt run -m snapchat_ads__account_report without the code update

  4. dbt test -m snapchat_ads__account_report -- produces failure without adjusting severity
    image

  5. dbt test again after updating the not_null test to be a warning (did so in Ad Reporting as well)
    image

If you had to summarize this PR in an emoji, which would it be?

⚠️

Copy link
Contributor

@fivetran-joemarkiewicz fivetran-joemarkiewicz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@fivetran-catfritz fivetran-catfritz Apr 30, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we also/do we need to change the combination_of_columns test to warn in case you have two deleted ad_account_ids in the same date_day and source_relation? Or would we want it to error out in that case? Same question for ad_reporting.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

due to our groupbys/aggregations, null accounts will get grouped together, so they shouldn't fail the combination_of_columns tests. do you think we should call this out?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ahh I see... I think it would make sense to mention.

@fivetran-jamie fivetran-jamie merged commit 17f2db7 into main Apr 30, 2024
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants