Feature/click uri deprecation

[fivetran-joemarkiewicz]

PR Overview

This PR will address the following Issue/Feature: LinkedIn Ads Issue #35

This PR will result in the following new package version: v0.10.0

This will be a breaking change since we are adding a new field. Additionally, there are major changes to the click_uri field to support the new LinkedIn Ads API and connector schema updates. Therefore, it would be most appropriate to list this as a breaking change so users are made fully aware.

Please provide the finalized CHANGELOG entry which details the relevant changes included in this PR:

Breaking Changes

• The click_uri_type field has been added to the stg_linkedin_ads__creative_history model. This field allows users to differentiate which click uri type (text_ad or spotlight) is being used to populate the results of the click_uri field.
  • Please be aware this field only supports text_ad or spotlight click uri types. If you are interested in this package supporting more click uri ad types, please let us know in this Feature Request.

Bug Fixes

• The click_uri field has been adjusted to populate the results following a coalesce on the text_ad_landing_page, spotlight_landing_page, or click_uri fields.
  • This change is in response to a LinkedIn Ads API and Fivetran LinkedIn Ads connector update which moved click_uri data to either the text_ad_landing_page or spotlight_landing_page fields depending on the creative type.
• Updated the is_latest_version window function in the following models to exclude the source_relation field from the partition statement when linkedin_ads_union_schemas or linkedin_ads_union_databases variables are empty in the following models:
  • stg_linkedin_ads__account_history
  • stg_linkedin_ads__campaign_group_history
  • stg_linkedin_ads__campaign_history
  • stg_linkedin_ads__creative_history
• In addition to the above, the is_latest_version window function within the stg_linkedin_ads__creative_history model has been moved to the final cte to avoid possible constant expression errors within Redshift destinations.

Under the Hood

• Updates to the linkedin_creative_history_data seed file to include the following new fields to ensure accurate data validation tests:
  • text_ad_landing_page
  • spotlight_landing_page

PR Checklist

Basic Validation

Please acknowledge that you have successfully performed the following commands locally:

• dbt run –full-refresh && dbt test
• [n/a] dbt run (if incremental models are present) && dbt test

Before marking this PR as "ready for review" the following have been applied:

• The appropriate issue has been linked, tagged, and properly assigned.
• All necessary documentation and version upgrades have been applied.
• docs were regenerated (unless this PR does not include any code or yml updates).
• BuildKite integration tests are passing.
• Detailed validation steps have been provided below.

Detailed Validation

Please share any and all of your validation steps:

Please see the downstream dbt_linkedin PR #38 for further validation details.

Additionally, I was able to confirm the click_uri and click_uri_type fields were populating as expected in the stg_linkedin_ads__creative_history model. You can see the text_ad and spotlight types populating as expected. However, the null records for http://www.github.com are expected since they are populated by the deprecated click_uri (per the seed data) field and should be displayed as null.

• 

If you had to summarize this PR in an emoji, which would it be?

🔗

[fivetran-reneeli]

Reviewed! Another question I had was I wanted to confirm text_ad_landing_page and spotlight_landing_page are exclusive? So there's no case where customer can have both.

never mind-- I see the internal thread that this has been discussed already!

[fivetran-joemarkiewicz]

question I had was I wanted to confirm text_ad_landing_page and spotlight_landing_page are exclusive?

@fivetran-reneeli, confirmed with product and engineering that it is exclusive. You will not have both. It will always either be one or the other.

See my other responses in the comments above. Let me know if you have other questions.

[fivetran-reneeli]

Thanks @fivetran-joemarkiewicz just followed up! And regarding the ad type exclusivity, I saw the internal thread that this has been discussed already!

[fivetran-joemarkiewicz]

Thanks @fivetran-reneeli! I just made the change in the CHANGELOG to reflect the proper macro name. This should be good for re-review.

[fivetran-reneeli]

lgtm!

[fivetran-avinash]

@fivetran-joemarkiewicz A few comments before release, but nothing blocking. Approved!

[fivetran-catfritz]

@fivetran-joemarkiewicz I was able to run the package updates and see that the click_uri coalesce is working properly, and the click_uri_type is populated correctly. I also tested the partitioning and source_relation logic, and that is compiling correctly. LGTM!

[fivetran-avinash]

Might request adding a "Documentation" section, similar to what you have in the Transform, to update customers on what these click_uri fields now represent.

[fivetran-avinash]

One small suggestion but otherwise LGTM!

[fivetran-joemarkiewicz]

Thanks for the suggestion @fivetran-avinash, applied the suggestion and getting ready for release!