Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add data quality part for parking_sensor_synapse using great expectations library #641

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Add data quality part for parking_sensor_synapse using great expectations library #641

wants to merge 8 commits into from

Commits on Jun 20, 2023

  1. Adding credential: WorkspaceSystemIdentity 

    Adding linkedService: sywsdev77-WorkspaceDefaultSqlServer
Adding integrationRuntime: AutoResolveIntegrationRuntime
Adding linkedService: sywsdev77-WorkspaceDefaultStorage
Adding linkedService: Ls_KeyVault_01
Adding linkedService: Ls_AdlsGen2_01
Adding linkedService: Ls_Rest_MelParkSensors_01
Adding pipeline: P_Ingest_MelbParkingData
Adding dataset: Ds_REST_MelbParkingData
Adding dataset: Ds_AdlsGen2_MelbParkingData
Adding notebook: 02_standardize
Adding notebook: 03_transform
Adding trigger: T_Sched
Adding notebook: 00_setup
Adding notebook: 01a_explore
Adding notebook: 01b_explore_sqlserverless
    @cchenshu
    cchenshu committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    ff59e82 View commit details
    Browse the repository at this point in the history

  2. Create publish_config.json

    @cchenshu
    cchenshu committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    e5232b1 View commit details
    Browse the repository at this point in the history

  3. Update publish_config.json

    @cchenshu
    cchenshu committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    ce4c456 View commit details
    Browse the repository at this point in the history

  4. Updating notebook: 03_transform

    @cchenshu
    cchenshu committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    52cd372 View commit details
    Browse the repository at this point in the history

  5. feat: add data validation part to notebooks

    @cchenshu
    cchenshu committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    13b93c6 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'feature/dev' of https://github.com/cchenshu/modern-data… 

    …-warehouse-dataops into feature/dev
    @cchenshu
    cchenshu committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    c265182 View commit details
    Browse the repository at this point in the history

  7. remove unrelated files

    @cchenshu
    cchenshu committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    2c3a6db View commit details
    Browse the repository at this point in the history

  8. remove unrelated files

    @cchenshu
    cchenshu committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    d1e03fa View commit details
    Browse the repository at this point in the history