Skip to content

Commit

Permalink
Adding keys to duplicated headers
Browse files Browse the repository at this point in the history
  • Loading branch information
deborahniesz committed Jan 13, 2025
1 parent 3a2ad9b commit cc35b32
Show file tree
Hide file tree
Showing 47 changed files with 89 additions and 89 deletions.
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
import GxData from '../../_core_components/_data.jsx'
import PreReqFileDataContext from '../../_core_components/prerequisites/_file_data_context.md'

### Prerequisites
### Prerequisites {#prerequisites-aws}

- An AWS Secrets Manager instance. See [AWS Secrets Manager](https://docs.aws.amazon.com/secretsmanager/latest/userguide/tutorials_basic.html).
- The ability to install Python packages with `pip`.
- <PreReqFileDataContext/>.

### Procedure
### Procedure {#procedure-aws}

1. Set up AWS Secrets Manager support.

Expand Down
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
import GxData from '../../_core_components/_data.jsx'
import PreReqFileDataContext from '../../_core_components/prerequisites/_file_data_context.md'

### Prerequisites
### Prerequisites {#prerequisites-azure}

- An [Azure Key Vault instance with configured secrets](https://docs.microsoft.com/en-us/azure/key-vault/general/overview).
- The ability to install Python packages with `pip`.
- <PreReqFileDataContext/>.

### Procedure
### Procedure {#procedure-azure}

1. Set up Azure Key Vault support.

Expand Down
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
import GxData from '../../_core_components/_data.jsx'
import PreReqFileDataContext from '../../_core_components/prerequisites/_file_data_context.md'

### Prerequisites
### Prerequisites {#prerequisites-gcp}

- A [GCP Secret Manager instance with configured secrets](https://cloud.google.com/secret-manager/docs/quickstart).
- The ability to install Python packages with `pip`.
- <PreReqFileDataContext/>.

### Procedure
### Procedure {#prerequisites-gcp}

1. Set up GCP Secret Manager support.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -8,13 +8,13 @@ import PrereqFileDataContext from '../../_core_components/prerequisites/_file_da
The Data Context variable `analytics_enabled` can be used to toggle the collection of analytics information. Because the analytics configuration is loaded when a Data Context is initialized this method is only suitable when working with a File Data Context. For other types of Data Context, use the [Environment Variable](/core/configure_project_settings/toggle_analytics_events/toggle_analytics_events.md?config_method=environment_variable#methods-for-toggling-analytics-collection) method for toggling analytics collection.


### Prerequisites
### Prerequisites {#prerequisites-context-variable}

- <PrereqPythonInstalled/>.
- <PrereqGxInstalled/>.
- <PrereqFileDataContext/>.

### Procedure
### Procedure {#procedure-context-variable}

<Tabs>

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,13 @@ The environment variable `GX_ANALYTICS_ENABLED` can be used to toggle the collec

`GX_ANALYTICS_ENABLED` will also work to toggle analytics collection when using a GX Cloud Data Context or a File Data Context.

### Prerequisites
### Prerequisites {#prerequisites-environment-variable}

- <PrereqPythonInstalled/>
- <PrereqGxInstalled/>
- Permissions necessary to set local Environment Variables.

### Procedure
### Procedure {#procedure-environment-variable}

1. Set the environment variable `GX_ANALYTICS_ENABLED`.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -20,14 +20,14 @@ A dataframe is a set of data that resides in-memory and is represented in your c

Because the dataframes reside in memory you do not need to specify the location of the data when you create your Data Source. Instead, the type of Data Source you create depends on the type of dataframe containing your data. Great Expectations has methods for connecting to both pandas and Spark dataframes.

### Prerequisites
### Prerequisites {#prerequisites-data-source}

- <PrereqPythonInstalled/>
- <PrereqGxInstalled/>
- Optional. <PrereqSparkIfNecessary/>.
- <PrereqDataContext/>. These examples assume the variable `context` contains your Data Context.

### Procedure
### Procedure {#procedure-data-source}

<Tabs
queryString="procedure"
Expand Down Expand Up @@ -107,15 +107,15 @@ Because the dataframes reside in memory you do not need to specify the location

A dataframe Data Asset is used to group your Validation Results. For instance, if you have a data pipeline with three stages and you wanted the Validation Results for each stage to be grouped together, you would create a Data Asset with a unique name representing each stage.

### Prerequisites
### Prerequisites {#prerequisites-data-asset}

- <PrereqPythonInstalled/>
- <PrereqGxInstalled/>
- Optional. <PrereqSparkIfNecessary/>.
- <PrereqDataContext/>. These examples assume the variable `context` contains your Data Context.
- A [pandas or Spark dataframe Data Source](#create-a-data-source).

### Procedure
### Procedure {#procedure-data-asset}

<Tabs
queryString="procedure"
Expand Down Expand Up @@ -173,15 +173,15 @@ This means that Batch Definitions for dataframe Data Assets don't work to subdiv
:::note For API-managed Expectations only
If you use GX Cloud and GX Core together, note that Batch Definitions you create with the API apply to [API-managed Expectations](/cloud/expectations/manage_expectations.md#gx-managed-vs-api-managed-expectations) only.
:::
### Prerequisites
### Prerequisites {#prerequisites-batch-definition}

- <PrereqPythonInstalled/>
- <PrereqGxInstalled/>
- Optional. <PrereqSparkIfNecessary/>.
- <PrereqDataContext/>. These examples assume the variable `context` contains your Data Context.
- A [pandas or Spark dataframe Data Asset](#create-a-data-asset).

### Procedure
### Procedure {#procedure-batch-definition}

<Tabs
queryString="procedure"
Expand Down Expand Up @@ -236,7 +236,7 @@ If you use GX Cloud and GX Core together, note that Batch Definitions you create

Because dataframes exist in memory and cease to exist when a Python session ends the dataframe itself is not saved as part of a Data Assset or Batch Definition. Instead, a dataframe created in the current Python session is passed in at runtime as a Batch Parameter dictionary.

### Prerequisites
### Prerequisites {#prerequisites-dataframes}

- <PrereqPythonInstalled/>
- <PrereqGxInstalled/>
Expand All @@ -246,7 +246,7 @@ Because dataframes exist in memory and cease to exist when a Python session ends
- Data in a pandas or Spark dataframe. These examples assume the variable `dataframe` contains your pandas or Spark dataframe.
- Optional. A Validation Definition.

### Procedure
### Procedure {#procedure-dataframes}

1. Define the Batch Parameter dictionary.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,11 +5,11 @@ import PreReqDataContext from '../../../_core_components/prerequisites/_preconfi

Batch Definitions for a Directory Data Asset can be configured to return all of the records for the files in the Data Asset, or to subdivide the Data Asset's records on the content of a Datetime field and only return the records that correspond to a specific year, month, or day.

### Prerequisites
### Prerequisites {#prerequisites-batch-definition-directory}
- <PreReqDataContext/>. The variable `context` is used for your Data Context in the following example code.
- [A File Data Asset on a Filesystem Data Source](#create-a-data-asset).

### Procedure
### Procedure {#procedure-batch-definition-directory}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ import PreReqDataContext from '../../../_core_components/prerequisites/_preconfi

Batch Definitions for File Data Assets can be configured to return the content of a specific file based on either a file path or a regex match for dates in the name of the file.

### Prerequisites
### Prerequisites {#prerequisites-batch-definition-file}
- <PreReqDataContext/>. The variable `context` is used for your Data Context in the following example code.
- [A File Data Asset on a Filesystem Data Source](#create-a-data-asset).

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ import PrereqGxInstall from '../../../../_core_components/prerequisites/_gx_inst
import PrereqDataContext from '../../../../_core_components/prerequisites/_preconfigured_data_context.md'
import PrereqSparkFilesystemDataSource from '../../../../_core_components/prerequisites/_data_source_spark_filesystem.md'

### Prerequisites
### Prerequisites {#prerequisites-data-asset-directory-abs}
- <PrereqPythonInstall/>.
- <PrereqGxInstall/> and [Spark dependencies](/core/set_up_a_gx_environment/install_additional_dependencies.md?dependencies=spark).
- <PrereqDataContext/>.
- [A Filesystem Data Source configured to access data files in Azure Blob Storage](/core/connect_to_data/filesystem_data/filesystem_data.md?data_source_type=spark&environment=abs#create-a-data-source).

### Procedure
### Procedure {#procedure-data-asset-directory-abs}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,14 +5,14 @@ import PrereqPythonInstall from '../../../../_core_components/prerequisites/_pyt
import PrereqGxInstall from '../../../../_core_components/prerequisites/_gx_installation_with_abs_dependencies.md'
import PrereqDataContext from '../../../../_core_components/prerequisites/_preconfigured_data_context.md'

### Prerequisites
### Prerequisites {#prerequisites-data-asset-file-abs}
- <PrereqPythonInstall/>.
- <PrereqGxInstall/>.
- <PrereqDataContext/>.
- Access to data files in Azure Blob Storage.
- A pandas or Spark [Filesystem Data Source configured for Azure Blob Storage data files](/core/connect_to_data/filesystem_data/filesystem_data.md?data_source_type=spark&environment=abs#create-a-data-source).

### Procedure
### Procedure {#procedure-data-asset-file-abs}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ import PrereqGxInstall from '../../../../_core_components/prerequisites/_gx_inst
import PrereqDataContext from '../../../../_core_components/prerequisites/_preconfigured_data_context.md'
import PrereqSparkFilesystemDataSource from '../../../../_core_components/prerequisites/_data_source_spark_filesystem.md'

### Prerequisites
### Prerequisites {#prerequisites-data-asset-directory-gcs}
- <PrereqPythonInstall/>.
- <PrereqGxInstall/> and [Spark dependencies](/core/set_up_a_gx_environment/install_additional_dependencies.md?dependencies=spark).
- <PrereqDataContext/>.
- [A Filesystem Data Source configured to access data files in Google Cloud Storage](/core/connect_to_data/filesystem_data/filesystem_data.md?data_source_type=spark&environment=gcs#create-a-data-source).

### Procedure
### Procedure {#procedure-data-asset-directory-gcs}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,14 +5,14 @@ import PrereqPythonInstall from '../../../../_core_components/prerequisites/_pyt
import PrereqGxInstall from '../../../../_core_components/prerequisites/_gx_installation_with_gcs_dependencies.md'
import PrereqDataContext from '../../../../_core_components/prerequisites/_preconfigured_data_context.md'

### Prerequisites
### Prerequisites {#prerequisites-data-asset-file-gcs}
- <PrereqPythonInstall/>.
- <PrereqGxInstall/>.
- <PrereqDataContext/>.
- Access to data files in Google Cloud Storage.
- [A pandas](/core/connect_to_data/filesystem_data/filesystem_data.md?data_source_type=pandas&environment=gcs#create-a-data-source) or [Spark Filesystem Data Source configured for Google Cloud Storage data files](/core/connect_to_data/filesystem_data/filesystem_data.md?data_source_type=spark&environment=gcs#create-a-data-source).

### Procedure
### Procedure {#procedure-data-asset-file-gcs}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ import PrereqGxInstall from '../../../../_core_components/prerequisites/_gx_inst
import PrereqDataContext from '../../../../_core_components/prerequisites/_preconfigured_data_context.md'
import PrereqSparkFilesystemDataSource from '../../../../_core_components/prerequisites/_data_source_spark_filesystem.md'

### Prerequisites
### Prerequisites {#prerequisites-data-asset-directory-lon}
- <PrereqPythonInstall/>.
- <PrereqGxInstall/>.
- <PrereqDataContext/>.
- [A Spark Filesystem Data Source configured to access data files in a local or networked folder hierarchy](/core/connect_to_data/filesystem_data/filesystem_data.md?data_source_type=spark&environment=filesystem#create-a-data-source).

### Procedure
### Procedure {#procedure-data-asset-directory-lon}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ import PrereqGxInstall from '../../../../_core_components/prerequisites/_gx_inst
import PrereqDataContext from '../../../../_core_components/prerequisites/_preconfigured_data_context.md'
import PrereqSparkFilesystemDataSource from '../../../../_core_components/prerequisites/_data_source_spark_filesystem.md'

### Prerequisites
### Prerequisites {#prerequisites-data-asset-file-lon}
- <PrereqPythonInstall/>.
- <PrereqGxInstall/>.
- <PrereqDataContext/>.
- Access to data files (such as `.csv` or `.parquet` files) in a local or networked folder hierarchy.
- [A pandas](/core/connect_to_data/filesystem_data/filesystem_data.md?data_source_type=pandas&environment=filesystem#create-a-data-source) or [Spark Filesystem Data Source configured for local or networked data files](/core/connect_to_data/filesystem_data/filesystem_data.md?data_source_type=spark&environment=filesystem#create-a-data-source).

### Procedure
### Procedure {#procedure-data-asset-file-lon}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ import PrereqGxInstall from '../../../../_core_components/prerequisites/_gx_inst
import PrereqDataContext from '../../../../_core_components/prerequisites/_preconfigured_data_context.md'
import PrereqSparkFilesystemDataSource from '../../../../_core_components/prerequisites/_data_source_spark_filesystem.md'

### Prerequisites
### Prerequisites {#prerequisites-data-asset-directory-s3}
- <PrereqPythonInstall/>.
- <PrereqGxInstall/> and [Spark dependencies](/core/set_up_a_gx_environment/install_additional_dependencies.md?dependencies=spark).
- <PrereqDataContext/>.
- [A Filesystem Data Source configured to access data files in S3](/core/connect_to_data/filesystem_data/filesystem_data.md?data_source_type=spark&environment=s3#create-a-data-source).

### Procedure
### Procedure {#procedure-data-asset-directory-s3}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,14 +5,14 @@ import PrereqPythonInstall from '../../../../_core_components/prerequisites/_pyt
import PrereqGxInstall from '../../../../_core_components/prerequisites/_gx_installation_with_s3_dependencies.md'
import PrereqDataContext from '../../../../_core_components/prerequisites/_preconfigured_data_context.md'

### Prerequisites
### Prerequisites {#prerequisites-data-asset-file-s3}
- <PrereqPythonInstall/>.
- <PrereqGxInstall/>.
- <PrereqDataContext/>.
- Access to data files in S3.
- [A Filesystem Data Source configured to access data files in S3](/core/connect_to_data/filesystem_data/filesystem_data.md?data_source_type=spark&environment=s3#create-a-data-source).

### Procedure
### Procedure {#procedure-data-asset-file-s3}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,14 +5,14 @@ import PrereqPythonInstall from '../../../../_core_components/prerequisites/_pyt
import PrereqGxInstall from '../../../../_core_components/prerequisites/_gx_installation_with_abs_dependencies.md'
import PrereqDataContext from '../../../../_core_components/prerequisites/_preconfigured_data_context.md'

### Prerequisites
### Prerequisites {#prerequisites-data-source-abs}
- <PrereqPythonInstall/>
- <PrereqGxInstall/>
- Optional. To create a Spark Filesystem Data Source you will also need to [install the Spark Python dependencies](/core/set_up_a_gx_environment/install_additional_dependencies.md?dependencies=spark).
- <PrereqDataContext/>
- Access to data files in Azure Blob Storage.

### Procedure
### Procedure {#procedure-data-source-abs}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,14 +5,14 @@ import PrereqPythonInstall from '../../../../_core_components/prerequisites/_pyt
import PrereqGxInstall from '../../../../_core_components/prerequisites/_gx_installation_with_gcs_dependencies.md'
import PrereqDataContext from '../../../../_core_components/prerequisites/_preconfigured_data_context.md'

### Prerequisites
### Prerequisites {#prerequisites-data-source-gcs}
- <PrereqPythonInstall/>
- <PrereqGxInstall/>
- Optional. To create a Spark Filesystem Data Source you will also need to [install the Spark Python dependencies](/core/set_up_a_gx_environment/install_additional_dependencies.md?dependencies=spark).
- <PrereqDataContext/>
- Access to data files in Google Cloud Storage.

### Procedure
### Procedure {#procedure-data-source-gcs}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ import PrereqDataContext from '../../../../_core_components/prerequisites/_preco

import PandasDefault from './_pandas_default.md'

### Prerequisites
### Prerequisites {#prerequisites-data-source-lon}
- <PrereqPythonInstall/>
- <PrereqGxInstall/>
- Optional. To create a Spark Filesystem Data Source you will also need to [install the Spark Python dependencies](/core/set_up_a_gx_environment/install_additional_dependencies.md?dependencies=spark).
Expand All @@ -18,7 +18,7 @@ import PandasDefault from './_pandas_default.md'
<PandasDefault/>
:::

### Procedure
### Procedure {#procedure-data-source-lon}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,14 +5,14 @@ import PrereqPythonInstall from '../../../../_core_components/prerequisites/_pyt
import PrereqGxInstall from '../../../../_core_components/prerequisites/_gx_installation_with_s3_dependencies.md'
import PrereqDataContext from '../../../../_core_components/prerequisites/_preconfigured_data_context.md'

### Prerequisites
### Prerequisites {#prerequisites-data-source-s3}
- <PrereqPythonInstall/>
- <PrereqGxInstall/>
- Optional. To create a Spark Filesystem Data Source you will also need to [install the Spark Python dependencies](/core/set_up_a_gx_environment/install_additional_dependencies.md?dependencies=spark).
- <PrereqDataContext/>
- Access to data files on a S3 bucket.

### Procedure
### Procedure {#procedure-data-source-s3}

<Tabs
queryString="procedure"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,11 +3,11 @@ import Tabs from '@theme/Tabs';
import GxData from '../../../_core_components/_data.jsx'
import PreReqDataContext from '../../../_core_components/prerequisites/_preconfigured_data_context.md'

### Prerequisites
### Prerequisites {#prerequisites-batch-definition}
- <PreReqDataContext/>. The variable `context` is used for your Data Context in the following example code.
- [A Data Asset on a SQL Data Source](#create-a-data-asset).

### Procedure
### Procedure {#procedure-batch-definition}

<Tabs
queryString="procedure"
Expand Down
Loading

0 comments on commit cc35b32

Please sign in to comment.