Skip to content
Back to pull request #12377

feat(ingest/datahub): use a CTE instead of subqueries #29281

Sign in to view logs

feat(ingest/datahub): use a CTE instead of subqueries

feat(ingest/datahub): use a CTE instead of subqueries #29281

Triggered via pull request January 17, 2025 18:35
@hsheth2hsheth2
opened #12377
datahub-source-optimization
Status Success
Total duration 2h 13m 22s
Artifacts 30

docker-unified.yml

on: pull_request
setup
1m 42s
setup
Build and Push DataHub Ingestion (Base) Docker Image
1m 31s
Build and Push DataHub Ingestion (Base) Docker Image
Build and Push DataHub Upgrade Docker Image
5m 25s
Build and Push DataHub Upgrade Docker Image
Build and Push DataHub Elasticsearch Setup Docker Image
0s
Build and Push DataHub Elasticsearch Setup Docker Image
Build and Push DataHub Frontend Docker Image
8m 7s
Build and Push DataHub Frontend Docker Image
Build and Push DataHub GMS Docker Image
7m 56s
Build and Push DataHub GMS Docker Image
Build and Push DataHub Kafka Setup Docker Image
0s
Build and Push DataHub Kafka Setup Docker Image
Build and Push DataHub MAE Consumer Docker Image
9m 9s
Build and Push DataHub MAE Consumer Docker Image
Build and Push DataHub MCE Consumer Docker Image
10m 21s
Build and Push DataHub MCE Consumer Docker Image
Build and Push DataHub MySQL Setup Docker Image
0s
Build and Push DataHub MySQL Setup Docker Image
smoke_test_matrix
4s
smoke_test_matrix
Build and Push DataHub Ingestion (Base-Full) Docker Image
1m 35s
Build and Push DataHub Ingestion (Base-Full) Docker Image
Build and Push DataHub Ingestion (Base-Slim) Docker Image
31s
Build and Push DataHub Ingestion (Base-Slim) Docker Image
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
58s
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
0s
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
[Monitoring] Scan Frontend images for vulnerabilities
45s
[Monitoring] Scan Frontend images for vulnerabilities
[Monitoring] Scan GMS images for vulnerabilities
1m 52s
[Monitoring] Scan GMS images for vulnerabilities
[Monitoring] Scan Kafka Setup images for vulnerabilities
0s
[Monitoring] Scan Kafka Setup images for vulnerabilities
[Monitoring] Scan MAE consumer images for vulnerabilities
1m 15s
[Monitoring] Scan MAE consumer images for vulnerabilities
[Monitoring] Scan MCE consumer images for vulnerabilities
1m 19s
[Monitoring] Scan MCE consumer images for vulnerabilities
[Monitoring] Scan MySQL Setup images for vulnerabilities
0s
[Monitoring] Scan MySQL Setup images for vulnerabilities
Build and Push DataHub Ingestion (Full) Docker Images
5m 58s
Build and Push DataHub Ingestion (Full) Docker Images
Build and Push DataHub Ingestion Docker Images
3m 11s
Build and Push DataHub Ingestion Docker Images
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
3m 45s
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
Matrix: Run Smoke Tests
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
3m 0s
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
Deploy to Datahub HEAD
0s
Deploy to Datahub HEAD
Fit to window
Zoom out
Zoom in

Annotations

7 errors and 35 warnings
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
CodeQL Action major versions v1 and v2 have been deprecated. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2025-01-10-code-scanning-codeql-action-v2-is-now-deprecated/
[Monitoring] Scan Frontend images for vulnerabilities
CodeQL Action major versions v1 and v2 have been deprecated. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2025-01-10-code-scanning-codeql-action-v2-is-now-deprecated/
[Monitoring] Scan GMS images for vulnerabilities
CodeQL Action major versions v1 and v2 have been deprecated. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2025-01-10-code-scanning-codeql-action-v2-is-now-deprecated/
[Monitoring] Scan MAE consumer images for vulnerabilities
CodeQL Action major versions v1 and v2 have been deprecated. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2025-01-10-code-scanning-codeql-action-v2-is-now-deprecated/
[Monitoring] Scan MCE consumer images for vulnerabilities
CodeQL Action major versions v1 and v2 have been deprecated. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2025-01-10-code-scanning-codeql-action-v2-is-now-deprecated/
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
CodeQL Action major versions v1 and v2 have been deprecated. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2025-01-10-code-scanning-codeql-action-v2-is-now-deprecated/
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
CodeQL Action major versions v1 and v2 have been deprecated. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2025-01-10-code-scanning-codeql-action-v2-is-now-deprecated/
setup
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
smoke_test_matrix
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Base) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Upgrade Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub GMS Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Frontend Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub MAE Consumer Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub MCE Consumer Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Base-Slim) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Base-Full) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Frontend images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan GMS images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan MAE consumer images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan MCE consumer images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion Docker Images
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Full) Docker Images
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (cypress, 0, 11)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 0, 5)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (cypress, 11, 1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (cypress, 11, 5)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (cypress, 11, 4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (cypress, 11, 10)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (cypress, 11, 2)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (cypress, 11, 3)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (cypress, 11, 8)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (cypress, 11, 9)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (cypress, 11, 7)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (cypress, 11, 6)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 2)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 3)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

Artifacts

Produced during runtime
Name Size
Test Results (smoke tests) cypress 0
391 Bytes
Test Results (smoke tests) cypress 1
389 Bytes
Test Results (smoke tests) cypress 10
392 Bytes
Test Results (smoke tests) cypress 2
391 Bytes
Test Results (smoke tests) cypress 3
392 Bytes
Test Results (smoke tests) cypress 4
389 Bytes
Test Results (smoke tests) cypress 5
391 Bytes
Test Results (smoke tests) cypress 6
391 Bytes
Test Results (smoke tests) cypress 7
391 Bytes
Test Results (smoke tests) cypress 8
390 Bytes
Test Results (smoke tests) cypress 9
391 Bytes
Test Results (smoke tests) pytests 0
1.09 KB
Test Results (smoke tests) pytests 1
1.23 KB
Test Results (smoke tests) pytests 2
1 KB
Test Results (smoke tests) pytests 3
1.67 KB
Test Results (smoke tests) pytests 4
1.12 KB
action_image_artifact_acryldata_datahub-frontend-react_pr12377
309 MB
action_image_artifact_acryldata_datahub-gms_pr12377
350 MB
action_image_artifact_acryldata_datahub-ingestion_pr12377
944 MB
action_image_artifact_acryldata_datahub-ingestion_pr12377-slim
653 MB
action_image_artifact_acryldata_datahub-mae-consumer_pr12377
323 MB
action_image_artifact_acryldata_datahub-mce-consumer_pr12377
327 MB
action_image_artifact_acryldata_datahub-upgrade_pr12377
374 MB
datahub-project~datahub~M5VSK9.dockerbuild
30.4 KB
datahub-project~datahub~MJEJRX.dockerbuild
32.3 KB
datahub-project~datahub~NK1CPC.dockerbuild
29.4 KB
datahub-project~datahub~WK15TR.dockerbuild
53.2 KB
datahub-project~datahub~WPC7XK.dockerbuild
29.1 KB
datahub-project~datahub~X8QMT0.dockerbuild
37.5 KB
datahub-project~datahub~XPFAFJ.dockerbuild
26.8 KB