Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Determine if Airflow can be made independent of Open Metadata #243

Open
HeatherAck opened this issue Dec 16, 2022 · 3 comments
Open

Determine if Airflow can be made independent of Open Metadata #243

HeatherAck opened this issue Dec 16, 2022 · 3 comments
Assignees
@caldeirav @jpaulrajredhat
Labels
blocked cluster/osc-cl1 cluster/osc-cl2 metadata

Comments

@HeatherAck
Copy link
Contributor

Currently open metadata and airflow are tightly coupled. Determine if airflow can be externalized to enable other functionality.
@HeatherAck HeatherAck mentioned this issue Dec 16, 2022
Open
@caldeirav
Copy link
Contributor

Deployment as of now has a stand-alone airflow. To be tested.

@caldeirav caldeirav moved this from 🆕 New to 🏗 In progress in Data Mesh Pattern Backlog May 16, 2023
@caldeirav
Copy link
Contributor

caldeirav commented Jul 2, 2023 •
edited
Loading

Right now I am unable to to create a new connection from OpenMetadata in the Data Mesh environment as it is not able to access the Airflow Managed APIs

Image

Added opendatahub-io-contrib/data-mesh-pattern#74 for tracking

@caldeirav
Copy link
Contributor

We need to steup airflow to external OpenMetaData as per:

https://docs.open-metadata.org/v1.1.x/deployment/ingestion/openmetadata

This means we need to install openmetadata-ingestion package with the connector plug -in and openmetadata-managed-apis module package to Airflow image.

@caldeirav caldeirav moved this from 🏗 In progress to 👀 In review in Data Mesh Pattern Backlog Nov 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@caldeirav caldeirav

@jpaulrajredhat jpaulrajredhat

Labels
blocked cluster/osc-cl1 cluster/osc-cl2 metadata
Projects
Data Commons Platform
Status: Todo
Milestone
No milestone
Development

No branches or pull requests
7 participants
@ryanaslett @eb-oss @tnscorcoran @caldeirav @redmikhail @jpaulrajredhat @HeatherAck