A Single place to Discover, Collaborate, and Get your data right
Darkseal includes the following:
- Metadata schemas - Defines core abstractions and vocabulary for metadata with schemas for Types, Entities, Relationships between entities. This is the foundation of the Open Metadata Standard.
- Metadata store - Stores metadata graph that connects data assets, user, and tool generated metadata.
- Metadata APIs - For producing and consuming metadata built on schemas for User Interfaces and Integration of tools, systems, and services.
- Ingestion framework - A pluggable framework for integrating tools and ingesting metadata to the metadata store. Ingestion framework already supports well know data warehouses - Google BigQuery, Snowflake, Amazon Redshift, and Apache Hive, and databases - MySQL, Postgres, Oracle, MSSQL, and Guinsoo.
- Metadata User Interface - One single place for users to discover, and collaborate on all data.
Darkseal depends on following components to build a metadata platform:
- JsonSchemas for defining Metadata Schemas
- Dropwizard/Jetty for REST APIs
- MySQL 8.x to store Metadata (Guinsoo is coming)
- ElasticSearch/OpenElasticsearch 7.x to index Metadata and power
# Clone source
git clone [email protected]:GuinsooLab/darkseal.git
# Package
mvn clean package -DskipTests
# Prepare database and indexes
./bootstrap/bootstrap_storage.sh create
# Start Server
java -cp catalog-rest-service org.openmetadata.catalog.CatalogApplication server ./conf/openmetadata.yaml
# Start UI
cd openmetadata-ui/src/ui
yarn run start# Clone source
git clone [email protected]:GuinsooLab/darkseal.git
# Package
mvn clean package -DskipTests
# Change dist dir & un-tar files
cd openmetadata-dist/target
tar zxvf openmetadata-xxx.tar.gz
cd openmetadata-xxx
# Prepare database and indexes
./bootstrap/bootstrap_storage.sh create
# Start Server
./bin/openmetadata.sh startFor more information, please referer to here.
- Athena
- AzureSQL
- BigQuery
- Clickhouse
- Databricks
- Datalake
- Db2
- DeltaLake
- Druid
- DynamoDB
- Glue
- Hive
- MariaDB
- Mssql
- MySQL
- Oracle
- Pinot
- Postgres
- Presto
- Redshift
- SQLite
- Salesforce
- SingleStore
- Snowflake
- Trino
- Vertica
- GuinsooLab Stack
- Kafka
- Pulsar
- Looker
- Metabase
- Mode
- PowerBI
- Redash
- Superset
- Tableau
- Spotrix 🚀
- Airbyte
- Airflow
- Glue
- Sheenflow
- Mlflow
- Overview
- Install & Deploy
- Quickstart With Darkseal
- Darkseal Main Concepts
- Dearkseal Service Integrates
- Roadmap
We ❤️ all contributions, big and small! Check out our CONTRIBUTING guide to get started and let us know how we can help.
Don't want to miss anything? Give the project a ⭐ 🚀
Darkseal is released under Apache License, Version 2.0