Dinky

Introduction

An open-source real-time computing platform built with Apache Flink as its core, capable of real-time application job development, data debugging, and runtime monitoring, helping to facilitate efficient real-time computing applications.

Feature

Its main features are as follows:

• Immersive Flink SQL Data Development: Dinky provides prompt completion, statement beautification, online debugging, syntax verification, logic plan, catalog, lineage, version comparison, and more.
• Support FlinkSQL multi-version development and execution modes: Dinky supports multiple development and execution modes for FlinkSQL, including Local, Standalone, Yarn/Kubernetes Session, Yarn Per-Job, and Yarn/Kubernetes Application.
• Support Flink ecosystem: Connector, FlinkCEP, FlinkCDC, Paimon, PyFlink
• Support FlinkSQL syntax enhancement: Dinky enhances FlinkSQL with features like database synchronization, execution environments, global variables, table-valued aggregate functions, load dependency, row-level permissions, and execute jar.
• Support real-time warehousing and lake entry of the entire FlinkCDC database and FlinkCDC Pipeline task.
• Support real-time online debugging: Preview Table, ChangeLog and UDF.
• Support Flink Catalog, data source metadata online query and management.
• Support real-time task operation and maintenance: Online and offline, job information, job log, version info, job snapshot, monitor, sql lineage, alarm record, etc.
• Support real-time job alarm and alarm group: DingTalk, WeChat, Feishu, E-mail, SMS, Http etc.
• Support automatically managed SavePoint/CheckPoint recovery and triggering mechanisms: latest, earliest, specified, etc.
• Support resource management: Cluster instance, cluster configuration, data source, alarm, document, global variable, git project, UDF, resource, system configuration, etc.
• Support enterprise-level management: multi-tenant, user, role, token.
• More hidden features await exploration by our users.

Principle

Run the Screenshot

Data Studio

Data Debug

Task Monitor

Task Metrics

Participate in Contributions

Welcome to join the community, build a win-win situation, please refer to the contribution process： How to contribute.

Thank you to all the people who already contributed to Dinky!

How to Deploy

See source code compilation and installation and deployment for details.

Thanks

Standing on the shoulders of giants, Dinky was born. For this we express our heartfelt thanks to all the open source software used and its communities! We also hope that we are not only beneficiaries of open source, but also contributors to open source. We also hope that partners who share our enthusiasm and belief in open source will join us in contributing to the open-source community.

Below is a partial list of acknowledgements:

Apache Flink

Apache FlinkCDC

Apache Paimon

Apache Dolphinscheduler

Apache Doris

Druid

Ant-Design-Pro

Mybatis Plus

Monaco Editor

Sa Token

SpringBoot

Thanks to JetBrains for providing a free open-source license.

Get Help

1.Create an issue and provide a clear description.

2.Visit the official website website to read the latest documentation manual.

3.Enter the WeChat user community group (recommended, add WeChat wenmo_ai to invite into the group) and QQ user community group (543709668) to communicate, and apply for the remarks "Dinky + company name + position".

4.Follow the WeChat public account to get the latest official articles: Dinky Open Source.

Copyright

Please refer to the LICENSE document.