This is used to track the status of issues and tasks within project AcetylCholine.
The primary objective of the Microsoft organization is to enable every person, developer and organization to succeed. Several developers and organizations from time to time face challenges with understanding what is possible, deploying OSS data workloads on Azure and integrating OSS data workloads with Azure Platform data solutions.
Protect AcetylCholine is a community-driven initiative in an effort to close gaps that currently exists in awareness, deployment options as well as integration options between Open Source data projects and the Microsoft Azure ecosystem.
Acetylcholine is the chief neurotransmitter of a branch of the peripheral nervous system responsible for contracting smooth muscles, dilating blood vessels and slowing our heart rates. In our nervous system there are neurons that transport signals from point to point but there are gaps known as synapses between these neurons. Acetylcholine is the neurotransmitter that helps bridge these gaps and allows for these signals to still be transmitted from neuron to neuron to and from the brain and spinal cord despite the presense of these gaps (synapses). This project was design to close any gaps that exist between the goals of our current and prospective partners/customers and the current awareness, deployment and integration options between key OSS projects focused on Event-Driven Architectures and the Microsoft Azure platform.
We are currently targetting the following open source data projects in our initial efforts
- Apache Kafka
- Apache Flink
- Apache Pulsar
- Apache Beam
For the Apache Kafka project, we are currently working on the following issues:
- KAFKA-12458 Integration Azure Storage (Blob and ADLS Gen2) with KIP-405 Kafka Tiered Storage implementation. Details of how the plugin can be downloaded and installed will be available soon.
For the Apache Flink project, several JIRA issues are available to track upcoming integrations
- FLINK-18562 Add Support for Azure Data Lake Store Gen 2 in Flink File System
- FLINK-18568 Add Support for Azure Data Lake Store Gen 2 in Streaming File Sink
- FLINK-18563 Add Support for Azure Cosmos DB DataStream Connector
- FLINK-18564 Add Support for Azure Event Hub DataStream Connector
- FLINK-24683 Add Support for Azure Synapse Analytics
For the Apache Beam project, several JIRA issues are available to track upcoming integrations
- BEAM-10440 Add Support for Azure Cosmos DB DataStream
- BEAM-10443 Add Support for Azure Cognitive Search DataStream Connector
- BEAM-10441 Add Support for Azure Event Hub DataStream Connector
We are currently looking for help in development, implementation, testing and creating awareness about this effort.
Please reach out to us if you have any questions, comments or suggestions
You can also open an issue in this repository and we will do our best to follow up as soon as we can.
Thanks in advance for your interest and participation.