Siddhi Distribution Release 5.1.0-m2

Overview

Siddhi 5.1.0-m2 distribution release contains the Siddhi engine 5.1.2 as the dependency. Other than that, there are a lot of improvements done to simplify deployment configuration of the Siddhi distribution.

Highlights

• Refer the Siddhi 5.1.2 release note to get to know about the latest feature improvements and bug fixes done for Siddhi engine.

Features & Improvements

• Improve deployment.yaml configuration for better user experience (#262, #269, #276)
• Siddhi Parser API to validate Siddhi Apps (#273)

Bug Fixes

• Fix design view toggle button position (#243)

Complete Changes

Please find the complete changes here

Bundled Siddhi Extensions

Execution Extensions

Name	Description	Latest Tested Version
execution-string	Provides basic string handling capabilities such as concat, length, replace all, etc.	5.0.4
execution-regex	Provides basic RegEx execution capabilities.	5.0.5
execution-math	Provides useful mathematical functions.	5.0.3
execution-time	Provides time related functionality such as getting current time, current date, manipulating/formatting dates, etc.	5.0.3
execution-map	Provides the capability to generate and manipulate map data objects.	5.0.4
execution-json	Provides the capability to retrieve, insert, and modify JSON elements.	2.0.2
execution-unitconversion	Converts various units such as length, mass, time and volume.	2.0.2
execution-reorder	Orders out-of-order event arrivals using algorithms such as K-Slack and alpha K-Stack.	5.0.3
execution-unique	Retains and process unique events based on the given parameters.	5.0.2
execution-streamingml	Performs streaming machine learning (clustering, classification and regression) on event streams.	2.0.2
execution-tensorflow	provides support for running pre-built TensorFlow models.	2.0.1

---

Input/Output Extensions

Name	Description	Latest Tested Version
io-http	Receives and publishes events via http and https transports, calls external services, and serves incoming requests and provide synchronous responses.	2.1.0
io-nats	Receives and publishes events from/to NATS.	2.0.4
io-kafka	Receives and publishes events from/to Kafka.	5.0.3
io-email	Receives and publishes events via email using smtp, pop3 and imap protocols.	2.0.3
io-cdc	Captures change data from databases such as MySQL, MS SQL, Postgresql, H2 and Oracle.	2.0.3
io-tcp	Receives and publishes events through TCP transport.	3.0.2
io-googlepubsub	Receives and publishes events through Google Pub/Sub.	2.0.1
io-file	Receives and publishes event data from/to files.	2.0.1
io-jms	Receives and publishes events via Java Message Service (JMS), supporting Message brokers such as ActiveMQ	2.0.2
io-prometheus	Consumes and expose Prometheus metrics from/to Prometheus server.	2.0.1

Data Mapping Extensions

Name	Description	Latest Tested Version
map-json	Converts JSON messages to/from Siddhi events.	5.0.4
map-xml	Converts XML messages to/from Siddhi events.	5.0.3
map-text	Converts text messages to/from Siddhi events.	2.0.4
map-avro	Converts AVRO messages to/from Siddhi events.	2.0.2
map-keyvalue	Converts events having Key-Value maps to/from Siddhi events.	2.0.3
map-csv	Converts messages with CSV format to/from Siddhi events.	2.0.2
map-binary	Converts binary events that adheres to Siddhi format to/from Siddhi events.	2.0.2

Store Extensions

Name	Description	Latest Tested Version
store-rdbms	Persist and retrieve events to/from RDBMS databases such as MySQL, MS SQL, Postgresql, H2 and Oracle.	6.0.3
store-mongodb	Persist and retrieve events to/from MongoDB.	2.0.1
store-elasticsearch	Persist and retrieve events to/from Elasticsearch.	3.1.0

Script Extensions

Name	Description	Latest Tested Version
script-js	Allows writing user defined JavaScript functions within Siddhi Applications to process events.	5.0.1

Siddhi Distribution Release 5.1.0-m1

New Features

• Siddhi Test Framework: Provides the capability to write integration tests using Docker containers #1327

Complete Changes

v0.1.0...v5.1.0-m1

Bundled Siddhi Extensions

Execution Extensions

Name	Description	Latest Tested Version
execution-string	Provides basic string handling capabilities such as concat, length, replace all, etc.	5.0.3
execution-regex	Provides basic RegEx execution capabilities.	5.0.3
execution-math	Provides useful mathematical functions.	5.0.2
execution-time	Provides time related functionality such as getting current time, current date, manipulating/formatting dates, etc.	5.0.2
execution-map	Provides the capability to generate and manipulate map data objects.	5.0.2
execution-json	Provides the capability to retrieve, insert, and modify JSON elements.	2.0.1
execution-unitconversion	Converts various units such as length, mass, time and volume.	2.0.1
execution-reorder	Orders out-of-order event arrivals using algorithms such as K-Slack and alpha K-Stack.	5.0.0
execution-unique	Retains and process unique events based on the given parameters.	5.0.0
execution-streamingml	Performs streaming machine learning (clustering, classification and regression) on event streams.	2.0.1
execution-tensorflow	provides support for running pre-built TensorFlow models.	2.0.1

---

Input/Output Extensions

Name	Description	Latest Tested Version
io-http	Receives and publishes events via http and https transports, calls external services, and serves incoming requests and provide synchronous responses.	2.0.6
io-nats	Receives and publishes events from/to NATS.	2.0.3
io-kafka	Receives and publishes events from/to Kafka.	5.0.2
io-email	Receives and publishes events via email using smtp, pop3 and imap protocols.	2.0.2
io-cdc	Captures change data from databases such as MySQL, MS SQL, Postgresql, H2 and Oracle.	2.0.1
io-tcp	Receives and publishes events through TCP transport.	3.0.2
io-googlepubsub	Receives and publishes events through Google Pub/Sub.	2.0.1
io-file	Receives and publishes event data from/to files.	2.0.1
io-jms	Receives and publishes events via Java Message Service (JMS), supporting Message brokers such as ActiveMQ	2.0.2
io-prometheus	Consumes and expose Prometheus metrics from/to Prometheus server.	2.0.1

Data Mapping Extensions

Name	Description	Latest Tested Version
map-json	Converts JSON messages to/from Siddhi events.	5.0.3
map-xml	Converts XML messages to/from Siddhi events.	5.0.3
map-text	Converts text messages to/from Siddhi events.	2.0.2
map-avro	Converts AVRO messages to/from Siddhi events.	2.0.2
map-keyvalue	Converts events having Key-Value maps to/from Siddhi events.	2.0.2
map-csv	Converts messages with CSV format to/from Siddhi events.	2.0.2
map-binary	Converts binary events that adheres to Siddhi format to/from Siddhi events.	2.0.2

Store Extensions

Name	Description	Latest Tested Version
store-rdbms	Persist and retrieve events to/from RDBMS databases such as MySQL, MS SQL, Postgresql, H2 and Oracle.	6.0.1
store-mongodb	Persist and retrieve events to/from MongoDB.	2.0.1
store-elasticsearch	Persist and retrieve events to/from Elasticsearch.	3.0.0

Script Extensions

Name	Description	Latest Tested Version
script-js	Allows writing user defined JavaScript functions within Siddhi Applications to process events.	5.0.1

Siddhi Distribution Release 0.1.0

Siddhi team is excited to announce the Siddhi runtime and tooling 0.1.0 release.

Siddhi maintains two distributions as Siddhi-Runner and Siddhi-Tooling distribution.

• Siddhi-Runner distribution bundles the Siddhi runtime which runs the Siddhi logic in a production environment.
• Siddhi-Tooling distribution bundles the tooling editor profile which can be used for developing, testing and debugging Siddhi applications before moving to production.

Please refer the Siddhi official documentation for quick start

Try Siddhi Runner & Tooling

Siddhi Runner Distribution

Download the latest released distributions from here

1. Extract the Siddhi runner distribution.

2. Unzip the siddhi-runner-x.x.x.zip.

3. Navigate to the <RUNNER_HOME>/bin directory. Start SiddhiApps with the runner config by executing the following commands from the distribution directory

   Linux/Mac :

   ./bin/runner.sh -Dapps=<siddhi-file> -Dconfig=<config-yaml-file>

   Windows :

   bin\runner.bat -Dapps=<siddhi-file> -Dconfig=<config-yaml-file>

Running Multiple SiddhiApps in one runner
To run multiple SiddhiApps in one runtime, have all SiddhiApps in a directory and pass its location through -Dapps parameter as follows,

-Dapps=<siddhi-apps-directory>

"Always use absolute path for SiddhiApps and runner configs."
Providing the absolute path of SiddhiApp file, or directory in -Dapps parameter, and when providing the Siddhi runner config yaml on -Dconfig parameter while starting Siddhi runner.

Siddhi Tooling Distribution

Download the latest released distributions from here

1. Extract the Siddhi tooling distribution.
2. Navigate to the <TOOLING_HOME>/bin directory and issue the following command:
   
   For Windows: tooling.bat
   
   For Linux: ./tooling.sh
   
3. Access the Editor UI using the following URL.
   
   http://localhost:<EDITOR_PORT>/editor (e.g: http://localhost:9390/editor)

Supported Siddhi Extensions

Name	Description	Version
execution-json	The siddhi-execution-json extension is an extension to Siddhi that provides a rich set of capabilities to retrieve data from JSONs and inserting/modifying elements in JSONs using Siddhi streams.	2.0.0
execution-math	The siddhi-execution-math is an extension to Siddhi, which provides useful mathematical functions that can make your siddhi queries more flexible.	5.0.0
execution-regex	The siddhi-execution-regex extension is an extension to Siddhi that provides basic RegEx execution capabilities.	5.0.0
execution-string	The siddhi-execution-string is an extension to Siddhi that provides basic string handling capabilities such as con-cat, length, convert to lowercase, and replace all.	5.0.1
execution-time	The siddhi-execution-time extension is an extension to Siddhi that provides time related functionality to Siddhi such as getting current time, current date, manipulating/formatting dates and etc.	4.1.0
io-cdc	The siddhi-io-cdc extension is an extension to Siddhi. It receives change data from MySQL, MS SQL Server, Postgresql, H2 and Oracle in the key-value format.	2.0.0
io-nats	The siddhi-io-nats extension is an extension to Siddhi that can be used to communicate (publish/subscribe) with an instance of nats-streaming server.	2.0.1
io-email	The siddhi-io-email extension is an extension to Siddhi that receives and publishes events via email. Using the extension, events can be published through smtp mail server and received through 'pop3' or 'imap' mail serves.	2.0.1
io-http	The siddhi-io-http extension is an extension to Siddhi that allows you to receive and publish events via http and https transports and also allow you perform synchronous request and response. This extension works with WSO2 Stream Processor and with standalone Siddhi.	2.0.4
io-kafka	The siddhi-io-kafka extension is an extension to Siddhi. This implements siddhi kafka source and sink that can be used to receive events from a kafka cluster and to publish events to a kafka cluster.	5.0.0
io-tcp	The siddhi-io-tcp extension is an extension to Siddhi that allows to receive and publish events through TCP.
map-binary	The siddhi-map-binary extension is an extension to Siddhi that can be used to convert binary events to/from Siddhi events.	3.0.1
map-csv	The siddhi-map-csv extension is an extension to Siddhi that supports mapping incoming events with csv format to a stream at the source, and mapping a stream to csv format events at the sink.	2.0.0
map-json	The siddhi-map-json extension is an extension to Siddhi which is used to convert JSON message to/from Siddhi events.	5.0.1
map-keyvalue	The siddhi-map-keyvalue extension is an extension to Siddhi that supports mapping incoming events with Key-Value map format to a stream at the source, and mapping a stream to Key-Value map events at the sink.	2.0.0
map-text	The siddhi-map-text extension is an extension to Siddhi that supports mapping incoming text messages to a stream at the source, and mapping a stream to text messages at the sink.	2.0.0
map-xml	The siddhi-map-xml extension is an extension to Siddhi that supports mapping incoming XML events to a stream at the source, and mapping a stream to XML events at the sink.	5.0.0
store-rdbms	The siddhi-store-rdbms extension is an extension to Siddhi that can be used to persist events to an RDBMS instance of the user's choice.	6.0.0

---

Tested Operating Systems and JDKs

JDK Version/s	Operating System/s
Oracle JDK 8	Windows 10, Alpine 3.5, Ubuntu 16.04 & 18.04, MacOS High Sierra
Open JDK 8	Alpine 3.5, Ubuntu 16.04
Oracle JDK 11	Ubuntu 16.04 & 18.04
Open JDK 11	Ubuntu 16.04 & 18.04

Tested DBMSs

• H2 1.4.187
• MySQL 5.5

Reporting Issues
Issues can be reported using at GitHub Issue Tracker.

Contact us
Siddhi-Dev Google Group Group is the main Siddhi project discussion forum for developers.

Users can use Siddhi-User Google Group to raise any queries and get some help to achieve their use cases.

StackOverflow is also can be used to get some support and GitHub for issues and code repositories.