Skip to content

Commit

Permalink
4.3 Release Notes and Changelog (#2577)
Browse files Browse the repository at this point in the history
Also remove stale attribution from NOTICE
  • Loading branch information
Marko Topolnik authored Oct 19, 2020
1 parent ee7c51f commit a47fbc5
Show file tree
Hide file tree
Showing 3 changed files with 84 additions and 5 deletions.
5 changes: 1 addition & 4 deletions NOTICE
Original file line number Diff line number Diff line change
@@ -1,5 +1,2 @@
The class com.hazelcast.jet.impl.TopologicalSorter contains code
derived from the Apache Tez project.

The class com.hazelcast.jet.kafka.impl.ResumeTransactionUtil contains
code derived from the Apache Flink project.
code derived from the Apache Flink project.
19 changes: 18 additions & 1 deletion hazelcast-jet-distribution/src/root/changelog.txt
Original file line number Diff line number Diff line change
@@ -1,3 +1,21 @@
** Hazelcast Jet 4.3 **

* @MohamedMandouh implemented distributed sorting: `BatchStage.sort()`.
* @guenter-hesse added a high-throughput source with precisely controlled
timing, to be used to benchmark Jet's throughput and latency.
* We added the ability for Jet to suspend an unbounded, fault-tolerant job
when it fails due to an exception in the pipeline code. This allows you
to diagnose the problem, remove its cause, and resume the pipeline without
data loss.
* We have improved the consistency of reconnect behaviour across CDC sources and
introduced a uniform API to configure the reconnect strategy.
* We improved the behavior of streaming pipelines based on ingestion time: a
low event rate in any partition of the source used to stall the progress,
now the watermark advances even without events.
* We moved the `Pipeline` to `DAG` transformation from the client to the server,
in preparation for the upcoming feature of preventing event reordering in the
pipeline.

** Hazelcast Jet 4.2 **

* We added Change Data Capture (CDC) support for PostgreSQL and MySql. New
Expand Down Expand Up @@ -39,7 +57,6 @@
directly instead of requiring custom code in the `mapToOutputFn`. Credit
for this one goes to @TomaszGaweda.


** Hazelcast Jet 4.0 **

* Updated Hazelcast IMDG version to 4.0, which brings many new features
Expand Down
65 changes: 65 additions & 0 deletions hazelcast-jet-distribution/src/root/release_notes.txt
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,70 @@ To expand an issue number into a full GitHub link, use this template:

https://github.com/hazelcast/hazelcast-jet/issues/<issue number>


** Hazelcast Jet 4.3 **

Members of the open source community that appear in these release notes:

@caioguedes
@guenter-hesse
@MohamedMandouh

Thank you for your valuable contributions!

1. New Features

[pipeline-api] [014] @MohamedMandouh implemented distributed sorting: `BatchStage.sort()`
(#2469, #2544)
[core] [012] Added `JobConfig.suspendOnFailure`: suspend a job on exception instead of
cancelling it (#2411)
[cdc] Improved the consistency of reconnect behaviour across CDC sources, new uniform API
to configure the reconnect strategy (#2419)

2. Enhancements

[core] @guenter-hesse contributed a test source to benchmark Jet's throughput and latency (#2382)
[core] [013] Improved watermark semantics that prevent low event rate from stalling an
ingestion time-based pipeline (#2485, #2514)
[cdc] Exposed the sequence number in the CDC `ChangeRecord` that orders the events (#2390)
[core] Two new DAG edge types: `distributeToOne` (sending all data to one member) and `ordered`
(maintaining the sort order) (#2394, #2469, #2544)
[core] Disabled access to external XML entities when parsing XML config, this was a potential
XXE attack vector (#2528)

3. Fixes

[core] Fixed error handling during job startup that could result in inconsistent job state (#2383)
[core] Fixed an internal exception that leaked out of Observable (#2313, #2389)
[core] Prevented Observable from processing in-flight items after cancellation (#2415, #2418)
[cli] @caioguedes fixed an issue with `--targets` option in CLI where it would overwrite other
settings (#2373, #2421)
[metrics] Fixed a problem where an internally added DAG vertex would show up as a source instead
of the actual source vertex (#2475, #2476)
[core] Fixed a race that could cause `getJobStatus()` to throw an exception if called right after
`newJob()` (#2481, #2484)
[core] Fix a race between snapshotting and restarting (#2487, #2503)
[core] Fixed a race where `getJobStatus()` would report `RUNNING` even though it was actually
`COMPLETING`. (#2507)
[core] Fixed an issue where a `DONE_ITEM` could get lost due to connection failure, preventing
the job from completing (#2158, #2532)
[core] Fixed a job failure related to the coordinator member failing (#2461, #2546)
[core] Fixed a job failure related to a member reconnecting (#2542, #2547)
[core] Improved robustness related to Jet's internal `IMap` operations (#2533, #2550)
[cdc] Upgraded Jackson jr dep, solving a null handling issue (#2459)
[cdc] Upgraded the Debezium dep, solving a Postgress issue resulting in data loss when
snapshotting (#2406)
[core] Fixed a bug where a non-keyed aggregating stage would produce no output when no input
(#2560, #2567)

4. Breaking Changes

[pipeline-api] Breaking signature change to `Sources.streamFromProcessorWithWatermarks()`
[pipeline-api] Deprecated `Pipeline.toDag()`, made `Pipeline` and all its components `Serializable`.
[core-api] Breaking signature change to `StreamEventJournalP`, methods `streamRemoteMapSupplier()`
and `streamRemoteCacheSupplier`


** Hazelcast Jet 4.2 **

Members of the open source community that appear in these release notes:
Expand Down Expand Up @@ -70,6 +134,7 @@ Thank you for your valuable contributions!
[jet-cli] Deprecated --address and --cluster-name options from command-line as --targets
should now be used instead. (#2276)


** Hazelcast Jet 4.1.1 **

1. Enhancements
Expand Down

0 comments on commit a47fbc5

Please sign in to comment.