v0.16.0

Flux v0.16.0

Highlights

This release has a single breaking change:

• The recurrent cells RNNCell, LSTMCell, and GRUCell forward has been changed to
  $y_t, state_t = cell(x_t, state_{t-1})$ in (#2551). Previously, it was $state_t = cell(x_t, state_{t-1})$.

Other highlights include:

• Added WeightNorm normalization layer.
• Added Recurrence layer, turning a recurrent layer into a layer processing the entire sequence at once.

Diff since v0.15.2

Merged pull requests:

• Recurrence layer (#2549) (@CarloLucibello)
• Add WeightNorm reparametrization (#2550) (@pxl-th)
• Change cells' return to out, state (#2551) (@CarloLucibello)
• fix: gpu_device not defined in Flux.DistributedUtils (#2552) (@AntonOresten)

Closed issues:

• Feature request: Weight normalization (#942)
• recurrent dropout (#1040)
• Stacked RNN in Flux.jl? (#2452)