Upgrade kube to 0.98 and migrate event Recorder

[clux]

for kube-rs/kube#1655

Migration

It is recommended to now create the event Recorder globally (and not inside the reconciler) because it caches recent events to not over-publish.

This can generally be done by stuffing it inside the Context you pass to the Controller and then give it an extra object reference (which you previously used to construct the Recorder) when publishing events.

(In our case that's made Context creation async, but that's because we use an async mutex around it.)

Showcasing

using cargo run (and installing the crd)

we can get repeat events using k apply -f yaml/instance-samuel.yaml and then k edit doc samuel to toggle hide on and off.

and it aggregates it correctly:

Events:
  Type    Reason         Age   From            Message
  ----    ------         ----  ----            -------
 Normal  HideRequested  56s (x2 over 75s)  doc-controller  Hiding `samuel`

Note the (x2 over 75s) part which is kubectl displaying EventSeries.