Add `RetryInvoker` class #4050

Job	Run time
Build, test and upload wheel	1m 22s
Strategy / FedMedian	1m 18s
Framework / bare	1m 52s
Strategy / FedTrimmedAvg	1m 23s
Framework / jax	3m 35s
Strategy / QFedAvg	1m 38s
Framework / pytorch	3m 31s
Strategy / FaultTolerantFedAvg	1m 16s
Framework / tensorflow	3m 51s
Strategy / FedAvgM	1m 20s
Framework / tabnet	3m 12s
Strategy / FedAdam	1m 33s
Framework / opacus	3m 13s
Strategy / FedAdagrad	1m 37s
Framework / pytorch-lightning	3m 29s
Strategy / FedYogi	1m 16s
Framework / mxnet	2m 1s
Framework / scikit-learn	3m 3s
Framework / fastai	4m 48s
Framework / pandas	1m 52s
	47m 10s

Provide feedback