E2E

Add `RetryInvoker` class #4010

Job	Run time
Build, test and upload wheel	1m 33s
Strategy / FedMedian	1m 33s
Framework / bare	1m 59s
Strategy / FedTrimmedAvg	1m 31s
Framework / jax	3m 36s
Strategy / QFedAvg	1m 43s
Framework / pytorch	3m 52s
Strategy / FaultTolerantFedAvg	1m 32s
Framework / tensorflow	4m 40s
Strategy / FedAvgM	1m 49s
Framework / tabnet	3m 18s
Strategy / FedAdam	1m 35s
Framework / opacus	4m 26s
Strategy / FedAdagrad	1m 50s
Strategy / FedYogi	1m 49s
Framework / pytorch-lightning	3m 23s
Framework / mxnet	2m 4s
Framework / scikit-learn	3m 18s
Framework / fastai	6m 9s
Framework / pandas	2m 5s
	53m 45s

Provide feedback