E2E

Do minor fixes to FedBN #4631

Job	Run time
Build, test and upload wheel	1m 12s
Framework / bare	1m 33s
Strategy / FedMedian	1m 8s
Framework / jax	5m 13s
Strategy / FedTrimmedAvg	1m 4s
Framework / pytorch	2m 33s
Strategy / QFedAvg	1m 10s
Framework / tensorflow	3m 2s
Strategy / FaultTolerantFedAvg	1m 10s
Framework / tabnet	2m 37s
Strategy / FedAvgM	1m 7s
Framework / opacus	2m 40s
Strategy / FedAdam	1m 11s
Framework / pytorch-lightning	2m 30s
Strategy / FedAdagrad	1m 6s
Framework / mxnet	1m 34s
Strategy / FedYogi	1m 5s
Framework / scikit-learn	2m 13s
Framework / fastai	3m 41s
Framework / pandas	1m 29s
	39m 18s

Provide feedback