E2E

Use minimal ray package #2917

Job	Run time
Build, test and upload wheel	1m 31s
Framework / bare	1m 44s
Strategy / FedMedian	1m 22s
Framework / jax	2m 7s
Strategy / FedTrimmedAvg	1m 37s
Framework / pytorch	3m 56s
Strategy / QFedAvg	1m 35s
Framework / tensorflow	3m 46s
Strategy / FaultTolerantFedAvg	1m 48s
Framework / tabnet	5m 37s
Strategy / FedAvgM	1m 26s
Framework / opacus	3m 22s
Strategy / FedAdam	1m 43s
Strategy / FedAdagrad	1m 37s
Framework / pytorch-lightning	3m 29s
Strategy / FedYogi	1m 24s
Framework / mxnet	1m 56s
Framework / scikit-learn	2m 56s
Framework / fastai	4m 42s
Framework / pandas	1m 53s
	49m 31s

Provide feedback