Remove usage of `XConverters#toJavac()`. #4731

Job	Run time
Validate Dagger version	12s
Bazel build	4m 33s
Bazel tests	16m 48s
Artifact verification tests	14m 46s
Artifact Android local tests (AGP 7.0.0)	6m 26s
Artifact Android local tests (AGP 7.1.2)	6m 47s
Artifact Java local tests	5m 26s
Artifact Android emulator tests (API ${{ matrix.api-level }})	0s
Artifact Android local tests (AGP 8.1.0)	4m 39s
Test Hilt Gradle plugin	10m 45s
Build Hilt Gradle plugin against latest AGP version	0s
Clean up GitHub Action caches	6s
Publish snapshot	0s
	1h 10m 28s

Provide feedback