CentOS and Rocky Linux Doesn't work properly

[simeononsecurity]

When attempting to point CentOS, Rocky Linux or otherwise RHEL based yum/dnf package managed OS'es, which are supported by apt-cacher-ng this implementation fails to work correctly. I'm unsure as to why. The only thing I can think of is file permissions. But I'm unable to test this well enough to say one way or the other.
Usually, this results in a 403 forbidden error, even though I can go to my file system and see that the files are there. For some reason they end up with a different UID/GID than all the other files. This makes me beleive it's a permission issue. However after manually changing the permissions it still doesn't work.
Does work however when I run the package without dockerization. So it is an issue in this implementation here.