Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Documentation for Replication Using a Load Balancer #2375

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

cniackz
Copy link
Contributor

@cniackz cniackz commented Dec 24, 2024

Description:

Document a scenario where a load balancer terminates the connection during replication and provide guidance on how to resolve this issue.

@@ -131,3 +131,58 @@ spec:
port:
number: 9443
```

### Replication configuration:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not necessarly related to replication, this is mainly a very slow deployment or best practice were not followed, like a user storing a lot of objects under a single prefix

the one here works most of the time,

https://min.io/docs/minio/linux/integrations/setup-nginx-proxy-with-minio.html

Copy link
Contributor

@ravindk89 ravindk89 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM mod nit/suggestion

Comment on lines +162 to +163
nginx.ingress.kubernetes.io/proxy-read-timeout: "60s"
nginx.ingress.kubernetes.io/proxy-send-timeout: "60s"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Q: Is there a value here we would consider to be too high? We have internal timeouts as well. Just curious.


### Replication configuration:

Sometimes, you need to configure timeout in order to avoid Load Balancer to kill the connection while replication is taking place, for that, we can configure a read/write timeout of X minutes in the provided load balancer, you can add the appropriate NGINX annotations to your ingress configuration under `metadata.annotations`. The relevant annotations are:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rec based on Anis comment:

Suggested change
Sometimes, you need to configure timeout in order to avoid Load Balancer to kill the connection while replication is taking place, for that, we can configure a read/write timeout of X minutes in the provided load balancer, you can add the appropriate NGINX annotations to your ingress configuration under `metadata.annotations`. The relevant annotations are:
Ingress by default may time out connections before an operation completes.
This is common with slower setups (network/drives) or poor operational practices (many objects in one prefix, flat organization).
You can set a timeout value that is above what your cluster requires on average to complete an operation to address the above issue.
Place the following nginx annotations in the ingress configuration under `metadata.anotations`:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants