Problem with kernel 5.9 or 5.10

[rudnypc]

Bug description
When I updated my debian 9 to kernel 5.9 or 5.10, the portainer agent doesn't work rigth.

Expected behavior
Enable console option

Portainer Logs

BAD AGENT NODE:
2021/04/01 04:39:57 [INFO] [main] [message: Agent running on Docker platform]
2021/04/01 04:39:57 [INFO] [main] [message: Agent running on a Swarm cluster node. Running in cluster mode]
2021/04/01 04:40:00 [INFO] serf: EventMemberJoin: SRV-SWARM-INFRA-e6d6fc02c69e 192.168.233.65
2021/04/01 04:40:00 [INFO] [http] [server_addr: 0.0.0.0] [server_port: 9001] [secured: true] [api_version: 2.0.0] [message: Starting Agent API server]

GOOD AGENT NODE:
2021/04/01 04:09:59 [INFO] [main] [message: Agent running on Docker platform]
2021/04/01 04:09:59 [INFO] [main] [message: Agent running on a Swarm cluster node. Running in cluster mode]
2021/04/01 04:10:02 [INFO] serf: EventMemberJoin: SRV-SWARM-01-c37dadc14f9d 192.168.233.56
2021/04/01 04:10:12 [INFO] serf: EventMemberJoin: SRV-SWARM-03-d59a82336d39 192.168.233.54
2021/04/01 04:10:12 [INFO] serf: EventMemberJoin: SRV-SWARM-06-03c818fa41db 192.168.233.55
2021/04/01 04:10:12 [INFO] serf: EventMemberJoin: SRV-SWARM-02-eaee5f8ec185 192.168.233.53
2021/04/01 04:10:12 [INFO] serf: EventMemberJoin: SRV-SWARM-04-2fd6e8bfe284 192.168.233.37
2021/04/01 04:10:13 [INFO] [http] [server_addr: 0.0.0.0] [server_port: 9001] [secured: true] [api_version: 2.0.0] [message: Starting Agent API server]
2021/04/01 04:10:14 [INFO] serf: EventMemberJoin: SRV-SWARM-05-a8a4571d55fe 192.168.233.57

Steps to reproduce the issue:

Upgrade your kernel to 5.9+

Technical details:

• Portainer version: 1.23.2 / agent latest
• Docker version (managed by Portainer):
• Client: Docker Engine - Community
  Version: 19.03.15
  API version: 1.40
  Go version: go1.13.15
  Git commit: 99e3ed8919
  Built: Sat Jan 30 03:17:11 2021
  OS/Arch: linux/amd64
  Experimental: false

Server: Docker Engine - Community
Engine:
Version: 19.03.15
API version: 1.40 (minimum version 1.12)
Go version: go1.13.15
Git commit: 99e3ed8919
Built: Sat Jan 30 03:15:40 2021
OS/Arch: linux/amd64
Experimental: false
containerd:
Version: 1.4.3
GitCommit: 269548fa27e0089a8b8278fc4fc781d7f65a939b
runc:
Version: 1.0.0-rc92
GitCommit: ff819c7e9184c13b7c2607fe6c30ae19403a7aff
docker-init:
Version: 0.18.0
GitCommit: fec3683

• Kubernetes version (managed by Portainer):
• Platform (windows/linux): Linux
• Command used to start Portainer (docker run -p 9000:9000 portainer/portainer):
• Browser: ALL
• Use Case (delete as appropriate): Using Portainer at Home, Using Portainer in a Commerical setup.
• Have you reviewed our technical documentation and knowledge base? Yes/No

Additional context
Add any other context about the problem here.
When a rollback to 4.9 kernel, the portainer agent works well.

Working:

Not working:

[rudnypc]

I tried ubuntu with kernel 5.11, 5.14... the same problem happens. I have to downgrade to 5.4.
agent doesn't communicate with each other, I don't see the EventMemberJoin message from all agents.

Portainer-ce is only able to have agent information on the same node.

You can download the ubuntu 20.04, and install the newest kernel with this tool:
https://github.com/pimlie/ubuntu-mainline-kernel.sh

sh ubuntu-mainline-kernel.sh -i v5.14.0

[huib-portainer]

Could there be an issue with your overlay network?