Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] node2node (HostNetwork is true, service is false scenario) failing on ROSA cluster #110

Closed
venkataanil opened this issue Oct 9, 2023 · 2 comments
Labels
bug Something isn't working

Comments

@venkataanil
Copy link
Contributor

Describe the bug
A clear and concise description of what the bug is.
node2node (hostNetwork is true, service is false scenario) is failing in "ROSA" cluster with below error (k8s-netperf version is v0.1.15). This is not reproducible on self-managed AWS cluster.

time="2023-10-09 16:02:33" level=debug msg="server Running on ip-10-0-217-22.us-west-2.compute.internal with IP 10.0.217.22"
time="2023-10-09 16:02:33" level=debug msg="client-across Running on ip-10-0-205-189.us-west-2.compute.internal with IP 10.0.205.189"
time="2023-10-09 16:02:33" level=debug msg="Executing workloads. hostNetwork is true, service is false"
time="2023-10-09 16:02:33" level=debug msg="🔥 Client (client-host-6548b5cbc4-sgt44,10.0.217.22) starting netperf against server : 10.0.205.189"
time="2023-10-09 16:02:33" level=info msg="🗒️ Running netperf TCP_STREAM (service false) for 300s "
time="2023-10-09 16:02:33" level=debug msg="[bash super-netperf 1 -H 10.0.205.189 -l 300 -t TCP_STREAM -- -k rt_latency,p99_latency,throughput,throughput_units,remote_recv_calls,local_send_calls,local_transport_retrans -m 64 -R 1]"
time="2023-10-09 16:04:43" level=debug msg="(standard_in) 2: syntax error\r\n(standard_in) 2: syntax error\r\n(standard_in) 2: syntax error\r\n(standard_in) 2: syntax error\r\n(standard_in) 2: syntax error\r\nestablish control: are you sure there is a netserver listening on 10.0.205.189 at port 12865?\r\nRT_LATENCY=\r\nP99_LATENCY=\r\nTHROUGHPUT=\r\nLOCAL_TRANSPORT_RETRANS=\r\nREMOTE_RECV_CALLS=\r\nLOCAL_SEND_CALLS="
time="2023-10-09 16:04:43" level=debug msg="Executing workloads. hostNetwork is false, service is false"

To Reproduce
Steps to reproduce the behavior:

  1. Run k8s-netperf on ROSA cluster with --all flag (i.e testing hostnetwork)
@venkataanil venkataanil added the bug Something isn't working label Oct 9, 2023
@vishnuchalla
Copy link
Collaborator

vishnuchalla commented Oct 9, 2023

@venkataanil
Copy link
Contributor Author

#109 corrected the behaviour of node2node. Prior to this PR, node2node test was actually executng node2pod scenario.
After adding AWS security group which allows port 12865 on AWS workers, netperf client is able to reach the network server.
We need to enhance our perf scripts to enable port 12865 on ROSA AWS workers before running netperf.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants