Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Hadoop JAR Download Timeouts in Behave Tests #1503

Merged
merged 2 commits into from
Jan 15, 2025

Conversation

parthosa
Copy link
Collaborator

@parthosa parthosa commented Jan 14, 2025

Fixes #1502

The behave tests currently downloads Hadoop JARs from Apache CDN (dlcdn.apache.org) for HDFS testing. However, there are test failures due to download timeouts making workflows unreliable.

Issue

  • Using CDN (dlcdn.apache.org) instead of the more reliable archive.apache.org
  • Insufficient timeout settings in download configurations

Changes

  1. Switch download source from dlcdn.apache.org to archive.apache.org
  2. Increased timeout settings

Signed-off-by: Partho Sarthi <[email protected]>
@parthosa parthosa added bug Something isn't working user_tools Scope the wrapper module running CSP, QualX, and reports (python) labels Jan 14, 2025
@parthosa parthosa requested a review from mattahrens January 14, 2025 19:12
@parthosa parthosa self-assigned this Jan 14, 2025
Signed-off-by: Partho Sarthi <[email protected]>
@parthosa parthosa marked this pull request as ready for review January 14, 2025 21:03
@parthosa parthosa merged commit 4e83fe4 into NVIDIA:dev Jan 15, 2025
13 checks passed
@parthosa parthosa deleted the spark-rapids-tools-1502 branch January 15, 2025 19:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working user_tools Scope the wrapper module running CSP, QualX, and reports (python)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Behave test fail due to timeout in downloading Hadoop jars
2 participants