[GH-15470] Upgrade Hadoop Libraries in Main Standalone Jar #15469
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
wendycwong
previously approved these changes
May 18, 2023
mn-mikke
changed the title
mn-mikke
force-pushed
the
mn/PUBDEV-9089
branch
2 times, most recently
from
5edc313
to
dd5ff0e
Compare
wendycwong
previously approved these changes
Jul 20, 2023
wendycwong
previously approved these changes
Jul 24, 2023
maurever
pushed a commit
that referenced
this pull request
Sep 6, 2023
* [PUBDEV-9089] Upgrade Hadoop Libraries in Main Standalone Jar (cherry picked from commit a2e9f68) * Add hadoop commons * Add some transitive dependencies for hdfs * Remove orc dependency for main * Specify different version of hadoop for orc * remove hive exec version spec from hive properties * Change hadoop version in orc tests * Fix usage of http client * Add libs for s3 persist tests * Update tests * Update tests * add hadoop-common to perstist-s3 tests * Refactor usage of hadoop-mapreduce-client-core * update usage of hadoop-common * try to relocate hadoop libraries * Revert relocation * Relocated hadoop libs * add hadoop-common.jar on tests * exclude org.apache.hadoop.net.DNSDomainNameResolver from relocation * exclude org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback * include hive shims common * remove hadoop common * remove s3n filesystem from hadoop tests * Upgrade hive shimps common * Exclude most of the Shim classes * Add some comments to build.gradle about extensions * Fix S3 tests
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Closes #15470