Skip to content

Spark and Spark History 2.12.0-3.0.1

Latest
Latest
Compare
Choose a tag to compare
@farhan5900 farhan5900 released this 13 Nov 21:09
2.12.0-3.0.1
135331e
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

New features

  • Base tech upgrades to 3.0.1
  • Adds support of _SPARK_AUTH_SECRET_FILE environment to accept file-based authentication, similar to _SPARK_AUTH_SECRET, which accepts secret directly.
  • Adds the flag --executor-auth-secret-path in a Spark CLI to enable File-Based RPC Authentication.
  • Adds configurations to support log rotate options stdout_max_size and stderr_max_size.

Updates

  • Supports Scala version 2.12 only. No longer supports Scala version 2.11.
  • Compiles Spark with Hadoop versions 3.2 and 2.7.

Breaking changes

  • Spark CLI flag --executor-auth-secret, no longer accepts filename or secret path.
  • No longer publish Spark docker image compiled with Hadoop 2.9.
Assets 2
Loading