Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[SPARK-45646][SQL] Remove hardcoding time variables prior to Hive 2.0
### What changes were proposed in this pull request? Remove the following hardcoding time variables prior to Hive 2.0 ``` hive.stats.jdbc.timeout hive.stats.retries.wait ``` ### Why are the changes needed? It's kind of a cleanup since Spark 4.0 only supports Hive 2.0 and above. The removal also reduces the warning message on `spark-sql` bootstrap. ### Does this PR introduce _any_ user-facing change? Yes, it reduces the warning message on `spark-sql` bootstrap. ```patch ➜ $ build/sbt clean package -Phive-thriftserver ➜ $ SPARK_PREPEND_CLASSES=true bin/spark-sql NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly. 23/10/24 15:42:22 WARN Utils: Your hostname, pop-os resolves to a loopback address: 127.0.1.1; using 10.221.99.150 instead (on interface wlp61s0) 23/10/24 15:42:22 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 23/10/24 15:42:23 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable - 23/10/24 15:42:25 WARN HiveConf: HiveConf of name hive.stats.jdbc.timeout does not exist - 23/10/24 15:42:25 WARN HiveConf: HiveConf of name hive.stats.retries.wait does not exist 23/10/24 15:42:28 WARN ObjectStore: Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 2.3.0 23/10/24 15:42:28 WARN ObjectStore: setMetaStoreSchemaVersion called but recording version is disabled: version = 2.3.0, comment = Set by MetaStore chengpan127.0.1.1 23/10/24 15:42:28 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException Spark Web UI available at http://10.221.99.150:4040 Spark master: local[*], Application Id: local-1698133344448 spark-sql (default)> ``` ### How was this patch tested? Pass GA and manually test. ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#43506 from pan3793/SPARK-45646. Authored-by: Cheng Pan <[email protected]> Signed-off-by: yangjie01 <[email protected]>
- Loading branch information