-
Notifications
You must be signed in to change notification settings - Fork 5.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding support for SSL/TLS in hive metastore #19164
base: master
Are you sure you want to change the base?
Conversation
@imjalpreet or @agrawalreetika Do you think you can do a first review of this PR? |
I haven't looked at the implementation, but two comments
|
Cherry-pick of trinodb/trino/pull/3087 Co-authored-by: Dongwoo Son <[email protected]>
|
1). We have corrected the comment format , please verify 2). On this point - this is a cherry picked code drop from trino with essential changes to fit to presto. We have tested this and its working fine. Similar SSL support is there in presto-cassandra and presto-elasticsearch. In all such modules we are not able to find end to end test cases. What we can do is to ensure that there are test cases to verify newly introduced methods such as And also want to mention that this change will be inactive or kind of no impact if we do not specify or configure |
I'm not concerned that this will break the hive connector with the feature disabled (that should be covered by current tests). Nor am I even very concerned that this feature doesn't work currently, as you said you have tried it out. I am most concerned that if we say we have support for this feature, we have tests that ensure that it continues to work. I hear you that cassandra and elastic search also don't have tests for their equivalent feature, but honestly, i think they should too. If it's not easy to test with our regular query runner set up, perhaps the docker based product tests will be a good way to test this. I haven't used them in a while, but as I recall the README was pretty good https://github.com/prestodb/presto/blob/master/presto-product-tests/README.md. We have some tests there that test specific security configurations that could be helpful for inspiration (e.g. tls between presto nodes, LDAP). For example, see this PR, which adds LDAP support to the JDBC driver https://github.com/prestodb/presto/pull/7725/commits or these commits which tests TLS between Presto nodes 190f260 b8f8031. Or cacccb8 tests HDFS Impersonation. |
Codenotify: Notifying subscribers in CODENOTIFY files for diff 762a82f...36f071f.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nit, checking if these are correct explanations for the properties.
======================================= ============================================================ ============ | ||
``hive.metastore.thrift.client.tls.enabled`` Whether TLS security is enabled. ``false`` | ||
|
||
``hive.metastore.thrift.client.tls.truststore.path`` Path to the PEM or JKS key store. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you check these last four and confirm they are correct?
hive.metastore.thrift.client.tls.truststore.path
andhive.metastore.thrift.client.tls.truststore.password
are described as for the key storehive.metastore.thrift.client.tls.keystore.path
andhive.metastore.thrift.client.tls.keystore.password
are described as for the trust store
Introduce SSL/TLS support for hive metastore
Cherry-pick of trinodb/trino/pull/3087
Co-authored-by: Dongwoo Son [email protected]
Test plan
Added unit test cases.