More FlightSQL endpoints

[matthewmturner]

• do_get_statement

[ahirner]

Would it make sense to use or combine efforts on this impl? https://github.com/datafusion-contrib/datafusion-federation/tree/main/datafusion-flight-sql-server

[matthewmturner]

@ahirner i apologize for missing your comment - not sure how I missed it.

This issue is specifically for improving the flight sql server implementation within dft. The client capabilities would be improved through other issues. That being said I think I saw there was a flight sql table provider / factory and I do think it would make sense to include that here. I have been on a brief dft pause for the holidays but I will be getting back into it shortly and can look into it more then.

Depending on the apis they implement in that repo it may be trivial to add this with a table provider factory in case you're interested in trying it out.

[ahirner]

Thanks, I thought this issue was about the server.

[matthewmturner]

@ahirner perhaps i misunderstood then - i looked at the example in the link you provided and it seemed to be more about a client implementation (it created a FlightSqlServiceClient whereas the server implementation uses FlightServiceServer).

[ahirner]

It's about the server implementation in service.rs. We are using this crate's implementation to run a flightsql server in production.
https://github.com/datafusion-contrib/datafusion-federation/blob/main/datafusion-flight-sql-server/src/service.rs

[matthewmturner]

Ah thanks for that. I will have to look a little further into it - on the surface it may make sense but the direction im moving with this is to have a much more opinionated / integrated setup (for example with metrics endpoint on the server and using same session context across local client and server to facilitate debugging.

Some parts that are limited to just plugging the session state into their SessionStateProvider may work fine (object stores, table providers, etc) but then that may hinder the local experience ive been working on.

[matthewmturner]

Im also planning / hoping to have a builder pattern in place where any endpoints implementation can be customized by user.