-
My processing function requires certain libraries that are only available in Python.Is there any way still to use the Parallel Consumer? ( Apart from making a API call from Java->Python in the processing logic) |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
Hi @Shounak47, |
Beta Was this translation helpful? Give feedback.
Hi @Shounak47,
IMHO easiest would be to use an API call over Rest or GRPC etc.
There are projects that allow to execute Python code from Java - for example PemJa - https://github.com/alibaba/pemja.
Flink is using it for PyFlink UDF execution in THREAD mode - some information on that - https://flink.apache.org/2022/05/06/exploring-the-thread-mode-in-pyflink/ https://nightlies.apache.org/flink/flink-docs-master/docs/dev/python/python_execution_mode/
But it would be quite involved to integrate python code through PemJa.