Replies: 1 comment
-
We played around with this too. The only good solution we found is to use the FileInput and accept a zip file of images. So in the service you unzip and process the images in batch. The client calling the service is responsible for zipping the images. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
So the main idea I understand in BentoML is that you can send a request at once.
or use micro-batching and batch multiple requests send by multiple users.
However in my case I want to send a batch of images to the API which isn't handled through any guide in the docs and I couldn't find any way to do it.
So if anyone has an idea on how to send a batch of images at once through the API, let me know.
Beta Was this translation helpful? Give feedback.
All reactions