Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable tools to accept input args as IRPA files #19783

Open
sogartar opened this issue Jan 23, 2025 · 1 comment
Open

Enable tools to accept input args as IRPA files #19783

sogartar opened this issue Jan 23, 2025 · 1 comment
Labels
enhancement ➕ New feature or request runtime/tools IREE's runtime tooling (iree-run-module, iree-benchmark-module, etc)

Comments

@sogartar
Copy link
Contributor

Request description

I want to be able to pass to iree-run-module and iree-benchmark-module input that is bfloat16. Numpy does not support this type.
I want to add support for consuming IRPA files. Would there be an objection supporting this?

There is also a comment that we may add pluggable support for different input types. Maybe it is a good time to add that as well.

What component(s) does this issue relate to?

Runtime

Additional context

No response

@sogartar sogartar added enhancement ➕ New feature or request runtime/tools IREE's runtime tooling (iree-run-module, iree-benchmark-module, etc) labels Jan 23, 2025
@benvanik
Copy link
Collaborator

benvanik commented Jan 23, 2025

you can pass that as a binary blob today ([email protected]) - that's the recommended path

IRPA files are key-value collections whereas numpy files and what we need in the tools are ordered lists - irpa files would only make sense with named entries and require more syntax - it could be useful, but it's more of a special case thing (you'd have to do [email protected]:some_key)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement ➕ New feature or request runtime/tools IREE's runtime tooling (iree-run-module, iree-benchmark-module, etc)
Projects
None yet
Development

No branches or pull requests

2 participants