Add functions that prepare tensors as input args for IREE tools #418
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
sogartar
force-pushed
the
iree-tool-input-arg-helpers
branch
2 times, most recently
from
2a159db to
2c5eb6e
Compare
sogartar
changed the title
sogartar
force-pushed
the
iree-tool-input-arg-helpers
branch
from
2c5eb6e to
8979355
Compare
sogartar
force-pushed
the
iree-tool-input-arg-helpers
branch
from
8979355 to
680995d
Compare
ScottTodd
reviewed
Feb 3, 2025
sogartar
force-pushed
the
iree-tool-input-arg-helpers
branch
from
680995d to
21ba9a8
Compare
ScottTodd
approved these changes
Feb 6, 2025
One drawback of using npy files is that they don't support some datatypes. This change adds functionality to prepare arguments from Torch tensors in the form --input=1x2xbf16=@arg0.bin These can then be passed to tools like iree-run-module and iree-benchmark-module. Signed-off-by: Boian Petkantchin <boian.petkantchin@amd.com>
sogartar
force-pushed
the
iree-tool-input-arg-helpers
branch
from
528d5fd to
6930b12
Compare
ScottTodd
reviewed
Feb 7, 2025
Comment on lines
+37
to
+60
| """Write the raw contents of tensors to files without any metadata. | ||
| Returns the CLI input args description. | ||
|
|
||
| If file_path_prefix is given, will chose a default naming for argument files. | ||
| It is treated as a string prefix and not as directory. | ||
| Example: | ||
| ``` | ||
| file_path_prefix="/some/path/arg" | ||
| ``` | ||
|
|
||
| returns | ||
| ``` | ||
| [ | ||
| "1x2x3xf32=@/some/path/arg0.bin", | ||
| "4x5xi8=@/some/path/arg1.bin" | ||
| ] | ||
| ``` | ||
|
|
||
| This results can be prefixed with "--input=" to arrive at the final CLI flags | ||
| expected by IREE tools. | ||
|
|
||
| Exactly one of file_paths and file_path_prefix must be provided. | ||
| Does not create parent directory(s). | ||
| """ |
There was a problem hiding this comment.
FYI this did not format correctly on the website: https://iree-turbine.readthedocs.io/en/latest/core/support.html#iree.turbine.support.tools.iree_tool_prepare_input_args
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
One drawback of using npy files is that they don't support some datatypes.
This change adds functionality to prepare arguments from Torch tensors in the form
--input=1x2xbf16=@arg0.bin
These can then be passed to tools like iree-run-module and iree-benchmark-module.