Skip to content
This repository has been archived by the owner on Apr 8, 2024. It is now read-only.

Write specifications for all inferencing modules and align #187

Open
jfomhover opened this issue Dec 3, 2021 · 0 comments
Open

Write specifications for all inferencing modules and align #187

jfomhover opened this issue Dec 3, 2021 · 0 comments
Labels
documentation Improvements or additions to documentation
Milestone

Comments

@jfomhover
Copy link
Contributor

There's a trade-off between aligning all inferencing modules, and providing flexibility to implement framework-specific arguments.

The inferencing pipeline should be able to rely on a standard set of parameters (ex: data type, batch size, num threads...) while providing flexibility for experiments requiring framework params (ex: using custom binaries).

Writing down a specification in our documentation, and decide which params should be the core "contract" of inferencing modules, then align on each of them, would put us in a better place before expanding to more frameworks.

@jfomhover jfomhover added the documentation Improvements or additions to documentation label Dec 3, 2021
@jfomhover jfomhover added this to the Self-Service milestone Dec 3, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

1 participant