Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adjust cpp inference adapters for OVMS #212

Merged

Conversation

atobiszei
Copy link
Contributor

@atobiszei atobiszei commented Oct 29, 2024

This is required to allow no-copy inference with Model API within Mediapipe graphs.

Use OVMS C-API with set output to avoid copy in OVMSModelAPIAdapter.

Ticket: CVS-155477

Related changes:
openvinotoolkit/model_server#2763
openvinotoolkit/mediapipe#92

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Did you make sure to update the documentation with your changes?
  • Did you write any new necessary tests? OVMS integration tests, are used.

This is required to allow no-copy inference with Model API within
Mediapipe graphs.
@atobiszei atobiszei force-pushed the atobisze_ovms_model_api_adjust branch from c194f2e to fbb0559 Compare October 31, 2024 07:49
@sovrasov sovrasov added this pull request to the merge queue Oct 31, 2024
Merged via the queue into openvinotoolkit:master with commit 25c88f8 Oct 31, 2024
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants