Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Inference] Update go inference api based on new capi. #33113

Merged
merged 24 commits into from
Jun 17, 2021

Conversation

jiweibo
Copy link
Contributor

@jiweibo jiweibo commented May 25, 2021

PR types

New features

PR changes

APIs

Describe

1、基于预测新版CAPI更新了预测Go API
2、demo及文档pr:PaddlePaddle/Paddle-Inference-Demo#138
3、demo https://github.com/PaddlePaddle/Paddle-Inference-Demo/blob/master/go/resnet50/demo.go

涉及到CI的修改:
1、ci docker镜像go版本升级,从1.8升级到1.15.12
2、PR-CI-Inference 流水线中增加go inference api的测试

业务160输入模型 不同API下的性能diff

method tp50 tp90 tp99 avg tp99相对于avg退化
GO API 20.89 25.11 38.68 21.82 77.23%
go封装C++业务逻辑(C++ API) 20.37 27.42 35.56 22.06 61.20%

@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@paddle-bot-old
Copy link

paddle-bot-old bot commented Jun 4, 2021

Sorry to inform you that 731e89a's CIs have passed for more than 7 days. To prevent PR conflicts, you need to re-run all CIs manually.

@paddle-bot-old
Copy link

Sorry to inform you that daf0f33's CIs have passed for more than 7 days. To prevent PR conflicts, you need to re-run all CIs manually.

Copy link
Contributor

@winter-wang winter-wang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@Superjomn Superjomn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jiweibo jiweibo merged commit c7e3c91 into PaddlePaddle:develop Jun 17, 2021
@jiweibo jiweibo deleted the go_new branch June 17, 2021 10:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants