Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Paddle Inference] Support range trt converter and add scalar interface. #48697

Merged
merged 2 commits into from
Dec 5, 2022

Conversation

xiaoxiaohehe001
Copy link
Contributor

@xiaoxiaohehe001 xiaoxiaohehe001 commented Dec 4, 2022

PR types

Others

PR changes

Others

Describe

  • Add range trt converter.
  • 由于 addfill 接口 input1 只接受 scalar 输入,在 GetITensor 新增 scalar 接口,可以直接从 opdesc 导出标量 rank0 itensor

@paddle-bot
Copy link

paddle-bot bot commented Dec 4, 2022

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@xiaoxiaohehe001 xiaoxiaohehe001 changed the title [Paddle Inference] Add range trt converter. [Paddle Inference] Support range trt converter and add scalar interface. Dec 4, 2022
Copy link
Contributor

@zhoutianzi666 zhoutianzi666 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@zhangjun zhangjun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Comment on lines +454 to +458
nvinfer1::ITensor *TensorRTEngine::GetITensor(const std::string &name,
bool scalar) {
if (scalar) {
return ConvertWeight2ITensor(name, true);
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TODO: scalar 部分,后面拆成一个独立接口

@jiweibo jiweibo merged commit aee2db0 into PaddlePaddle:develop Dec 5, 2022
lxsbupt pushed a commit to lxsbupt/Paddle that referenced this pull request Dec 17, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants