Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PIR & Inference] Refactor fused_weight_only_linear_pass #59792

Merged
merged 12 commits into from
Dec 12, 2023

Conversation

Wanglongzhi2001
Copy link
Contributor

@Wanglongzhi2001 Wanglongzhi2001 commented Dec 7, 2023

PR types

Others

PR changes

Others

Description

Pcard-71502
修改了之前的 fused_weight_only_linear_pass 的 PR #59366

Copy link

paddle-bot bot commented Dec 7, 2023

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

Copy link

paddle-bot bot commented Dec 7, 2023

✅ This PR's description meets the template requirements!
Please wait for other CI results.

yuanlehome
yuanlehome previously approved these changes Dec 8, 2023
if (sm_vesion != 70 && sm_vesion != 80 && sm_vesion != 86 &&
sm_vesion != 75) {
// TODO(Wanglongzhi2001): only support sm80 for now
if (sm_vesion != 80) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

当前develop版本已经支持了70 75 80 86这四个架构

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

yuanlehome
yuanlehome previously approved these changes Dec 12, 2023
Copy link
Contributor

@yuanlehome yuanlehome left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@@ -30,5 +30,7 @@ bool DtypeInterface::operator==(const DtypeInterface& other) const {
return *dtype_ == *other.dtype_;
}

IrDtype DtypeInterface::dtype() const { return *(this->dtype_); }
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里返回类型直接用pir::Type吧,设计早起本来是不希望暴露太多pir的概念到上层,目前看pir::Type在drr中的使用场景比较有限,可以直接用

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

是指像下面这样吗

pir::Type DtypeInterface::dtype() const { return this->dtype_->get(); }

@yuanlehome yuanlehome merged commit 2360fae into PaddlePaddle:develop Dec 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants