Fix TRT destroying a runtime before destroying deserialized engines

[Tom-Zheng]

PR types

Bug fixes

PR changes

Others

Description

Currently TRT-related UTs will report the following error:

E0326 08:50:28.902647  3101 helper.h:114] 3: [runtime.cpp::~Runtime::346] Error Code 3: API Usage Error (Parameter check failed at: runtime/rt/runtime.cpp::~Runtime::346, condition: mEngineCounter.use_count() == 1. Destroying a runtime before destroying deserialized engines created by the runtime leads to undefined behavior. 

The error is self-explained: Destroying a runtime before destroying deserialized engines created by the runtime is not allowed. This PR fixes this issue.

[paddle-bot]

你的PR提交成功，感谢你对开源项目的贡献!
请关注后续CI自动化测试结果，详情请参考Paddle-CI手册。
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

[paddle-bot]

❌ The PR is not created using PR's template. You can refer to this Demo.
Please use PR's template, it helps save our maintainers' time so that more developers get helped.

[jeng1220]

@tianshuo78520a,
我看 PR-CI-Coverage 是標記 DLA 的代碼沒測到，但這 PR 和 DLA 沒有關係，能麻煩你手動批准嗎?

[jeng1220]

PR-CI-GpuPS-PSLIB 的 log 顯示

/workspace/Paddle/build/third_party/install/pslib/include/proto/ps.pb.h:17:2: error: \
#error This file was generated by an older version of protoc which is

這 PR 也並沒有改動 protocol buffer. 問題似乎是 CI 設置有問題?

[tianshuo78520a]

Details

这条任务并不是Required，因此不会影响PR正常Merge。

[tianshuo78520a]

@tianshuo78520a, 我看 PR-CI-Coverage 是標記 DLA 的代碼沒測到，但這 PR 和 DLA 沒有關係，能麻煩你手動批准嗎?

已经豁免

[jeng1220]

PR-CI-Windows 的 log 顯示

[2827/3874] Building CUDA object paddle\fluid\operators\CMakeFiles\paddle_operators_unity.dir\paddle_operators_unity_5_cu.cu.obj
FAILED: paddle/fluid/operators/CMakeFiles/paddle_operators_unity.dir/paddle_operators_unity_5_cu.cu.obj 
C:\Python37\Scripts\sccache.exe C:\PROGRA~1\NVIDIA~2\CUDA\v10.2\bin\nvcc.exe ... paddle_operators_unity_5_cu.cu
../paddle/fluid/framework/eigen.h(159): error C2065: 'NumIndices': undeclared identifier

錯誤是發生在 eigen.h，也和這 PR 無關
這應是 develop branch 現在已有的問題

[tianshuo78520a]

PR-CI-Windows 的 log 顯示

[2827/3874] Building CUDA object paddle\fluid\operators\CMakeFiles\paddle_operators_unity.dir\paddle_operators_unity_5_cu.cu.obj
FAILED: paddle/fluid/operators/CMakeFiles/paddle_operators_unity.dir/paddle_operators_unity_5_cu.cu.obj 
C:\Python37\Scripts\sccache.exe C:\PROGRA~1\NVIDIA~2\CUDA\v10.2\bin\nvcc.exe ... paddle_operators_unity_5_cu.cu
../paddle/fluid/framework/eigen.h(159): error C2065: 'NumIndices': undeclared identifier

錯誤是發生在 eigen.h，也和這 PR 無關 這應是 develop branch 現在已有的問題

windows可能是cache原因导致的，我正在尝试重跑CI

[jeng1220]

PR-CI-Windows 的 log 顯示

[2827/3874] Building CUDA object paddle\fluid\operators\CMakeFiles\paddle_operators_unity.dir\paddle_operators_unity_5_cu.cu.obj
FAILED: paddle/fluid/operators/CMakeFiles/paddle_operators_unity.dir/paddle_operators_unity_5_cu.cu.obj 
C:\Python37\Scripts\sccache.exe C:\PROGRA~1\NVIDIA~2\CUDA\v10.2\bin\nvcc.exe ... paddle_operators_unity_5_cu.cu
../paddle/fluid/framework/eigen.h(159): error C2065: 'NumIndices': undeclared identifier

錯誤是發生在 eigen.h，也和這 PR 無關 這應是 develop branch 現在已有的問題

windows可能是cache原因导致的，我正在尝试重跑CI

錯誤仍然是 eigen

c:\home\workspace\paddle\third_party\eigen3\eigen\src/Core/GlobalFunctions.h(88): \
error C2065: 'Dest': undeclared identifier

[tianshuo78520a]

PR-CI-Windows 的 log 顯示

[2827/3874] Building CUDA object paddle\fluid\operators\CMakeFiles\paddle_operators_unity.dir\paddle_operators_unity_5_cu.cu.obj
FAILED: paddle/fluid/operators/CMakeFiles/paddle_operators_unity.dir/paddle_operators_unity_5_cu.cu.obj 
C:\Python37\Scripts\sccache.exe C:\PROGRA~1\NVIDIA~2\CUDA\v10.2\bin\nvcc.exe ... paddle_operators_unity_5_cu.cu
../paddle/fluid/framework/eigen.h(159): error C2065: 'NumIndices': undeclared identifier

錯誤是發生在 eigen.h，也和這 PR 無關 這應是 develop branch 現在已有的問題

windows可能是cache原因导致的，我正在尝试重跑CI

錯誤仍然是 eigen

c:\home\workspace\paddle\third_party\eigen3\eigen\src/Core/GlobalFunctions.h(88): \
error C2065: 'Dest': undeclared identifier

已经通过，CheckPRTemplate可以通过修改PR模板进行重新触发操作。

[jeng1220]

@yuanlehome , @qingqing01 , and @zhangjun ,
All CI tests were passed. Please help to review the code.
Thanks

[yuanlehome]

LGTM

[zhangjun]

LGTM