[Core] Streamline stream termination in AsyncLLMEngine
#16510
Job | Run time |
---|---|
9s | |
14s | |
11s | |
8s | |
8s | |
50s |
AsyncLLMEngine
#16510
Job | Run time |
---|---|
9s | |
14s | |
11s | |
8s | |
8s | |
50s |