Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Slice the last matmull in stateful llm pipeline #814

Merged
merged 2 commits into from
Oct 12, 2024
Merged

Slice the last matmull in stateful llm pipeline #814

merged 2 commits into from
Oct 12, 2024

Conversation

olpipi
Copy link
Collaborator

@olpipi olpipi commented Sep 2, 2024 •
edited by andrei-kochin
Loading

Ticket: CVS-154175

@ilya-lavrenov ilya-lavrenov self-assigned this Sep 3, 2024
@olpipi olpipi force-pushed the cut_matmul branch 3 times, most recently from 38280c4 to c726fe5 Compare September 19, 2024 10:24
@olpipi olpipi changed the title PoC Slice the last matmull in stateful llm pipeline Sep 19, 2024
@olpipi olpipi marked this pull request as ready for review September 19, 2024 10:25
Wovchena
Wovchena requested changes Sep 19, 2024
View reviewed changes
src/cpp/src/llm_pipeline.cpp Outdated Show resolved Hide resolved
src/cpp/src/llm_pipeline.cpp Outdated Show resolved Hide resolved
@ilya-lavrenov ilya-lavrenov added this to the 2024.5 milestone Sep 19, 2024
@olpipi olpipi requested a review from Wovchena September 20, 2024 17:10
@Wovchena
Copy link
Collaborator

You have a check fallen

@olpipi olpipi force-pushed the cut_matmul branch 2 times, most recently from 083424a to b343cd8 Compare October 9, 2024 10:46
Wovchena
Wovchena approved these changes Oct 9, 2024
View reviewed changes
Copy link
Collaborator

@Wovchena Wovchena left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Resolve the conflict

@andrei-kochin andrei-kochin added this pull request to the merge queue Oct 11, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Oct 11, 2024
@ilya-lavrenov ilya-lavrenov added this pull request to the merge queue Oct 12, 2024
Merged via the queue into openvinotoolkit:master with commit 67bcef1 Oct 12, 2024
47 checks passed
@ilya-lavrenov ilya-lavrenov added the category: LLM LLM pipeline (stateful, static) label Oct 15, 2024
@smirnov-alexey smirnov-alexey mentioned this pull request Oct 24, 2024
Merged
github-merge-queue bot pushed a commit to openvinotoolkit/openvino that referenced this pull request Oct 24, 2024
@smirnov-alexey
[NPUW] Add Slice before last MatMul (#27229)
433e44e 
Based on openvinotoolkit/openvino.genai#814
CuriousPanCake pushed a commit to CuriousPanCake/openvino that referenced this pull request Nov 6, 2024
@smirnov-alexey @CuriousPanCake
[NPUW] Add Slice before last MatMul (openvinotoolkit#27229)
9f991a5 
Based on openvinotoolkit/openvino.genai#814
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@itikhono itikhono itikhono left review comments

@ilya-lavrenov ilya-lavrenov ilya-lavrenov approved these changes

@Wovchena Wovchena Wovchena approved these changes

Assignees

@ilya-lavrenov ilya-lavrenov

@Wovchena Wovchena

@itikhono itikhono

@slyalin slyalin

Labels
category: LLM LLM pipeline (stateful, static) Code Freeze
Projects
None yet
Milestone
2024.5
Development

Successfully merging this pull request may close these issues.
6 participants
@olpipi @Wovchena @ilya-lavrenov @itikhono @slyalin @andrei-kochin