Skip to content
This repository has been archived by the owner on Oct 25, 2024. It is now read-only.

Support Mistral model in NeuralChat #710

Merged
merged 7 commits into from
Nov 20, 2023
Merged

Support Mistral model in NeuralChat #710

merged 7 commits into from
Nov 20, 2023

Conversation

lvliang-intel
Copy link
Contributor

Type of Change

feature
API not changed

Description

Support Mistral model

Expected Behavior & Potential Risk

Users can run Mistral model using NeuralChat.

How has this PR been tested?

Pre-CI and local test.

Dependency Change?

None

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…ransformers into lvl/support_mistral

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…ransformers into lvl/support_mistral

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
@lvliang-intel lvliang-intel changed the title Support Mistral model Support Mistral model in NeuralChat Nov 17, 2023
@hshen14
Copy link
Contributor

hshen14 commented Nov 20, 2023

pls resolve the conflict @lvliang-intel

…ransformers into lvl/support_mistral

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
@VincyZhang VincyZhang merged commit fcee612 into main Nov 20, 2023
13 checks passed
@VincyZhang VincyZhang deleted the lvl/support_mistral branch November 20, 2023 06:23
sywangyi pushed a commit that referenced this pull request Nov 21, 2023
VincyZhang pushed a commit that referenced this pull request Nov 30, 2023
* add local mem vnni_tiled load

* update payload_t

* rename ut

* rename ut

* add sw barrier before vnni_convert

* remove the assert of is_local_B in brgemm

* update the usage of select in vnni_convert func

* check is matB col_major and add matB slm_size if load from local

* fix warnings

* update ut
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants