From 04a37dc605693ccd233597ffd60021487c7faf22 Mon Sep 17 00:00:00 2001 From: Elliott Wang Date: Fri, 9 Jun 2023 10:15:29 +0800 Subject: [PATCH] PLAM => PaLM --- docs/source/en/model_doc/open-llama.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/en/model_doc/open-llama.mdx b/docs/source/en/model_doc/open-llama.mdx index f4d2b72b09a3dc..fa463953eeb409 100644 --- a/docs/source/en/model_doc/open-llama.mdx +++ b/docs/source/en/model_doc/open-llama.mdx @@ -16,7 +16,7 @@ specific language governing permissions and limitations under the License. The Open-Llama model was proposed in [Open-Llama project](https://github.com/s-JoL/Open-Llama) by community developer s-JoL. -The model is mainly based on LLaMA with some modifications, incorporating memory-efficient attention from Xformers, stable embedding from Bloom, and shared input-output embedding from PLAM. +The model is mainly based on LLaMA with some modifications, incorporating memory-efficient attention from Xformers, stable embedding from Bloom, and shared input-output embedding from PaLM. And the model is pre-trained on both Chinese and English, which gives it better performance on Chinese language tasks. This model was contributed by [s-JoL](https://huggingface.co/s-JoL).