Update README.md

McGill-NLP · Apr 4, 2024 · df20178 · df20178
1 parent 14bd9dc
commit df20178
Showing 1 changed file with 3 additions and 4 deletions.
diff --git a/README.md b/README.md
@@ -1,12 +1,11 @@
-# LLM2Vec
-
-*LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders*. 
+# *LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders* 
+LLM2Vec is a simple recipe to convert decoder-only LLMs into text encoders. It consists of 3 simple steps: 1) enabling bidirectional attention, 2) training with masked next token prediction, and 3) unsupervised contrastive learning. The model can be further fine-tuned to achieve state-of-the-art performance.
 
 <p align="center">
   <img src="https://github.com/McGill-NLP/llm2vec/assets/12207571/48efd48a-431b-4625-8e0f-248a442e3839" width="75%" alt="LLM2Vec_figure1"/>
 </p>
 
-## Instrallation
+## Installation
 To use LLM2Vec, first install the llm2vec package from PyPI.
 
 ```bash