SLAM

SLAM: Towards Efficient Multilingual Reasoning via Selective Language Alignment

📃 Paper | 🤗 Huggingface

🌚 Overview

• This repository shows our latest work on the efficient expansion of model multilingual capabilities.

🛠️ Installation

To install this repository, follow these steps:

git clone git@github.com:fmm170/SLAM.git
cd SLAM/LLaMA-Factory
pip install -r requirements.txt
cd transformers
pip install -e .

🍀 Training

• finetuning MetaMath-7B / MetaMath-13B

bash MetaMath-7b.sh
bash MetaMath-13b.sh

🔍 Evaluation

We use the evaluation code provided by Chen et al.

• evaluating with mGSM

cd evaluate

bash mgsm.sh

• evaluating with mSVAMP

cd evaluate

bash msvamp.sh

• evaluating with xCSQA

cd evaluate

bash evaluate_xcsqa6.sh

🐛 Bugs or Questions?

If you have any questions related to the code or the paper, feel free to email yuchunfan_neu@outlook.com