Benchmarking gemma2-9b Efficiency Across Fine-Tuning Techniques

Contents

• Benchmarking gemma2-9b Efficiency Across Fine-Tuning Techniques
  • Contents
    • Experiments list
  • Inspiration

Experiments list

• document full chart and finesetup and inference setup on local
• Model architecture:
  • Gemma2-9b LLMs from scratch for small dataset
  • alternative for Collators used in model its have some limitations

Inspiration

• The dataset to explore Competition and multiple sources from Huggin Face
• Some techniques inspired form here tascj/kaggle-lmsys-chatbot-arena-post winner's solutions.