This project is designed to evaluate the performance of different Large Language Models (LLMs) in extracting email signature information and structuring it into a JSON format.
config.py
: Contains the OpenAI API key.functions.py
: Defines the functions used for prompt evaluation and result analysis.main.py
: The main script that runs the evaluation.
-
Clone the repository:
git clone https://github.com/your-repo/email_signature_extractor_evaluator.git cd email_signature_extractor_evaluator
-
Set up a Python virtual environment:
python3 -m venv .venv source .venv/bin/activate
-
Install the required packages:
pip install openai transformers
-
Set your OpenAI API key in
config.py
:# config.py OPENAI_API_KEY = "your_openai_api_key_here"
Run the main script to evaluate the prompt against the test cases:
python main.py
Contact
For any questions or issues, please contact [brandon14ogola@gmail.com].