Models: Add Nous-Hermes-2-Mistral-7B-DPO.Q4_0.gguf

[ThiloteE]

Adds Nous-Hermes-2-Mistral-7B-DPO.Q4_0.gguf, which is the new 7b flagship model of NousResearch, to models3.json.

Original Model location:

https://huggingface.co/NousResearch/Nous-Hermes-2-Mistral-7B-DPO-GGUF

Model description:

Nous Hermes 2 on Mistral 7B DPO is the new flagship 7B Hermes! This model was DPO'd from Teknium/OpenHermes-2.5-Mistral-7B and has improved across the board on all benchmarks tested - AGIEval, BigBench Reasoning, GPT4All, and TruthfulQA.

The model prior to DPO was trained on 1,000,000 instructions/chats of GPT-4 quality or better, primarily synthetic data as well as other high quality datasets, available from the repository teknium/OpenHermes-2.5.

Original Dataset Location:

https://huggingface.co/datasets/teknium/OpenHermes-2.5

Dataset description:

This is the dataset that made OpenHermes 2.5 and Nous Hermes 2 series of models.

The Open Hermes 2/2.5 and Nous Hermes 2 models have made significant advancements of SOTA LLM's over recent months, and are underpinned by this exact compilation and curation of many open source datasets and custom created synthetic datasets.

The Open Hermes 2.5 dataset is a continuation of the Open Hermes 1 dataset, at a much larger scale, much more diverse, and much higher quality compilation, reaching 1M, primarily synthetically generated instruction and chat samples.

Describe your changes

Issue ticket number and link

Checklist before requesting a review

• I have performed a self-review of my code.
• If it is a core feature, I have added thorough tests.
• I have added thorough documentation for my code.
• I have tagged PR with relevant project labels. I acknowledge that a PR without labels may be dismissed.
• If this PR addresses a bug, I have provided both a screenshot/video of the original bug and the working solution.

Screenshots

Notes

• I inspected the OpenHermes-2.5 dataset, which to 99.9% does not contain any system prompts, so this is a model that should work really well with various system prompts.
• sideloaded and tested a little (nothing extensive) on Windows 10 with Nvidia 1060 3GB and AMD Ryzen 5 5600 with GPT4All 2.7.1

[Titaniumtown]

Been using this model for a bit now. Big improvement over OpenOrca.