A simple HTTP server using Rust and configuring it to manage HuggingFace text-to-text generator bot.
Due to less resources on hugging face it takes a while for the server to load the request.
- HuggingFace for the ml models
- Rust based server to handle the requests
Note Though it is using gpt2-medium but it can use better models. Link https://huggingface.co/spaces/anujchourasia/gpt2-text-generator