mosaicml/mpt-7b-chat

This code demonstrates how to run the mosaicml/mpt-7b-chat model

Deploying on Beam

You can easily deploy the code as web endpoints:

1. Create an account on Beam
2. Download the CLI and Python-SDK. Instructions here.
3. run beam deploy app.py from the working directory.

Example Request

 curl -X POST --compressed "https://beam.slai.io/cjm9u" \
   -H 'Authorization: Basic [ADD_YOUR_AUTH_TOKEN]' \
   -H 'Content-Type: application/json' \
   -d '{"query": "What is up?"}'

Example Response

{"pred":{"output_text":" I'm good and you?"}}