A Python package to access different LLMs, embeddings, vector stores etc.

Explore the docs »

View Demo . Report Bug . Request Feature

Table Of Contents

• About the Project
• Features
• Getting Started
  • Prerequisites
  • Installation
• Usage
• Roadmap
• Contributing
• License
• Contact
• Acknowledgements

About The Project

LLM Gateway Core is a Python package that simplifies access to different LLMs, embeddings, vector stores, etc. With the help of credentials (API key, username, password, etc.), you can access any LLM provider with a single package.

Features

Milap comes with a multitude of features:

• Create Google Meetings: Automate the process of scheduling new Google meetings. Customize settings such as date, time, participants, and more.
• Update Existing Meetings: Modify details of scheduled meetings, such as changing the time, adding participants, or updating the agenda.
• Delete Meetings: Provides functionality to cancel meetings, which can be integrated into various applications to handle schedule changes dynamically.
• Fetch Meeting Information: Retrieve details about meetings, including participant lists, meeting times, and links, which can be used for reminders, attendance tracking, and more.

Getting Started

To install Milap, follow these steps:

Prerequisites

1. Python >=3.9

Installation

With pip:

pip install llm-gateway-core

With Poetry:

peotry add llm-gateway-core

Usage

For Synchronous Communication

chat_obj = Chat(
    model_name="groq/gemma2-9b-it",
    sync=False,
    api_key="<api-key>",
)
response = await chat_obj.generate(
    [{"role": "user", "content": "How are you?"}]
)

For Asynchronous Communication

import asyncio
async def main():
    chat_obj = Chat(
        model_name="groq/gemma2-9b-it",
        sync=False,
        api_key="<api-key>",
    )
    response = await chat_obj.generate(
        [{"role": "user", "content": "How are you?"}]
    )
    async for chunk in response:
        print(chunk.choices[0].delta.content, end="")

asyncio.run(main())

Read the Documentation here

Roadmap

See the open issues for a list of proposed features (and known issues).

Contributing

Contributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are greatly appreciated.

• If you have suggestions for adding or removing projects, feel free to open an issue to discuss it, or directly create a pull request after you edit the README.md file with necessary changes.
• Please make sure you check your spelling and grammar.
• Create individual PR for each suggestion.

Creating A Pull Request

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/<feature>)
3. Commit your Changes (git commit -m 'Add some <feature>')
4. Push to the Branch (git push origin feature/<feature>)
5. Open a Pull Request

License

Distributed under the MIT License. See LICENSE for more information.

Contact

Subhomoy Roy Choudhury - Github - Linkedin - Twitter

Project Link: https://github.com/LLM-Gateway-ORG/llm-gateway-core

Acknowledgements

• Poetry
• Beautify Github Readme
• LiteLLM
• Huggingface