forked from oobabooga/text-generation-webui
-
Notifications
You must be signed in to change notification settings - Fork 2
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
SD Api Pics extension, v.1.1 (oobabooga#596)
- Loading branch information
Showing
6 changed files
with
282 additions
and
102 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,78 @@ | ||
| ## Description: | ||
| TL;DR: Lets the bot answer you with a picture! | ||
|
|
||
| Stable Diffusion API pictures for TextGen, v.1.1.0 | ||
| An extension to [oobabooga's textgen-webui](https://github.com/oobabooga/text-generation-webui) allowing you to receive pics generated by [Automatic1111's SD-WebUI API](https://github.com/AUTOMATIC1111/stable-diffusion-webui) | ||
|
|
||
| <details> | ||
| <summary>Interface overview</summary> | ||
|
|
||
|  | ||
|
|
||
| </details> | ||
|
|
||
| Load it in the `--chat` mode with `--extension sd_api_pictures` alongside `send_pictures` (it's not really required, but completes the picture, *pun intended*). | ||
|
|
||
| The image generation is triggered either: | ||
| - manually through the 'Force the picture response' button while in `Manual` or `Immersive/Interactive` modes OR | ||
| - automatically in `Immersive/Interactive` mode if the words `'send|main|message|me'` are followed by `'image|pic|picture|photo|snap|snapshot|selfie|meme'` in the user's prompt | ||
| - always on in Picturebook/Adventure mode (if not currently suppressed by 'Suppress the picture response') | ||
|
|
||
| ## Prerequisites | ||
|
|
||
| One needs an available instance of Automatic1111's webui running with an `--api` flag. Ain't tested with a notebook / cloud hosted one but should be possible. | ||
| To run it locally in parallel on the same machine, specify custom `--listen-port` for either Auto1111's or ooba's webUIs. | ||
|
|
||
| ## Features: | ||
| - API detection (press enter in the API box) | ||
| - VRAM management (model shuffling) | ||
| - Three different operation modes (manual, interactive, always-on) | ||
| - persistent settings via settings.json | ||
|
|
||
| The model input is modified only in the interactive mode; other two are unaffected. The output pic description is presented differently for Picture-book / Adventure mode. | ||
|
|
||
| Connection check (insert the Auto1111's address and press Enter): | ||
|  | ||
|
|
||
| ### Persistents settings | ||
|
|
||
| Create or modify the `settings.json` in the `text-generation-webui` root directory to override the defaults | ||
| present in script.py, ex: | ||
|
|
||
| ```json | ||
| { | ||
| "sd_api_pictures-manage_VRAM": 1, | ||
| "sd_api_pictures-save_img": 1, | ||
| "sd_api_pictures-prompt_prefix": "(Masterpiece:1.1), detailed, intricate, colorful, (solo:1.1)", | ||
| "sd_api_pictures-sampler_name": "DPM++ 2M Karras" | ||
| } | ||
| ``` | ||
|
|
||
| will automatically set the `Manage VRAM` & `Keep original images` checkboxes and change the texts in `Prompt Prefix` and `Sampler name` on load. | ||
|
|
||
| --- | ||
|
|
||
| ## Demonstrations: | ||
|
|
||
| Those are examples of the version 1.0.0, but the core functionality is still the same | ||
|
|
||
| <details> | ||
| <summary>Conversation 1</summary> | ||
|
|
||
|  | ||
|  | ||
|  | ||
|  | ||
|
|
||
|
|
||
| </details> | ||
|
|
||
| <details> | ||
| <summary>Conversation 2</summary> | ||
|
|
||
|  | ||
|  | ||
|  | ||
|
|
||
| </details> | ||
|
|
Oops, something went wrong.