Purpose

This is an extension for developers who want to probe the insides of the webui.

Replace bits here and there without waiting those few painfully slow seconds restarting the webui every time you change a line of code.

Caution

Remember to unload the extension and restart the webui before running in production.

How it works

Create a python file or use the existing test_playground.py to write your test code.

The code is automatically imported on save.

Replacing functions

Import the module and function from the webui. For example

# Tools from the extension
from extensions.hot_reload.utils import restore, replace

import modules.text_generation
from modules.text_generation import generate_reply_HF, generate_reply_custom

# Replacement code
def test_generator(*a, **kw):
    output = ''
    for letter in "This is a test.":
        output += letter
        yield output

And use the provided replace function to overwrite it, While keeping a backup of the original code safe!

replace(modules.text_generation, generate_reply_HF, test_generator)
replace(modules.text_generation, generate_reply_custom, test_generator)

Restoring the original behavior

Utilize the restore function to revert to the old behavior without having to restart the webui.

Provide the module, And current function you wish to restore.

import modules.text_generation
from modules.text_generation import generate_reply_HF, generate_reply_custom

restore(modules.text_generation, generate_reply_HF)
restore(modules.text_generation, generate_reply_custom)

Notes

• Feel free to make as many test files as you want. The extensions/hot_reload folder is scanned for changes every couple seconds.
• The extension crashes if an exception occurs in your live files during startup, something to do with threads. (I'm more of an asyncio person, threads are still newish to me!)

Untested areas

• Replacing a class: Will probably work.
• Replacing a function of an object: Should also work since I use setattr.

Installation

Sessions page: Install or update an extension -> https://github.com/Artificiangel/hot_reload

Restart the webui.

Start the webui with --extensions hot_reload

Open the test python file and start editing!