Feat/chatml add system message

[mhenrichsen]

Need ideas on how to change the default system message in the prompter.

[mhenrichsen]

register_conv_template(
    Conversation(
        name="chatml",
        system_template="<|im_start|>system\n{system_message}",
        system_message="You are a helpful assistant.",
        roles=["<|im_start|>user", "<|im_start|>assistant"],
        sep_style=SeparatorStyle.CHATML,
        sep="<|im_end|>",
    )
)

I need help finding a way to change this system_message here, and possibly in all other prompt formats.

[winglian]

@mhenrichsen one option would be in the cli/train.py and cli.preprocess.py to add a call to register the chatml template with the default system message like register_chatml_template(system_message=cfg.default_system_message)

in sharegpt.py wrap the register_conv_template call with :

def register_chatml_template(system_message=None):
    system_message = system_message or "You are a helpful assistant."
    register_conv_template(
        Conversation(
            name="chatml",
            system_template="<|im_start|>system\n{system_message}",
            system_message=system_message,
            roles=["<|im_start|>user", "<|im_start|>assistant"],
            sep_style=SeparatorStyle.CHATML,
            sep="<|im_end|>",
        )
    )
)

[mhenrichsen]

thanks for the fixes @winglian
I had totally forgotten about this :)