Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Allow overriding GGUF metadata when loading model #4092

Merged
merged 13 commits into from
Dec 5, 2023
Merged

feat: Allow overriding GGUF metadata when loading model #4092

merged 13 commits into from
Dec 5, 2023

Commits on Nov 15, 2023

  1. feat: Allow overriding GGUF metadata when loading model

    @KerfuffleV2
    KerfuffleV2 committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    ba839d1 View commit details
    Browse the repository at this point in the history

  2. Fix the one time GCC is stricter than clang about something

    @KerfuffleV2
    KerfuffleV2 committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    9d39dea View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. Step1

    @KerfuffleV2
    KerfuffleV2 committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    69be5c3 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. Refactor... basically everything!

    @KerfuffleV2
    KerfuffleV2 committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    8c9f776 View commit details
    Browse the repository at this point in the history

  2. Nuke obsolete GetArrayLen struct

    @KerfuffleV2
    KerfuffleV2 committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    1844207 View commit details
    Browse the repository at this point in the history

  3. simplify std::string specialization

    @cebtenzzre
    cebtenzzre committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    dd89015 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2023

  1. Various cleanups 

    Add informational output when overrides are applied

Warn user when an override with the wrong type is specified
    @KerfuffleV2
    KerfuffleV2 committed Nov 18, 2023
    Configuration menu
    Copy the full SHA
    cb5bfe0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into feat-override-metadata

    @KerfuffleV2
    KerfuffleV2 committed Nov 18, 2023
    Configuration menu
    Copy the full SHA
    2147421 View commit details
    Browse the repository at this point in the history

  3. Fix broken logic for parsing bool KV overrides 

    Fix issue where overrides didn't apply when key missing in GGUF metadata
Resolve merge changes
    @KerfuffleV2
    KerfuffleV2 committed Nov 18, 2023
    Configuration menu
    Copy the full SHA
    aa7cf31 View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. Merge branch 'master' into feat-override-metadata

    @KerfuffleV2
    KerfuffleV2 committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    a5b7d72 View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2023

  1. llama : rearrange model params

    @ggerganov
    ggerganov authored Dec 5, 2023
    Configuration menu
    Copy the full SHA
    14e0ba1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into feat-override-metadata

    @KerfuffleV2
    KerfuffleV2 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    a59bf93 View commit details
    Browse the repository at this point in the history

  3. Update new GET_KEY call 

    Add note that metadata KV overrides aren't reflected in initial metadata KV info dump
    @KerfuffleV2
    KerfuffleV2 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    7bbe605 View commit details
    Browse the repository at this point in the history