Interface HuggingFaceParams

interface HuggingFaceParams {
    file?: string;
    hfToken?: string;
    mmprojFile?: string;
    mmprojQuant?: string;
    quant?: string;
    repo: string;
}

Properties

file? hfToken? mmprojFile? mmprojQuant? quant? repo

Properties

Optionalfile

file?: string

The file name or path to file in the repo. Only file or quant is needed.

OptionalhfToken

hfToken?: string

The Hugging Face token with permission to access the repo. It can be omitted if the repo is public.

OptionalmmprojFile

mmprojFile?: string

The file name or path to file in the repo for mmproj. Only mmprojFile or mmprojQuant is needed.

OptionalmmprojQuant

mmprojQuant?: string

The GGUF quantization name for mmproj, e.g. Q4_K_M, Q8_0, etc. Only mmprojFile or mmprojQuant is needed.

Optionalquant

quant?: string

The GGUF quantization name, e.g. Q4_K_M, Q8_0, etc. Only file or quant is needed.

By default, Q4_K_M will be used, then fallback to Q8_0, and finally the non-quantized version if no quantized version is found.

repo

repo: string

The repo name, e.g. user/model

Settings

Member Visibility

On This Page

Properties