Interface ModelSource

interface ModelSource {
    mmprojUrl?: string;
    url: string;
}

Properties

Properties

mmprojUrl?: string
url: string

URL to the GGUF file. If the model is splitted, pass the URL to the first shard. Mmproj file should also be provided via this array if you want to use multimodal.