• irate944@piefed.social
    link
    fedilink
    English
    arrow-up
    3
    ·
    7 hours ago

    That is a bit too much for your hardware, even the Q4_0. You needed a smaller version (26B likely would suit you better. It would be faster and is a MoE)