SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 1 month agoDo you host your own AI?message-squaremessage-square203linkfedilinkarrow-up1182arrow-down142file-text
arrow-up1140arrow-down1message-squareDo you host your own AI?SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 1 month agomessage-square203linkfedilinkfile-text
minus-squareJakeroxs@sh.itjust.workslinkfedilinkEnglisharrow-up5·1 month agoYes, llama-swap and I use it for home assistant text-gen notifications, basic coding tasks, etc If anyone here self-hosts definitely check out llama-swap as it has some nifty features for hotswapping LLMs, image generation models and voice models.
Yes, llama-swap and I use it for home assistant text-gen notifications, basic coding tasks, etc
If anyone here self-hosts definitely check out llama-swap as it has some nifty features for hotswapping LLMs, image generation models and voice models.