hisao@ani.social to Technology@lemmy.worldEnglish · 5 days agogpt-oss: OpenAI releases 2 open-source modelsopenai.comexternal-linkmessage-square8fedilinkarrow-up126arrow-down15cross-posted to: hackernews
arrow-up121arrow-down1external-linkgpt-oss: OpenAI releases 2 open-source modelsopenai.comhisao@ani.social to Technology@lemmy.worldEnglish · 5 days agomessage-square8fedilinkcross-posted to: hackernews
minus-squareJeena@piefed.jeena.netlinkfedilinkEnglisharrow-up14·5 days agoI tried the 20b on my PC with ollama and Open WebUI and I have to say for some of my use cases it preforms similar to the online version, I was impressed.
minus-squareglimse@lemmy.worldlinkfedilinkEnglisharrow-up2·5 days agoWhat card are you running it on?
minus-squareJeena@piefed.jeena.netlinkfedilinkEnglisharrow-up3arrow-down1·5 days agoNvidia rtx 3060 the 12GB Vram one
minus-squareglimse@lemmy.worldlinkfedilinkEnglisharrow-up2·5 days agoNot bad. Does it use all the VRAM?
minus-squareJeena@piefed.jeena.netlinkfedilinkEnglisharrow-up2·4 days agoI need to check with that model but usually yes.
I tried the 20b on my PC with ollama and Open WebUI and I have to say for some of my use cases it preforms similar to the online version, I was impressed.
What card are you running it on?
Nvidia rtx 3060 the 12GB Vram one
Not bad. Does it use all the VRAM?
I need to check with that model but usually yes.