lemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · 21 days agoI Put a Datacenter GPU in My Gaming PC for £200blog.tymscar.comexternal-linkmessage-square137linkfedilinkarrow-up1319arrow-down139cross-posted to: localllama@sh.itjust.workslobsters
arrow-up1280arrow-down1external-linkI Put a Datacenter GPU in My Gaming PC for £200blog.tymscar.comlemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · 21 days agomessage-square137linkfedilinkcross-posted to: localllama@sh.itjust.workslobsters
minus-squareranzispa@mander.xyzlinkfedilinkEnglisharrow-up24·21 days ago448 GB/s memory vs 900 GB/s and at a cheaper price.
minus-squaremelfie@lemmy.ziplinkfedilinkEnglisharrow-up3·21 days agoGood point, that should theoretically be double the decode speed, though not sure how the prefill would differ since it’s mainly compute-bound.
448 GB/s memory vs 900 GB/s and at a cheaper price.
Good point, that should theoretically be double the decode speed, though not sure how the prefill would differ since it’s mainly compute-bound.