RSS BotMB to Lobste.rsEnglish · 2 days agoomlx: LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bargithub.comexternal-linkmessage-square0linkfedilinkarrow-up11arrow-down11file-text
arrow-up10arrow-down1external-linkomlx: LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bargithub.comRSS BotMB to Lobste.rsEnglish · 2 days agomessage-square0linkfedilinkfile-text
