• 0 Posts
  • 7 Comments
Joined 3 years ago
cake
Cake day: August 12th, 2023

help-circle

  • Honestly just jump in with whatever hardware you have available and a small 1.5b/7b model. You’ll figure out all the difficult uncertainties as you go and try to improve things.

    I’m hosting a few lighter models that are somewhat useful and fun without even using a dedicated GPU- just a lot of ram and fast NVMe so the models don’t take forever to spin up.

    Of course I’ve got an upgrade path in mind for the hardware and to add a GPU but there are other places I’d rather put the money atm and I do appreciate that it all currently runs on a 250w PSU.





  • Similar thought to your first paragraph, now that the dust is settling. My best guess is the current US playbook is to risk most of the US soft power and take advantage of its current economic position to really bolster its hard power so the US is in a position to exert more direct force/coerce the rest of the world for what it wants and have more control over policy in other countries. If that’s really the case then china is probably the biggest threat to that gamble as it’s been catching up to or surpassing the US in a few industries recently. And if the gamble fails the economy sinks for a while and Europe or china passes the us as the global powerhouse.