Lemmy: Bestiverse
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
RSS BotMB to Hacker NewsEnglish · 5 days ago

You can now train a 70B language model at home

www.answer.ai

external-link
message-square
5
fedilink
6
external-link

You can now train a 70B language model at home

www.answer.ai

RSS BotMB to Hacker NewsEnglish · 5 days ago
message-square
5
fedilink
You can now train a 70b language model at home – Answer.AI
www.answer.ai
external-link
We’re releasing an open source system, based on FSDP and QLoRA, that can train a 70b model on two 24GB GPUs.

Comments

alert-triangle
You must log in or register to comment.
  • fubarx@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    5 days ago

    They’re using fine-tuning on top of existing models. Still useful, but the headline implies creating foundation models, which is still the domain of big iron.

  • insufferableninja@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    2
    ·
    5 days ago

    And yet, I still won’t

  • Noxy@pawb.social
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 days ago

    The fuck does 70B mean? 70 bytes?

    • howrar@lemmy.ca
      link
      fedilink
      English
      arrow-up
      6
      ·
      edit-2
      5 days ago

      70 billion parameters. It’s standard notation in the context of LLMs.

  • Kairos@lemmy.today
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 days ago

    “Can”

Hacker News

hackernews

Subscribe from Remote Instance

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !hackernews@lemmy.bestiver.se
lock
Community locked: only moderators can create posts. You can still comment on posts.

Posts from the RSS Feed of HackerNews.

The feed sometimes contains ads and posts that have been removed by the mod team at HN.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 603 users / day
  • 1.86K users / week
  • 4.04K users / month
  • 9.38K users / 6 months
  • 2 local subscribers
  • 2.18K subscribers
  • 27.1K Posts
  • 10.4K Comments
  • Modlog
  • mods:
  • patrick
  • RSS Bot
  • BE: 0.19.5
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org