In a press conference this week on New York City’s $12 billion budget gap, Mayor Zohran Mamdani zeroed in on the previous administration’s artificial intelligence chatbot as one of “a number of different things we’re going to pursue for savings.”

  • WorldsDumbestMan@lemmy.today
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    23
    ·
    8 hours ago

    Good luck arguing that my local AI models are harming Earth.

    Yes, you can argue phones themselves/lightbulbs harm Earth. I don’t care at that scale.

    • Eximius@lemmy.world
      link
      fedilink
      English
      arrow-up
      22
      ·
      edit-2
      6 hours ago

      Are you perchance ignoring the petawatt-hours that were needed to train and distil your local AI model?

      • WorldsDumbestMan@lemmy.today
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 minutes ago

        Yes, it is already developed. Nuclear bombs killed people, does not mean we should stop all research into fusion.

        Me downloading the model does not light up a data center somewhere else. I run it on my local laptop.

    • Kokesh@lemmy.world
      link
      fedilink
      English
      arrow-up
      13
      ·
      7 hours ago

      Oh, you’re right. Everything being plugged into massive datacenters that use more power than whole countries is ok, because your computer somehow doesn’t use much power per query. I stand corrected, sir.

    • Dremor@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      ·
      edit-2
      6 hours ago

      A model being local doesn’t make it magically better than cloud based ones. Especially since your local hardware may not be as optimized as professional hardware.

      And I say that as a local AI user.

      The way to make it less harmful mainly comes from external factors :

      • The origin of the electricity (renewable)
      • Shift consumption to a time of low demand (or use a residential battery)
      • Use specific hardware for specific tasks (use less energy per token)

      Edit:

      I’d add to that that you can reuse the heat generated to heat your apartment. But it only works during winter, as during summer any heat generated will make your AC (if you have one) work harder.