The massive computer clusters powering artificial intelligence consume vast quantities to answer the world’s queries, but how is Big Tech redressing the balance?
Writing a 100-word email using ChatGPT (GPT-4, latest model) consumes 1 x 500ml bottle of water It uses 140Wh of energy, enough for 7 full charges of an iPhone Pro Max
So, the whole debate about “environmental impact of AI” is not about generative AI as such at all.
Really comes down to people using disproportionally large models for simple tasks that could be done just as well by smaller ones, run locally.
Or worse yet, asking a behemoth model like GPT-4 about something that could and should have been a simple search engine query, which I (subjectively) feel has become a trend in everyday tech usage…
Computational demands scale aggressively with model size.
And if you want a response back in a reasonable amount of time you’re burning a ton of power to do so. These models are not fast at all.
Thanks for confirming my suspicion.
So, the whole debate about “environmental impact of AI” is not about generative AI as such at all. Really comes down to people using disproportionally large models for simple tasks that could be done just as well by smaller ones, run locally. Or worse yet, asking a behemoth model like GPT-4 about something that could and should have been a simple search engine query, which I (subjectively) feel has become a trend in everyday tech usage…