Writing a 100-word email using ChatGPT (GPT-4, latest model) consumes 1 x 500ml bottle of water It uses 140Wh of energy, enough for 7 full charges of an iPhone Pro Max
Am I going insane? As far as I know cooling with water doesn’t consume the water, it just cycles through the system again. If anyone knows otherwise PLEASE tell me.
Industrial HVAC systems use water towers to cool the hot side of system. The method relies on physics of evaporative cooling to reduce temperatures of the water. The process requires water to be absorbed by atmosphere, to drive the cooling effect. (Lower the humidity, the higher the cooling efficiency is, as the air as greater potential to absorb and hold moisture).
The method is somewhat similar to power station cooling towers. Or even swamp coolers. (An odd example would be, experimental PC water cooling builds with ‘bong coolers’, which are evaporative coolers, built from drainage pipes)
yea i really don’t know when or why they started measuring electricity in water
Maybe it’s a valid measure in the future, albeit 500ml would be enough to power New York for a day (the state) by means of fusion.
perplexity.ai says that one chat GPT query consumes half a liter of water O_O
im imagining a rack of servers just shooting out a fire hose of water directly into the garbage 24 hours a day
I have read the comments here and all I understand from my small brain is that, because we are using bigger models which are online, for simple tasks, this huge unnecessary power consumption is happening.
So, can the on-device NPUs we are getting on flagship mobile phones solve these problems, as we can do most of those simple tasks offline on-device?
I’ve run an LLM on my desktop GPU and gotten decent results, albeit not nearly as good as what ChatGPT will get you.
Probably used less than 0.1Wh per response.
Is this for inferencing only? Do you include training?
Training is a one time thing. Tge more it get use, the less energy per query it will take
Good point. But considering the frequent retraining, the environmental impacts can only be spread on a finite number of queries.
🥵🥵🥵🔥🔥🔥💦💦💦
These article titles are so crazy. Who thinks of this stuff?
ChatGPT.
Can we PLEASE shut that shit down? We were doing just fine without it.
Billions of people have been using Google for years, and Google has been using artificial intelligence for years. It’s nothing new.
I don’t understand the hate for AI. It’s a new technology that has some teething issues, but it’s only going to get better and more efficient.
Mark my words: generative “AI” is the tech bubble of all tech bubbles.
It’s an infinite supply of “content” in a world of finite demand. While fast, it is incredibly inefficient at creating anything, often including things with dubious quality at best. And finally, there seems to be very little consumer interest in paid-for, commercial generative AI services. A niche group of people are happy to use generative AI while it’s available for free, but once companies start charging for access to services and datasets, the number of people who are interested in paying for it will obviously be significantly smaller.
Last I checked there was more than a TRILLION dollars of investment into generative AI across the US economy, with practically zero evidence of genuinely profitable business models that could ever lead to any return on investment. The entire thing is a giant money pit, and I don’t see any way in which someone doesn’t get left holding the $1,000,000,000,000 generative AI bag.
