The reason I dont believe you, is software efficenies are WAY cheaper than a data centre. If they could devlope existing infrastructure to hold the increase of usage like that, then they wouldn’t expand hardware.
You’re just repeating the same point I’ve just addressed, so I’ll explain in more detail.
Data centres expanding is perfectly compatible with huge efficiency gains per token. If the cost of inference falls, companies can afford to run vastly more inference, serve more users, use larger models and embed AI into more products.
It’s the same reason more fuel-efficient cars didn’t eliminate demand for roads or petrol. Efficiency lowers the cost of using something, which can increase total consumption.
So “if software got more efficient, they wouldn’t need more data centres” is basically backwards. The relevant question is whether total AI demand is growing faster than efficiency is improving.
You can find token energy efficiency information studies online, I was smashed when I pulled that figure out of my arse but the numbers are similarly huge.
They’re already orders of magnitude more energy efficient than we predicted just a few years ago and both the software and the hardware continue to accelerate that.
You’re forgetting that usage can still go up while token cost goes down.
Or rather, efficiency and usage can increase at the same time.
The reason I dont believe you, is software efficenies are WAY cheaper than a data centre. If they could devlope existing infrastructure to hold the increase of usage like that, then they wouldn’t expand hardware.
You’re just repeating the same point I’ve just addressed, so I’ll explain in more detail.
Data centres expanding is perfectly compatible with huge efficiency gains per token. If the cost of inference falls, companies can afford to run vastly more inference, serve more users, use larger models and embed AI into more products.
It’s the same reason more fuel-efficient cars didn’t eliminate demand for roads or petrol. Efficiency lowers the cost of using something, which can increase total consumption.
So “if software got more efficient, they wouldn’t need more data centres” is basically backwards. The relevant question is whether total AI demand is growing faster than efficiency is improving.
So your really making the claim that there’s over a 900x demand for AI in the last year?
I’m calling bullshit.
No.
?
When you lock onto something really hard in a discussion like this it becomes very obvious you’re faltering and dont really have much to contribute.
Ypu claimed up above a 900x increase in token efficiency, and claim that demand is outpacing efficiencies.
So yes you are.
I’m calling bullshit on demand outpacing efficiencies in general.
Are you also sayogn there’s over a 900x increase in usage?
Again, citations needed.
You can find token energy efficiency information studies online, I was smashed when I pulled that figure out of my arse but the numbers are similarly huge.
They’re already orders of magnitude more energy efficient than we predicted just a few years ago and both the software and the hardware continue to accelerate that.
Oh I know its getting more efficient, just no where close to 900x. I’m not gonna research for you. You provided the claim, not me.
Yeah I can tell you dont want to look into it, that comes across very clear 😂
Still more than your trust me bro sources.