I'm confused by this because I was involved in various distributed computing projects from about 1997 to about 2001 (as a person running compute notes for them) and from about 2001 to 2019 (as a person helping to administer a distributed computing related prize), and in the early part of that era we routinely talked about idle computer power as "wasted" because of the idea that the computer might as well be used to compute something rather than sitting idle. This may have been very credible in 1990s devices that consumed a roughly comparable amount of power regardless of what specific computation they were performing, but all modern devices have extremely variable power consumption depending on the load. You can easily feel this as devices have fans turn on or get hot when the CPU is loaded, and in many cases you can easily query the CPU with software to find out how its power consumption or clock rate or other factors get adjusted based on computational load.

This means that the idea that idle compute would have gone to waste is just no longer true on modern devices.

Now there is certainly compute that couldn't be sold to a paying cloud customer because it's too fragmented in some sense, but it still has some amount of energy cost, and, in a data center, corresponding cooling cost attributable to the marginal heat production. How can one actually say that there is literally no marginal cost at all? I just can't imagine a device that literally has the same power draw regardless of load factor!

My guess would be https://devin.ai/