At the end of the day, how cheaply and energy efficiently can you generate tokens matters. "Tokens per watt per dollar" metric mentioned by Satya Nadella, CEO of Microsoft, is trying to achieve the same.
This will be a metric by which every LLM is going to be benchmarked against. This is the metric which will showcase how long can an AI investment lasts and how much is your profitability of AI startups.
There will be a comparison of LLMs with "Tokens per watt per dollar" soon, if not already existing.
I would love to hear your thoughts on this?
This is related post by Satya.
If you have not already watched, highly recommend Satya Nadella's AI Tour Keynote: London.
Top comments (0)