$Advanced Micro Devices(AMD)$ Taalas has built a chip with a single AI model wired directly into its metal layers, with no programmability at all, so one part runs one model and nothing else. In the public demo it returns a complete answer in about 33 milliseconds, which works out at roughly 14,200 tokens per second for one user, where an H200 sits nearer 230. When the company came out of stealth, plenty of people wrote the approach off, because a chip locked to a single model looks obsolete as soon as the model changes, and nobody had answered that objection. Then, three hours before I recorded this, AMD signed an agreement to acquire them, which tells you somebody at AMD has worked out where a fixed-function inference part sits alongside Instinct, EPYC and the Xilinx silicon. I've got the announcement, the numbers behind the demo, and a fair idea of what they're planning. Taalas is a game changer.
Disclaimer: Investing carries risk. This is not financial advice. The above content should not be regarded as an offer, recommendation, or solicitation on acquiring or disposing of any financial products, any associated discussions, comments, or posts by author or other users should not be considered as such either. It is solely for general information purpose only, which does not consider your own investment objectives, financial situations or needs. TTM assumes no responsibility or warranty for the accuracy and completeness of the information, investors should do their own research and may seek professional advice before investing.
Comments