Over the past three years, Volcano Engine president Tan Dai has repeated the same cycle when setting revenue targets for his ...

ByteDance’s Volcano Engine, the cloud unit that released an OpenClaw-based cloud agent tool ArkClaw, is betting that the next phase of artificial intelligence will hinge on cheaper tokens, higher ...

It is almost certainly not a coincidence that a networking expert at Google has risen to the top to be put in charge of the infrastructure development at the search engine, advertising, and now AI ...

In China’s hyper-competitive and lucrative tech industry, releasing cutting-edge artificial intelligence models for free may seem counter-intuitive – but it has become a core business strategy. At the ...

Memory prices are falling, and stock prices of memory companies took a hit, following news from Google Research of a breakthrough that will greatly reduce the amount of memory needed for AI processing ...

When Google unveiled TurboQuant, an AI data compression technology that promises to slash the amount of memory required to serve models, many hoped it would help with a memory shortage that has seen ...

The message from Nvidia chief Jensen Huang at GTC this week is that AI is no longer about models or chips alone, but about monetizing inference at scale – where tokens become the core unit of value, ...

FEATURE By now you've probably heard AI datacenters called factories. It's an apt description: power goes in and tokens come out. Admittedly it's an oversimplified description, but the economics of AI ...

The startup Taalas, founded in Canada in 2023, has announced the HC1, a technology demonstrator that is intended to take AI inference to a new level. Instead of running a language model via software ...

WebLLM is a high-performance in-browser LLM inference engine that brings language model inference directly onto web browsers with hardware acceleration. Everything runs inside the browser with no ...

A pattern is emerging in the AI infrastructure world: popular open source tools are transforming into venture-backed startups worth hundreds of millions of dollars. The latest example is RadixArk, the ...

With that, the AI industry is entering a “new and potentially much larger phase: AI inference,” explains an article on the Morgan Stanley blog. They characterize this phase by widespread AI model ...