OpenAI ditches Nvidia for faster AI inference chips, threatening chipmaker's dominance

Nvidia remains dominant in chips for training large AI models, while inference has become a new front in the competition.

The New Frontier Of LLM Inference: Where The Next Tenfold Gains Will Come From

This brute-force scaling approach is slowly fading and giving way to innovations in inference engines rooted in core computer systems design.
TMCnet

Nokia Strengthens Edge AI Capabilities Through Strategic Collaboration with Blaize on Hybrid Inference Solutions Across Asia Pacific Regions

Under the MOU, Blaize and Nokia intend to collaborate on: ...
VentureBeat

How Snowflake's open-source text-to-SQL and Arctic inference models solve enterprise AI's two biggest deployment headaches

Snowflake has thousands of enterprise customers who use the company's data and AI technologies. Though many issues with generative AI are solved, there is still lots of room for improvement. Two such ...
VentureBeat

The inference crisis: Why AI economics are upside down

As frontier models move into production, they're running up against major barriers like power caps, inference latency, and rising token-level costs, exposing the limits of traditional scale-first ...
ZDNet

Cloud-native computing is poised to explode, thanks to AI inference work

The CNCF is bullish about cloud-native computing working hand in glove with AI. AI inference is the technology that will make hundreds of billions for cloud-native companies. New kinds of AI-first ...