In another wild turn for AI chips, Meta signs deal for millions of Amazon AI CPUs - BERITAJA

Amazon conscionable scored a awesome coup pinch Meta thanks, erstwhile again, to Amazon’s ain homegrown chips. Meta has signed a woody to usage millions of AWS Graviton chips to powerfulness its increasing AI needs, Amazon announced Friday.

Note that the AWS Graviton is an ARM-based CPU, (a cardinal processing unit, the spot that handles wide computing tasks) not a GPU (a graphical processing unit).

While GPUs stay the spot of prime for training ample models, erstwhile those models are trained, AI agents built connected apical of them are causing a displacement successful the type of spot is needed. Agents create compute-intensive workloads for illustration real-time reasoning, penning code, search, and the the coordination progressive successful managing agents done multi-step tasks. AWS’s latest type of Graviton was designed specifically to grip AI-related compute needs, the institution says.

This woody brings much of Meta’s rate backmost to AWS alternatively of competitors for illustration Google Cloud. Last August, Meta signed a six year, $10 cardinal woody pinch Google Cloud, though Meta had, until then, chiefly been an AWS customer that besides utilized Microsoft Azure.

We couldn’t thief but announcement that AWS timed the announcement of this woody correct arsenic the Google Cloud Next convention wrapped up, for illustration a virtual smirk astatine its unreality rival. Google, of course, besides makes its ain civilization AI chips and announced caller versions of them astatine the show.

True, Amazon makes its ain AI GPU arsenic well: the Trainium, which, contempt its name, is utilized for some training and conclusion — the shape that happens aft a exemplary is trained, erstwhile it’s actively processing prompts.

But Anthropic had already swooped successful pinch a woody announced earlier this period that commandeered galore of those chips for years to come. The Claude shaper agreed to walk $100 cardinal complete 10 years to tally its workloads connected AWS — pinch a peculiar attraction connected Trainium — while Amazon agreed to put different $5 cardinal (bringing its full to $13 cardinal of investment) into Anthropic successful return.

Ultimately, the Meta woody is allowing Amazon to showcase a immense AI customer arsenic a proving constituent for its homegrown CPUs. These are chips that compete pinch Nvidia’s caller Vera CPU, which is besides ARM-based and designed to grip AI agentic workloads. The difference, of course, is that Nvidia sells its chips and AI systems to enterprises and unreality providers (including AWS). AWS only sells entree to its chips done its unreality service.

Earlier this period Amazon CEO Andy Jassy took purpose astatine Nvidia and Intel successful his yearly shareholder letter, saying that enterprises want amended price-performance ratios for AI, and that he intends to triumph deals connected that basis. This besides intends the unit couldn’t beryllium higher connected Amazon’s soul spot building squad to deliver, a squad that we visited past period successful an exclusive circuit of their lab.