AI
The Datacenter Is The Accelerator
There is a fractal nature in modern computing that is only becoming more and more apparent as workloads have long since outstripped the capacity of a single server. …
Meta Platforms
AI
Cerebras Trains Llama Models To Leap Over GPUs
It was only a few months ago when waferscale compute pioneer Cerebras Systems was bragging that a handful of its WSE-3 engines lashed together could run circles around Nvidia GPU instances based on Nvidia’s “Hopper” H100 GPUs when running the open source Llama 3.1 foundation model created by Meta Platforms. …
AI
Meta Lets Its Largest Llama AI Model Loose Into The Open Field
A scant three months ago, when Meta Platforms released the Llama 3 AI model in 8B and 70B versions, which correspond to the billions of parameters they can span, we asked the question we ask of every open source tool or platform since the dawn of Linux: Who’s going to profit from it and how are they going to do it? …
Store
The Perfect AI Storage: Trino From Facebook And Iceberg From Netflix?
When it comes to solving data analytics problems at scale, it is tough to beat the hyperscalers. …
AI
With MTIA v2 Chip, Meta Can Do AI Inference, But Not Training
If you control your code base and you have only a handful of applications that run at massive scale – what some have called hyperscale – then you, too, can win the Chip Jackpot like Meta Platforms and a few dozen companies and governments in the world have. …
AI
Inside The Massive GPU Buildout At Meta Platforms
If you handle hundreds of trillions of AI model executions per day, and are going to change that by one or two orders of magnitude as GenAI goes mainstream, you are going to need GPUs. …
Connect
Meta Platforms Is Determined To Make Ethernet Work For AI
We said it from the beginning: There is no way that Meta Platforms, the originator of the Open Compute Project, wanted to buy a complete supercomputer system from Nvidia in order to advance its AI research and move newer large language models and recommendation engines into production. …
Connect
Ethernet Consortium Shoots For 1 Million Node Clusters That Beat InfiniBand
Here we go again. Some big hyperscalers and cloud builders and their ASIC and switch suppliers are unhappy about Ethernet, and rather than wait for the IEEE to address issues, they are taking matters in their own hands to create what will ultimately become an IEEE standard that moves Ethernet forward in a direction and speed of their choosing. …
AI
The Balancing Act Of Training Generative AI
We learn a lot of lessons from the hyperscalers and HPC centers of the world, and one of them is that those who control their own software control their own fates. …
AI
Meta Platforms Crafts Homegrown AI Inference Chip, AI Training Next
As we pointed out a year ago when some key silicon experts were hired from Intel and Broadcom to come work for Meta Platforms, the company formerly known as Facebook was always the most obvious place to do custom silicon. …