There are lots of ways that we might build out the memory capacity and memory bandwidth of compute engines to drive AI and HPC workloads better than we have been able to do thus far. But, as we were reminded in a webinar we recently hosted with experts from Microsoft …
Think of it as the ultimate offload model. One of the geniuses of the cloud – perhaps the central genius – is that a big company that would have a large IT budget, perhaps on the order of hundreds of millions of dollars per year, and that has a certain …
It is beginning to look like chip maker Intel hit the bottom in its products and foundry businesses in the second quarter of this year and that revenues are slowly – we won’t go so far as to say surely – improving. But now the restructuring charges and cost cutting …
The minute that search engine giant Google wanted to be a cloud, and the several years later that Google realized that companies were not ready to buy full-on platform services that masked the underlying hardware but wanted lower level infrastructure services that gave them more optionality as well as more …
Lisu Su has turned in her first ten years at the helm of AMD, and what a hell of a run it has been. The company was a mess when she came on board two years prior to being named chief executive officer, and she took her knowledge of the …
No matter how elegant and clever the design is for a compute engine, the difficulty and cost of moving existing – and sometimes very old – code from the device it currently runs on to that new compute engine is a very big barrier to adoption. This is a particularly …
The third quarter earnings season starts this week for the hyperscaler and cloud giants, and it is fortuitous that the economists and IT analysts at Gartner have updated their forecast for IT spending for 2024 and added an jaw-dropping forecast for 2025 and hinted at a brave new world of …
Featuring highlights, analysis, and stories from the week directly from us to your inbox with nothing in between.
Subscribe now
COMMISSIONED As enterprises increasingly adopt GenAI-powered AI agents, making high-quality data available for these software assistants will come into sharper focus. This is why it’s more important than ever for IT leaders to get their data house in order. Unfortunately, the data houses of most IT shops may be messier …
It was only a few months ago when waferscale compute pioneer Cerebras Systems was bragging that a handful of its WSE-3 engines lashed together could run circles around Nvidia GPU instances based on Nvidia’s “Hopper” H100 GPUs when running the open source Llama 3.1 foundation model created by Meta Platforms. …
Big Blue has reported its financial results for the third quarter of 2024, and the thing that stands out most is not the System z16 mainframes and Power10 midrange and big iron are getting a little long in the tooth ahead of new product cycles expected to start in 2025. …
To AI or to not AI, that is not even a question in 2024. And to need sovereign AI is also not a question. Which is the main reason that we see country after country, and large multinational companies, investing in AI infrastructure in a way that we never did …
With the bottlenecks between compute engines, their memories, and their networking adapters growing larger with each passing generation of AI machinery, there has never been a more pressing need to shift away from copper and towards optics in datacenter systems. In fact, AI is the killer app that those developing …
As the last several years have shown, scaling up AI systems to train larger models with more parameters across more data is a very expensive proposition, and one that has made Nvidia fabulously rich. But putting AI into production in enterprises, whether they are hyperscalers or regular enterprises, is quite …
Every time Lisa Su, chief executive officer at AMD, announces a new Instinct GPU accelerator, the addressable market for AI acceleration in the datacenter seems to expand. But, we observe, the growth rate in the AI datacenter accelerator forecast has slowed even as the ramp rate for AMD and Nvidia …
With a near monopoly on advanced chip manufacturing and packaging, it is no wonder that during the AI boom that the world’s largest foundry is not only making money. But it is a wonder that TSMC is not extracting even more revenue and profits from its customers than it does. …
According to rumors, Nvidia is not expected to deliver optical interconnects for its GPU memory-lashing NVLink protocol until the “Rubin Ultra” GPU compute engine in 2027. And what that means is that everyone designing an accelerator – particularly the ones being designed in house by the hyperscalers and cloud builders …
All Content Copyright The Next Platform
