HPC
One Small Shop, One Extreme HPC Storage Challenge
Being at the bleeding edge of computing in the life sciences does not always mean operating at extreme scale. …
Lustre
HPC
Bolstering Lustre on ZFS: Highlights of Continuing Work
The Zettabyte File System (ZFS), as a back-end file system to Lustre, has had support in Lustre for a long time. …
HPC
DDN Turns The Crank On “Wolfcreek” Storage
In the high performance computing arena, the stress is always on performance. …
AI
Lustre to DAOS: Machine Learning on Intel’s Platform
Training a machine learning algorithm to accurately solve complex problems requires large amounts of data. …
Control
ARM, Open Source Feed Buzz Around HPC File System
There is but a small cadre of scalable parallel file systems and while the list might be small, weighing the relative benefits of each option against the available resources can be a challenge, as Sven Breuner and his HPC admin colleagues at the Fraunhofer Institute realized in 2004. …
HPC
Improving HPC File System Performance and Data Integrity
The precise point of departure in the history of almost anything of significance – of a country, a company or a technology – is usually imperceptible. …
Enterprise
Panasas Expands Reach Beyond HPC Foundations
For any company in the high performance computing storage market, sixteen years is quite a run. …
AI
Bringing HPC and Hadoop Under the Same Cluster Umbrella
The computational capability of modern supercomputers, matched with the data handling abilities of the Hadoop framework, when done efficiently, creates a best of both worlds opportunity. …
Enterprise
Where is Lustre Finding its Brightest Shine?
Lustre will continue to grow in enterprise settings, but as we have described in part one and part two of this extended series on the state of the HPC-centric file system, it appears it will probably not have a sudden, meteoric rise to the top of the large enterprise list if users are not already invested in high performance computing infrastructure and applications. …
Enterprise
What Stands in the Way of Enterprise Lustre Adoption?
As we described in detail in the previous section of this series on the state of Lustre and the roadmap for the parallel file system, beyond traditional HPC, the file system has some weaknesses for large-scale enterprise shops. …