Dan’s Biz Bookshelf: ‘Believe in Better'
The Big Picture: Our Big ‘Why’ in the Age of AI
The Chemical Connection: Through-glass Vias in Glass Substrates
IBM Expands its AI Accelerator Offerings; Announces Collaboration with AMD
November 18, 2024 | IBMEstimated reading time: 2 minutes
IBM and AMD have announced a collaboration to deploy AMD Instinct MI300X accelerators as a service on IBM Cloud. This offering, which is expected to be available in the first half of 2025, aims to enhance performance and power efficiency for Gen AI models such as and high-performance computing (HPC) applications for enterprise clients. This collaboration will also enable support for AMD Instinct MI300X accelerators within IBM's watsonx AI and data platform, as well as Red Hat® Enterprise Linux® AI inferencing support.
“As enterprises continue adopting larger AI models and datasets, it is critical that the accelerators within the system can process compute-intensive workloads with high performance and flexibility to scale,” said Philip Guido, executive vice president and chief commercial officer, AMD. “AMD Instinct accelerators combined with AMD ROCm software offer wide support including IBM watsonx AI, Red Hat Enterprise Linux AI and Red Hat OpenShift AI platforms to build leading frameworks using these powerful open ecosystem tools. Our collaboration with IBM Cloud will aim to allow customers to execute and scale Gen AI inferencing without hindering cost, performance or efficiency.”
“AMD and IBM Cloud share the same vision around bringing AI to enterprises. We’re committed to bringing the power of AI to enterprise clients, helping them prioritize their outcomes and ensuring they have the power of choice when it comes to their AI deployments,” said Alan Peacock, General Manager of IBM Cloud. “Leveraging AMD’s accelerators on IBM Cloud will give our enterprise clients another option to scale to meet their enterprise AI needs, while also aiming to help them optimize cost and performance.”
IBM and AMD are collaborating to deliver MI300X accelerators as a service on IBM Cloud to support enterprise clients leveraging AI. To help enterprise clients across industries, including those that are heavily regulated, IBM and AMD intend to leverage IBM Cloud’s security and compliance capabilities.
- Support for Large Model Inferencing: Equipped with 192GB of high-bandwidth memory (HBM3), AMD Instinct MI300X accelerators offer support for the largest model inferencing and fine tuning. The large memory capacity can also help customers run larger models with fewer GPUs, potentially lowering costs for inferencing.
- Enhanced Performance and Security: Offering AMD Instinct MI300X accelerators as a service on IBM Cloud Virtual Servers for VPC, as well as through container support with IBM Cloud Kubernetes Service and IBM Red Hat OpenShift on IBM Cloud, can help optimize performance for enterprises running AI applications.
For generative AI inferencing workloads, IBM plans to enable support for AMD instinct MI300X accelerators within IBM's watsonx AI and data platform, providing watsonx clients with additional AI infrastructure resources for scaling their AI workloads across hybrid cloud environments. Additionally, Red Hat Enterprise Linux AI and Red Hat OpenShift AI platforms can run Granite family large language models (LLMs) with alignment tooling using InstructLab on MI300X accelerators.
IBM Cloud with AMD Instinct MI300X accelerators are expected to be generally available in the first half of 2025. Stay tuned for more updates from AMD and IBM in the coming months.
Share on:
Suggested Items
IBM, RIKEN Unveil First IBM Quantum System Two Outside of the U.S.
06/24/2025 | IBMIBM and RIKEN, a national research laboratory in Japan, today unveiled the first IBM Quantum System Two ever to be deployed outside of the United States and beyond an IBM Quantum Data Center.
IBM Officially Closes Deal, Acquiring DataStax
05/30/2025 | I-Connect007On May 28, DataStax announced that its acquisition by IBM had officially closed. The open-source database company based in Santa Clarita, California, announced the deal earlier this year, as part of its vision to accelerate AI production and NoSQL data at scale.
ClassOne Technology, IBM Research Jointly Developing Non-NMP Solvent Processing for Semiconductor Manufacturing
05/26/2025 | ClassOne TechnologyClassOne Technology, a leading global provider of advanced electroplating and wet processing tools for microelectronics manufacturing, announced it has signed a joint development agreement with IBM Research focused on wet processing for advanced packaging.
Deca Announces Agreement with IBM to Bring High-Density Fan-Out Interposer Production to North America
05/20/2025 | Deca TechnologiesDeca Technologies announced the signing of an agreement with IBM to implement Deca’s M-Series™ and Adaptive Patterning® technologies in IBM’s advanced packaging facility in Bromont, Quebec.
Hunting for Clues: Feng Xue Solving Circuit Board 'Crimes' With AOI Standard
05/08/2025 | Linda Stepanich, IPCWhen residents in sleepy English villages needed a top-tier detective to solve a murder, they called on Belgian super-sleuth Hercule Poirot, author Agatha Christie’s fictional detective famous for using his “little grey cells” to solve crimes. In the same way, IPC standards development committees, when creating a standard to detect defects in circuit boards using Automated Optical Inspection (AOI), call on IPC A-Team, Hercule.