AMD floats new AI chip to rival Nvidia’s H100 dominance

Getting your Trinity Audio player ready...

Underneath the growing popularity of artificial intelligence (AI), there is a brewing battle among chipmakers, with Nvidia (NASDAQ: NVDA) and Advanced Micro Devices (NASDAQ: AMD) gearing up for a major showdown.

On June 15, AMD launched a new MI300X AI Accelerator chip in a valiant attempt to increase the size of its AI market share. The latest move challenges Nvidia’s dominance in the sector amid the increasing adoption of AI platforms.

AMD hopes to attract firms experimenting with large language models (LLMs) with its 192GB of memory capacity. AMD CEO Lisa Su disclosed that the new chip was specifically built for AI functionality and will be compatible with recent edge models.

“With all of that additional memory capacity, we actually have an advantage for large language models because we can run larger models directly in memory,” Su said.

Large memory capacities are integral for AI chips because training models require deep data volumes. Su remarks that AMG’s new chip will allow researchers to complete tasks faster without additional GPUs.

As proof of its worthiness, the chip’s launch ran the Falcon 40B LLM, with Su hailing the offering as the “first time an LLM of this size can be run entirely in memory.” In addition to the chip, AMD floated a GPU programming software stack to serve as a direct contender with NVIDIA’s CUDA, but it remains unclear if the industry’s giants like Google’s (NASDAQ: GOOGL) Bard will pivot to AMG.

The AI hype has provided a range of benefits for both firms, given the recent valuations of both technology firms. Nvidia hit a $1 trillion valuation, while AMD shares have climbed by 94% since the start of the year, attracting several investors along the way.

OpenAI CEO Sam Altman has indicated a desire to invest in local South Korean chip manufacturers as his firm may be pivoting to Korean chips to supplement supply from Taiwan.

Regulators join the party

Tech firms are not the only ones creating the buzz in AI, with regulators also sending ripples across the ecosystem. After establishing regulation for the digital currency industry, European regulators upped the ante following the greenlight of an overarching AI legal framework seeking to protect users’ privacy and ensure safe usage of the technology.

The proposed legislation is pushing for a regional ban on predictive policing and emotion recognition systems using AI while urging service providers to clearly label AI-generated content. The rules order AI service providers to test-run their proposed platforms in regulatory sandboxes ahead of retail rollouts.

In order for artificial intelligence (AI) to work right within the law and thrive in the face of growing challenges, it needs to integrate an enterprise blockchain system that ensures data input quality and ownership—allowing it to keep data safe while also guaranteeing the immutability of data. Check out CoinGeek’s coverage on this emerging tech to learn more why Enterprise blockchain will be the backbone of AI.

CoinGeek Conversations with Owen Vaughan & Alessio Pagani: Blockchain can bring accountability to AI