Nvidia (NVDA) Stock: Will New Chip Resolve OpenAI’s Frustrations?

Posted on by

TLDR

  • Nvidia is creating a new inference computing platform designed to accelerate AI model execution for OpenAI and other companies.
  • The platform will incorporate a chip from the startup Groq and is scheduled for unveiling at Nvidia’s GTC conference in San Jose next month.
  • OpenAI has expressed dissatisfaction with the speed of Nvidia’s existing hardware for specific tasks, such as software development inquiries.
  • Nvidia entered into a $20 billion licensing agreement with Groq, terminating OpenAI’s independent negotiations with the chip manufacturer.
  • In September, Nvidia pledged up to $100 billion to OpenAI in an arrangement that granted Nvidia an ownership interest in the AI firm.

According to a Wall Street Journal report published Friday, Nvidia is constructing a new processor designed to enhance the speed and efficiency of AI inference.

Inference computing enables AI models such as ChatGPT to answer user questions. This process differs from training, an area where Nvidia has maintained long-standing dominance.

The upcoming platform is anticipated to be announced at Nvidia’s GTC developer conference in San Jose next month. The system will feature a chip developed by the startup Groq.

NVDA Stock Card

Neither Reuters nor Nvidia immediately verified the report. OpenAI likewise declined to reply to a request for comment.

The timing is significant. Reuters reported earlier this month that OpenAI has been dissatisfied with the speed at which Nvidia’s current hardware processes certain workloads, particularly software development tasks and AI-to-AI communication.

OpenAI seeks hardware that could ultimately manage approximately 10% of its inference computing requirements. This represents a portion of the market that Nvidia clearly aims to retain.

OpenAI’s Quest for Accelerated Chips

Prior to Nvidia’s intervention, OpenAI had been negotiating with two chip startups—Cerebras and Groq—to procure faster inference chips.

Those discussions were short-lived. Nvidia secured a $20 billion licensing agreement with Groq, which effectively closed the door on OpenAI’s talks with the startup.

This was a strategic maneuver. By securing Groq, Nvidia prevented a key alternative from reaching OpenAI while simultaneously integrating Groq’s chip technology into its own new platform.

Nvidia’s Wider Investment in OpenAI

The partnership between Nvidia and OpenAI extends beyond mere chip provision.

In September, Nvidia announced plans to invest as much as $100 billion into OpenAI. The agreement granted Nvidia an equity stake in the AI firm and provided OpenAI with capital to purchase more advanced chips.

Thus, Nvidia serves as both supplier and investor—a role that creates strong motivation to maintain OpenAI’s hardware requirements within its ecosystem.

NVDA shares declined 4.16% on February 27, the day prior to this report’s emergence.

If confirmed at GTC next month, the new inference platform would signify Nvidia’s direct reply to increasing pressure from customers requiring faster, more specialized AI processing capabilities.

The inclusion of Groq’s chip in the platform indicates that Nvidia is open to collaborating with startups rather than solely competing against them—at least when such partnerships prevent rivals from accessing its largest customers.

The GTC developer conference is set to take place in San Jose next month, where Nvidia is anticipated to make the official announcement.