Jen-Hsun Huang, president and chief government officer of Nvidia Corp., pronounces the EGX Edge Supercomputing Platform throughout the firm’s occasion at Mobile World Congress Americas in Los Angeles, California, Oct. 21, 2019.
Patrick T. Fallon | Bloomberg | Getty Images
Nvidia’s most-advanced graphics playing cards are promoting for greater than $40,000 on eBay, as demand soars for chips wanted to coach and deploy synthetic intelligence software program.
The costs for Nvidia’s H100 processors had been famous by 3D gaming pioneer and former Meta consulting expertise chief John Carmack on Twitter. On Friday, at the least eight H100s had been listed on eBay at costs starting from $39,995 to simply beneath $46,000. Some retailers have provided it prior to now for round $36,000.
The H100, introduced final 12 months, is Nvidia’s newest flagship AI chip, succeeding the A100, a roughly $10,000 chip that is been referred to as the “workhorse” for AI functions.
Developers are utilizing the H100 to construct so-called giant language fashions (LLMs), that are on the coronary heart of AI functions like OpenAI’s ChatGPT. Running these methods is pricey and requires highly effective computer systems to churn via terabytes of information for days or even weeks at a time. They additionally depend on hefty computing energy so the AI mannequin can generate textual content, photographs or predictions.
Training AI fashions, particularly giant ones like GPT, requires a whole lot of high-end Nvidia GPUs working collectively.
Microsoft spent a whole lot of tens of millions of {dollars} on tens of 1000’s of Nvidia A100 chips to assist construct ChatGPT. Nvidia controls the overwhelming majority of the marketplace for AI chips.
Nvidia additionally presents a supercomputer with eight GPUs working collectively referred to as the DGX. Earlier this 12 months, the corporate introduced new providers that might permit firms to lease entry to DGX computer systems for $37,000 monthly. At that worth, the system would use Nvidia’s older A100 processors.
Nvidia says the H100 is the primary chip to be optimized for the precise AI structure underpinning lots of the latest advances in AI, referred to as transformers. Industry consultants say the extra highly effective chips might be obligatory to construct even larger and extra data-hungry fashions than these which might be at present accessible.
WATCH: Google chip manufacturing takes purpose at Nvidia’s generative A.I.
Source: www.cnbc.com”