Most Viewed Content:

BYD Seal / Seal Champion Edition models get OTA upgrade added super iTAC and other functions

BYD Auto announced that its Seal, Seal Champion Edition...

India’s censorship body gave power to remove pirated Movies from platforms

India’s Ministry of Information and Broadcasting announced that its...

Google to bring PWA application backup & restore function for Chrome/android

According to thespAndroid reports, GitHub's Chromium repository recently added...

How much does ChatGPT cost? $2-12 million per training for large models

ChatGPT took the world by storm, technology giants have entered the game, and generative AI behind its large model-based artificial intelligence has become the direction of industry investment.

The so-called “big model” is usually trained on a large data set without labeling, using self-supervised learning methods. In other scenarios, developers only need to fine-tune the model or use a small amount of data for secondary training to meet the needs of new application scenarios.

However, training large general-purpose models is very “costly”. According to the report “How much computing power does ChatGPT need”, the cost of a single training session for GPT-3 is estimated to be around $1.4 million, and for some larger LLMs (Large Language Models), the training cost ranges from $2 million to $12 million. With an average of 13 million unique visitors to ChatGPT in January, the corresponding chip requirement is more than 30,000 Nvidia A100 GPUs, with an initial investment cost of about $800 million and a daily electricity cost of about $50,000.

If the current ChatGPT is deployed to every search conducted by Google, 512820.51 A100 HGX servers and a total of 4102568 A100 GPUs are required, and the total cost of these servers and network is over $100 billion in capital expenditure alone.

According to Guosun Securities, training costs in the millions to tens of millions of dollars on the public cloud are not cheap for global technology majors such as Google, but they are within the acceptable range and not expensive.

Latest

Samsung Galaxy S25 rumored to come with a 6.36-inch screen

The source yeux1122 recently published a blog post stating...

Elon Musk: Next-gen Tesla Roadster with rocket technology will go beyond car concepts

Tesla CEO Elon Musk recently talked about the much-anticipated...

Realme GT Neo 6 SE line drawing exposed, horizontal matrix lens design

Blogger @digitalchat.com today announced the line drawing of the...

New Alfa Romeo Giulia to launch in 2026

The current generation of Alfa Romeo Giulia was officially...

Newsletter

Don't miss

Samsung Galaxy S25 rumored to come with a 6.36-inch screen

The source yeux1122 recently published a blog post stating...

Elon Musk: Next-gen Tesla Roadster with rocket technology will go beyond car concepts

Tesla CEO Elon Musk recently talked about the much-anticipated...

Realme GT Neo 6 SE line drawing exposed, horizontal matrix lens design

Blogger @digitalchat.com today announced the line drawing of the...

New Alfa Romeo Giulia to launch in 2026

The current generation of Alfa Romeo Giulia was officially...

Ford Developing Compact EV: $25K, Lithium Iron Phosphate Batteries

According to a report by Bloomberg Businessweek today, Ford...
Threza Gabriel
Threza Gabrielhttps://www.techgoing.com
Threza Gabriel is a news writer at TechGoing. TechGoing is a global tech media to brings you the latest technology stories, including smartphones, electric vehicles, smart home devices, gaming, wearable gadgets, and all tech trending.

Skoda Epiq EV official images released, adopting a new design style

The Skoda Epiq official photo was officially released. The car is a small pure electric SUV, which can be regarded as the pure electric...

Xiaomi Auto’s top-end version of SU7 is priced at over 300,000 RMB

According to the Science and Technology Innovation Board Daily, Xiaomi Motors SU7 is currently available in two versions, including a standard version and a...

Luxury electric performance car Cadillac new concept car preview

Cadillac has currently launched three new pure electric models, namely the expensive and more symbolic Celestiq, the medium and large SUV model IQ Ruige,...