Most Viewed Content:

Vivo X Fold 3 Pro passed 3C certification, with 120W fast charging

A Vivo phone model V2337A recently passed the domestic...

Huawei Enjoy 70z phone released with 6000mAh large battery

Huawei Enjoy 70z phone started pre-sale today, equipped with...

Samsung Galaxy A55 5G photos exposed: 50MP main camera, up to 12GB memory

Source Mukul Sharma recently tweeted, sharing real photos of...

How much does ChatGPT cost? $2-12 million per training for large models

ChatGPT took the world by storm, technology giants have entered the game, and generative AI behind its large model-based artificial intelligence has become the direction of industry investment.

The so-called “big model” is usually trained on a large data set without labeling, using self-supervised learning methods. In other scenarios, developers only need to fine-tune the model or use a small amount of data for secondary training to meet the needs of new application scenarios.

However, training large general-purpose models is very “costly”. According to the report “How much computing power does ChatGPT need”, the cost of a single training session for GPT-3 is estimated to be around $1.4 million, and for some larger LLMs (Large Language Models), the training cost ranges from $2 million to $12 million. With an average of 13 million unique visitors to ChatGPT in January, the corresponding chip requirement is more than 30,000 Nvidia A100 GPUs, with an initial investment cost of about $800 million and a daily electricity cost of about $50,000.

If the current ChatGPT is deployed to every search conducted by Google, 512820.51 A100 HGX servers and a total of 4102568 A100 GPUs are required, and the total cost of these servers and network is over $100 billion in capital expenditure alone.

According to Guosun Securities, training costs in the millions to tens of millions of dollars on the public cloud are not cheap for global technology majors such as Google, but they are within the acceptable range and not expensive.

Latest

Elon Musk: Roadster accelerates from 0-96km/h in less than 1 second

In November 2017, Tesla’s new Roadster was officially released....

Samsung Galaxy A55 5G expected to be released on March 1st with Exynos 1480 chip

Winfuture today announced the specifications of the Samsung Galaxy...

New Audi A7L model will be launched on March 1st, starting from 418,700 RMB

SAIC’s new A7L model will be launched on March...

Realme RMX3993 phone network details released, 720p screen

A Realme phone model RMX3993 released the network access...

Newsletter

Don't miss

Elon Musk: Roadster accelerates from 0-96km/h in less than 1 second

In November 2017, Tesla’s new Roadster was officially released....

Samsung Galaxy A55 5G expected to be released on March 1st with Exynos 1480 chip

Winfuture today announced the specifications of the Samsung Galaxy...

New Audi A7L model will be launched on March 1st, starting from 418,700 RMB

SAIC’s new A7L model will be launched on March...

Realme RMX3993 phone network details released, 720p screen

A Realme phone model RMX3993 released the network access...

Nubia releases Neo 2 5G with sci-fi style appearance, priced from $199

Nubia launched a Neo 2 5G phone at MWC...
Threza Gabriel
Threza Gabrielhttps://www.techgoing.com
Threza Gabriel is a news writer at TechGoing. TechGoing is a global tech media to brings you the latest technology stories, including smartphones, electric vehicles, smart home devices, gaming, wearable gadgets, and all tech trending.

Realme RMX3993 phone network details released, 720p screen

A Realme phone model RMX3993 released the network access map today. The product name is not yet clear, and it is expected to be...

BYD Song Pro / PLUS DM-i Honor Edition will be launched in early March

Bitauto reported that BYD Song Pro DM-i Honor Edition and Song PLUS DM-i Honor Edition will be launched in early March. These two new...

Real photos of Meizu 21 Pro exposed, priced more than 5000 RMB

Li Nan, former senior vice president of Meizu, released real-life photos of Meizu 21 Pro today, revealing that it was originally planned to be...