According to the Taiwanese media “Economic Daily”, due to the high heat dissipation requirements of AI chips and servers, following the previous introduction of “immersion cooling and high-efficiency computing computer rooms”, it has recently been reported that it will cooperate with hardware manufacturers such as Colliers, Gigabyte, and Shuanghong to continue to improve high-speed computing heat dissipation.
▲ Picture source Pexels
According to industry analysts, the AI server has a fast computing speed, generates more heat and consumes more energy, and current mainstream cooling technologies cannot meet the requirements. With the average CPU and GPU power consumption jumping from 300W to over 1000W, cooling is more difficult than ever, and liquid cooling is currently the most effective and advanced cooling solution.
At present, there are two mainstream liquid cooling solutions. The first is to use water circulation to enter the body through pumps and pipelines to take away heat. The other is immersion technology, where the heat source (such as a chip) is placed in a non-conductive liquid, thereby removing heat energy.
It was previously reported that TSMC has listed CPU, GPU and AI accelerators and other server chips that perform training and inference functions as AI-related revenue. TSMC has previously mentioned that AI will enter the era of popularization and provide broad technology business opportunities.
According to news from the supply chain, Colliers has confirmed that it has obtained an order for 150 liquid-cooled distributors from TSMC, and other major North American server manufacturers have other cooperation projects in progress. Colliers also stated that NVIDIA is working towards providing immersion warranty for GPU chips, and related experiments are in progress.
In terms of Shuanghong, sources said that the company has a dedicated team to conduct research and development and cooperation with TSMC. The main content is not only the cabinet water cooling solution, but also new technology research and development for semiconductor heat dissipation during the manufacturing process.
Gigabyte has entered TSMC’s cooling supply chain in 2022, providing immersion servers for TSMC’s “immersion cooling and high-efficiency computing computer room”, which has boosted the company’s server performance.