Skip to main content Tech Radar Pro Tech Radar Gaming Tech Radar Pro TechRadar the business technology experts Search TechRadar View Profile België (Nederlands) Deutschland North America US (English) Australasia New Zealand Expert Insights Website builders Web hosting Best web hosting Best office chairs Best website builder Best antivirus Expert Insights Recommended reading Microsoft, Google, and Meta have borrowed EV tech for the next big thing in data centers: 1MW watercooled racks I sat down with two cooling experts to find out what AI's biggest problem is in the data center Overheating is a big problem for AI hardware as demand rises - and Dell thinks it might have the answer Seawater’s role in surfing the AI wave One of world's largest oil companies just launched a unique cooling fluid for data centers and AI chips AI workloads are reshaping infrastructure - here’s what data centers need to know Cooling data centers is a multi-billion dollar problem - now researchers want to use a common cooling mechanism found in animals to solve it AWS is working on proprietary innovative cooling tech to use on Nvidia GPUs for now — I wouldn't be surprised if Graviton chips get it as well Wayne Williams 12 July 2025 Existing cooling systems couldn’t scale to AWS’s needs When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works. (Image credit: AWS) AWS built custom Nvidia cooling after rejecting existing liquid solutions for scale IRHX fits into AWS racks without changes to existing infrastructure Amazon could extend this cooling approach to Graviton chips in the future Amazon Web Services (AWS) has introduced a proprietary cooling system built to handle the demands of Nvidia’s newest GPUs. The In-Row Heat Exchanger, or IRHX, was developed in response to the growing power and heat requirements of hardware like the Nvidia GB200 NVL72. AWS evaluated existing liquid cooling solutions but found they didn’t fit the company’s needs. You may like Microsoft, Google, and Meta have borrowed EV tech for the next big thing in data centers: 1MW watercooled racks I sat down with two cooling experts to find out what AI's biggest problem is in the data center Overheating is a big problem for AI hardware as demand rises - and Dell thinks it might have the answer AWS Graviton next? “They would take up too much data center floor space, would still require major modifications to data centers, or increase water usage substantially,” Dave Brown, VP Compute and ML Services at AWS, said in a presentation posted on YouTube, which you can see below. “And while some of these solutions could work for lower volumes at other providers, they simply wouldn't be enough liquid cooling capacity to support our scale.” The IRHX system consists of a pumping unit, a water distribution cabinet, and fan coils. Liquid cools the chips through a cold plate co-designed by AWS and Nvidia, then cycles back through the IRHX, where it is cooled and released. Are you a pro? Subscribe to our newsletter Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed! Contact me with news and offers from other Future brandsReceive email from us on behalf of our trusted partners or sponsorsBy submitting your information you agree to the Terms & Conditions and Privacy Policy and are aged 16 or over. “With the IRHX we don’t need to design the data center around the rack,” Brown said. The system supports AWS’s most powerful EC2 instance, the P6e UltraServer, which includes the GB200 NVL72. This rack-scale setup allows 72 Blackwell GPUs to work together as one unit. Brown said the GB200 NVL72 “enables 72 Nvidia Blackwell GPUs to act as a single massive GPU.” Amazon has previously built custom hardware, including chips and networking systems. The IRHX extends that strategy into cooling, allowing AWS to deploy new GPU racks without redesigning its facilities. The company said the system fits existing rack dimensions and infrastructure, making it scalable across global data centers. While IRHX is currently paired with Nvidia’s Blackwell-based systems, it is likely to be used with Amazon’s own Graviton chips if their cooling needs rise. For now, the system is powering AI workloads that demand both scale and speed. Introducing Amazon EC2 P6e-GB200 UltraServers: Powering Frontier AI at Scale | Amazon Web Services - YouTube You might also like AWS says customers are turning back to on-prem These are best dedicated hosting services you can get right now AWS reveals European Sovereign Cloud to allay fears about US providers Wayne Williams Social Links Navigation Wayne Williams is a freelancer writing news for TechRadar Pro. He has been writing about computers, technology, and the web for 30 years. In that time he wrote for most of the UK’s PC magazines, and launched, edited and published a number of them too. You must confirm your public display name before commenting Please logout and then login again, you will then be prompted to enter your display name. Microsoft, Google, and Meta have borrowed EV tech for the next big thing in data centers: 1MW watercooled racks I sat down with two cooling experts to find out what AI's biggest problem is in the data center Overheating is a big problem for AI hardware as demand rises - and Dell thinks it might have the answer Seawater’s role in surfing the AI wave One of world's largest oil companies just launched a unique cooling fluid for data centers and AI chips AI workloads are reshaping infrastructure - here’s what data centers need to know Latest in Pro I've seen so many amazing deals for business pros and students that don't need a Prime membership over Prime Day that I'm finally calling them out One of the fastest SSDs I've ever seen is on sale in the last few hours of Amazon Prime Day - so be quick This Orico 2TB SSD deal is one of the best I've seen all throughout Prime Day - and I'm sort of annoyed that it won't stay this price when the deals end tonight With this Crucial 8TB SSD deal, I have absolutely no excuse not to take and store as many photos as I possibly can How to build and manage an integrated patient pathway Researcher tricks ChatGPT into revealing security keys - by saying "I give up" Latest in News The Samsung Galaxy S26 Ultra is rumored to be be getting a major camera upgrade You can finally preorder the Oakley Meta smart glasses, but there's a catch Squid Game: The Challenge season 3 is a win for Netflix, but one unhinged game from the K-drama can’t be replicated ICYMI: the 8 biggest tech stories of the week, from Prime Day deals to Samsung's shiny new foldables Intel CEO reportedly admits 'it is too late for us' to catch AI leaders like Nvidia, but here's how it could still recover Tracy Ifeachor exits The Pitt as Dr. Collins in shock casting shakeup, and that’s bad news for season 2 of the hit HBO Max show LATEST ARTICLES While Prime Day was causing a fuss, the best laptop deal was quietly at Dell the entire time The Samsung Galaxy S26 Ultra is rumored to be be getting a major camera upgrade Good news: worldwide PC shipments are up. Bad news: it's due to the Windows 10 end of life and business upgrades Electric cars can be fun – the 6 hottest new EVs from the Goodwood Festival of Speed 2025 Missed your chance to buy a MacBook this Prime Day? Fear not, the best deals weren't even at Amazon TechRadar is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site. Contact Future's experts Terms and conditions Privacy policy Cookies policy Advertise with us Web notifications Accessibility Statement Future US, Inc. Full 7th Floor, 130 West 42nd Street, Please login or signup to comment Please wait...