Home โ€บ Blog โ€บ Heat and Water
AI Compute Stack ยท Part 5 ยท Cooling

Heat and Water: How AI Data Centres Keep Cool, and What It Costs

Every watt an AI chip uses becomes heat that has to go somewhere. As racks climb from about 40 kilowatts to a planned 600, air can no longer carry it away, and the industry is rebuilding data centres around liquid. That shift decides how much water and electricity AI consumes, which towns welcome data centres and which fight them, and a new wave of state laws. This guide follows the heat from chip to sky, compares every cooling method, measures AI's water use, and maps the backlash.

FL
FrontierAGI Team
โš ๏ธ How this was researched This draws on web searches run up to 23 October 2026: Lawrence Berkeley National Laboratory's data-centre report, Google and Microsoft disclosures, Data Center Watch, Vertiv filings, state government pages and trade press. Rubin-generation rack power is an estimate (Nvidia has not published it); liquid-cooling adoption shares come from weak market-research sources; some water totals (such as Google's 2025 figure) appear only in secondary reports. The water calculator uses illustrative factors. See Reading the numbers.

๐ŸŒก๏ธ From 40 kW to 600 kW per rack

A rack of Nvidia Hopper servers drew roughly 40 kW. The 72-GPU Blackwell NVL72 rack roughly tripled that, Vera Rubin racks are estimated at around 190โ€“230 kW, and Nvidia's planned Kyber rack for 2027 is about 600 kW, as much as a few hundred homes in a space the size of a wardrobe (see Inside the AI Factory). Air can practically cool only a few tens of kilowatts per rack. Beyond that, fans cannot move enough air through the servers, so the heat must be carried away by liquid.

๐Ÿ“ˆ Rack power by generation

Approximate kilowatts per rack. The dashed line marks where air cooling stops being practical.

Hopper ~40 kW and Kyber ~600 kW from Nvidia and DCD; Blackwell NVL72 ~120 kW widely reported; Vera Rubin NVL72 ~190โ€“230 kW is an analyst estimate (Nvidia has not disclosed it). Air-cooling limit is a common rule of thumb, not a hard threshold.

๐Ÿ” Where the heat goes

Cooling an AI data centre is a relay. Heat moves from the chip into a liquid, from that liquid into the building's water loop, and from there out into the air, sometimes by evaporating water.

๐Ÿงญ Follow the heat: click each stage

โ„๏ธ Cooling methods compared

โš–๏ธ Five ways to cool a rack

Click a method. Ratings are our qualitative summary (more bars = better).

๐Ÿ’ก Why warm water is a big deal Vera Rubin racks are designed for single-phase direct liquid cooling with water supplied at about 45ยฐC. Water that warm can shed its heat through simple dry coolers (big radiators with fans) in most climates, without power-hungry chillers or evaporating water. Hotter liquid loops are how the industry plans to cut both energy and water use as racks get denser.

Estimates of how quickly liquid cooling is spreading are rough: one widely shared figure puts it at about 10% of data centres in 2024 rising to about 30% by the end of 2026, with direct-to-chip the dominant approach for AI. Two-phase immersion, where servers sit in a fluid that boils, took a hit when 3M exited production of PFAS chemicals, including its Novec fluids, by the end of 2025; most new AI deployments use single-phase cold plates instead.

๐Ÿญ The industry behind the pipes

Cooling has become one of the hottest businesses in AI infrastructure. Vertiv, the largest independent supplier of power and thermal equipment, guided 2026 net sales of $13.5โ€“14.0 billion after Q1 sales of $2.65 billion (+30%), and analysts put its order backlog around $15 billion. In 2026 it bought cold-plate designer Strategic Thermal Labs (April) and heat-rejection maker ThermoKey (June). Rivals include Schneider Electric (which bought Motivair), CoolIT, LiquidStack, Boyd and the server makers' own designs; Nvidia's reference designs largely set the specifications everyone builds to.

๐Ÿ’ง How much water does AI really use?

Water figures are confusing because there are two kinds of use:

๐Ÿข Direct (on site)

Water evaporated in cooling towers or used by the facility. Lawrence Berkeley National Laboratory (LBNL) estimates US data centres consumed about 17 billion gallons (โ‰ˆ64 billion litres) directly in 2023, rising to 38โ€“73 billion gallons by 2028.

โšก Indirect (at power plants)

Water evaporated by the thermal and hydro power plants that generate the electricity. LBNL puts this at about 211 billion gallons in 2023, more than ten times the direct figure. Switching to wind and solar cuts it sharply.

At the level of a single request, Google says a median Gemini text prompt uses about 0.26 millilitres of water on site, about five drops. Google's company-wide water consumption was about 8.1 billion gallons in 2024 (other sources give 6.1โ€“7.7 billion depending on scope), and secondary reports cite 10.9 billion gallons for 2025, up 34%, a figure we could not confirm in Google's own report. Google says it replenished 64% of its freshwater consumption in 2024.

๐Ÿ“Š US data-centre water use (LBNL)

Billions of gallons per year.

LBNL 2024 United States Data Center Energy Usage Report, via MOST Policy Initiative and other summaries.

๐Ÿงฎ The water vs energy trade-off

Evaporating water is the most energy-efficient way to reject heat in hot weather, so designs that save water usually use more electricity, and electricity itself uses water at the power plant. Microsoft's "zero-water" design, which recirculates coolant in a closed loop instead of evaporating it, saves more than 125 million litres a year per data centre by Microsoft's estimate, at the cost of a "nominal" increase in energy use; pilots are planned in Phoenix, Arizona and Mount Pleasant, Wisconsin in 2026.

๐ŸŽ›๏ธ Water and energy for an AI campus

Pick a cooling design and power source. All factors are illustrative ranges, not measurements of any site.

Cooling
Power source

Assumed on-site water use (litres per kWh of IT energy): evaporative ~1.8, hybrid ~0.6, closed-loop dry ~0.05. Assumed PUE: 1.15, 1.20, 1.25. Assumed power-plant water (litres per kWh): typical grid mix ~2.0, gas-heavy ~1.0, wind/solar ~0.1. Household: ~1,100 litres a day (US average). Olympic pool: 2.5 million litres.

โ™จ๏ธ Heat as a resource

AI data centres produce vast amounts of low-grade heat. In northern Europe, where cities run district heating networks, that heat is increasingly sold rather than dumped. Liquid cooling helps, because it captures heat at higher temperatures than air.

๐Ÿ˜๏ธ Data-centre heat warming homes

WhereWhoWhatWhen
HelsinkiHelen & OnZeroHeat from a new data centre into the city network; Helen has used data-centre heat since 2010From 2027
CopenhagenatNorth & VestforbrรฆndingDirect-liquid-cooling heat from DEN01 for 8,000+ homesFrom 2028
MilanEquinix & A2A~225 GWh a year via 72 MW of heat pumpsPlanned
BerlinNTT DATAUp to 8 MW of heat for a new districtBy end 2026
DuisburgStadtwerke DuisburgWedau Energy Center lifts data-centre heat to 83ยฐC with heat pumps (~โ‚ฌ14M)Commissioned

Helen (31 Aug 2026), DCD, Baxtel, Silicon UK, Bayern Innovativ. Northern Virginia is studying similar schemes; US cities mostly lack district heating networks.

๐Ÿ“ข The backlash

Water has joined power bills, noise and land use as a reason communities resist data centres. Data Center Watch counted at least 75 projects worth about $130 billion blocked or delayed in the first quarter of 2026, the most on record, and 45 worth about $68 billion in the second quarter, still more than half of the large developments it tracked in that period. The number of active opposition groups more than doubled to 833 across 49 states. The group notes that delays also have other causes, such as utility capacity and regulation.

๐Ÿšง Projects blocked or delayed by local opposition

Data Center Watch Q1 2026 report; Q2 figures via Bloomberg, Tom's Hardware and Newsweek.

๐ŸŒต Case study: Tucson's Project Blue In August 2025 Tucson's city council unanimously rejected bringing Project Blue, a huge Amazon-linked data centre, into city limits after an outcry over water and energy. The developer, Beale Infrastructure, obtained zoning from Pima County instead and said it would build the campus with air cooling rather than water cooling. Local reporting in 2026 said the project still drew some Tucson water. The episode shows both the power of local opposition and how designs change in response.

๐Ÿ›๏ธ The new rules

๐Ÿ“œ Data-centre water rules (2026)

JurisdictionMeasureStatus
UtahHB 76: large data centres (over 10,000 sq ft, drawing 75+ acre-feet a year) must notify the Division of Water Rights and report water useIn force 1 Jul 2026
CaliforniaPackage of laws requiring data centres to report water and electricity use and disclose resource impacts of new projectsSigned 21 Sep 2026
VirginiaNew regulations requiring water-use information (facility details still protected as trade secrets)From January 2027
TexasSenate water committee hearing signalled possible ban on evaporative cooling, monthly reporting and drought plansExpected in 2027 session
Ohio, West VirginiaBills on water disclosure and NDAs; West Virginia's would require annual reporting of withdrawalsPending
FederalBills from Sen. Durbin (March 2026) and Rep. Chip Roy to track data-centre water and energy useIntroduced

Utah Division of Water Rights; Unite.AI and DLA Piper (California); VPM (Virginia); Holland & Knight (Texas); state legislature sites; NGWA; Fox (Roy bill). Data Center Watch reports 30 state legislatures have adopted rules on data-centre siting or resource use.

๐Ÿ•ฐ๏ธ Timeline

2010 ยท Helen begins feeding data-centre waste heat into Helsinki's district heating.
Dec 2022 ยท 3M announces it will exit PFAS manufacturing by the end of 2025, including fluids used in two-phase immersion cooling.
2024 ยท Hopper racks at ~40 kW; Blackwell NVL72 brings liquid cooling to the mainstream. LBNL publishes US data-centre energy and water estimates.
Dec 2024โ€“Jan 2025 ยท Microsoft announces its zero-water-evaporation data-centre design.
Aug 2025 ยท Tucson rejects Project Blue over water and energy concerns.
Mar 2026 ยท GTC: Vera Rubin's 45ยฐC warm-water cooling and the 600 kW Kyber rack. Sen. Durbin introduces a federal water-transparency bill.
Q1 2026 ยท Record 75 projects (~$130B) blocked or delayed by local opposition.
Aprโ€“Jun 2026 ยท Vertiv buys Strategic Thermal Labs and ThermoKey; Microsoft zero-water pilots begin in 2026.
Jul 2026 ยท Utah's data-centre water reporting law takes effect.
Sep 2026 ยท California signs data-centre water and power laws; Texas Senate hearing on data-centre water.

๐Ÿ”ญ What to watch

๐ŸŽฏ The bottom line AI chips now produce more heat per rack than air can remove, so liquid cooling has gone from niche to necessity. That shift is also an opportunity: warm-water liquid loops can reject heat without chillers or evaporation, cutting both energy and water use, and the captured heat can warm homes where district heating exists. But data centres' water use, direct and especially indirect through power plants, is real and concentrated in specific towns, and it has become a central reason for local opposition and new state laws. How AI keeps cool will shape where it can be built.

๐Ÿ”ข Reading the numbers

๐Ÿ“š References