Heat and Water: How AI Data Centres Keep Cool, and What It Costs
Every watt an AI chip uses becomes heat that has to go somewhere. As racks climb from about 40 kilowatts to a planned 600, air can no longer carry it away, and the industry is rebuilding data centres around liquid. That shift decides how much water and electricity AI consumes, which towns welcome data centres and which fight them, and a new wave of state laws. This guide follows the heat from chip to sky, compares every cooling method, measures AI's water use, and maps the backlash.
๐ก๏ธ From 40 kW to 600 kW per rack
A rack of Nvidia Hopper servers drew roughly 40 kW. The 72-GPU Blackwell NVL72 rack roughly tripled that, Vera Rubin racks are estimated at around 190โ230 kW, and Nvidia's planned Kyber rack for 2027 is about 600 kW, as much as a few hundred homes in a space the size of a wardrobe (see Inside the AI Factory). Air can practically cool only a few tens of kilowatts per rack. Beyond that, fans cannot move enough air through the servers, so the heat must be carried away by liquid.
๐ Rack power by generation
Approximate kilowatts per rack. The dashed line marks where air cooling stops being practical.
Hopper ~40 kW and Kyber ~600 kW from Nvidia and DCD; Blackwell NVL72 ~120 kW widely reported; Vera Rubin NVL72 ~190โ230 kW is an analyst estimate (Nvidia has not disclosed it). Air-cooling limit is a common rule of thumb, not a hard threshold.
๐ Where the heat goes
Cooling an AI data centre is a relay. Heat moves from the chip into a liquid, from that liquid into the building's water loop, and from there out into the air, sometimes by evaporating water.
๐งญ Follow the heat: click each stage
โ๏ธ Cooling methods compared
โ๏ธ Five ways to cool a rack
Click a method. Ratings are our qualitative summary (more bars = better).
Estimates of how quickly liquid cooling is spreading are rough: one widely shared figure puts it at about 10% of data centres in 2024 rising to about 30% by the end of 2026, with direct-to-chip the dominant approach for AI. Two-phase immersion, where servers sit in a fluid that boils, took a hit when 3M exited production of PFAS chemicals, including its Novec fluids, by the end of 2025; most new AI deployments use single-phase cold plates instead.
๐ญ The industry behind the pipes
Cooling has become one of the hottest businesses in AI infrastructure. Vertiv, the largest independent supplier of power and thermal equipment, guided 2026 net sales of $13.5โ14.0 billion after Q1 sales of $2.65 billion (+30%), and analysts put its order backlog around $15 billion. In 2026 it bought cold-plate designer Strategic Thermal Labs (April) and heat-rejection maker ThermoKey (June). Rivals include Schneider Electric (which bought Motivair), CoolIT, LiquidStack, Boyd and the server makers' own designs; Nvidia's reference designs largely set the specifications everyone builds to.
๐ง How much water does AI really use?
Water figures are confusing because there are two kinds of use:
๐ข Direct (on site)
Water evaporated in cooling towers or used by the facility. Lawrence Berkeley National Laboratory (LBNL) estimates US data centres consumed about 17 billion gallons (โ64 billion litres) directly in 2023, rising to 38โ73 billion gallons by 2028.โก Indirect (at power plants)
Water evaporated by the thermal and hydro power plants that generate the electricity. LBNL puts this at about 211 billion gallons in 2023, more than ten times the direct figure. Switching to wind and solar cuts it sharply.At the level of a single request, Google says a median Gemini text prompt uses about 0.26 millilitres of water on site, about five drops. Google's company-wide water consumption was about 8.1 billion gallons in 2024 (other sources give 6.1โ7.7 billion depending on scope), and secondary reports cite 10.9 billion gallons for 2025, up 34%, a figure we could not confirm in Google's own report. Google says it replenished 64% of its freshwater consumption in 2024.
๐ US data-centre water use (LBNL)
Billions of gallons per year.
LBNL 2024 United States Data Center Energy Usage Report, via MOST Policy Initiative and other summaries.
๐งฎ The water vs energy trade-off
Evaporating water is the most energy-efficient way to reject heat in hot weather, so designs that save water usually use more electricity, and electricity itself uses water at the power plant. Microsoft's "zero-water" design, which recirculates coolant in a closed loop instead of evaporating it, saves more than 125 million litres a year per data centre by Microsoft's estimate, at the cost of a "nominal" increase in energy use; pilots are planned in Phoenix, Arizona and Mount Pleasant, Wisconsin in 2026.
๐๏ธ Water and energy for an AI campus
Pick a cooling design and power source. All factors are illustrative ranges, not measurements of any site.
Assumed on-site water use (litres per kWh of IT energy): evaporative ~1.8, hybrid ~0.6, closed-loop dry ~0.05. Assumed PUE: 1.15, 1.20, 1.25. Assumed power-plant water (litres per kWh): typical grid mix ~2.0, gas-heavy ~1.0, wind/solar ~0.1. Household: ~1,100 litres a day (US average). Olympic pool: 2.5 million litres.
โจ๏ธ Heat as a resource
AI data centres produce vast amounts of low-grade heat. In northern Europe, where cities run district heating networks, that heat is increasingly sold rather than dumped. Liquid cooling helps, because it captures heat at higher temperatures than air.
๐๏ธ Data-centre heat warming homes
| Where | Who | What | When |
|---|---|---|---|
| Helsinki | Helen & OnZero | Heat from a new data centre into the city network; Helen has used data-centre heat since 2010 | From 2027 |
| Copenhagen | atNorth & Vestforbrรฆnding | Direct-liquid-cooling heat from DEN01 for 8,000+ homes | From 2028 |
| Milan | Equinix & A2A | ~225 GWh a year via 72 MW of heat pumps | Planned |
| Berlin | NTT DATA | Up to 8 MW of heat for a new district | By end 2026 |
| Duisburg | Stadtwerke Duisburg | Wedau Energy Center lifts data-centre heat to 83ยฐC with heat pumps (~โฌ14M) | Commissioned |
Helen (31 Aug 2026), DCD, Baxtel, Silicon UK, Bayern Innovativ. Northern Virginia is studying similar schemes; US cities mostly lack district heating networks.
๐ข The backlash
Water has joined power bills, noise and land use as a reason communities resist data centres. Data Center Watch counted at least 75 projects worth about $130 billion blocked or delayed in the first quarter of 2026, the most on record, and 45 worth about $68 billion in the second quarter, still more than half of the large developments it tracked in that period. The number of active opposition groups more than doubled to 833 across 49 states. The group notes that delays also have other causes, such as utility capacity and regulation.
๐ง Projects blocked or delayed by local opposition
Data Center Watch Q1 2026 report; Q2 figures via Bloomberg, Tom's Hardware and Newsweek.
๐๏ธ The new rules
๐ Data-centre water rules (2026)
| Jurisdiction | Measure | Status |
|---|---|---|
| Utah | HB 76: large data centres (over 10,000 sq ft, drawing 75+ acre-feet a year) must notify the Division of Water Rights and report water use | In force 1 Jul 2026 |
| California | Package of laws requiring data centres to report water and electricity use and disclose resource impacts of new projects | Signed 21 Sep 2026 |
| Virginia | New regulations requiring water-use information (facility details still protected as trade secrets) | From January 2027 |
| Texas | Senate water committee hearing signalled possible ban on evaporative cooling, monthly reporting and drought plans | Expected in 2027 session |
| Ohio, West Virginia | Bills on water disclosure and NDAs; West Virginia's would require annual reporting of withdrawals | Pending |
| Federal | Bills from Sen. Durbin (March 2026) and Rep. Chip Roy to track data-centre water and energy use | Introduced |
Utah Division of Water Rights; Unite.AI and DLA Piper (California); VPM (Virginia); Holland & Knight (Texas); state legislature sites; NGWA; Fox (Roy bill). Data Center Watch reports 30 state legislatures have adopted rules on data-centre siting or resource use.
๐ฐ๏ธ Timeline
๐ญ What to watch
- Kyber and 600 kW racks in 2027: whether facilities can deliver and cool them at scale.
- Warm-water and dry cooling replacing evaporative towers in hot, dry regions.
- Texas' 2027 legislative session and whether other states ban or restrict evaporative cooling.
- Disclosure: the first data published under Utah's and California's laws.
- Opposition trends in Data Center Watch's next reports.
- Heat reuse outside Europe, starting with Northern Virginia's studies.
๐ข Reading the numbers
- Rack power for Vera Rubin (~190โ230 kW) is an analyst estimate; Nvidia has not published it. Kyber's ~600 kW is a planned figure.
- Liquid-cooling adoption (10% โ 30%) comes from weak market-research sources.
- LBNL water figures are model-based estimates for 2023 and projections for 2028.
- Google's 2025 water figure (10.9B gallons) appears only in secondary sources; earlier figures vary by scope.
- Microsoft's savings (125M litres per data centre a year) are the company's own estimate.
- Opposition counts are Data Center Watch's tallies; attribution of delays to opposition alone is debated.
- The calculator uses illustrative factors; real sites vary hugely with climate and design.
๐ References
- Cooling technology and industry
- Network World: Why AI rack densities make liquid cooling nonnegotiable
- DCD: Nvidia's Jensen Huang, Ian Buck and Charlie Boyle on rack density
- IES: From data centres to AI factories โ GTC 2026 explained
- Teradata Labs: The data centre isn't ready
- Vertiv Q1 2026 results (8-K)
- Seeking Alpha: Vertiv's $15 billion backlog
- Water
- MOST Policy Initiative: Data centre water use (LBNL figures)
- Britannica: Why do AI data centres need so much water?
- Latitude Media: Data-centre water use can be a "black box"
- Google 2025 Environmental Report
- Microsoft: Inside our two-decade push to cut water intensity (Jun 2026)
- HPCwire: Microsoft to open "zero water" data centres in 2026
- Heat reuse
- Helen: Waste heat from a new data centre for Helsinki district heating (Aug 2026)
- DCD: atNorth DEN01 waste heat for Copenhagen
- Baxtel: Equinix to reuse data-centre heat in Milan
- NTT DATA: Waste heat for a Berlin district
- Bayern Innovativ: Wedau Energy Center
- Opposition and policy
- Data Center Watch: Q1 2026 report
- Tom's Hardware: $68B of projects blocked in Q2 2026
- Arizona Luminaria: Tucson rejects Project Blue
- KJZZ: Water for Project Blue (May 2026)
- Utah Division of Water Rights: Large data centre water use reporting
- Unite.AI: California enacts data-centre power and water laws
- VPM: Virginia data-centre water rules
- Holland & Knight: Texas Senate scrutinises data-centre water use
- NGWA: Federal water-transparency bill (Mar 2026)
- Related on this site
- Inside the AI Factory ยท Energy Beyond the Grid ยท The Power Bottleneck ยท AI Compute Stack at a Glance