Intelligent Data Centres Issue 72 | Page 70

FORGET COOLING : DATA CENTRES ’ BIGGEST HURDLE IS NOW POWER

As AI technologies advance , their escalating power demands are rendering traditional data centre designs outdated . Gary Tinkler , Managing Director of Data Centres , Northern Data Group , explores how AI is reshaping the data centre landscape , and why operators must rethink their approach to create more efficient , future- ready facilities . hen we talk about High-Performance

W

Computing ( HPC ), the fusion of Artificial Intelligence ( AI ) and computational power is driving incredible innovations . In the past , we focused mainly on cooling solutions to keep systems running smoothly . But now , with AI-driven HPC systems requiring so much more power , the real challenge isn ' t just about keeping hardware cool ; it ' s about managing an enormous demand for electricity . This pivotal shift in the industry is telling us something important : it ’ s no longer a cooling problem – it ’ s a power problem .
Where are we now ?
Let ’ s take a closer look at NVIDIA , a giant in the HPC world . It ’ s created popular air-cooled systems that have served us well . However , as AI models get more complex , the power requirements are skyrocketing . Reports show that AI training tasks use 10-15x more power than traditional data centres were designed to handle . Facilities that once operated at 5-8kW per rack are quickly becoming outdated . Recently , NVIDIA announced a major rollout of new GPUs , highlighting the urgent need for advanced technology to meet these growing power demands .
To put this into perspective , data centre operators are now reevaluating their power strategies because their existing setups can ’ t keep up . For example , a facility that used to work well with 8kW per rack now finds that this just isn ’ t enough anymore . As AI continues to advance , we ’ re looking at power needs soaring to between 50-80kW per rack . This isn ’ t just a small tweak ; it ’ s a major change in how data centres need to be designed .
A recent study from the International Data Corporation ( IDC ) found that global data centre electricity consumption is expected to more than double from 2023 to 2028 , reaching an astounding 857TWh by 2028 . This underlines the importance of having data centre facilities that can support higher power loads if they want to stay competitive in the fast-paced AI world . This isn ’ t just a theory – it ’ s a reality that data centre operators must face head-on .
Steps data centres can take
One of the biggest challenges in this transition is updating power supply systems . Traditional Power Distribution Units ( PDUs ) aren ’ t built to handle the demands of these new AIdriven systems . To meet the required power levels , data centres can invest in more advanced PDUs that can manage heavier loads while boosting overall efficiency .
For many setups today , that means installing six units that can each supply 63 amps of power . This shift not only changes how data centres are built but also adds complexity to how everything is arranged inside the racks .
Of course , as facilities rush to meet these new power needs , we ’ re seeing innovative solutions come to light . Ultrascale Digital Infrastructure has partnered with Cargill , for example , so that its data centres can run on 99 % plant-based fluids , eliminating the need for billions of gallons of water used annually in cooling , offering new opportunities for water conservation , particularly for data centres designed to rely on water in their operations .
70 www . intelligentdatacentres . com