Execution at Scale: The Real Challenge of Building AI Infrastructure

 

AI infrastructure is evolving at breakneck speed, and the real challenge is no longer just designing next-generation data centers—it’s executing them at scale. As demand for AI-ready facilities grows, operators must adapt to immense increases in power density, new cooling technologies, and unconventional deployment locations. Power density requirements for AI workloads are pushing the limits of traditional data center design, forcing operators to rethink everything from electrical infrastructure to thermal management systems.

So, what does it really take to run a high-density, liquid-cooled, AI-ready data center in a rural region like Ellendale, North Dakota? How do leaders balance execution, cost, resilience, and sustainability under these extreme conditions?

On this episode of Architects of Acceleration, host Philbert Shih, Founder and Managing Director of Structure Research, sits down with Laura Laltrello, Chief Operating Officer at Applied Digital, to explore how execution works at scale for Polaris Forge—a 100-megawatt AI-ready data center. From contingency planning to liquid cooling and rural workforce development, Laura shares how her team is overcoming infrastructure and operational challenges to bring AI workloads to life.

Highlights from the Episode:

  • Operating in High-Density AI Environments: AI data centers like Polaris Forge are moving from 4–9 kW per rack to 100–130 kW. This shift demands a radical rethink of cooling—from traditional air to precision-engineered liquid systems—and redefines what “mission-critical operations” really mean.

  • Leveraging Location for Efficiency: North Dakota’s climate provides up to 220 days of “free cooling,” driving PUE down to 1.18. Combined with access to stranded wind power and a closed-loop water system, the data center achieves up to $85 million in annual savings compared to traditional facilities.

  • Planning for the Unplannable: With 14-foot snow drifts, remote access, and no legacy data center workforce, Laura details how Applied Digital blends community integration, smart tech, and internal simulations like “What Could Go Wrong” days to bulletproof the facility against disruptions.

Laura Laltrello is the Chief Operating Officer at Applied Digital. With a robust background in infrastructure operations, she brings decades of experience navigating complex, high-stakes environments. Known for her pragmatic approach and passion for building resilient teams, Laura has been instrumental in designing and launching one of the industry’s most efficient AI-ready data centers. Her work draws on deep cross-sector insights and a history of successful leadership in both technology and operations.

Recent Episodes

As demand for artificial intelligence continues to soar, the AI infrastructure needed to power it is scaling just as rapidly. A 2024 report from the International Data Corporation (IDC) forecasts that global spending on AI infrastructure will exceed $200 billion by 2028, driven by an explosion in compute-heavy applications like large language models and…

AI workloads are redefining the limits of data center design and infrastructure. Legacy data centers, built for traditional co-location, cannot handle the density, thermal demands, or power dynamics of accelerated computing. The AI boom has upended the data center sector, forcing a rapid shift to liquid-cooled racks as facilities pivot from sub-10kW racks to…

At PayPal Dev Days, the convergence of agentic AI tools and real-world developer ingenuity signaled a bold shift in the future of digital commerce. This wasn’t just about code—it was a glimpse into a world where AI collaborates, not just automates, and developers become architects of intelligent systems. Across immersive sessions and live coding…