What are tailored AI accelerators and why do they matter?

Tailored AI accelerators are custom-designed chips optimized for specific AI workloads such as inference or training. Unlike general-purpose CPUs or GPUs, they offer greater performance per watt for targeted tasks. This efficiency is critical as enterprises scale AI deployments and face rising energy and cost constraints.

How is the demand for AI accelerators driving infrastructure growth?

As enterprises adopt AI at scale, the need for supporting data centers, power systems, and networking infrastructure has grown significantly. Custom accelerators require purpose-built facilities with higher power density and advanced cooling. This is fueling construction and engineering projects tied to next-generation AI data centers.

Which industries are most affected by the AI infrastructure surge?

Engineering, construction, energy, and telecommunications sectors are among the most directly impacted. Data center construction is accelerating to house new AI hardware, requiring specialized design and build expertise. Utilities and grid operators are also responding to increased power demands driven by AI workloads.

‹ Back to Industries Engineering & Construction

Tailored AI Accelerators Pave the Way for an AI Infrastructure Surge

Custom AI accelerator chips are emerging as critical infrastructure as enterprises push for faster and more efficient AI deployment. Tailored silicon designs from companies like NVIDIA, AMD, and hyperscalers are reshaping how AI workloads are processed at scale. This shift is driving a broader surge in AI infrastructure investment across industries including engineering and construction.

This story was produced through MarketScale. See how Engineering & Construction teams put it to work with Partner & Channel Enablement.

Promoted content from Experts Talk on MarketScale.

By Joel Polanco · May 14, 2024, 11:33 AM UTCAi InfrastructureExperts Talk PodcastIntel CorporationJoel Polanco

Key takeaways

Custom chip designs are replacing general-purpose hardware as the preferred substrate for enterprise AI workloads.

Hyperscalers and specialized semiconductor firms are accelerating investment in tailored AI accelerators to meet surging demand.

The buildout of AI-specific infrastructure is creating downstream opportunities across engineering, construction, and data center sectors.

The AI industry is experiencing a significant infrastructure expansion to support a wide array of AI applications. This development, driven by the need for tailored AI accelerators, ensures the swift delivery of sophisticated services and applications. As major players like Microsoft, Google, and Amazon race to market with their offerings, the core question emerges: How will tailored AI accelerators influence future AI applications across different sectors?

In a recent Experts Talk roundtable, Joel Polanco, a Segment Manager at Intel Corporation, provided key insights into the role of these tailored AI accelerators. Polanco's analysis underscores the strategic importance of these specialized accelerators in enhancing computational capabilities while addressing diverse AI needs.

Takeaways from Polanco's insights include:

Cost Considerations: Initially, cost was not a primary concern for major tech companies investing in AI infrastructure. These companies prioritized rapid time-to-market for their services over budget constraints.
Infrastructure Build-Out: A substantial infrastructure build-out is underway, reminiscent of the Internet boom in the late 1990s. This expansion aims to support the imminent delivery of advanced AI applications and services.
AI Accelerators as Engines: Polanco likens AI accelerators to different types of engines—internal combustion engines and electric motors—each excelling in specific environments. Similarly, distinct use cases optimize AI accelerators.
Diverse AI Needs: The variety of AI accelerators available reflects the diverse computational needs of different AI applications, ensuring the efficient meeting of specific requirements. Tailored AI accelerators play a critical role in this customization.
Future Prospects: The ongoing evolution of AI infrastructure and accelerators highlights the early stage of this technological revolution, with immense potential for future developments and innovations.

The ongoing evolution of AI infrastructure and accelerators highlights the early stage of this technological revolution, with immense potential for future developments and innovations.

For a comprehensive analysis of this topic, including more insights from industry experts, refer to the full expert roundtable discussion here.

Video TranscriptExpand ↓

Yeah. I would say, to David's point, it's looking at cost. Initially, cost probably was not, looked at as much because a lot of the purchases are being made by companies who, you know, really have very deep pockets. Right? And they're much more concerned, with with time to market, you know, the Microsofts and the Googles and and the Amazons, because they're in a race to get their services up and running. And, you know, to to Mark's point, things are evolving. This is still early days. This is much like the Internet in the late nineties. You know, there is a large infrastructure build out happening right now, and that is to get ahead of all the services and the applications that are gonna be delivered and all the amazing things that are gonna happen as a result of this. And, you know, I would I would say here, the at the core, these AI accelerators are like engines in a car. And today, you see several engines, at play. You have your internal combustion engines and you have your electric motors. And these these two types of engines, they operate better in different environments. And that's kind of what you see on the chip side.