Breaking Barriers to Data Center Growth

By Vivian Lee Pattabi Seshadri Clark O’Niell Archit ChoudharyBraden Holstege, and  Stefan A. Deutscher
Article 15 MIN read

Key Takeaways

Data centers are booming, but power, supply chain, and sustainability challenges threaten growth. Companies can surmount the obstacles and meet the growing thirst for computing power.
  • GenAI will be the fastest-growing segment of computing demand from 2023 to 2028, but traditional enterprise workloads such as database management and file sharing and storage will continue to account for the majority of demand.
  • Although the US, which is the leading data center market today, will account for the majority of data center power demand growth over the same period, other regions will see significant growth supported by regulations, access to clean energy, and other variables.
  • Creative collaboration throughout the ecosystem—including among companies, utilities, and regulators on supply chain issues, community engagement, and climate change impact—can address the most significant industry challenges.
Saved To My Saved Content
Download Article

Global demand for computing power is surging, and leading data center players are readying a massive deployment of capital—$1.8 trillion from 2024 to 2030—to meet the need. This rapid expansion reflects a growing bet on data-intensive technologies, from traditional enterprise workloads to GenAI applications.

Several significant barriers, however, could slow the industry’s development. Among the most pressing of these are power infrastructure bottlenecks, supply chain constraints, community concerns over resource use, and the growing environmental impact of data centers. With a focus on actionable solutions, we outline a set of strategies that operators and ecosystem stakeholders can adopt to navigate these complexities and capture the opportunities ahead.

Rapid Growth Ahead

Although it’s clear that the data center sector is experiencing rapid growth, the mix of forces driving that expansion is less well understood. Our work, leveraging BCG’s proprietary Global Data Center Model, sheds light on the forces underpinning demand for data centers, the unprecedented levels of capital investment underway, and the global dynamics shaping this emerging industry.1 1 BCG’s proprietary Global Data Center Model projects compute demand through an analysis of workload segments (grouped as “traditional business computing,” “GenAI,” and “other AI + high-performance computing”) and associated growth drivers. We extrapolated results by using hardware demand projections (for example, for wafer production and GPU demand projections). The model’s scenario-based views include four components: unconstrained computing power demand; hardware supply constrained through 2027 (base case); data center infrastructure constrained; and variations in GenAI adoption trajectory. Unless otherwise explicitly stated, figures included in this report refer to the base case scenario.

Data center computing demand is surging. We expect global demand for data center power to grow at approximately 16% on a compound annual basis from 2023 to 2028—33% faster growth than from 2020 to 2023—reaching about 130 GW by 2028.2 2 The term data center demand refers to power required for both computing (for example, servers) and noncomputing (for example, cooling) infrastructure demand, measured in GW. GenAI’s role in the growing thirst for computing power garners the most attention today, but the reality is more complex. (See Exhibit 1.)

Traditional enterprise workloads—non-AI applications such as file storage and sharing, transaction processing, and other conventional business applications—actually represent the majority of data center power demand today and will continue to do so in the future, accounting for roughly 55% in 2028. That translates into a 7% compound annual growth rate from 2023 through 2028, fueled by the continued rise of enterprise data volumes and further digitization of company businesses. Wider usage of cloud services, which can increase cost efficiency, operational flexibility, and scalability, is a key enabler of this growth.

In parallel, GenAI-related computing demand now ranks as the fastest-growing segment, and we project that it will account for roughly 60% of total growth in data center power demand from 2023 to 2028. The training of large foundational models, such as OpenAI’s GPT models, will grow at a compound annual rate of about 30%, while inferencing workloads—the use of pretrained models to generate insights and predictions—will increase at an explosive 122%. Still, despite that ramp-up, we expect GenAI to represent only about 35% of data center power demand by 2028.

The precise trajectory and timing of computing demand—and, by extension, of data center buildout—could depend to a significant extent on the uncertain future of GenAI computing growth. For example, technological progress and innovations in model architecture and hardware might curb power demand for GenAI training computations. Conversely, wider adoption of inferencing paradigms such as chain-of-thought reasoning, which requires multistep processing per prompt, might trigger faster growth in computing power needs.

Hyperscalers drive growth and major investments. We expect that hyperscalers— technology players such as Amazon, Meta, Microsoft, and Google—will generate approximately 60% of the industry’s growth from 2023 through 2028, increasing their share of global demand for data center power from 35% to 45%. Within this time frame, the power demand share for enterprise players—companies that maintain on-premises facilities for their own use—will decline from 10% to 5%. In part, this reflects continued migration of businesses’ data to the cloud and to colocation providers. Colocation providers, which rent sites to tenants or develop specialized cloud offerings, will account for the remaining 50% of data center power demand by 2028, as hyperscalers continue to rely on them to meet growing needs. (See Exhibit 2.)

To realize this growth, hyperscalers will need to spend an estimated $1.8 trillion in data center-related capex in the US from 2024 to 2030.3 3 Sources: BCG analysis; analyst reports; Datacenter as a Computer: Designing Warehouse-Scale Machine (Third Edition); datacenterHawk; Form 10Ks; Gartner; OEM websites. New entrants are also expected to make significant investments to meet the surging demand.

Hyperscalers will also drive growth in facility size. The average size of a US data center will increase from 40 MW today to 60 MW by 2028, with about a third of campuses above 200 MW.4 4 Sources: BCG analysis; datacenterHawk; market participant interviews. This shift is a function both of economies of scale—for example, regarding cooling efficiency—and the unique demands of GenAI model training, which requires large-scale parallel processing and ultrafast communications across centralized servers to efficiently train models with billions or even trillions of parameters.

Regional Dynamics Evolve

The US currently represents approximately 60% of globally installed data center capacity. Taking into consideration the base of currently installed data centers and those expected to come online in light of public announcements, our model estimates that the US will account for the majority of data center power demand growth from 2023 to 2028.5 5 This projection corresponds to the data center infrastructure-constrained scenario in our Global Data Center Model. (See Exhibit 3.)

This expansion will be concentrated in specific electricity market regions. We project that about 70% of the installed base for US data centers will be located in the PJM Interconnection (which includes Virginia and Ohio), Midcontinent Independent System Operator (which includes Illinois and Iowa), Northwest (including Oregon), and Southeast (including Georgia) in 2028.6 6 Geographic markets as described here follow the delineation used by the US Federal Energy Regulatory Commission, including areas covered by both regional transmission organizations (for example, PJM) and independent system operators (for example, MISO). The US’s dominance in the data center landscape reflects factors such as major hyperscalers’ headquarters in the country, access to reliable energy , strong connectivity, a country risk profile that is low overall, and a favorable regulatory environment. For hyperscalers with ambitious climate goals, the accessibility of large-scale renewable energy and the widespread adoption of mechanisms such as power purchase agreements (PPAs) have further supported data center development in the US.

Our projections based on current and planned data centers show that locations outside the US will capture the remaining 30% of total growth during the period from 2023 to 2028, owing largely to three factors:

Our model captures only publicly disclosed plans for data center construction. The variables mentioned above, along with undisclosed data center projects, could ultimately lead to faster-than-expected growth and a shift in growth trajectories outside the US. Although not a focus of this analysis due to data limitations, China will likely continue to emerge as a major AI player with strong access to talent, capital, and power resources. For example, Alibaba’s Qwen large language models (LLMs) are achieving performance comparable to US models despite limited access to advanced chips due to export restrictions that the US has imposed.9 9 Current US export rules that apply to US companies and to foreign companies using US technology prohibit the selling of advanced US semiconductors and technologies to Chinese-owned companies. For further details on the geopolitics of GenAI, see “ How CEOs Can Navigate the New Geopolitics of GenAI.”

Confronting Challenges to Seize the Data Center Opportunity

Around the globe, national and business leaders see innovating in AI as a mission-critical priority. But players throughout the data center ecosystem face significant challenges as they push to develop new and larger sites. A close look at those issues reveals a path forward to address them.

Access to Power

The growing number and size of data centers will have a transformative impact on electrical grids. Global power demand by data centers is expected to total roughly 130 GW in 2028, reflecting a 16% compound annual growth rate from 2023 through 2028—up from the 12% rate over the years 2020 through 2023. In the US, data center power demand will account for up to 60% of total load growth from 2023 through 2030, outpacing load growth in sectors such as transportation electrification.

In this context, access to the power needed for ever-larger data centers is emerging as a critical bottleneck. Primarily, this results from a mismatch between the development period of two to three years for a typical greenfield data center and the time required to complete associated interconnection studies and infrastructure upgrades, which usually spans four to eight years.10 10 Sources: BCG analysis; The Datacenter as a Computer: Design Warehouse-Scale Machines (Third Edition); market participant interviews; Interconnection.fyi. Greenfield data center development time reflects the timeline from land acquisition to completion of building the facility. Interconnection study and infrastructure upgrade statistics refer to proposed completion time by year entering queue and are based on publicly available data for interconnection projects across US ISOs/RTOs and non-ISO utilities.

To overcome this challenge, data center operators can work proactively with energy providers to accelerate grid infrastructure development. Two steps are especially important:

As companies develop plans to meet the surge in demand for computing power, they are trying to gauge the degree to which new approaches could reduce the need to bring new grid-connected power capacity online. A close look at two trends—the development of behind-the-meter resources and continued technological innovation—reveals that neither is likely to change the power equation significantly in the near term. (See the sidebar, “No Easy Fix for Data Center Power Demands .”)

No Easy Fix for Data Center Power Demands
Discussions about the power issues confronting the data center industry today almost inevitably lead to questions about the role that behind-the-meter resources and continued hardware innovation will play in the years ahead. Both trends have significant potential, but their ultimate impact is uncertain.

Behind-the-Meter (BTM) Resources. Co-located energy resources have recently gained attention as a way to overcome grid bottlenecks in data center projects and enable faster time to power. Although still in the early stages of adoption, BTM resources such as co-located gas power plants, hydrogen fuel cell farms, and solar parks equipped with backup systems are poised to play a larger role in powering data centers. Certainly, we need all of these resources. However, the current focus on BTM is not commensurate with its likely contribution toward delivering the nearly 70 GW of additional data center capacity needed from 2023 through 2028. That reflects several important issues related to large-scale implementation.

First, BTM resources are subject to unique reliability considerations, including the need to manage planned and unplanned maintenance and risks associated with outages independent of the grid. Consequently, data center operators, which require exceptionally high levels of energy reliability and redundancy, have historically shied away from exploring fully islanded and off-grid solutions. There are potential technical solutions—such as load bridges—that may help address reliability concerns, but these approaches will take time to develop and mature.

Second, scaling BTM resources to meet the demands of data centers operating at a multi-megawatt or gigawatt scale presents significant technical hurdles. Although developers may have experience with smaller off-grid solar systems, few have expertise integrating diverse resources—including natural gas, solar, and batteries—on a massive scale. Managing the unique power flows and dynamic loads associated with data center operations—such as delivering near-instantaneous responses and managing wide load fluctuations—adds complexity and increases project risk.

Third, the adoption of BTM solutions could be slowed by regulatory uncertainty. For example, questions persist about grid cost allocation and stability impacts, as reflected in recent Federal Energy Regulatory Commission rulings rejecting interconnection agreements for BTM data center loads.11 11 Refers to the November 1, 2024 Federal Energy Regulatory Commission’s rejection of an amended interconnection services agreement filed by PJM Interconnection to increase co-located data center load at the Susquehanna nuclear generating facility; ER24-2172 | PJM’s Susquehanna Co-Location Proposal.

As a result, we expect grid-connected data centers to remain the favored choice for operators. At the same time, to facilitate these grid-connected solutions, we expect to see regulatory reforms in large-load interconnection processes and the emergence of contractual innovations to de-risk and expedite utilities' investments in new grid infrastructure. In this evolving landscape, regulated utilities—particularly vertically integrated ones—are well positioned to capture substantial value from data center expansion through investments in new grid infrastructure and power generation.

Technological Innovation. A common question we hear from clients is whether quantum computing, which has garnered attention with breakthroughs such as Google’s Willow, will help curb data center energy needs through more efficient processing of computing workloads. The reality is that quantum computing will not offer practical solutions to address data centers’ immediate and growing demands for energy for at least the next decade. Quantum computers are probably unsuitable for inferencing tasks and for most enterprise workloads, and its application to LLM training remains speculative. Even if technically viable for AI training, scalable quantum solutions for this space are many years away.

Real progress in hardware is expected to come from incremental but impactful advances in chips developed by leading players like Nvidia and emerging challengers, and from innovations in essential supporting technologies such as liquid cooling that will continue to propel critical gains in performance and efficiency. Innovations in software and algorithms will likely play a similar role.

Supply Chain Issues

Amid rapid growth, supply chain management has moved to the forefront of concerns among data center operators and developers seeking timely access to the resources they need to build data centers. Access to chips is a well-known issue today. However, disruption can emerge from any component of the supply chain, from power and cooling systems to networking infrastructure and even the construction workforce. For example, lead times for procuring critical equipment such as backup generators have gone from months to years.12 12 Sources: CBRE Research, August 2024; Wall Street Journal, April 2024.

To ensure a resilient supply chain and alleviate capacity bottlenecks, data center operators can implement a set of practical strategies:

Community Engagement

As data centers expand, they face increasing scrutiny from host communities regarding their impact on local resources, such as land and water. Specifically, cost allocation rules for the grid upgrades required to support data center growth and the expanded data center’s impact on energy affordability are key concerns for many communities.

Key players in the data center ecosystem can take two primary actions to address these concerns:

Climate Change Impact

Rising energy demand over the next five years, fueled in part by the data center boom, will drive the largest five-year expansion of energy capacity in history. Achieving this unprecedented growth will require scaling diverse energy sources, including wind and solar, battery storage, and conventional nuclear. A key factor shaping the energy buildout is data centers’ critical need to have a continuous, redundant supply of energy. Renewables with storage can provide that firm power supply, but fossil-fuel-based generation currently has an economic advantage over renewables after accounting for storage requirements. Consequently, although energy providers continue to broaden their adoption of renewable energy, many are also expanding—or slowing the retirement of—unabated fossil generation in order to meet immediate customer demand.

Some data center operators have taken important foundational steps to address the climate impact of their operations, including by procuring renewable energy credits and by contracting PPAs with renewable energy generators. In addition, operators can take further action to address the climate challenge :


The data center industry stands at a pivotal juncture, and the path ahead is edged with uncertainty. As operators confront power bottlenecks, supply chain hurdles, and rising community expectations, the industry’s growth depends on creative collaboration throughout the ecosystem. Forward-thinking strategies and partnerships will drive the industry's transformation and separate the leaders from the laggards.

Subscribe to our Energy E-Alert.

Authors

Managing Director & Partner

Vivian Lee

Managing Director & Partner
Dallas

Managing Director & Senior Partner; Global Leader, Energy Practice

Pattabi Seshadri

Managing Director & Senior Partner; Global Leader, Energy Practice
Dallas

Managing Director & Partner

Clark O’Niell

Managing Director & Partner
San Francisco - Bay Area

Managing Director & Partner and Asia Campus Manager

Archit Choudhary

Managing Director & Partner
Singapore

Managing Director & Partner

Braden Holstege

Managing Director & Partner
San Francisco - Bay Area

Partner & Director

Stefan A. Deutscher

Partner & Director
Berlin

Related Content

Saved To My Saved Content
Download Article
Saved To My Saved Content
Download Article