Managing Director & Partner
Austin
BCG estimates that 90% of tech jobs will be directly impacted by generative AI (GenAI). In an already complex market for tech talent, these shifts will create new challenges for technology leaders. How will they face the dual mandate of building GenAI capabilities within their own department while leading the charge for implementing GenAI across the entire enterprise?
To succeed, tech leaders need to rethink how they can mobilize talent in response to GenAI.
We estimate that AI will reduce costs in the tech function by approximately 10%—or free up capacity that tech leaders can reallocate to other areas.
There are four developments driving this.
For the vast majority of tech jobs, roles and skills will change as employees increasingly incorporate GenAI into their processes and workflows. For example, data scientists will need to work with greater volumes of unstructured data to train large language models (LLMs) and generate insights.
GenAI will make many tasks within tech functions more efficient. For example, it will increasingly take on tasks like generating code for app development and handling transactional processes in tech support, requiring fewer resources and time dedicated to these tasks.
Both AI and GenAI will create new roles as well. One example is the role of a chief AI officer—a senior person specifically tasked with overseeing all AI projects and use cases, including predictive AI and GenAI. Similarly, most organizations will need prompt engineers to develop and refine the prompts given to GenAI solutions. LLM operations engineers will need to work to simplify and automate prompt processes and fine-tune models.
Skills will evolve with GenAI. This evolution can be seen in individual roles, such as a data scientist upskilling in prompt engineering and fine-tuning AI models. Over time, GenAI skills will become table stakes across tech and digital roles.
In addition to understanding specific skills, roles, and capabilities, technology leaders need to determine the right organizational structure for the tech function, so that GenAI capabilities and expertise are positioned where they can be most effective.
Start by centralizing GenAI expertise. Initially, a company can create a center of excellence that sits within the tech function and reports to the technology leader. This approach enables an organization to accelerate the rollout of GenAI while establishing guardrails for the responsible, ethical use of the technology. Cross-functional ambassadors can foster collaboration across business units, working with the technology leader to implement responsible AI and train broader business teams on GenAI usage.
Decentralize over time. As capabilities grow, the company can shift to a decentralized model, with GenAI squads embedded into business units and support functions to implement GenAI use cases. In this stage, the tech function’s responsibility shifts to monitoring and governance, evolving the common infrastructure and security standards, and continuing to refine the guardrails for GenAI.
Technology leaders need to rethink their talent strategy to account for the added capacity from GenAI. They have two principal options.
Reduce headcount. As GenAI automates processes and workflows, some companies may opt to eliminate some roles and apply the cash savings to other areas.
Overall, this scenario would lead to a leaner tech function.
Redeploy talent. Other companies may opt to redeploy the talent that GenAI frees up, applying those employees to other needs.
This scenario would help the tech function create more value for the company.
The talent market is already competitive, and GenAI will exacerbate the competition for top tech talent in key areas. To succeed, technology leaders should focus on the following priorities:
Conduct a rapid assessment of the organization to understand the current baseline of capabilities and where GenAI applications can have the biggest impact.
Establish a center of excellence for GenAI within the tech function.
Prioritize a small number of use cases—both within the tech function and across a small
number of business units—to begin building institutional expertise and get people engaged.
Build and refine governance over time, even as you begin adopting GenAI.
ABOUT BOSTON CONSULTING GROUP
Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we work closely with clients to embrace a transformational approach aimed at benefiting all stakeholders—empowering organizations to grow, build sustainable competitive advantage, and drive positive societal impact.
Our diverse, global teams bring deep industry and functional expertise and a range of perspectives that question the status quo and spark change. BCG delivers solutions through leading-edge management consulting, technology and design, and corporate and digital ventures. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, fueled by the goal of helping our clients thrive and enabling them to make the world a better place.
© Boston Consulting Group 2024. All rights reserved.
For information or permission to reprint, please contact BCG at permissions@bcg.com. To find the latest BCG content and register to receive e-alerts on this topic or others, please visit bcg.com. Follow Boston Consulting Group on Facebook and X (formerly Twitter).