BIG DATA & AI IN DRUG DEVELOPMENT

The Promise Is Becoming Reality — But the Leadership Gap Is Now Critical

Oliver Life Sciences Search  |  2026

Five years ago, we called out the unfulfilled promise of big data in drug discovery. IBM Watson’s $62 million misadventure in oncology had become the cautionary tale of the decade — a reminder that transformative technology without the right organizational infrastructure and leadership produces expensive paperweights. The question then was whether pharma could ever bridge the gap between algorithmic potential and real-world drug development.

Today, that question has a more concrete answer. An AI-designed drug has completed Phase 2 clinical trials. A Nobel Prize has been awarded for AI protein structure prediction. Venture capital poured $3.3 billion into AI drug discovery companies in a single year. The technology is no longer a promise — it is a business imperative.

And yet, the leadership gap that held the industry back in 2020 has not closed. It has widened. The urgency to act has never been greater.

FROM WATSON TO BREAKTHROUGH: WHAT CHANGED

In 2019, IBM quietly pivoted Watson away from drug discovery and toward clinical trials — a face-saving retreat from a space where it had consistently underdelivered. The core problem, as Atrium Research CEO Michael Elliott noted at the time, was not the technology itself but the quality and accessibility of the data behind it. Pharma data was “trapped in Excel or PowerPoint” and “lacks consistency in formats and quality.” That insight remains relevant today. But the tools surrounding that data have advanced dramatically.

The watershed moment came in 2021, when DeepMind’s AlphaFold 2 solved the 50-year-old protein structure prediction problem. The result: a publicly accessible database of more than 200 million protein structures used by over 3 million researchers in more than 190 countries. In 2024, the Nobel Prize in Chemistry was awarded to DeepMind’s Demis Hassabis and John Jumper for this achievement. AlphaFold 3, released in May 2024, expanded the model to predict interactions between proteins, DNA, RNA, and the small molecules that form the basis of most drugs — fundamentally reshaping how targets are identified and validated. (DeepMind, 2024)

Equally significant is the emergence of generative AI in lead discovery. Insilico Medicine’s rentosertib (ISM001-055) — a drug designed entirely by AI to target idiopathic pulmonary fibrosis — progressed from target identification to Phase 2a clinical trial in under 18 months, compared to a traditional timeline of four or more years, and at roughly one-tenth the typical cost. Phase 2a results, published in Nature Medicine in 2024, showed the candidate was safe, well-tolerated, and demonstrated encouraging early clinical efficacy. (Insilico Medicine, 2024)

"AI molecules have shown Phase I clinical trial success rates of 80–90% — compared to an industry average of roughly 50%.” — Jayatunga et al., Drug Discovery Today, 2024

The broader market reflects this momentum. The global AI in drug discovery market was valued at $3.6 billion in 2024 and is projected to reach $49.5 billion by 2034, growing at a compound annual rate of 30%. McKinsey now estimates that generative AI alone could generate $60 to $110 billion per year in economic value for the pharmaceutical and medical products industries, including $15 to $28 billion in early-stage drug discovery. (McKinsey Global Institute, 2024) 

TWO PROBLEMS PERSIST — AND ONE HAS BECOME MORE URGENT

The original article identified two structural problems standing between pharma and the full realization of AI’s potential. Both remain. One has evolved. One has become a crisis.

Problem One: Data Remains the Foundation — and the Liability

Elliott’s 2019 observation has aged well. Despite years of digital transformation investment, pharma organizations still struggle with fragmented, inconsistent, and siloed data. The problem has become more complex, not less: the modern drug discovery pipeline now requires integrating multi-modal data sets — genomics, proteomics, electronic health records, imaging, and clinical trial results — each collected under different standards, stored in different systems, and owned by different organizational functions.

MIT’s Machine Learning for Pharmaceutical Discovery and Synthesis Consortium (MLPDS), founded in 2018 with partners including Lilly, AstraZeneca, Amgen, and Pfizer, continues to address this divide between academic machine learning research and real-world drug development. But progress requires organizations to make the internal investment to prepare their data for these tools. Federated learning approaches — which allow AI models to be trained across distributed data sets without centralizing sensitive information — are emerging as a practical solution, but they require sophisticated data infrastructure and leadership to implement.

Problem Two: The Leadership Gap Is Now a Business Risk

In 2020, the shortage of AI and analytical leaders in pharma was a competitive disadvantage. In 2026, it is a strategic risk. The technology has arrived. Companies that cannot field the leadership to deploy it will cede ground to those that can.

The numbers are stark. A GlobalData industry report (November 2024) found that “lack of specific skills and talents” was the single biggest obstacle to digital transformation in pharma, cited by 49% of surveyed professionals. A separate Deloitte survey found that 83% of pharmaceutical and life sciences companies have difficulty finding skilled AI talent — and 75% expect the shortage to worsen over the next five years. Demand for AI professionals has driven a 77% year-over-year increase in life sciences job postings. The average time to fill an AI/ML Specialist role in pharma is now four to six months.

The Chief Data Officer role, which was largely new to pharma in 2020, has since proliferated — but companies are now discovering that a CDO alone is insufficient. A new role is emerging: the Chief AI Officer, or CAIO, responsible for AI strategy, governance, and deployment across the enterprise. The competition for these executives is fierce. Pharma is now competing directly with technology, financial services, and consumer companies — industries that have been using AI at scale for a decade. As of 2024, a majority of pharma CDOs and CAIOs still come from outside the life sciences industry, bringing technical depth but often lacking the domain knowledge required to understand drug development’s scientific and regulatory complexity.

"Lack of specific skills and talents is the single biggest obstacle to digital transformation in pharma.” — GlobalData Industry Report, November 2024

 THE NEW LEADERSHIP IMPERATIVES

The original article made the case for statisticians as drug development’s unsung leaders — individuals who could interpret safety signals, drive data-driven portfolio decisions, and design studies that minimize bias and false discovery. That case is still valid. But the landscape has expanded considerably.

The leadership needs of a pharmaceutical company deploying AI in 2026 span at least five distinct profiles:

•      AI/ML Strategy Leaders: Executives who can evaluate and prioritize AI investments, build internal capability, and distinguish genuine breakthrough from vendor hype. These individuals must be fluent in both the business of drug development and the technical realities of machine learning.

•      Data Platform and Infrastructure Leaders: Drug discovery AI is only as good as its data foundation. Companies need senior architects who can design and govern cloud-based data platforms, implement data quality standards across therapeutic areas, and enable the multi-modal data integration that modern AI requires.

•      Computational Biology and Generative AI Scientists: The AlphaFold era has created a new category of scientist — one who bridges structural biology, cheminformatics, and deep learning. These individuals are in extraordinary demand and short supply.

•      Regulatory AI Experts: In January 2025, the FDA published draft guidance introducing a seven-step credibility framework for the use of AI in regulatory decision-making for drug and biological products. By 2024, CDER had already received over 500 submissions incorporating AI components. Companies need leaders who understand this framework and can build AI pipelines that satisfy regulatory requirements without compromising innovation. (FDA, 2025)

•      Translational Leaders: Perhaps the most critical — and rarest — profile is the executive who can operate at the intersection of AI and drug development: who understands the biology, the statistics, the technology, and the business. These “bilingual” leaders are the ones who will determine which companies realize AI’s potential and which are left managing expensive infrastructure with nothing to show for it.

OLIVER LIFE SCIENCES SEARCH: BUILT FOR THIS MOMENT

The promise that big data once dangled in front of the pharmaceutical industry is now being fulfilled — selectively, in organizations that have made the right talent investments. Insilico Medicine succeeded not because it had better technology than its competitors, but because it had the scientific and operational leadership to build and deploy that technology in a drug development context. The same principle that Milind Kamkolkar, then Chief Data Officer at Sanofi, articulated in 2017 holds true today: the data is already there. The algorithms exist. What is still missing, in too many organizations, is the leadership to bring them together.

Oliver Life Sciences Search is purpose-built to close that gap. Our practice focuses exclusively on the life sciences sector, which means we understand not just the technical profiles these roles require, but the scientific context in which they must operate. We know the difference between an AI leader who can build models and one who can drive a drug development program — and we know where to find both.

We bring deep cross-industry reach to match our life sciences expertise. The executives who will lead pharma’s AI transformation are not all sitting in pharma companies today. Many are in technology, financial services, and advanced manufacturing — industries that have been deploying AI at enterprise scale for years. Identifying those leaders, assessing their ability to navigate the specific complexities of drug development, and bringing them into life sciences organizations is one of the most consequential recruiting challenges of this decade.

The question is no longer whether AI will transform drug development. It already is. The question is which organizations will have the leadership in place to be on the right side of that transformation. We look forward to partnering with you to find them.

References

DeepMind. (2024). AlphaFold: Five Years of Impact. Google DeepMind. https://deepmind.google/blog/alphafold-five-years-of-impact/

FDA. (2025, January). Considerations for the Use of Artificial Intelligence to Support Regulatory Decision-Making for Drug and Biological Products; Draft Guidance. Federal Register. https://www.federalregister.gov/documents/2025/01/07/2024-31542

Gibson, E. W. (2017, June 29). Leadership in Statistics: Increasing Our Value and Visibility. doi: https://doi.org/10.1080/00031305.2017.1336484

GlobalData. (2024, November). Digital Transformation in Pharma: Industry Challenges Survey. Cited in IntuitionLabs. https://intuitionlabs.ai/articles/pharma-ai-skills-gap

Grand View Research. (2024). AI in Drug Discovery Market Report, 2033. https://www.grandviewresearch.com/industry-analysis/artificial-intelligence-drug-discovery-market

Insilico Medicine. (2024). Insilico Announces Nature Medicine Publication of Phase IIa Results of Rentosertib. https://insilico.com/news/tnrecuxsc1-insilico-announces-nature-medicine-publi

Kamkolkar, M. (2017, September 22). Chief Data Officer, Sanofi. Digital Transformation in the Pharmaceutical Industry. CXO Talk.

Koperniak, S. (2018, May 17). Applying Machine Learning to Challenges in the Pharmaceutical Industry. MIT News. http://news.mit.edu/2018/applying-machine-learning-to-challenges-in-pharmaceutical-industry-0517

McKinsey Global Institute. (2024). Generative AI in the Pharmaceutical Industry: Moving from Hype to Reality. https://www.mckinsey.com/industries/life-sciences/our-insights/generative-ai-in-the-pharmaceutical-industry-moving-from-hype-to-reality

Jayatunga, M. K. P., Ayers, M., Bruens, L., Jayanth, D., & Meier, C. (2024). How successful are AI-discovered drugs in clinical trials? A first analysis and emerging lessons. Drug Discovery Today, 29(6), 104009. https://doi.org/10.1016/j.drudis.2024.104009

Mullin, R. (2019, April 26). IBM Shifts Watson from Drug Discovery to the Clinic. Chemical & Engineering News, 97(17).

Susan Oliver

Partner, Oliver Life Sciences Search

susan.oliver@oliversearch.com

www.oliversearch.com