AI as Cancer Oracle?

How is artificial intelligence (AI) being used for cancer detection and prevention?

Abstract illustration of a humanoid looking AI scanning health records

Illustration by Matt Chinworth

Computational biologist Chris Sander and other scientists have developed a method for using artificial intelligence to identify people at high risk of pancreatic cancer, solely from national health records. The crucial insight, the research revealed, was not simply whether a risk factor appeared in a patient’s medical record of symptoms and diagnoses, but when it appeared in the patient’s history. “One of our innovations was to use time sequences of clinical health records rather than just what disease somebody had,” Sander said. The team took advantage of a design feature of generative AI large language models, which predict the next word in a sequence. “We adapted that for a sequence of disease codes,” said Sander, “to see if the next disease in the sequence was cancer or not.”

Sander’s approach, detailed last summer in Nature Medicine, proved to be powerfully predictive. For example, the model was able to identify a subset of patients with a 59-fold higher risk than average of developing pancreatic cancer within three years. The importance of identifying particularly high-risk patients is that they can undergo regular screening via CT or MRI scans to ensure that if they develop pancreatic cancer, it will be caught as early as possible.

Sander, a senior lecturer in the systems biology department at Harvard Medical School, was not an early believer in the abilities of AI to solve such problems. But in 2018, he had received an invitation from Nobel laureate Phil Sharp to attend a small meeting at MIT’s Koch Institute for Integrative Cancer Research that changed the course of his research—and potentially the future of cancer detection.

Sharp wanted to explore potential applications of artificial intelligence for treating pancreatic cancer, which claims the lives of about 50,000 Americans each year. Although it doesn’t rank among the top 10 most-diagnosed cancers in the United States, it is one of the most deadly. Early detection is the most effective way to reduce cancer deaths, but unlike prostate or breast cancer, there are no reliable and easily accessible screening tools for pancreatic cancer. The result is that the disease is often detected only after it has reached an advanced stage, when the odds of surviving five years post-diagnosis are less than 9 percent. Sharp wondered whether artificial intelligence tools could mine patient health records for early warning signs of pancreatic cancer.

Sander was skeptical: “I thought this was just too ambitious. There’s no way AI can just miraculously make a solution to pancreatic cancer.” His decades-long career working at the nexus of big data and biology had exposed him to the challenges associated with using mathematics to make predictions about human diseases—especially ones as complex as cancer. “To make this realistic, the AI would need a lot of medical data, which is a big challenge because medical data can be so unreliable,” Sander said. “But we knew that Denmark has an excellent computerized national health database, and being able to access that data was really the breakthrough.”

With a team of MIT and University of Copenhagen researchers, he accessed more than nine million patient records from the Danish national health and U.S. Veterans Affairs health systems and used these data to build machine learning models that could predict individuals’ risk of developing pancreatic cancer based on their medical history.

The factors that Sander’s AI uses to make its remarkable predictions are not always clear. When a human physician suspects that a patient has or is at risk of pancreatic cancer, they are usually able to explain why. For example, patients with type 2 diabetes who have lost weight over the course of two years are known to have a heightened risk for pancreatic cancer. AI systems look for patterns across millions—or even billions—of parameters, and this complexity results in an opaque prediction model.

Sander said this shouldn’t be a roadblock to applying the technology in clinical settings. “The key thing is whether you can make a correct prediction right now,” he said. His team is working with researchers conducting two pancreatic cancer clinical trials to collect additional patient data to further validate the AI’s predictions. The system is also being validated by multiple hospitals for deployment as a decision support tool, and Sander is in early talks with a company about potentially commercializing the system. In the meantime, he and his colleagues are exploring ways to apply their prediction models to ovarian cancer, which is similarly difficult to detect.

“I think this has a chance of revolutionizing how we deal with pancreatic and other cancers by catching it much earlier,” Sander said. “We’re getting closer to creating actual benefits for patients, sooner than I ever expected.”

Read more articles by Daniel Oberhaus
Related topics

You might also like

Five Questions with Andrew Knoll

A paleontologist on how to understand Earth’s biggest extinction event

This Harvard Scientist Is Changing the Future of Genetic Diseases

David Liu has pioneered breakthroughs in gene editing, creating new therapies that may lead to cures.

A Flu Vaccine That Actually Works

Next-gen vaccines delivered directly to the site of infection are far more effective than existing shots.

Most popular

Harvard’s Class of 2029 Reflects Shifts in Racial Makeup After Affirmative Action Ends

International students continue to enroll amid political uncertainty; mandatory SATs lead to a drop in applications.

What Trump Means for John Roberts’s Legacy

Executive power is on the docket at the Supreme Court.

Harvard’s Endowment, Donations Rise—but the University Runs a Deficit

The annual financial report signals severe challenges to come.

Explore More From Current Issue

A person walks across a street lined with historic buildings and a clock tower in the background.

Harvard In the News

A legal victory against Trump, hazing in the Harvard-Radcliffe Orchestra, and kicking off a Crimson football season with style

An illustrative portrait of Justice Roberts in a black robe, resting his chin on his hand.

What Trump Means for John Roberts’s Legacy

Executive power is on the docket at the Supreme Court.

Aerial view of a landscaped area with trees and seating, surrounded by buildings and parking.

Landscape Architect Julie Bargmann Transforming Forgotten Urban Sites

Julie Bargmann and her D.I.R.T. Studio give new life to abandoned mines, car plants, and more.