Scientists Often Skip A Simple Test That Could Verify Their Work
There's a simple test that scientists could use to make sure the cells they're studying in the lab are what they think they are. But most of the time, academic scientists don't bother.
That omission is a problem. One study found that between 18 percent and 36 percent of all cell lines have been misidentified. And this kind of mistaken identity is one reason that many results from experiments run in scientific labs can't be reproduced elsewhere.
"These are really not very easy discussions to have," says Leonard Freedman, founding president of the Global Biological Standards Institute. "Irreproducibility is kind of an uncomfortable subject to talk about, particularly among researchers."
But Freedman is trying to kindle that conversation. Last month he hosted a discussion in Washington, D.C., on the subject that I was invited to moderate and allowed to record.
"We are fully convinced that this is a significant enough problem that we have to take steps to address it," Jon Lorsch, director of the NIH's National Institute of General Medical Sciences, said during the panel discussion.
One obvious step would be to require scientists who get federal funding to test their cells. Howard Soule, chief science officer at the Prostate Cancer Foundation, said that's what his charity requires of the scientists it funds.
There's a commercial lab that will run this test for about $140, so "this is not going to break the bank," Soule said.
But Lorsch at the NIH argued that it's not so simple on the scale at which his institute hands out funding. "We really can't go and police 10,000 grants," Lorsch said.
"Sure you can," Soule shot back. "How can you not?"
Lorsch said if they do police this issue, "there are dozens and dozens of other issues" that the NIH should logically police as well. "It becomes a Hydra," Lorsch said. "You know, you chop off one head and others grow."
Biomedical research gets more expensive all the time, and the NIH is reluctant to pile on a whole bunch of new rules. It's a balancing act.
"If we become too draconian we're going to end up squashing creativity and slowing down research, which is not good for the taxpayers because they aren't going to get as much for their money," Lorsch said.
"On the other hand, if it's the wild, wild West, we're going to end up using taxpayer money in nonproductive ways ... which is absolutely not acceptable."
The scientific journals that publish this research could also require that all cell lines be authenticated. But at the moment, that would mean rejecting the vast majority of submissions.
Veronique Kiermer, executive editor at the Nature journals, said editors there have tried to coax scientists to test their cells by adding it to a checklist they have to provide when they submit a paper. But only about 10 percent of the scientists submitting papers check that box.
"The thing that keeps me up is that we've tried to address this issue and we've failed," she said.
This may all come down to money. Scientists can avoid most of these problems by purchasing cells from a company that routinely tests them. But most scientists would rather walk down the hall and borrow cells from another lab.
"Academics share their cell lines like candy because they don't want to go back and spend another $300," said Richard Neve from Genentech. "It is economics. And they don't want to spend another $100 to [verify] that's still the same cell line."
For companies like Genentech, though, the economic driver is to make sure that scientists there know exactly which cells they're using.
Neve runs a massive cell bank at the Bay Area biotech giant, and like other biotech and pharmaceutical companies, it maintains strict quality controls. When scientists at his company find an intriguing result from an academic lab, the first thing they do is try to replicate the result.
Neve said often they can't, and misidentified cells are a common reason.
This is a problem. But "the exact implications of it, though, I don't think we'll ever understand," he said. "And I think what we need to do at this point is to set these standards and move forward. And then we can say, from this point on, we can believe the science that was generated."
In an ideal world, scientists would toss all of their unauthenticated cell lines into the trash and start from scratch. Freedman's nonprofit is trying to nudge scientists in that direction. But so far, there's not enough incentive for academic scientists to take that step.
Copyright 2023 NPR. To see more, visit https://www.npr.org.