Surviving the Grind of Fact-Checking

 

It was a low moment, the kind most writers remember for a long time. I was sitting at my desk, wrestling with a tight deadline, when I received an email from one of my editors. A reader had just written in challenging the accuracy of a description I had given in a recent story. Could I look into it, my editor asked? I began scouring my research and realized to my chagrin that the reader was right: I had slipped up. The following day I sat down and wrote a correction, which ran in the next issue of the magazine.

Even the most careful writers get caught out committing an error from time to time. Editors seldom rank these blunders near the cardinal sins of plagiarism or fictionalization, but frequent errors or a cavalier attitude towards accuracy can quickly erode the credibility of a writer and the reputation of a magazine. To guard against this, large publications often hire fact-checkers to root out mistakes before articles see the light of day.

Editors’ note: This article is published with funding support from the National Association of Science Writers.

Many science writers I know have a kind of love-hate relationship with fact-checkers. In principle, most appreciate that someone is looking after their backs, but they can’t help seeing the process itself as a little humiliating and painful, right up there with having a root canal or a colonoscopy. “I really hate it with all my heart and soul,” says veteran science writer Ann Finkbeiner. “It’s everything I left grade school to get away from.”

Many large-circulation magazines insist on fact-checking, however, writing it into their letters of assignment. National Geographic, for example, requires writers to provide a manuscript copy that includes “the annotated list of publications, addresses and phone numbers of people and institutions mentioned in the text and other sources of information,” and to submit all the source material they collected during the assignment. The magazine then assigns a fact-checker to go through the story with a fine-tooth comb, checking each fact against the backup material to ensure that the writer has gotten even tiny details right.

I’ve been through this kind of gruelling fact-checking many times, yet I still feel a little anxious every time a fact-checker calls. But I have learned over the years that a writer can keep a fact-checker’s queries to a minimum by making the best and most detailed annotated copy possible.

Keeping Track of Source Material

Zach Zorich, a former fact-checker for Discover magazine and now a freelance science journalist, says the best time to start thinking about the annotated copy is when you begin researching a story. Zorich prints out the journal articles he comes across that contain valuable source material and then stores these print versions in manila folders in his office. He admits that this method is a little old-fashioned, but says, “I prefer having a hard copy of the thing. Maybe it’s the instinct I had when I was a fact-checker, that if I can’t put my hands on a piece of information, it doesn’t exist.”

I started out using that exact method, but have now switched to digitally archiving my source material. I usually download relevant journal articles as PDFs or use a Microsoft program called OneNote for taking screen shots of interesting web pages and storing them on my computer. Often I will do this as soon as I find something interesting, rather than waiting until after editing is done and trying to backtrack. Companies sometimes post information about their activities that is later considered damaging, and when that happens, a webmaster can quickly delete the incriminating page. But with the original printed and stored in a manila folder or preserved in a program like OneNote, a writer has solid evidence to pass on to a fact-checker.

The best written sources for a science story, by the way, are always primary sources, such as a researcher’s own published papers. Using information derived from secondary sources such as a Wikipedia entry or a newspaper story reporting on a scientific discovery won’t cut the mustard when it comes to fact-checking. You could just be recycling someone else’s errors.

Marking Up a Story

Once a story has been edited and accepted, the editor generally lets the writer know when to submit the annotated copy and accompanying backup material. (There’s little point in going to the trouble of annotation before then, because an editor may have to cut a long passage at the last minute in order to make a story fit the available space.) As soon as I am given the green light, I try to get down to annotating as quickly as I can, since fact-checkers often work on tight deadlines.

An annotated copy is just what it sounds like. It contains footnotes or embedded comments that tell a fact-checker where the writer found each piece of information, whether from human or written sources. Word processors such as Microsoft Word make the technical process of inserting footnotes easy; the hard part is remembering where each discrete piece of information came from.

I asked David Lande, a senior researcher and fact-checker at National Geographic, what really good annotated copy looks like, and he sent me what he called “a shining example,” the backup that Joel Bourne submitted for his April 2010 story “California’s Pipe Dream.” The article was some 2,700 words long, and it contained 86 footnotes—roughly one per sentence. These annotations provided Lande with all the info he required to check the facts: the name, phone number, and email address for each human source; links to all written online sources; and the titles of PDFs and books consulted by the writer. The author then emailed the PDFs and even sent entire books to back up his annotations. For the sake of expediency, Lande told me in an email, he appreciates it if the author sends entire books, which he always returns.

There seem to be no hard-and-fast rules when it comes to the submission of reporting notes, interview tapes, and transcripts, however, and a writer is best advised to ask the fact-checker about preferences. Lande, for example, is happy to receive digital interview recordings or transcripts of interviews. Though he’s also glad to receive handwritten notes if that’s all a writer has, he says he is less keen about poring over a reporter’s handwriting. “The adventurers come back with little pocket notebooks [that] they provide, but it’s often hard to decipher the notes,” he says.

Thin Annotation Is More Than Rude—It’s Risky

Over the years, Lande has seen just about everything from writers. He told me in our email exchanges that he was in the midst of a fact-checking nightmare, working on a feature of about the same length as Joel Bourne’s story, but which arrived with “a grand total of 10 footnotes.” The writer, Lande noted, had previously written at length on the subject, but the flimsy annotation meant the fact-checker had to do far more work than he had bargained for in chasing down sources.

Moreover, writers who go too light on annotation risk a more serious problem. Often, Zorich says, fact-checkers who don’t get the information they need from a writer have little choice but to start tracking down potential sources on their own and checking out the story with a new cast of researchers. Rarely are writers happy with the results, because the new sources have different ideas and points of view than those of the original contacts. “That’s where, as a writer, you’re going to get your article severely tweaked,” Zorich notes.

Writers can save themselves a lot of grief by working with, rather than against, a fact-checker. After all, the fact-checker and writer are ultimately on the same team. “In science writing,” Finkbeiner says, “you are just a fraud if you don’t get the details right.”

 

Heather PringleCourtesy of Heather Pringle

Heather Pringle

Guest contributor Heather Pringle is a contributing correspondent at Science and a contributing editor at Archaeology. She has written four books, including The Mummy Congress: Science, Obsession, and the Everlasting Dead. Follow her at Twitter at @hpringle.

4 Comments

  1. Pocket (http://getpocket.com) is a great tool for keeping track of your links, and can become part of your browser as well.

    The “pro” version is $45 a year, and can organize your links into different “tags” (and it helps suggest tags as well).

    In addition, when I write a piece that needs to be backed up with detailed research, in the latest version of Microsoft Word under “References” you can add footnotes (or endnotes if you prefer) for each piece of backed up text. This is very handy to do as you’re writing. In the end, you’ll have a nicely organized collection of links.

  2. Pingback: I’ve Got Your Missing Links Right Here (29 November 2014) | Gaia Gazette

  3. Pingback: I’ve Got Your Missing Links Right Here (29 November 2014) – Phenomena: Not Exactly Rocket Science

  4. I love Evernote for this kind of thing, because it lets you clip web pages ‘as is’, complete with a URL and date, so you have the text to go back to. You can also upload PDF files, and if you have a premium account they become full-text searchable. Everything is filed into notebooks, and can be tagged, so you get a really good record of all your research – it even deals with photos, handwritten notes and audio files. It makes life a lot easier, but annotation is still a bit of a chore 😉

Leave a Reply

Your email address will not be published. Required fields are marked *