5.3 Source Criticism and Evaluation

Why Source Criticism Matters Now More Than Ever

We live in an age of information abundance, unprecedented in human history. For most of our species' existence, information was scarce and hard to come by. If you wanted to learn something, you needed access to people who knew it or books that contained it. Libraries were treasures. Knowledge was guarded. Now, in the span of just a few decades, that scarcity has flipped to overwhelming abundance. Anyone can publish anything online, instantly, to a potentially global audience. A professional journalist's carefully researched article appears in your social media feed right next to a random person's uninformed blog post. A peer-reviewed scientific study competes for attention with a viral claim made by someone with no expertise whatsoever. A legitimate news organization's website looks, at first glance, remarkably similar to a propaganda outlet designed to look like a news organization.

In this environment, the ability to evaluate sources isn't just an academic skill that teachers care about. It's a practical survival skill for navigating modern life. The gatekeepers who used to filter information, the editors and publishers and librarians who decided what was worth reading, have largely disappeared from online spaces. Their absence means freedom, which is wonderful, but it also means you're on your own. Nobody is protecting you from misinformation. You have to protect yourself.

Poor source evaluation leads to poor decisions with real consequences. People have made serious health choices based on medical misinformation, sometimes with tragic results. They've been deceived by financial scams that looked legitimate. They've formed strong opinions about important political and social issues based on unreliable, biased, or completely fabricated information. They've shared false stories that damaged other people's reputations. And in most cases, it's not because these people were stupid or gullible. It's because they didn't have the tools to evaluate what they were reading. They weren't trained in source criticism.

The good news is that source criticism can be learned. There are specific questions you can ask and specific techniques you can use, systematic approaches that work across different types of sources and different kinds of claims. In this chapter, we'll cover these approaches in detail. By the end, you'll have a complete toolkit for navigating the information landscape with confidence, distinguishing reliable sources from unreliable ones, and making better decisions about what to believe.

The CRAAP Test: A Systematic Approach

One widely used framework for evaluating sources goes by the memorable name CRAAP. Developed by librarians at California State University, Chico, this framework has been taught in schools and libraries around the world because it's both comprehensive and easy to remember. Each letter stands for a criterion you should consider: Currency, Relevance, Authority, Accuracy, and Purpose. Together, these five criteria give you a systematic way to evaluate almost any source.

Currency asks: How recent is this information? Depending on your topic, this matters a great deal or very little. If you're researching current events, technology, medicine, or rapidly changing fields, an article from last week might already be outdated. Medical recommendations change as new research emerges. Technology evolves at a dizzying pace. Political situations shift. For these topics, you need recent sources. On the other hand, if you're researching ancient history, classic literature, or stable scientific principles, a ten-year-old book or even an older one might be perfectly fine. Shakespeare's plays haven't changed since they were written. The basic laws of physics remain constant. The key question isn't simply "how old is this source?" but rather "is this information current enough for my specific purpose?" Always check when the source was created or last updated.

Relevance asks: Does this source actually address your question or topic? This might seem obvious, but it's a common mistake to use sources that are only tangentially related to what you're researching. A source can be excellent in its field but still not useful for your specific purpose. Check whether the depth and scope match what you need. Is it too basic for your level of inquiry? Too advanced? Too narrow? Too broad? Also consider the intended audience. A children's encyclopedia article on climate change is probably not appropriate for a high school research paper, even if it's factually accurate. A highly technical academic paper might be overkill for a basic overview. Match the source to your needs.

Authority asks: Who created this, and are they credible to speak on this topic? Look for the author's credentials and expertise. What's their background? What qualifies them to write about this subject? Check the publisher or organization behind the source. Is it a respected institution? A reputable publisher? A known news organization? Or is it an unknown entity that you can't verify? Be especially careful with anonymous sources or sources where you can't determine who created them. On the internet, anonymity is easy, and people sometimes pretend to be experts when they're not. Look for "about" pages, author biographies, and institutional affiliations that you can verify.

We'll explore Accuracy and Purpose in the next sections, as they deserve deeper and more detailed treatment.

Accuracy: Can You Trust the Information?

Accuracy is perhaps the most crucial criterion. A source can be current, relevant, and written by someone with credentials, but still contain errors or falsehoods.

To evaluate accuracy, first look at the evidence. Does the source cite other sources? Are claims supported by data, research, or documentation? Can you verify the key facts independently? Be especially skeptical of sources that make claims without any supporting evidence.

Check for internal consistency. Does the source contradict itself? Do the numbers add up? Does the logic hold together? Careless errors often signal deeper problems with reliability.

Look at the writing quality. Frequent spelling and grammar errors suggest the source wasn't carefully edited. This doesn't automatically mean the information is wrong, but professional, reliable sources usually maintain basic quality standards.

Consider whether the source has been reviewed. Academic journals use peer review, where experts check articles before publication. Reputable news organizations have editorial processes. Self-published content has no such checks. This doesn't make self-published material automatically wrong, but it means you need to be more careful.

Finally, compare with other sources. If a claim appears in one source but contradicts everything else you've read, be suspicious. Extraordinary claims require extraordinary evidence.

Purpose: Why Does This Source Exist?

Every source exists for a reason, and understanding that reason helps you interpret the information appropriately.

Some sources aim primarily to inform. News reporting, encyclopedias, and textbooks generally fall into this category. Their goal is to present facts and explanations. Even informative sources have some perspective, but they're at least trying to be balanced and factual.

Some sources aim to persuade. Opinion pieces, political advertisements, and advocacy group publications are trying to change your mind. This doesn't make them useless. A well-argued opinion piece can be valuable. But you should recognize that you're reading an argument, not a neutral presentation of facts.

Some sources aim to sell. Advertisements are obvious, but some content is subtler. A blog post about "the best laptops" might be funded by affiliate commissions. A health website might be selling supplements. When money is involved, be alert to how that might influence the information.

Some sources aim to entertain. Satire sites like The Onion write fake news for humor. This is fine if you recognize it as satire, but dangerous if you mistake it for real news. Many satire articles have been shared as if they were genuine.

Ask yourself: What does the creator of this source gain from my believing it? Follow the incentives, and you'll understand the source better.

Lateral Reading: Looking Beyond the Source

Here's a technique that professional fact-checkers use: instead of spending all your time evaluating the source itself, open new tabs and see what others say about it.

This is called lateral reading. Rather than reading vertically down through a source, you read laterally across different sources about that source. What do experts say about this organization? Has this claim been fact-checked? What's this author's reputation?

Lateral reading is powerful because sources can be very good at making themselves look credible. A professional-looking website with an authoritative name might actually be a front for propaganda. You can't tell just by looking at the source itself. But a quick search reveals what others know about it.

When you encounter a new source, try this: Before reading deeply, open a new tab. Search for the name of the organization or author. Add words like "reliability" or "bias" or "criticism." See what comes up. Check if fact-checking sites have evaluated any of their claims. This takes only a few minutes but can save you from being misled.

Red flags to watch for include: no author identified, domain names that mimic legitimate sites (like ABCnews.com.co instead of abcnews.com), emotional or sensational language, requests to share before reading, and claims that seem too good or too outrageous to be true.

Putting It All Together

Source criticism isn't about being cynical or distrustful of everything. It's about being appropriately cautious and making informed judgments about what to believe and use.

When you encounter a new source, run through the CRAAP test. Is it current enough? Is it relevant to your needs? Who created it and are they credible? Can you verify the accuracy? What is the purpose, and how might that affect the information?

Use lateral reading to check the source's reputation. A few minutes of searching can reveal a lot.

Pay attention to red flags: anonymous authors, sensational claims, lack of evidence, requests to share immediately, and URLs that look suspicious.

Remember that no source is perfect. Even excellent sources have some bias and occasionally make mistakes. The goal isn't to find perfect sources. It's to understand the limitations of your sources and account for them in how you use the information.

And finally, maintain intellectual humility. If you're not an expert in a field, be careful about dismissing the consensus of those who are. Critical thinking means being appropriately skeptical, not reflexively suspicious of everything that challenges your existing beliefs.

Summary: Your Source Evaluation Toolkit

You now have a systematic approach to evaluating sources. Here's the recap:

The CRAAP Test:
Currency (timeliness), Relevance (fit for purpose), Authority (creator credibility), Accuracy (verifiable information), Purpose (why it exists).

Evaluating Accuracy:
Check evidence and citations. Look for internal consistency. Note writing quality. Consider whether it's been reviewed. Compare with other sources.

Understanding Purpose:
Sources may aim to inform, persuade, sell, or entertain. Understanding purpose helps you interpret information appropriately.

Lateral Reading:
Search for what others say about the source. Check fact-checkers. Investigate reputation. This is often more efficient than evaluating from within.

Red Flags:
Anonymous authors, sensational language, no evidence for claims, suspicious URLs, requests to share before reading.

Key Terms:
CRAAP test, currency, relevance, authority, accuracy, purpose, lateral reading, fact-checking, red flags.