← Back to all topics
Teaching · Ch. 11 (When Trust Breaks Down) · Evidence & Reasoning

The Welcome Test: Two Questions, Four Things to Do

Companion to Chapter 11 of Everybody’s Science, “A World Competing on Truth,” and to Breakout Box 2

The test

Can it be checked?
Will they let you?

Six words. You can carry them out of here.

The Welcome Test doesn’t tell you whether they’re right. It tells you what happens if they’re not.

Only one of those is yours to answer. You usually can’t judge the claim. You can almost always find out whether anyone would catch it if it were wrong.

One: the doctor says wait

You’re in an exam room. Something hurts, and you came in expecting to be given something for it. The doctor says let’s wait and see.

You can’t judge that. Sitting there, you cannot weigh the medical literature against your own body. Question one is closed to you.

Question two takes eight seconds:

“How will we know if this is the wrong call, and what do we do then?”

Listen for a threshold and a plan.

“If it’s not better in two or three days, or the pain gets worse, or you run a fever — call me and we’ll start treatment.”

She just named, in advance, the thing that would prove her wrong, and told you what happens when it does. She handed you the tripwire.

She isn’t improvising, either. In the national guideline for the childhood version of this, the plan isn’t a courtesy — “a mechanism must be in place to ensure follow-up.”

Now the other version. “Trust me, it’ll clear up.”

It might. It may be the same correct call. But nothing has been set. If this goes wrong, nothing trips.

Ask for the tripwire, not the credential. A credential tells you who someone is. A tripwire tells you what happens if they’re wrong.

You are not testing her.
You are asking whether anyone can.

Two: when the claim is yours

Turn it around.

You’ve done the work. You’re presenting it — a project, a plan, something you stayed up on. And somebody asks the question you were hoping nobody would ask.

There’s a second in there. You can feel yourself choose: you are already building the reply instead of hearing the point. That second is the test. Everything after it is paperwork.

Nobody warns you how it feels. Passing does not feel like passing. It feels like losing.

Three things to do with that second:

  1. Say the tripwire first. “Here’s what would make me drop this.”
  2. Answer the question that was asked. The most common way to refuse a test while looking cooperative is to answer an easier one nearby.
  3. Change your mind out loud, in front of the people who watched you be sure. Not in a follow-up email.

One exception: the sell. If you’re pitching — a product, a grant, yourself in an interview — nobody is asking you whether you’re right. They’re asking you to advocate. That’s a real job, and it isn’t this one. Even there, though, one sentence is usually available: here’s what would make me tell you not to do this. It costs less than it feels like it will.

They are not testing you.
They are asking whether anyone can.

Four things to do

Two questions, four answers, four moves. A test with no next move is just an opinion with a name.

It was checked, it held, and they welcomed the checking.

Use it — and write down what would make you put it down.

Nobody’s checked it yet, but they’d welcome it.

Wait with them. Name what would settle it and when you’ll look. Most honest disagreement lives here.

It was checked, it failed, and they welcomed the checking.

Hand it back. Say what failed, then stop. Watching whether they take it is the whole point.

They won’t be checked at all.

Keep the person. Stop arguing the claim — evidence isn’t the currency anymore, and every round makes the wall thicker. That’s not giving up on someone. It’s the only route back to a conversation where evidence works.

Two things I’m not sure about

Welcome can be faked. “I’m just asking questions” is the costume version. A fake welcome invites challenge in general; a real one names one result that would change one mind. General openness is free. A tripwire costs something.

This doesn’t work on a stranger’s post. You can’t ask, and you can’t watch what happens when the answer comes back. It works where you can ask and then wait: an exam room, a meeting, a kitchen table, a classroom.

For the teacher

Everything above is meant to be handed over. This part isn’t.

The guideline behind the scene

The exam-room scene is generic on purpose — no condition is named, so the page makes no medical claim. The documented case behind it is the American Academy of Pediatrics guideline on acute otitis media, which is worth reading because of how strong it is. Watchful waiting isn’t merely permitted; Key Action Statement 3D requires the plan: “When observation is used, a mechanism must be in place to ensure follow-up and begin antibiotic therapy if the child worsens or fails to improve within 48 to 72 hours of onset of symptoms.” And the choice is not the clinician’s alone. Both this statement’s profile and its neighbour 3C’s say the same thing under role of patient preference: “joint decision-making with the family is essential before choosing observation.”

That is a national body writing the tripwire into the standard of care.

And it prints its own dissent

The same guideline goes further than the standard of care. In the profile attached to 3C, it records that one of its own authors disagreed:

“In the judgment of 1 Subcommittee member (AH), antimicrobial treatment of these children is preferred… AH did not endorse Key Action Statement 3C.”

A national clinical guideline, naming by initials the member who would not sign, inside the document itself. That is the Welcome Test passed at the scale of an institution, and it is a better artifact for a class discussion than anything written for the purpose could be.

Two clinical details, for accuracy

The guideline describes both ways of arranging the follow-up, and the page uses the second: a safety-net or wait-and-see prescription handed over to be filled only if things worsen (Siegel et al.; Spiro et al.), or — in the guideline’s own words — “not to provide a written prescription but to instruct the parent/caregiver to call or return if the child fails to improve within 2 to 3 days or if symptoms worsen.” The call-back version is the one on the page, because it holds regardless of local practice.

What the research says about asking

Worth handing to students only if it comes up, because it complicates the scene in a useful way. Forty Australian doctors, interviewed in 2019–20, described patient questions as routine and expected — one called them “a good thing,” another said patients “should be asking more questions.” Patients don’t believe it: in a separate study, people who wanted to share in their own decisions held back for fear of being filed under difficult. The distance between those two findings is the best reason to ask anyway. The same study also found doctors warm about a question and cool about a printed list of them — so ask one.

Run the second scene live

Before anyone else gets to ask, have a student name the tripwire on their own project — the result that would make them drop it. Then let somebody ask a hard question, and watch for the second where they choose.

Six questions, one per level

  1. Say the two questions from memory. Remember
  2. Why can’t you tell an honest challenger from a bad-faith one just by watching them say the establishment is wrong? Understand
  3. One time in the last month someone told you something you weren’t expecting. Which of the four moves fit? Did you make it? Apply
  4. Séralini republished a retracted study instead of revising it. Which of the two questions does that answer? Analyze
  5. Someone says “I welcome any challenge” and never names a result that would change their mind. What’s that worth? Evaluate
  6. Write the sentence you’d say to hand somebody else the tripwire on a plan of your own. Create

Standards

This page carries no disciplinary content, so it aligns to practices and nature-of-science understandings — not to a disciplinary core idea. Said plainly so nobody files it as content coverage.

NGSS SEP 1 NGSS SEP 7 NGSS SEP 8 NGSS App. H BIO.1 a, d, f CH.1 a, d, f RST.11-12.8

NGSS practices, 9–12. Practice 8, “Evaluate the validity and reliability of and/or synthesize multiple claims, methods, and/or designs that appear in scientific and technical texts or media reports” — that is question one. Practice 7, “Respectfully provide and/or receive critiques on scientific arguments by probing reasoning and evidence”receive is the word doing the work, and that is the second scene. Practice 1 as well: the page is one question and what to do with each answer.

NGSS nature of science, Appendix H. Scientific Knowledge is Open to Revision in Light of New Evidence“Most scientific knowledge is quite durable but is, in principle, subject to change based on new evidence and/or reinterpretation of existing evidence.” And Science is a Human Endeavor“Scientists’ backgrounds, theoretical commitments, and fields of endeavor influence the nature of their findings,” which is why the second question is about a person rather than a claim.

Virginia SOL (2018): BIO.1 a, d, f · CH.1 a, d, f. The alignment sits in the scientific-and-engineering-practices strand that opens each course, not in a content strand, for the reason above. Each course’s first standard reads “The student will demonstrate an understanding of scientific and engineering practices by” — and three of its six sub-strands are what this page trains:

Prince William County Public Schools states the practical version plainly: the 2018 SOL “require the Scientific and Engineering Practices (SOL BIO.1 a-f) to be embedded throughout all units of study” — and the same for CH.1 a–f. This page is a way to spend fifteen minutes on a, d and f without giving up a lab day.

Standards status, checked August 10, 2026. The 2018 Science Standards of Learning remain the adopted set for Biology and Chemistry. The Board of Education approved 2025 Expanded High School Science Standards on December 11, 2024, which add courses rather than replacing these. VDOE revises and re-posts its supporting framework documents on its own cycle, so where a framework link and the standard disagree, the standard is the durable reference. Next scheduled review of this section: January 2027.

Common Core literacy, 11–12. RST.11-12.8“Evaluate the hypotheses, data, analysis, and conclusions in a science or technical text, verifying the data when possible and corroborating or challenging conclusions with other sources of information.” The closest single match in any standards document — and note it, too, assumes verification is sometimes impossible.

Where this comes from

The test is built and argued in Chapter 11 of Everybody’s Science, Breakout Box 2. Teaching #6 is the classroom guide to Chapters 11–12. Teaching #11 covers what has to be true before a correction can land. Evidence #2 is the professional version.

Allan S. Lieberthal et al., “The Diagnosis and Management of Acute Otitis Media,” Pediatrics, 131(3), 2013, pp. e964–e999 (doi:10.1542/peds.2012-3488) — Key Action Statements 3C and 3D and their profiles, pp. e974–e975, for the observation option, the requirement that a mechanism be in place to ensure follow-up, the 48-to-72-hour window, joint decision-making with the family, the two ways of arranging follow-up, and the published dissent of one subcommittee member; Marguerite C. Tracy, Danielle M. Muscat, Heather L. Shepherd, and Lyndal J. Trevena, “Doctors’ Attitudes to Patient Question Asking, Patient-Generated Question Lists, and Question Prompt Lists: A Qualitative Study,” Medical Decision Making, 42(3), 2022, pp. 283–292; Dominick L. Frosch, Suepattra G. May, Katharine A.S. Rendle, Caroline Tietbohl, and Glyn Elwyn, “Authoritarian Physicians and Patients’ Fear of Being Labeled ‘Difficult’ Among Key Obstacles to Shared Decision Making,” Health Affairs, 31(5), 2012, pp. 1030–1038; Adam Grant, Think Again (2021), building on Philip E. Tetlock, “Social Functionalist Frameworks for Judgment and Choice,” Psychological Review, 2002 — the preacher, prosecutor, politician and scientist postures; Naomi Oreskes, Why Trust Science? (Princeton University Press, 2019); Naomi Oreskes and Erik M. Conway, Merchants of Doubt (Bloomsbury Press, 2010); Karen M. Douglas, Robbie M. Sutton, and Aleksandra Cichocka, “The Psychology of Conspiracy Theories,” Current Directions in Psychological Science, 2017; Dan M. Kahan et al., “Culture and Identity-Protective Cognition,” Journal of Empirical Legal Studies, 2007; Richard E. Petty and John T. Cacioppo, “The Elaboration Likelihood Model of Persuasion,” Advances in Experimental Social Psychology, vol. 19, 1986; Barry J. Marshall and J. Robin Warren, Nobel Prize in Physiology or Medicine, 2005; G.-E. Séralini et al., Food and Chemical Toxicology, 2012 (retracted 2013), and the 2014 republication in Environmental Sciences Europe, not independently peer-reviewed.

Standards: NGSS Lead States, Next Generation Science Standards: For States, By States (The National Academies Press, 2013), Appendices F and H (nextgenscience.org); Virginia Board of Education, Science Standards of Learning for Virginia Public Schools (adopted October 2018), BIO.1 and CH.1 (doe.virginia.gov); the a–f sub-strand wording quoted above is that of the 2018 Science Standards of Learning Curriculum Framework’s scientific-and-engineering-practices strand, which is common to the high-school courses; Prince William County Public Schools, high-school science curriculum pages, for BIO.1 a–f and CH.1 a–f as embedded across all units; National Governors Association Center for Best Practices and Council of Chief State School Officers, Common Core State Standards (2010), RST.11-12.8 (thecorestandards.org).