A large number of radio-search hits can sound like a large number of possible alien transmissions. The useful question is what the count represents and what happened to those hits as the investigators examined them.
A paper submitted to arXiv on November 11 reports pilot observations made over three nights in summer 2023 with the Allen Telescope Array. Its results section describes 1.9 million narrowband hits in about 17 hours of data. After filtering and examination, the authors report no sky-localised signals of interest and no narrowband technosignatures within the pilot’s stated search coverage and sensitivity. The count is not a count of extraterrestrial transmissions. These are results from a bounded search, not evidence that no extraterrestrial technology exists anywhere.
Read the label attached to the count
The following is our original evidence-literacy reading guide. The examples are hypothetical ways to interpret a screening process, not additional observations or findings from the paper.
Imagine a search program flagging records that meet an initial rule. At that stage, the count tells a reader how many items passed that rule. It does not necessarily tell the reader how many distinct sources, unusual events or supported discoveries those records represent.
Before repeating an impressive number, look for the authors’ definition of the counted item. A short label can carry a narrower meaning in a methods section than it acquires in a headline. Keep that definition attached to the number when discussing the result.
Follow what changes between stages
In a hypothetical screening exercise, the first stage might cast a wide net so that material worth examining is not missed early. Later stages could ask more specific questions. A reduction in the count would then be part of the work the screening process was designed to do.
Ask what each stage establishes. Does it remove repeated entries, compare an item against another explanation or select material for closer examination? Those are different operations, and knowing which occurred helps explain what the remaining list means.
A reader should not rename every survivor a discovery. Nor should the initial list be described as though all of its entries had already passed the later checks. The interpretation needs to stay with the stage that produced the count.
Distinguish an interesting item from its explanation
Suppose an invented example remains worth examining because it looks different from most of the surrounding material. That difference is a reason to investigate. It is not, by itself, an account of the item’s origin.
A useful report would explain what made the example interesting and what subsequent work found. If the interpretation becomes more ordinary after examination, that change belongs in the account of the investigation.
Be especially careful when a striking illustration is shared without the surrounding explanation. An image chosen to show a search method or a rejected example should not acquire the role of evidence for a discovery simply because someone omitted its caption.
Keep the result within the question examined
A search conclusion should be read alongside its stated scope. Ask what was examined and what conditions the conclusion covers. Avoid widening a bounded result into a claim about every possible location, time or type of technology.
The opposite mistake is to treat a limited search as having learned nothing. Its report can still describe what the investigators did and the result of those checks. The useful response is to preserve the scope and the remaining uncertainties, rather than inflate or dismiss the conclusion.
Also keep publication and observation dates separate. A newly available paper can describe work carried out earlier. The date readers encounter the result should not be substituted for the date the observations were made.
Clear reporting follows the evidence through its stages: what was counted, what the checks meant and what conclusion the examined material supported. That gives readers a more informative picture of a search than the largest number in its opening summary.
AI-generated conceptual photograph of a fictional radio-observatory control room; not the paper’s authors, instruments, recorded data or evidence of alien technology.