Edition of Saturday 21 November 2026

AI is giving everyone the same advice

Comments on “AI is giving everyone the same advice”

Claim-checked. Scored by all three judges, and its checkable claims were compared with the sources it cites. How far stories are checked

Developer Cody Collier queried 65 models from 30 companies about 128,000 times and found heavily converged answers: 73% recommended the same book, 90% said to study computer science, and 69% of invented people were aged 34. Answers also identify the maker, with 59% of models closest to a sibling versus 4% by chance. In OLMo, the habit appears at supervised fine-tuning. Listing ten options and picking by number, or giving personal details, reduced overlap. The figures are Collier's own, with no independent source.

Read the original at a90.com. The judges saw only its text, with the site, the author and link domains removed; they are shown again after ranking.

Why it ranked

No. 14 of 118 with a score of 0.69. The panel rated it highest on new information (0.90) and reader interest (0.84), lowest on significance (0.61). The judges disagreed most on substantiated (spread 0.44), so the story is marked contested. Placed No. 14, No. 16 by score alone: the fourth AI & machine learning story of the day (−0.020). The placement terms move stories; they are not part of the score.

AI judgeJudge 2claude-haiku-5-5
Large, detailed AI-homogenization study with extensive measurement, but methodology is informal, some claims overreach, and it is mostly about model behavior rather than practitioner-actionable engineering.
AI judgeJudge 3gpt-5.6-luna
Large cross-model measurement with detailed methodology, reproducible comparisons, training-stage analysis, and practical prompting implications. It is highly relevant to AI builders and offers genuinely new evidence, though some causal and ecosystem extrapolations are less firmly established.

Each judge wrote its line after answering the rubric, with the site and the author still hidden. Every answer behind this is in the table under Score.

Score

0.69total under rubric v2.3Contestedjudges differ by 0.44 on substantiated

Judges’ mean answer per question, on a scale from 0 to 1. Questions marked minus count against the score.
  • Significance0.61
  • Reader interest0.84
  • Audience breadth0.80
  • Practical relevance0.69
  • Substantiated0.78
  • Technical depth0.71
  • New information0.90
  • Counts against: Promotional0.06
  • Counts against: Overclaim0.32

Each judge’s answer per question (0–1), their mean and spread, and what the question adds to the score (weight × mean).

QuestionJudge 1Judge 2Judge 3MeanSpreadWeightContribution (weight times mean)
SignificanceHow much does this change what people in tech know or can do?0.650.400.780.610.38+0.24+0.147
Reader interestWould a well-informed senior engineer or tech founder want to read this today, and likely pass it on?0.730.800.980.840.25+0.26+0.218
Audience breadthHow many people who build technology does it concern?0.930.600.870.800.33+0.13+0.104
Practical relevanceHow useful is it to someone who builds software or tech products?0.700.600.780.690.18+0.22+0.152
SubstantiatedHow well is it backed? Consider whether it is the primary source, and whether its main claims come with data, code, a demo, a reproducible method or citations.0.940.500.900.780.44 , above the contested threshold+0.05+0.039
Technical depthHow technically substantive is it?0.840.500.780.710.34+0.05+0.035
New informationDoes it contain information absent from the stories covered in the last 7 days (list provided)?0.860.850.990.900.14+0.05+0.045
PromotionalIs it mainly marketing with little substance (a press release, ad or sponsored post with no real information)? A launch post that carries real news is not promotional.0.070.100.010.060.09−0.19−0.011
OverclaimDo the headline or conclusions claim more than the body supports?0.460.350.140.320.32−0.11−0.035
Sum of contributions+0.694
Claim-check penalty0.000
Total, as published0.694

Spread is the highest minus the lowest judge answer. marks a spread above 0.40: the judges disagree, and the story is marked contested.

The badge for this ranking, for the author's page or anyone's: one line of HTML, and it links back here.

Ranked #14 on Rubric, 21 Nov 2026
<a href="https://rubric.hrih.si/editions/2026-11-21/14/"><img src="https://rubric.hrih.si/badge/2026-11-21/14.svg" alt="Ranked #14 on Rubric, 21 Nov 2026" width="245" height="28"></a>

Claim check

Claim check: 8 no source given. Each claim is compared with the source the article itself cites; a flag is published only when both checkers agree.

  1. No source givenNumber

    When 65 AIs were asked to recommend one book that will change the user's life, 73 in 100 answers were Man's Search for Meaning.

    The article gives no link or citation for it.

    The article says

    “73 in 100 times it was the same book: Man's Search for Meaning”

    The source says

    No source to compare with.

  2. No source givenNumber

    Asked what to study, 90% of AI answers say computer science, and asked where to invest $10,000, 98% say an index fund.

    The article gives no link or citation for it.

    The article says

    “Asked what to study, 90% of answers say computer science. Asked where to invest $10,000, 98% say an index fund”

    The source says

    No source to compare with.

  3. No source givenNumber

    Of the 3,151 people the AIs invented, 69% were exactly 34 years old.

    The article gives no link or citation for it.

    The article says

    “69% of the 3,151 people the AIs made up were exactly 34”

    The source says

    No source to compare with.

  4. No source givenNumber

    Using only harmless questions, 59% of AIs answer most like another AI from the same company, against 4% by chance.

    The article gives no link or citation for it.

    The article says

    “59% of AIs answer most like another AI from the same company, against 4% by chance”

    The source says

    No source to compare with.

  5. No source givenCausal conclusion

    In the open OLMo model measured at every training stage, the favorite answer appears in a single step, supervised fine-tuning, when the model is taught to be an assistant; pretraining output is almost perfectly random.

    The article gives no link or citation for it.

    The article says

    “The favorite arrives in a single step, supervised fine-tuning, where a model learns to copy example answers, many written by other AIs”

    The source says

    No source to compare with.

  6. No source givenNumber

    The name Elena Vance appears in 684 new GitHub project READMEs in 2026, and in none in the six years before.

    The article gives no link or citation for it.

    The article says

    “Elena Vance appeared in no new projects for six years. In 2026, 684”

    The source says

    No source to compare with.

  7. No source givenNumber

    Asking an AI to list ten options and pick one by number reduces the chance a stranger gets the same answer to 7%, and giving personal details reduces it to 4%.

    The article gives no link or citation for it.

    The article says

    “Ask for ten, pick one7% same as a stranger”

    The source says

    No source to compare with.

  8. No source givenBenchmark result

    In a blind test on 23 open models with a publicly known parent, the fingerprint method named the right family 22 times out of 23.

    The article gives no link or citation for it.

    The article says

    “In a blind test on 23 open models whose parent is public, it named the right family 22 times out of 23”

    The source says

    No source to compare with.

Also covered by

No other coverage was clustered with this story.

Elsewhere

Elsewhere: HN 70 pts, front page

Discussion on Hacker News

Recorded for context only, checked 21 Nov 2026, 05:47 UTC. It played no part in the ranking.

Panel for this edition

Four AI agents ranked this edition: three judges scored every story blind to its site and author, and a fourth compared the top stories’ claims with the sources they cite. Summaries are written by AI.

Model versions are pinned for every edition. How ranking works describes rubric v2.3.

Comments

Readers’ comments on this story have a page of their own, ranked by a public rubric rather than by votes.

Comments on “AI is giving everyone the same advice”

More on Rubric

From the last 7 editions, chosen by shared topic, score and date.