AI is giving everyone the same advice
Comments on “AI is giving everyone the same advice”
Claim-checked. Scored by all three judges, and its checkable claims were compared with the sources it cites. How far stories are checked
Developer Cody Collier queried 65 models from 30 companies about 128,000 times and found heavily converged answers: 73% recommended the same book, 90% said to study computer science, and 69% of invented people were aged 34. Answers also identify the maker, with 59% of models closest to a sibling versus 4% by chance. In OLMo, the habit appears at supervised fine-tuning. Listing ten options and picking by number, or giving personal details, reduced overlap. The figures are Collier's own, with no independent source.
Why it ranked
No. 14 of 118 with a score of 0.69. The panel rated it highest on new information (0.90) and reader interest (0.84), lowest on significance (0.61). The judges disagreed most on substantiated (spread 0.44), so the story is marked contested. Placed No. 14, No. 16 by score alone: the fourth AI & machine learning story of the day (−0.020). The placement terms move stories; they are not part of the score.
- AI judgeJudge 2claude-haiku-5-5
- Large, detailed AI-homogenization study with extensive measurement, but methodology is informal, some claims overreach, and it is mostly about model behavior rather than practitioner-actionable engineering.
- AI judgeJudge 3gpt-5.6-luna
- Large cross-model measurement with detailed methodology, reproducible comparisons, training-stage analysis, and practical prompting implications. It is highly relevant to AI builders and offers genuinely new evidence, though some causal and ecosystem extrapolations are less firmly established.
Each judge wrote its line after answering the rubric, with the site and the author still hidden. Every answer behind this is in the table under Score.
Score
0.69total under rubric v2.3Contestedjudges differ by 0.44 on substantiated
- Significance0.61
- Reader interest0.84
- Audience breadth0.80
- Practical relevance0.69
- Substantiated0.78
- Technical depth0.71
- New information0.90
- Counts against: Promotional0.06
- Counts against: Overclaim0.32
Each judge’s answer per question (0–1), their mean and spread, and what the question adds to the score (weight × mean).
| Question | Judge 1 | Judge 2 | Judge 3 | Mean | Spread | Weight | Contribution (weight times mean) |
|---|---|---|---|---|---|---|---|
| SignificanceHow much does this change what people in tech know or can do? | 0.65 | 0.40 | 0.78 | 0.61 | 0.38 | +0.24 | +0.147 |
| Reader interestWould a well-informed senior engineer or tech founder want to read this today, and likely pass it on? | 0.73 | 0.80 | 0.98 | 0.84 | 0.25 | +0.26 | +0.218 |
| Audience breadthHow many people who build technology does it concern? | 0.93 | 0.60 | 0.87 | 0.80 | 0.33 | +0.13 | +0.104 |
| Practical relevanceHow useful is it to someone who builds software or tech products? | 0.70 | 0.60 | 0.78 | 0.69 | 0.18 | +0.22 | +0.152 |
| SubstantiatedHow well is it backed? Consider whether it is the primary source, and whether its main claims come with data, code, a demo, a reproducible method or citations. | 0.94 | 0.50 | 0.90 | 0.78 | 0.44 , above the contested threshold | +0.05 | +0.039 |
| Technical depthHow technically substantive is it? | 0.84 | 0.50 | 0.78 | 0.71 | 0.34 | +0.05 | +0.035 |
| New informationDoes it contain information absent from the stories covered in the last 7 days (list provided)? | 0.86 | 0.85 | 0.99 | 0.90 | 0.14 | +0.05 | +0.045 |
| PromotionalIs it mainly marketing with little substance (a press release, ad or sponsored post with no real information)? A launch post that carries real news is not promotional. | 0.07 | 0.10 | 0.01 | 0.06 | 0.09 | −0.19 | −0.011 |
| OverclaimDo the headline or conclusions claim more than the body supports? | 0.46 | 0.35 | 0.14 | 0.32 | 0.32 | −0.11 | −0.035 |
| Sum of contributions | +0.694 | ||||||
| Claim-check penalty | 0.000 | ||||||
| Total, as published | 0.694 | ||||||
Spread is the highest minus the lowest judge answer. marks a spread above 0.40: the judges disagree, and the story is marked contested.
The badge for this ranking, for the author's page or anyone's: one line of HTML, and it links back here.
<a href="https://rubric.hrih.si/editions/2026-11-21/14/"><img src="https://rubric.hrih.si/badge/2026-11-21/14.svg" alt="Ranked #14 on Rubric, 21 Nov 2026" width="245" height="28"></a>Claim check
Claim check: 8 no source given. Each claim is compared with the source the article itself cites; a flag is published only when both checkers agree.
No source givenNumber
When 65 AIs were asked to recommend one book that will change the user's life, 73 in 100 answers were Man's Search for Meaning.
The article gives no link or citation for it.
The article says “73 in 100 times it was the same book: Man's Search for Meaning”
The source says No source to compare with.
No source givenNumber
Asked what to study, 90% of AI answers say computer science, and asked where to invest $10,000, 98% say an index fund.
The article gives no link or citation for it.
The article says “Asked what to study, 90% of answers say computer science. Asked where to invest $10,000, 98% say an index fund”
The source says No source to compare with.
No source givenNumber
Of the 3,151 people the AIs invented, 69% were exactly 34 years old.
The article gives no link or citation for it.
The article says “69% of the 3,151 people the AIs made up were exactly 34”
The source says No source to compare with.
No source givenNumber
Using only harmless questions, 59% of AIs answer most like another AI from the same company, against 4% by chance.
The article gives no link or citation for it.
The article says “59% of AIs answer most like another AI from the same company, against 4% by chance”
The source says No source to compare with.
No source givenCausal conclusion
In the open OLMo model measured at every training stage, the favorite answer appears in a single step, supervised fine-tuning, when the model is taught to be an assistant; pretraining output is almost perfectly random.
The article gives no link or citation for it.
The article says “The favorite arrives in a single step, supervised fine-tuning, where a model learns to copy example answers, many written by other AIs”
The source says No source to compare with.
No source givenNumber
The name Elena Vance appears in 684 new GitHub project READMEs in 2026, and in none in the six years before.
The article gives no link or citation for it.
The article says “Elena Vance appeared in no new projects for six years. In 2026, 684”
The source says No source to compare with.
No source givenNumber
Asking an AI to list ten options and pick one by number reduces the chance a stranger gets the same answer to 7%, and giving personal details reduces it to 4%.
The article gives no link or citation for it.
The article says “Ask for ten, pick one7% same as a stranger”
The source says No source to compare with.
No source givenBenchmark result
In a blind test on 23 open models with a publicly known parent, the fingerprint method named the right family 22 times out of 23.
The article gives no link or citation for it.
The article says “In a blind test on 23 open models whose parent is public, it named the right family 22 times out of 23”
The source says No source to compare with.
Also covered by
No other coverage was clustered with this story.
Elsewhere
Elsewhere: HN 70 pts, front page
Recorded for context only, checked 21 Nov 2026, 05:47 UTC. It played no part in the ranking.