The story’s score and claims

Comments on No. 52 of 59 · GitHub · edition of Sunday 1 November 2026

Huntsman – Self-hosted web scraper that turns pages into Markdown

Summary

Huntsman is a new open-source, self-hosted web scraper, released under Apache-2.0, that converts web pages into clean Markdown for LLMs and search. It renders JavaScript via Lightpanda, strips ads and cookie banners, and offers a Firecrawl-compatible /v1 API from a single Go binary.

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules