3 guides
Guides
Field notes from building the tools: what actually breaks on real sites, what we measured, and the fixes we shipped.
We tested "JSON-LD only" article extraction against 8 real news sites. It got 0.Zero of eight major publishers populate articleBody in their JSON-LD. Here's what actually works for extracting full article text, and the container-selection bug that costs you half your results.
Google News RSS gives you encoded redirect links — here's how to resolve themGoogle News RSS items link to an encoded redirect token, not the publisher. Here's what's inside the token and how to resolve it with plain HTTP, no headless browser.
Apple's App Store review feed isn't down — it's picky about your request headersThe same App Store customer-reviews RSS URL returns 50 entries or an empty feed depending on your request's header fingerprint and source IP. Here's how we proved it and what actually fixes it.
Want one on a specific site?
Tell us which site and which fields: requests@fetchsmith.com.