» Tag
web-scraping
11 postsShieldFont: A Web Font That Makes AI Scraping Costly
ShieldFont uses OpenType font substitution so scrapers see decoy text while browsers render the original — an open-source anti-AI-scraping protocol.
Building a Deal Finder Bot from Catawiki's Expert Estimate Data
Catawiki quietly embeds expert price estimates in its NEXT_DATA JSON on every lot page. Here's how that discovery became a live deal-finding Apify Actor for auction bidders.
chrome-agent: a Rust-built browser automation CLI for LLM agents
chrome-agent is a lightweight Rust CLI that gives LLM agents a token-efficient, stable-ID browser automation interface via CDP, cutting context by ~66%.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comMirrorframe clones web pages into React, verified by pixel diff
Mirrorframe captures a live web page with a headless browser, extracts a Design Genome, and rebuilds it as a React app—verified node by node via pixel diff, no LLM involved.
Building a Live Licence-Verification Site From Canada's Open Data
A build log on merging 65,000+ Canadian contractor licences into one searchable site and API, covering a silent data-loss bug and a caching false alarm.
Spain's BORME Registry Has a Hidden Open-Data API
Spain's BORME registry has offered a free open-data API since 2009 that almost nobody uses—now parsed into 9.5 million structured company events.
Web Scraping: When to Outsource vs. Build In-House
A guide for deciding between outsourcing and in-house web scraping. Assess your maintenance load.
Fortress MCP: A Stealth Browser That Lets AI Agents Bypass Blocks
Fortress MCP is an open-source, locally running MCP server that helps AI agents bypass anti-bot systems like Cloudflare and DataDome.
Addressing the Benchmark Problem in the Web Scraping Industry
An open-source benchmark has been developed to address issues in web scraping evaluations.
Fitter: AI-Powered Web Data Scraping Engine
Fitter leverages LLM-generated configurations for web data scraping.