Release notes, design notes and the occasional benchmark from the netweir project.
RSS feed
The first release of netweir: Chrome-identical fetching, a Rust parser with Scrapy, XPath and Beautiful Soup queries, crawling that heals itself, and a Chrome driver. What it does today, and what comes next.