"Easy," I thought. But weeks later, I found myself building data pipelines, implementing proxy rotation schemes, and dealing with TLS fingerprinting. Not fun—and definitely not how I wanted to spend my time. My product was a bookmark manager, not a data extraction service, yet most of my efforts ended up there!
It turns out that the Internet has become a difficult place to extract information from. Many websites have implemented measures against data extraction, making it more challenging and expensive than it should be to build products that rely on web data.
Handinger is my attempt to fix this. During that time, I also noticed that people training LLMs need to fetch data at scale. So, I extracted the work I'd done for Fika and built a very affordable, general-purpose scraping API. I managed to optimize it so I can price it at only 0.0005 EUR per URL—peanuts!
Try it out and let me know what you think :)
