back
2 comments
Depends on your use case. If you just need specific data from a known location, build a scraper.

If you’re looking to index as much data as possible, build a crawler.

The complexity of a crawler is significantly more than a scraper, so it’s not always the right choice.

Make open APIs, not scrapers.
The problem is that most companies/developers still aren't "Open API first"... So, people must build scrapers.