6 Comments

Thanks Leonardo for a useful post for non-techies trying to understand web scraping.

For those who want to dig deeper into discovering which tools, apps and software. could help them get their hands wet on this front, I have just published a small deep-dive in the universe of web scrapers and data extractors: https://goodtools.substack.com/p/web-scrapers-and-data-extractors

Expand full comment

There would be times when you see some information on the website but not on the html extracted by your scraper. These are sites where information is sourced from a java script function. The html sourced through the scraper might not have this information unless you execute the JS through code.

Expand full comment

Thanks for sharing, Justin

Expand full comment

maybe one of the best guest posts i've seen on here. great job leonardo.

Expand full comment

As a web scraping professional, I love this post ;)

Expand full comment

Good article ! I was wondering : is we scrapping illegal ? What are the risks a person is facing if he/she is scrapping from websites like Airbnb, Facebook, Eventbrite, Dice…

Thanks

Expand full comment