Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Beautifulsoup vs Selenium vs Scrapy - Which Tool for Web Scraping?

John Watson Rooney
98.4K subscribers
<__slot-el>
<__slot-el>
80K views 4 years ago
Lets talk about scraping and which tool should you use for your web scraping projects in 2021 - Beautifulsoup, Scrapy or Selenium? When picking the right tool for your web scraping project these are the main 3 options that pop up, so learning when to use each one is an important skill. I go through what I think the top line is for each, and give some insight into the pros and cons and what they are best suited for. BS4 Tips:    • 5 Things You Might Not Be Using in Be...   Scrapy for beginners:    • Scrapy for Beginners - A Complete How...   Selenium scraping:    • How to SCRAPE DYNAMIC websites with S...   Support me: Amazon US: https://amzn.to/3cdvjEr Amazon UK: https://amzn.to/3iMRtOW Digital Ocean: https://m.do.co/c/c7c90f161ff6 Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases ...more
...more
Beautifulsoup vs Selenium vs Scrapy - Which Tool for Web Scraping?
2.7KLikes
80,748Views
2021Jan 13
Lets talk about scraping and which tool should you use for your web scraping projects in 2021 - Beautifulsoup, Scrapy or Selenium? When picking the right tool for your web scraping project these are the main 3 options that pop up, so learning when to use each one is an important skill. I go through what I think the top line is for each, and give some insight into the pros and cons and what they are best suited for. BS4 Tips:    • 5 Things You Might Not Be Using in Be...   Scrapy for beginners:    • Scrapy for Beginners - A Complete How...   Selenium scraping:    • How to SCRAPE DYNAMIC websites with S...   Support me: Amazon US: https://amzn.to/3cdvjEr Amazon UK: https://amzn.to/3iMRtOW Digital Ocean: https://m.do.co/c/c7c90f161ff6 Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases

Follow along using the transcript.

John Watson Rooney

98.4K subscribers