Episode
#50: Web scraping at scale with Scrapy and ScrapingHub
Talk Python To Me · Mar 15, 2016 · 58 min
What do you do when you are working with an amazing web application that, for whatever reason, doesn't have an API? One option is to say I wish that site had an API and give up. Or, you could use scrapy, an open source web scraping framework from Pablo Hoffman and [scrapinghub.com](scrapinghub.com) and create your own API!