If you’ve been using Scrapy for any period of time, you know the capabilities a well-designed Scrapy spider can give you.