Skip to content

Autoscraping casts a wider net

by on February 27, 2012

We have recently started letting more users into the private beta for our Autoscraping service. We’re receiving a lot of applications following the shutdown of Needlebase and we’re increasing our capacity to accommodate these users.

Natalia made a screencast to help our new users get started:
It’s also a great introduction to what this service can do.

We released slybot as an open source integration of the scrapely extraction library and the scrapy framework. This is the core technology behind the autoscraping service and we will make it easy to export autoscraping spiders from Scrapinghub  and run them completely with slybot – allowing our users to have the flexibility and freedom provided by open source.

  1. mukmil permalink

    Great product. Well done. At the moment I couldn’t see any documentation in slybot. It’d be great if I could get some very basic usage guide type of documentation for slybot.

  2. Looking forward to test it!

  3. qhoc permalink

    What I don’t understand is how this can work with multiple pages such as Page 1 to 100 (Navigation). With 1 page only, simple jQuery can deal with it.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s


Get every new post delivered to your Inbox.

Join 121 other followers

%d bloggers like this: