grab framework project online with Winfy

We have hosted the application grab framework project in order to run this application in our online workstations with Wine or directly.

Quick description about grab framework project:

Grab is a python framework for building web scrapers. With Grab you can build web scrapers of various complexity, from simple 5-line scripts to complex asynchronous website crawlers processing millions of web pages. Grab provides an API for performing network requests and for handling the received content e.g. interacting with DOM tree of the HTML document. The single request/response API that allows you to build network request, perform it and work with the received content. The API is built on top of urllib3 and lxml libraries. The Spider API to build asynchronous web crawlers. You write classes that define handlers for each type of network request. Each handler is able to spawn new network requests. Network requests are processed concurrently with a pool of asynchronous web sockets. Grab provides interface called Spider to develop multithreaded web-site scrapers.

Features:

• Automatic cookies (session) support
• HTTPS/SOCKS proxy support with/without authentication
• IDN support
• Tools to work with web forms
• Easy multipart file uploading
• Flexible customization of HTTP requests

Programming Language: Python.
Categories: