node crawler

We have hosted the application node crawler in order to run this application in our online workstations with Wine or directly.

Quick description about node crawler:

Most powerful, popular and production crawling/scraping package for Node, happy hacking.

Features:

• Server-side DOM & automatic jQuery insertion with Cheerio (default) or JSDOM
• Configurable pool size and retries
• Control rate limit
• Priority queue of requests
• forceUTF8 mode to let crawler deal for you with charset detection and conversion
• Compatible with 4.x or newer version

Programming Language: JavaScript.
Categories: