deduplicator heritrix add on

We have hosted the application deduplicator heritrix add on in order to run this application in our online workstations with Wine or directly.

Quick description about deduplicator heritrix add on:

The DeDuplicator is an add-on module (plug-in) for the web crawler Heritrix. It offers a means to reduce the amount of duplicate data collected in a series of snapshot crawls.

Audience: Advanced End Users, Developers, System Administrators.
User interface: Plugins.
Programming Language: Java.

.